[INFO] cloning repository https://github.com/Skidaux/BlackBox
[INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/Skidaux/BlackBox" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FSkidaux%2FBlackBox", kill_on_drop: false }`
[INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FSkidaux%2FBlackBox'...
[INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }`
[INFO] [stdout] bff601b1c60d570777a44b67378bac9df0cb55ff
[INFO] testing Skidaux/BlackBox against 1.90.0 for beta-1.91-2
[INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FSkidaux%2FBlackBox" "/workspace/builds/worker-1-tc1/source", kill_on_drop: false }`
[INFO] [stderr] Cloning into '/workspace/builds/worker-1-tc1/source'...
[INFO] [stderr] done.
[INFO] started tweaking git repo https://github.com/Skidaux/BlackBox
[INFO] finished tweaking git repo https://github.com/Skidaux/BlackBox
[INFO] tweaked toml for git repo https://github.com/Skidaux/BlackBox written to /workspace/builds/worker-1-tc1/source/Cargo.toml
[INFO] validating manifest of git repo https://github.com/Skidaux/BlackBox on toolchain 1.90.0
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.90.0" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] crate git repo https://github.com/Skidaux/BlackBox already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.90.0" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] [stderr]     Updating crates.io index
[INFO] [stderr]  Downloading crates ...
[INFO] [stderr]   Downloaded serial_test_derive v2.0.0
[INFO] [stderr]   Downloaded serial_test v2.0.0
[INFO] [stderr]   Downloaded env_logger v0.11.8
[INFO] [stderr]   Downloaded dashmap v5.5.3
[INFO] [stderr]   Downloaded portable-atomic-util v0.2.4
[INFO] [stderr]   Downloaded anstyle-query v1.1.3
[INFO] [stderr]   Downloaded anstream v0.6.19
[INFO] [stderr]   Downloaded anstyle-wincon v3.0.9
[INFO] [stderr]   Downloaded env_filter v0.1.3
[INFO] [stderr]   Downloaded jiff v0.2.14
[INFO] [stderr]   Downloaded brotli-decompressor v5.0.0
[INFO] [stderr]   Downloaded jiff-static v0.2.14
[INFO] [stderr]   Downloaded brotli v8.0.1
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:e90291280db7d1fac5b66fc6dad9f9662629e7365a55743daf9bdf73ebc4ea79" "/opt/rustwide/cargo-home/bin/cargo" "+1.90.0" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] [stdout] 4021b0663c07ad686a3d172315e4ae56635df3205a7a5c62029902c9eb65d32b
[INFO] running `Command { std: "docker" "start" "-a" "4021b0663c07ad686a3d172315e4ae56635df3205a7a5c62029902c9eb65d32b", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "4021b0663c07ad686a3d172315e4ae56635df3205a7a5c62029902c9eb65d32b", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "4021b0663c07ad686a3d172315e4ae56635df3205a7a5c62029902c9eb65d32b", kill_on_drop: false }`
[INFO] [stdout] 4021b0663c07ad686a3d172315e4ae56635df3205a7a5c62029902c9eb65d32b
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:e90291280db7d1fac5b66fc6dad9f9662629e7365a55743daf9bdf73ebc4ea79" "/opt/rustwide/cargo-home/bin/cargo" "+1.90.0" "build" "--frozen" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] 354e40ab4713791cb7edeb49ddc5b119239d16070fc15da62ca6474c4750b51e
[INFO] running `Command { std: "docker" "start" "-a" "354e40ab4713791cb7edeb49ddc5b119239d16070fc15da62ca6474c4750b51e", kill_on_drop: false }`
[INFO] [stderr]    Compiling syn v2.0.101
[INFO] [stderr]    Compiling smallvec v1.15.0
[INFO] [stderr]    Compiling getrandom v0.2.16
[INFO] [stderr]    Compiling futures-util v0.3.31
[INFO] [stderr]    Compiling alloc-no-stdlib v2.0.4
[INFO] [stderr]    Compiling tracing-core v0.1.33
[INFO] [stderr]    Compiling hashbrown v0.15.3
[INFO] [stderr]    Compiling regex-syntax v0.8.5
[INFO] [stderr]    Compiling alloc-stdlib v0.2.2
[INFO] [stderr]    Compiling rand_core v0.6.4
[INFO] [stderr]    Compiling brotli-decompressor v5.0.0
[INFO] [stderr]    Compiling miniz_oxide v0.8.8
[INFO] [stderr]    Compiling rand_chacha v0.3.1
[INFO] [stderr]    Compiling indexmap v2.9.0
[INFO] [stderr]    Compiling rand v0.8.5
[INFO] [stderr]    Compiling tracing v0.1.41
[INFO] [stderr]    Compiling multer v2.1.0
[INFO] [stderr]    Compiling serde_json v1.0.140
[INFO] [stderr]    Compiling anstyle-parse v0.2.7
[INFO] [stderr]    Compiling regex-automata v0.4.9
[INFO] [stderr]    Compiling flate2 v1.1.1
[INFO] [stderr]    Compiling brotli v8.0.1
[INFO] [stderr]    Compiling encoding_rs v0.8.35
[INFO] [stderr]    Compiling anstyle-query v1.1.3
[INFO] [stderr]    Compiling colorchoice v1.0.4
[INFO] [stderr]    Compiling spin v0.9.8
[INFO] [stderr]    Compiling anstyle v1.0.11
[INFO] [stderr]    Compiling headers v0.3.9
[INFO] [stderr]    Compiling anstream v0.6.19
[INFO] [stderr]    Compiling scoped-tls v1.0.1
[INFO] [stderr]    Compiling jiff v0.2.14
[INFO] [stderr]    Compiling regex v1.11.1
[INFO] [stderr]    Compiling env_filter v0.1.3
[INFO] [stderr]    Compiling synstructure v0.13.2
[INFO] [stderr]    Compiling zerofrom-derive v0.1.6
[INFO] [stderr]    Compiling yoke-derive v0.8.0
[INFO] [stderr]    Compiling zerovec-derive v0.11.1
[INFO] [stderr]    Compiling displaydoc v0.2.5
[INFO] [stderr]    Compiling tokio-macros v2.5.0
[INFO] [stderr]    Compiling serde_derive v1.0.219
[INFO] [stderr]    Compiling thiserror-impl v1.0.69
[INFO] [stderr]    Compiling tokio v1.45.1
[INFO] [stderr]    Compiling pin-project-internal v1.1.10
[INFO] [stderr]    Compiling env_logger v0.11.8
[INFO] [stderr]    Compiling thiserror v1.0.69
[INFO] [stderr]    Compiling zerofrom v0.1.6
[INFO] [stderr]    Compiling yoke v0.8.0
[INFO] [stderr]    Compiling zerovec v0.11.2
[INFO] [stderr]    Compiling zerotrie v0.2.2
[INFO] [stderr]    Compiling pin-project v1.1.10
[INFO] [stderr]    Compiling serde v1.0.219
[INFO] [stderr]    Compiling tinystr v0.8.1
[INFO] [stderr]    Compiling potential_utf v0.1.2
[INFO] [stderr]    Compiling icu_collections v2.0.0
[INFO] [stderr]    Compiling icu_locale_core v2.0.0
[INFO] [stderr]    Compiling icu_provider v2.0.0
[INFO] [stderr]    Compiling icu_normalizer v2.0.0
[INFO] [stderr]    Compiling icu_properties v2.0.1
[INFO] [stderr]    Compiling idna_adapter v1.2.1
[INFO] [stderr]    Compiling idna v1.0.3
[INFO] [stderr]    Compiling url v2.5.4
[INFO] [stderr]    Compiling tungstenite v0.21.0
[INFO] [stderr]    Compiling serde_urlencoded v0.7.1
[INFO] [stderr]    Compiling bincode v1.3.3
[INFO] [stderr]    Compiling tokio-util v0.7.15
[INFO] [stderr]    Compiling async-compression v0.4.23
[INFO] [stderr]    Compiling tokio-tungstenite v0.21.0
[INFO] [stderr]    Compiling h2 v0.3.26
[INFO] [stderr]    Compiling hyper v0.14.32
[INFO] [stderr]    Compiling warp v0.3.7
[INFO] [stderr]    Compiling blackbox v0.1.0 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `dev` profile [unoptimized + debuginfo] target(s) in 1m 34s
[INFO] running `Command { std: "docker" "inspect" "354e40ab4713791cb7edeb49ddc5b119239d16070fc15da62ca6474c4750b51e", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "354e40ab4713791cb7edeb49ddc5b119239d16070fc15da62ca6474c4750b51e", kill_on_drop: false }`
[INFO] [stdout] 354e40ab4713791cb7edeb49ddc5b119239d16070fc15da62ca6474c4750b51e
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:e90291280db7d1fac5b66fc6dad9f9662629e7365a55743daf9bdf73ebc4ea79" "/opt/rustwide/cargo-home/bin/cargo" "+1.90.0" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] 1e5576cbd29bab9945538adb97c9162a57f2b6d159d41f802a06f445ab005a40
[INFO] running `Command { std: "docker" "start" "-a" "1e5576cbd29bab9945538adb97c9162a57f2b6d159d41f802a06f445ab005a40", kill_on_drop: false }`
[INFO] [stderr]    Compiling futures-util v0.3.31
[INFO] [stderr]    Compiling ring v0.17.14
[INFO] [stderr]    Compiling openssl-macros v0.1.1
[INFO] [stderr]    Compiling parking_lot_core v0.9.11
[INFO] [stderr]    Compiling hashbrown v0.14.5
[INFO] [stderr]    Compiling serial_test_derive v2.0.0
[INFO] [stderr]    Compiling openssl v0.10.73
[INFO] [stderr]    Compiling parking_lot v0.12.4
[INFO] [stderr]    Compiling dashmap v5.5.3
[INFO] [stderr]    Compiling rustls-webpki v0.101.7
[INFO] [stderr]    Compiling sct v0.7.1
[INFO] [stderr]    Compiling rustls v0.21.12
[INFO] [stderr]    Compiling h2 v0.3.26
[INFO] [stderr]    Compiling futures-executor v0.3.31
[INFO] [stderr]    Compiling multer v2.1.0
[INFO] [stderr]    Compiling tokio-tungstenite v0.21.0
[INFO] [stderr]    Compiling futures v0.3.31
[INFO] [stderr]    Compiling serial_test v2.0.0
[INFO] [stderr]    Compiling tokio-rustls v0.24.1
[INFO] [stderr]    Compiling native-tls v0.2.14
[INFO] [stderr]    Compiling tokio-native-tls v0.3.1
[INFO] [stderr]    Compiling hyper v0.14.32
[INFO] [stderr]    Compiling warp v0.3.7
[INFO] [stderr]    Compiling hyper-tls v0.5.0
[INFO] [stderr]    Compiling hyper-rustls v0.24.2
[INFO] [stderr]    Compiling reqwest v0.11.27
[INFO] [stderr]    Compiling blackbox v0.1.0 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 57.33s
[INFO] running `Command { std: "docker" "inspect" "1e5576cbd29bab9945538adb97c9162a57f2b6d159d41f802a06f445ab005a40", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "1e5576cbd29bab9945538adb97c9162a57f2b6d159d41f802a06f445ab005a40", kill_on_drop: false }`
[INFO] [stdout] 1e5576cbd29bab9945538adb97c9162a57f2b6d159d41f802a06f445ab005a40
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:e90291280db7d1fac5b66fc6dad9f9662629e7365a55743daf9bdf73ebc4ea79" "/opt/rustwide/cargo-home/bin/cargo" "+1.90.0" "test" "--frozen", kill_on_drop: false }`
[INFO] [stdout] 4dba0269c486ee75275c1cb2c5dd80cf103c59547a436ba3f24714ee1e070dbb
[INFO] running `Command { std: "docker" "start" "-a" "4dba0269c486ee75275c1cb2c5dd80cf103c59547a436ba3f24714ee1e070dbb", kill_on_drop: false }`
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 0.29s
[INFO] [stderr]      Running unittests src/main.rs (/opt/rustwide/target/debug/deps/blackbox-7da481be79c85448)
[INFO] [stdout] 
[INFO] [stdout] running 0 tests
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stderr]      Running tests/api.rs (/opt/rustwide/target/debug/deps/api-292029b673b1943f)
[INFO] [stdout] running 9 tests
[INFO] [stdout] Server running on port 4501
[INFO] [stderr] failed to create data dir: Read-only file system (os error 30)
[INFO] [stderr] [2025-09-24T23:22:41Z INFO  warp::server] Server::run; addr=0.0.0.0:4501
[INFO] [stderr] [2025-09-24T23:22:41Z INFO  warp::server] listening on http://0.0.0.0:4501
[INFO] [stderr] [2025-09-24T23:22:42Z INFO  blackbox] GET / -> 200 0ms req=0b
[INFO] [stderr] failed to save index testidx1: No such file or directory (os error 2)
[INFO] [stderr] [2025-09-24T23:22:42Z INFO  blackbox] POST /indexes/testidx1/documents -> 404 0ms req=42b
[INFO] [stderr] [2025-09-24T23:22:42Z INFO  blackbox] GET /indexes/testidx1/search -> 200 0ms req=0b
[INFO] [stderr] failed to create data dir: Read-only file system (os error 30)
[INFO] [stdout] test test_add_and_search ... ok
[INFO] [stderr] [2025-09-24T23:22:42Z INFO  warp::server] Server::run; addr=0.0.0.0:4304
[INFO] [stdout] Server running on port 4304
[INFO] [stderr] [2025-09-24T23:22:42Z INFO  warp::server] listening on http://0.0.0.0:4304
[INFO] [stderr] [2025-09-24T23:22:42Z INFO  blackbox] GET / -> 200 0ms req=0b
[INFO] [stderr] failed to save index persistidx: No such file or directory (os error 2)
[INFO] [stderr] [2025-09-24T23:22:42Z INFO  blackbox] POST /indexes/persistidx/documents -> 404 0ms req=19b
[INFO] [stderr] failed to create data dir: Read-only file system (os error 30)
[INFO] [stdout] Server running on port 4404
[INFO] [stderr] [2025-09-24T23:22:42Z INFO  warp::server] Server::run; addr=0.0.0.0:4404
[INFO] [stderr] [2025-09-24T23:22:42Z INFO  warp::server] listening on http://0.0.0.0:4404
[INFO] [stderr] [2025-09-24T23:22:42Z INFO  blackbox] GET / -> 200 0ms req=0b
[INFO] [stderr] [2025-09-24T23:22:42Z INFO  blackbox] GET /indexes/persistidx/search -> 200 0ms req=0b
[INFO] [stdout] test test_persistence ... FAILED
[INFO] [stderr] failed to create data dir: Read-only file system (os error 30)
[INFO] [stderr] [2025-09-24T23:22:42Z INFO  warp::server] Server::run; addr=0.0.0.0:4602
[INFO] [stdout] Server running on port 4602
[INFO] [stderr] [2025-09-24T23:22:42Z INFO  warp::server] listening on http://0.0.0.0:4602
[INFO] [stderr] [2025-09-24T23:22:42Z INFO  blackbox] GET / -> 200 0ms req=0b
[INFO] [stderr] failed to save index fuzzyidx: No such file or directory (os error 2)
[INFO] [stderr] [2025-09-24T23:22:42Z INFO  blackbox] POST /indexes/fuzzyidx/documents -> 404 0ms req=17b
[INFO] [stderr] [2025-09-24T23:22:42Z INFO  blackbox] POST /indexes/fuzzyidx/query -> 200 0ms req=49b
[INFO] [stdout] test test_dsl_fuzzy ... ok
[INFO] [stdout] Server running on port 4103
[INFO] [stderr] failed to create data dir: Read-only file system (os error 30)
[INFO] [stderr] [2025-09-24T23:22:43Z INFO  warp::server] Server::run; addr=0.0.0.0:4103
[INFO] [stderr] [2025-09-24T23:22:43Z INFO  warp::server] listening on http://0.0.0.0:4103
[INFO] [stderr] [2025-09-24T23:22:43Z INFO  blackbox] GET / -> 200 0ms req=0b
[INFO] [stderr] [2025-09-24T23:22:43Z INFO  blackbox] POST /indexes/testidx3/bulk -> 200 0ms req=81b
[INFO] [stderr] [2025-09-24T23:22:43Z INFO  blackbox] POST /indexes/testidx3/search_vector -> 200 0ms req=44b
[INFO] [stderr] failed to create data dir: Read-only file system (os error 30)
[INFO] [stderr] [2025-09-24T23:22:43Z INFO  warp::server] Server::run; addr=0.0.0.0:4306
[INFO] [stdout] test test_vector_search ... ok
[INFO] [stderr] [2025-09-24T23:22:43Z INFO  warp::server] listening on http://0.0.0.0:4306
[INFO] [stdout] Server running on port 4306
[INFO] [stderr] [2025-09-24T23:22:43Z INFO  blackbox] GET / -> 200 0ms req=0b
[INFO] [stderr] [2025-09-24T23:22:43Z INFO  blackbox] PUT /indexes/mapidx/mapping -> 400 0ms req=33b
[INFO] [stderr] failed to create data dir: Read-only file system (os error 30)
[INFO] [stdout] Server running on port 4406
[INFO] [stderr] [2025-09-24T23:22:43Z INFO  warp::server] Server::run; addr=0.0.0.0:4406
[INFO] [stderr] [2025-09-24T23:22:43Z INFO  warp::server] listening on http://0.0.0.0:4406
[INFO] [stderr] [2025-09-24T23:22:43Z INFO  blackbox] GET / -> 200 0ms req=0b
[INFO] [stderr] [2025-09-24T23:22:43Z INFO  blackbox] POST /indexes/mapidx/bulk -> 200 0ms req=39b
[INFO] [stderr] [2025-09-24T23:22:43Z INFO  blackbox] POST /indexes/mapidx/search_vector -> 200 0ms req=50b
[INFO] [stdout] test test_mapping_persistence ... ok
[INFO] [stdout] Server running on port 4601
[INFO] [stderr] failed to create data dir: Read-only file system (os error 30)
[INFO] [stderr] [2025-09-24T23:22:43Z INFO  warp::server] Server::run; addr=0.0.0.0:4601
[INFO] [stderr] [2025-09-24T23:22:43Z INFO  warp::server] listening on http://0.0.0.0:4601
[INFO] [stderr] [2025-09-24T23:22:44Z INFO  blackbox] GET / -> 200 0ms req=0b
[INFO] [stderr] [2025-09-24T23:22:44Z INFO  blackbox] POST /indexes/limitidx/bulk -> 200 0ms req=63b
[INFO] [stderr] [2025-09-24T23:22:44Z INFO  blackbox] GET /indexes/limitidx/search -> 200 0ms req=0b
[INFO] [stdout] test test_search_limit ... ok
[INFO] [stderr] failed to create data dir: Read-only file system (os error 30)
[INFO] [stdout] Server running on port 4102
[INFO] [stderr] [2025-09-24T23:22:44Z INFO  warp::server] Server::run; addr=0.0.0.0:4102
[INFO] [stderr] [2025-09-24T23:22:44Z INFO  warp::server] listening on http://0.0.0.0:4102
[INFO] [stderr] [2025-09-24T23:22:44Z INFO  blackbox] GET / -> 200 2ms req=0b
[INFO] [stderr] [2025-09-24T23:22:44Z INFO  blackbox] POST /indexes/testidx2/bulk -> 200 0ms req=90b
[INFO] [stderr] [2025-09-24T23:22:44Z INFO  blackbox] POST /indexes/testidx2/query -> 200 0ms req=111b
[INFO] [stdout] test test_bulk_and_dsl ... ok
[INFO] [stderr] failed to create data dir: Read-only file system (os error 30)
[INFO] [stdout] Server running on port 4105
[INFO] [stderr] [2025-09-24T23:22:44Z INFO  warp::server] Server::run; addr=0.0.0.0:4105
[INFO] [stderr] [2025-09-24T23:22:44Z INFO  warp::server] listening on http://0.0.0.0:4105
[INFO] [stderr] [2025-09-24T23:22:44Z INFO  blackbox] GET / -> 200 0ms req=0b
[INFO] [stderr] [2025-09-24T23:22:44Z INFO  blackbox] PUT /indexes/vecidx/mapping -> 400 0ms req=33b
[INFO] [stderr] [2025-09-24T23:22:44Z INFO  blackbox] POST /indexes/vecidx/bulk -> 200 0ms req=91b
[INFO] [stderr] [2025-09-24T23:22:44Z INFO  blackbox] POST /indexes/vecidx/search_vector -> 200 0ms req=64b
[INFO] [stderr] failed to create data dir: Read-only file system (os error 30)
[INFO] [stderr] [2025-09-24T23:22:44Z INFO  warp::server] Server::run; addr=0.0.0.0:4206
[INFO] [stderr] [2025-09-24T23:22:44Z INFO  warp::server] listening on http://0.0.0.0:4206
[INFO] [stdout] test test_vector_custom_field ... ok
[INFO] [stdout] Server running on port 4206
[INFO] [stderr] [2025-09-24T23:22:44Z INFO  blackbox] GET / -> 200 0ms req=0b
[INFO] [stderr] [2025-09-24T23:22:44Z INFO  blackbox] GET / -> 200 0ms req=0b
[INFO] [stderr] [2025-09-24T23:22:44Z INFO  blackbox] GET /indexes/missing/search -> 200 0ms req=0b
[INFO] [stderr] [2025-09-24T23:22:44Z INFO  blackbox] POST /indexes/empty/bulk -> 200 0ms req=16b
[INFO] [stdout] test test_root_and_errors ... ok
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout] 
[INFO] [stdout] ---- test_persistence stdout ----
[INFO] [stdout] persist body: {"error":"index not found"}
[INFO] [stdout] 
[INFO] [stdout] thread 'test_persistence' panicked at tests/api.rs:262:39:
[INFO] [stdout] called `Option::unwrap()` on a `None` value
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x5ffadbd0fac2 - std::backtrace_rs::backtrace::libunwind::trace::h2d45396358f41939
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9
[INFO] [stdout]    1:     0x5ffadbd0fac2 - std::backtrace_rs::backtrace::trace_unsynchronized::hffcefc0b67f1d6e2
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14
[INFO] [stdout]    2:     0x5ffadbd0fac2 - std::sys::backtrace::_print_fmt::hd72f71d23b436b92
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/sys/backtrace.rs:66:9
[INFO] [stdout]    3:     0x5ffadbd0fac2 - <std::sys::backtrace::BacktraceLock::print::DisplayBacktrace as core::fmt::Display>::fmt::hdcfcb6d4c8489523
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/sys/backtrace.rs:39:26
[INFO] [stdout]    4:     0x5ffadbd397c3 - core::fmt::rt::Argument::fmt::h2c56b3114963061a
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/core/src/fmt/rt.rs:173:76
[INFO] [stdout]    5:     0x5ffadbd397c3 - core::fmt::write::h8a494366950f23bb
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/core/src/fmt/mod.rs:1468:25
[INFO] [stdout]    6:     0x5ffadbd0bc23 - std::io::default_write_fmt::h7b8824096454f323
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/io/mod.rs:639:11
[INFO] [stdout]    7:     0x5ffadbd0bc23 - std::io::Write::write_fmt::h4e71294925c334d0
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/io/mod.rs:1954:13
[INFO] [stdout]    8:     0x5ffadbd0f912 - std::sys::backtrace::BacktraceLock::print::hb2a626a81e06b2dc
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/sys/backtrace.rs:42:9
[INFO] [stdout]    9:     0x5ffadbd110e9 - std::panicking::default_hook::{{closure}}::h4f78485264f12d10
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/panicking.rs:300:27
[INFO] [stdout]   10:     0x5ffadbd10f1e - std::panicking::default_hook::h2c66fc99e962531d
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/panicking.rs:324:9
[INFO] [stdout]   11:     0x5ffadb616e14 - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::hb6bd65493727d71a
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/alloc/src/boxed.rs:1985:9
[INFO] [stdout]   12:     0x5ffadb616e14 - test::test_main_with_exit_callback::{{closure}}::h60217ec76a0ece4a
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/test/src/lib.rs:145:21
[INFO] [stdout]   13:     0x5ffadbd11bbe - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::h318e4efb8c1a5689
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/alloc/src/boxed.rs:1985:9
[INFO] [stdout]   14:     0x5ffadbd11bbe - std::panicking::rust_panic_with_hook::h33ac55f64bbd807d
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/panicking.rs:841:13
[INFO] [stdout]   15:     0x5ffadbd11856 - std::panicking::begin_panic_handler::{{closure}}::h30e7cb89678a57fe
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/panicking.rs:699:13
[INFO] [stdout]   16:     0x5ffadbd0ffc9 - std::sys::backtrace::__rust_end_short_backtrace::hed60f27456c16ced
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/sys/backtrace.rs:174:18
[INFO] [stdout]   17:     0x5ffadbd1151d - __rustc[de2ca18b4c54d5b8]::rust_begin_unwind
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/panicking.rs:697:5
[INFO] [stdout]   18:     0x5ffadbd37090 - core::panicking::panic_fmt::h62f63d096dd276af
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/core/src/panicking.rs:75:14
[INFO] [stdout]   19:     0x5ffadbd3711c - core::panicking::panic::h89a5f2df32b0508a
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/core/src/panicking.rs:145:5
[INFO] [stdout]   20:     0x5ffadbd37009 - core::option::unwrap_failed::he1a8284b5a1e2496
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/core/src/option.rs:2130:5
[INFO] [stdout]   21:     0x5ffadb5b6f79 - core::option::Option<T>::unwrap::hde76b3c3605a27fb
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/core/src/option.rs:1009:21
[INFO] [stdout]   22:     0x5ffadb5b6f79 - api::_test_persistence_internal::{{closure}}::he3d70169516af0a6
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/api.rs:262:39
[INFO] [stdout]   23:     0x5ffadb5c2c5b - serial_test::serial_code_lock::local_async_serial_core::{{closure}}::h2a75643801aafaef
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/serial_test-2.0.0/src/serial_code_lock.rs:51:9
[INFO] [stdout]   24:     0x5ffadb5b755b - api::test_persistence::{{closure}}::hd6834a61b758ace4
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/api.rs:227:1
[INFO] [stdout]   25:     0x5ffadb5dbc02 - <core::pin::Pin<P> as core::future::future::Future>::poll::h8d35d1a3e6dc073e
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/core/src/future/future.rs:133:9
[INFO] [stdout]   26:     0x5ffadb5d64dd - tokio::runtime::park::CachedParkThread::block_on::{{closure}}::h077f08106da9dbde
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.1/src/runtime/park.rs:284:71
[INFO] [stdout]   27:     0x5ffadb5d5732 - tokio::task::coop::with_budget::h49a6892d9eae7312
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.1/src/task/coop/mod.rs:167:5
[INFO] [stdout]   28:     0x5ffadb5d5732 - tokio::task::coop::budget::hc3e2cf13d9f103d6
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.1/src/task/coop/mod.rs:133:5
[INFO] [stdout]   29:     0x5ffadb5d5732 - tokio::runtime::park::CachedParkThread::block_on::h44403b4d20e02122
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.1/src/runtime/park.rs:284:31
[INFO] [stdout]   30:     0x5ffadb5d6614 - tokio::runtime::context::blocking::BlockingRegionGuard::block_on::h7b86bfe621e09a35
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.1/src/runtime/context/blocking.rs:66:14
[INFO] [stdout]   31:     0x5ffadb5cded8 - tokio::runtime::scheduler::multi_thread::MultiThread::block_on::{{closure}}::hb722723569747d9a
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.1/src/runtime/scheduler/multi_thread/mod.rs:87:22
[INFO] [stdout]   32:     0x5ffadb5cd296 - tokio::runtime::context::runtime::enter_runtime::h74f79af005e98f5c
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.1/src/runtime/context/runtime.rs:65:16
[INFO] [stdout]   33:     0x5ffadb5cdea4 - tokio::runtime::scheduler::multi_thread::MultiThread::block_on::hfdbe7bae918a7293
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.1/src/runtime/scheduler/multi_thread/mod.rs:86:9
[INFO] [stdout]   34:     0x5ffadb5db3c4 - tokio::runtime::runtime::Runtime::block_on_inner::h568e564a78a38390
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.1/src/runtime/runtime.rs:358:50
[INFO] [stdout]   35:     0x5ffadb5db5b7 - tokio::runtime::runtime::Runtime::block_on::h8312774819b2fd4e
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.1/src/runtime/runtime.rs:330:18
[INFO] [stdout]   36:     0x5ffadb5b7372 - api::test_persistence::h4fd8f5c1e88a2842
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/api.rs:227:1
[INFO] [stdout]   37:     0x5ffadb5b7207 - api::test_persistence::{{closure}}::h0ebbdda532b0e1ca
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/api.rs:227:10
[INFO] [stdout]   38:     0x5ffadb5c84a6 - core::ops::function::FnOnce::call_once::h53d48de6a965577d
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/core/src/ops/function.rs:253:5
[INFO] [stdout]   39:     0x5ffadb61c67b - core::ops::function::FnOnce::call_once::h1f9474f1347fff52
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/core/src/ops/function.rs:253:5
[INFO] [stdout]   40:     0x5ffadb61c67b - test::__rust_begin_short_backtrace::ha52ab26e77157f03
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/test/src/lib.rs:648:18
[INFO] [stdout]   41:     0x5ffadb61b7b5 - test::run_test_in_process::{{closure}}::h229c1a11a50b261f
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/test/src/lib.rs:671:74
[INFO] [stdout]   42:     0x5ffadb61b7b5 - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::h78821afbf97b39a9
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/core/src/panic/unwind_safe.rs:272:9
[INFO] [stdout]   43:     0x5ffadb61b7b5 - std::panicking::catch_unwind::do_call::h53abf3ed5bd32ba3
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/panicking.rs:589:40
[INFO] [stdout]   44:     0x5ffadb61b7b5 - std::panicking::catch_unwind::h6deb5fe1e91873c9
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/panicking.rs:552:19
[INFO] [stdout]   45:     0x5ffadb61b7b5 - std::panic::catch_unwind::hea0829b6b565654b
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/panic.rs:359:14
[INFO] [stdout]   46:     0x5ffadb61b7b5 - test::run_test_in_process::hdc44dfecea3db21b
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/test/src/lib.rs:671:27
[INFO] [stdout]   47:     0x5ffadb61b7b5 - test::run_test::{{closure}}::h0364ba59bf23f652
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/test/src/lib.rs:592:43
[INFO] [stdout]   48:     0x5ffadb5df3b4 - test::run_test::{{closure}}::h32730b304eec05da
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/test/src/lib.rs:622:41
[INFO] [stdout]   49:     0x5ffadb5df3b4 - std::sys::backtrace::__rust_begin_short_backtrace::h177cb952fc54ad2c
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/sys/backtrace.rs:158:18
[INFO] [stdout]   50:     0x5ffadb5e2d8a - std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}}::h119d903520007597
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/thread/mod.rs:559:17
[INFO] [stdout]   51:     0x5ffadb5e2d8a - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::hab88401d606702a6
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/core/src/panic/unwind_safe.rs:272:9
[INFO] [stdout]   52:     0x5ffadb5e2d8a - std::panicking::catch_unwind::do_call::h163fe12cca9901c2
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/panicking.rs:589:40
[INFO] [stdout]   53:     0x5ffadb5e2d8a - std::panicking::catch_unwind::he81557d0e17cc1bc
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/panicking.rs:552:19
[INFO] [stdout]   54:     0x5ffadb5e2d8a - std::panic::catch_unwind::hc2b8e79c20593955
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/panic.rs:359:14
[INFO] [stdout]   55:     0x5ffadb5e2d8a - std::thread::Builder::spawn_unchecked_::{{closure}}::hfa6b4978e07815cc
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/thread/mod.rs:557:30
[INFO] [stdout]   56:     0x5ffadb5e2d8a - core::ops::function::FnOnce::call_once{{vtable.shim}}::hddcd7484a13fd793
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/core/src/ops/function.rs:253:5
[INFO] [stdout]   57:     0x5ffadbd14d5f - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h5924238c754de3b8
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/alloc/src/boxed.rs:1971:9
[INFO] [stdout]   58:     0x5ffadbd14d5f - std::sys::pal::unix::thread::Thread::new::thread_start::hb6e99e73da4d28f8
[INFO] [stdout]                                at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/sys/pal/unix/thread.rs:107:17
[INFO] [stdout]   59:     0x76a39bd09aa4 - <unknown>
[INFO] [stdout]   60:     0x76a39bd96a34 - clone
[INFO] [stdout]   61:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout]     test_persistence
[INFO] [stdout] 
[INFO] [stdout] test result: FAILED. 8 passed; 1 failed; 0 ignored; 0 measured; 0 filtered out; finished in 3.26s
[INFO] [stdout] 
[INFO] [stderr] error: test failed, to rerun pass `--test api`
[INFO] running `Command { std: "docker" "inspect" "4dba0269c486ee75275c1cb2c5dd80cf103c59547a436ba3f24714ee1e070dbb", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "4dba0269c486ee75275c1cb2c5dd80cf103c59547a436ba3f24714ee1e070dbb", kill_on_drop: false }`
[INFO] [stdout] 4dba0269c486ee75275c1cb2c5dd80cf103c59547a436ba3f24714ee1e070dbb
