[INFO] fetching crate feox-ann 0.1.0...
[INFO] testing feox-ann-0.1.0 against 1.100.0-beta.1+cargoflags=--release for beta-release-1.100-2
[INFO] extracting crate feox-ann 0.1.0 into /workspace/builds/worker-7-tc2/source
[INFO] started tweaking crates.io crate feox-ann 0.1.0
[INFO] removed 0 missing examples
[INFO] finished tweaking crates.io crate feox-ann 0.1.0
[INFO] tweaked toml for crates.io crate feox-ann 0.1.0 written to /workspace/builds/worker-7-tc2/source/Cargo.toml
[INFO] validating manifest of crates.io crate feox-ann 0.1.0 on toolchain 1.100.0-beta.1
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.100.0-beta.1" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] crate crates.io crate feox-ann 0.1.0 already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.100.0-beta.1" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-m" "1610612736" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:77db811e55d90add9212f6832c23229e3de5f1c1f9905e8cb07319ea15df73ac" "sleep" "infinity", kill_on_drop: false }`
[INFO] [stdout] 0c49d124f6bae3e719d180209b4ee1a60e4a154f3b827a8e6706147248bb37c6
[INFO] running `Command { std: "docker" "start" "0c49d124f6bae3e719d180209b4ee1a60e4a154f3b827a8e6706147248bb37c6", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "0c49d124f6bae3e719d180209b4ee1a60e4a154f3b827a8e6706147248bb37c6", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-w" "/opt/rustwide/workdir" "--user" "0:0" "0c49d124f6bae3e719d180209b4ee1a60e4a154f3b827a8e6706147248bb37c6" "/opt/rustwide/cargo-home/bin/cargo" "+1.100.0-beta.1" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "0c49d124f6bae3e719d180209b4ee1a60e4a154f3b827a8e6706147248bb37c6", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "0c49d124f6bae3e719d180209b4ee1a60e4a154f3b827a8e6706147248bb37c6" "/opt/rustwide/cargo-home/bin/cargo" "+1.100.0-beta.1" "build" "--frozen" "--message-format=json" "--release", kill_on_drop: false }`
[INFO] [stderr]    Compiling proc-macro2 v1.0.106
[INFO] [stderr]    Compiling quote v1.0.46
[INFO] [stderr]    Compiling unicode-ident v1.0.24
[INFO] [stderr]    Compiling thiserror v2.0.18
[INFO] [stderr]    Compiling syn v2.0.118
[INFO] [stderr]    Compiling thiserror-impl v2.0.18
[INFO] [stderr]    Compiling feox-ann v0.1.0 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `release` profile [optimized] target(s) in 6.65s
[INFO] running `Command { std: "docker" "inspect" "0c49d124f6bae3e719d180209b4ee1a60e4a154f3b827a8e6706147248bb37c6", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "0c49d124f6bae3e719d180209b4ee1a60e4a154f3b827a8e6706147248bb37c6" "/opt/rustwide/cargo-home/bin/cargo" "+1.100.0-beta.1" "test" "--frozen" "--no-run" "--message-format=json" "--release", kill_on_drop: false }`
[INFO] [stderr]    Compiling serde_core v1.0.228
[INFO] [stderr]    Compiling crossbeam-utils v0.8.21
[INFO] [stderr]    Compiling zerocopy v0.8.52
[INFO] [stderr]    Compiling zmij v1.0.21
[INFO] [stderr]    Compiling serde v1.0.228
[INFO] [stderr]    Compiling autocfg v1.5.1
[INFO] [stderr]    Compiling serde_json v1.0.150
[INFO] [stderr]    Compiling rayon-core v1.13.0
[INFO] [stderr]    Compiling cfg-if v1.0.4
[INFO] [stderr]    Compiling either v1.16.0
[INFO] [stderr]    Compiling plotters-backend v0.3.7
[INFO] [stderr]    Compiling clap_lex v1.1.0
[INFO] [stderr]    Compiling anstyle v1.0.14
[INFO] [stderr]    Compiling memchr v2.8.2
[INFO] [stderr]    Compiling syn v2.0.118
[INFO] [stderr]    Compiling regex-syntax v0.8.11
[INFO] [stderr]    Compiling ciborium-io v0.2.2
[INFO] [stderr]    Compiling itoa v1.0.18
[INFO] [stderr]    Compiling same-file v1.0.6
[INFO] [stderr]    Compiling cast v0.3.0
[INFO] [stderr]    Compiling walkdir v2.5.0
[INFO] [stderr]    Compiling anes v0.1.6
[INFO] [stderr]    Compiling oorandom v11.1.5
[INFO] [stderr]    Compiling plotters-svg v0.3.7
[INFO] [stderr]    Compiling itertools v0.13.0
[INFO] [stderr]    Compiling clap_builder v4.6.0
[INFO] [stderr]    Compiling crossbeam-epoch v0.9.18
[INFO] [stderr]    Compiling crossbeam-deque v0.8.6
[INFO] [stderr]    Compiling num-traits v0.2.19
[INFO] [stderr]    Compiling rayon v1.12.0
[INFO] [stderr]    Compiling plotters v0.3.7
[INFO] [stderr]    Compiling criterion-plot v0.6.0
[INFO] [stderr]    Compiling zerocopy-derive v0.8.52
[INFO] [stderr]    Compiling serde_derive v1.0.228
[INFO] [stderr]    Compiling thiserror-impl v2.0.18
[INFO] [stderr]    Compiling regex-automata v0.4.14
[INFO] [stderr]    Compiling thiserror v2.0.18
[INFO] [stderr]    Compiling feox-ann v0.1.0 (/opt/rustwide/workdir)
[INFO] [stderr]    Compiling clap v4.6.1
[INFO] [stderr]    Compiling regex v1.12.4
[INFO] [stderr]    Compiling tinytemplate v1.2.1
[INFO] [stderr]    Compiling half v2.7.1
[INFO] [stderr]    Compiling ciborium-ll v0.2.2
[INFO] [stderr]    Compiling ciborium v0.2.2
[INFO] [stderr]    Compiling criterion v0.7.0
[INFO] [stderr]     Finished `release` profile [optimized] target(s) in 1m 02s
[INFO] running `Command { std: "docker" "inspect" "0c49d124f6bae3e719d180209b4ee1a60e4a154f3b827a8e6706147248bb37c6", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "0c49d124f6bae3e719d180209b4ee1a60e4a154f3b827a8e6706147248bb37c6" "/opt/rustwide/cargo-home/bin/cargo" "+1.100.0-beta.1" "test" "--frozen" "--release", kill_on_drop: false }`
[INFO] [stderr]     Finished `release` profile [optimized] target(s) in 0.09s
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/release/build/feox-ann/3dae674a78525b5c/out/feox_ann-3dae674a78525b5c)
[INFO] [stdout] 
[INFO] [stdout] running 14 tests
[INFO] [stdout] test math::tests::simd_dot_matches_scalar ... ok
[INFO] [stdout] test tests::index_tests::delete_hides_records_from_results ... ok
[INFO] [stdout] test tests::index_tests::queries_nearest_vectors ... ok
[INFO] [stdout] test tests::index_tests::upsert_replaces_visible_record ... ok
[INFO] [stdout] test tests::index_tests::query_applies_filter_to_results ... ok
[INFO] [stdout] test tests::bulk_tests::bulk_load_upserts_duplicate_ids ... ok
[INFO] [stdout] test tests::index_tests::rebuilds_are_deterministic ... ok
[INFO] [stdout] test tests::bulk_tests::concurrent_queries_share_the_index ... FAILED
[INFO] [stdout] test tests::persist_tests::snapshot_roundtrip_preserves_tombstones ... ok
[INFO] [stdout] test tests::persist_tests::corrupted_snapshots_are_rejected ... ok
[INFO] [stdout] test tests::persist_tests::snapshot_saves_and_loads_from_disk ... ok
[INFO] [stdout] test tests::persist_tests::snapshot_roundtrip_preserves_the_graph ... ok
[INFO] [stdout] test tests::bulk_tests::bulk_load_is_thread_count_invariant ... ok
[INFO] [stdout] test tests::bulk_tests::bulk_load_finds_true_neighbors ... ok
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout] 
[INFO] [stdout] ---- tests::bulk_tests::concurrent_queries_share_the_index stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread '<unnamed>' (1118) panicked at src/tests/bulk_tests.rs:121:21:
[INFO] [stdout] assertion `left == right` failed
[INFO] [stdout]   left: [AnnCandidate { id: "record-00023", score: 0.9999987 }, AnnCandidate { id: "record-00193", score: 0.99992365 }, AnnCandidate { id: "record-00192", score: 0.99893546 }, AnnCandidate { id: "record-00022", score: 0.9983806 }, AnnCandidate { id: "record-00024", score: 0.9981957 }, AnnCandidate { id: "record-00194", score: 0.99749094 }, AnnCandidate { id: "record-00191", score: 0.99453115 }, AnnCandidate { id: "record-00021", score: 0.9933488 }, AnnCandidate { id: "record-00025", score: 0.99297994 }, AnnCandidate { id: "record-00195", score: 0.9916487 }]
[INFO] [stdout]  right: [AnnCandidate { id: "record-00023", score: 0.9999988 }, AnnCandidate { id: "record-00193", score: 0.99992365 }, AnnCandidate { id: "record-00192", score: 0.9989356 }, AnnCandidate { id: "record-00022", score: 0.99838066 }, AnnCandidate { id: "record-00024", score: 0.99819577 }, AnnCandidate { id: "record-00194", score: 0.997491 }, AnnCandidate { id: "record-00191", score: 0.9945312 }, AnnCandidate { id: "record-00021", score: 0.9933489 }, AnnCandidate { id: "record-00025", score: 0.99297994 }, AnnCandidate { id: "record-00195", score: 0.9916488 }]
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x5d099a86aa67 - <unknown>
[INFO] [stdout]    1:     0x5d099a85201a - <unknown>
[INFO] [stdout]    2:     0x5d099a86a01b - <unknown>
[INFO] [stdout]    3:     0x5d099a869aff - <unknown>
[INFO] [stdout]    4:     0x5d099a86972a - <unknown>
[INFO] [stdout]    5:     0x5d099a869265 - <unknown>
[INFO] [stdout]    6:     0x5d099a890011 - <unknown>
[INFO] [stdout]    7:     0x5d099a88ffc9 - <unknown>
[INFO] [stdout]    8:     0x5d099a8904cc - <unknown>
[INFO] [stdout]    9:     0x5d099a851eab - <unknown>
[INFO] [stdout]   10:     0x5d099a851dca - <unknown>
[INFO] [stdout]   11:     0x5d099a83d623 - <unknown>
[INFO] [stdout]   12:     0x5d099a83de2a - <unknown>
[INFO] [stdout]   13:     0x5d099a840757 - <unknown>
[INFO] [stdout]   14:     0x5d099a891f54 - <unknown>
[INFO] [stdout]   15:     0x7f606773ddfa - <unknown>
[INFO] [stdout]   16:     0x7f60677d13d4 - clone
[INFO] [stdout]   17:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] thread '<unnamed>' (1117) panicked at src/tests/bulk_tests.rs:121:21:
[INFO] [stdout] assertion `left == right` failed
[INFO] [stdout]   left: [AnnCandidate { id: "record-00188", score: 0.9999355 }, AnnCandidate { id: "record-00018", score: 0.9997551 }, AnnCandidate { id: "record-00019", score: 0.99933887 }, AnnCandidate { id: "record-00189", score: 0.9988892 }, AnnCandidate { id: "record-00187", score: 0.997561 }, AnnCandidate { id: "record-00017", score: 0.9967511 }, AnnCandidate { id: "record-00020", score: 0.9955047 }, AnnCandidate { id: "record-00190", score: 0.99442685 }, AnnCandidate { id: "record-00186", score: 0.9917766 }, AnnCandidate { id: "record-00016", score: 0.99034125 }]
[INFO] [stdout]  right: [AnnCandidate { id: "record-00188", score: 0.9999355 }, AnnCandidate { id: "record-00018", score: 0.999755 }, AnnCandidate { id: "record-00019", score: 0.99933887 }, AnnCandidate { id: "record-00189", score: 0.9988892 }, AnnCandidate { id: "record-00187", score: 0.9975609 }, AnnCandidate { id: "record-00017", score: 0.9967511 }, AnnCandidate { id: "record-00020", score: 0.9955047 }, AnnCandidate { id: "record-00190", score: 0.9944268 }, AnnCandidate { id: "record-00186", score: 0.9917766 }, AnnCandidate { id: "record-00016", score: 0.9903412 }]
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x5d099a86aa67 - <unknown>
[INFO] [stdout]    1:     0x5d099a85201a - <unknown>
[INFO] [stdout]    2:     0x5d099a86a01b - <unknown>
[INFO] [stdout]    3:     0x5d099a869aff - <unknown>
[INFO] [stdout]    4:     0x5d099a86972a - <unknown>
[INFO] [stdout]    5:     0x5d099a869265 - <unknown>
[INFO] [stdout]    6:     0x5d099a890011 - <unknown>
[INFO] [stdout]    7:     0x5d099a88ffc9 - <unknown>
[INFO] [stdout]    8:     0x5d099a8904cc - <unknown>
[INFO] [stdout]    9:     0x5d099a851eab - <unknown>
[INFO] [stdout]   10:     0x5d099a851dca - <unknown>
[INFO] [stdout]   11:     0x5d099a83d623 - <unknown>
[INFO] [stdout]   12:     0x5d099a83de2a - <unknown>
[INFO] [stdout]   13:     0x5d099a840757 - <unknown>
[INFO] [stdout]   14:     0x5d099a891f54 - <unknown>
[INFO] [stdout]   15:     0x7f606773ddfa - <unknown>
[INFO] [stdout]   16:     0x7f60677d13d4 - clone
[INFO] [stdout]   17:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] thread '<unnamed>' (1115) panicked at src/tests/bulk_tests.rs:121:21:
[INFO] [stdout] assertion `left == right` failed
[INFO] [stdout]   left: [AnnCandidate { id: "record-00179", score: 1.0 }, AnnCandidate { id: "record-00009", score: 0.99993885 }, AnnCandidate { id: "record-00010", score: 0.99887526 }, AnnCandidate { id: "record-00180", score: 0.9983065 }, AnnCandidate { id: "record-00178", score: 0.9982723 }, AnnCandidate { id: "record-00008", score: 0.99758136 }, AnnCandidate { id: "record-00011", score: 0.99439585 }, AnnCandidate { id: "record-00181", score: 0.9931998 }, AnnCandidate { id: "record-00177", score: 0.9931315 }, AnnCandidate { id: "record-00007", score: 0.99181396 }]
[INFO] [stdout]  right: [AnnCandidate { id: "record-00179", score: 0.99999994 }, AnnCandidate { id: "record-00009", score: 0.99993885 }, AnnCandidate { id: "record-00010", score: 0.99887526 }, AnnCandidate { id: "record-00180", score: 0.9983065 }, AnnCandidate { id: "record-00178", score: 0.9982723 }, AnnCandidate { id: "record-00008", score: 0.99758136 }, AnnCandidate { id: "record-00011", score: 0.99439585 }, AnnCandidate { id: "record-00181", score: 0.9931998 }, AnnCandidate { id: "record-00177", score: 0.9931315 }, AnnCandidate { id: "record-00007", score: 0.99181396 }]
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x5d099a86aa67 - <unknown>
[INFO] [stdout]    1:     0x5d099a85201a - <unknown>
[INFO] [stdout]    2:     0x5d099a86a01b - <unknown>
[INFO] [stdout]    3:     0x5d099a869aff - <unknown>
[INFO] [stdout]    4:     0x5d099a86972a - <unknown>
[INFO] [stdout]    5:     0x5d099a869265 - <unknown>
[INFO] [stdout]    6:     0x5d099a890011 - <unknown>
[INFO] [stdout]    7:     0x5d099a88ffc9 - <unknown>
[INFO] [stdout]    8:     0x5d099a8904cc - <unknown>
[INFO] [stdout]    9:     0x5d099a851eab - <unknown>
[INFO] [stdout]   10:     0x5d099a851dca - <unknown>
[INFO] [stdout]   11:     0x5d099a83d623 - <unknown>
[INFO] [stdout]   12:     0x5d099a83de2a - <unknown>
[INFO] [stdout]   13:     0x5d099a840757 - <unknown>
[INFO] [stdout]   14:     0x5d099a891f54 - <unknown>
[INFO] [stdout]   15:     0x7f606773ddfa - <unknown>
[INFO] [stdout]   16:     0x7f60677d13d4 - clone
[INFO] [stdout]   17:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] thread 'tests::bulk_tests::concurrent_queries_share_the_index' (1057) panicked at src/tests/bulk_tests.rs:116:5:
[INFO] [stdout] a scoped thread panicked
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x5d099a86aa67 - <unknown>
[INFO] [stdout]    1:     0x5d099a85201a - <unknown>
[INFO] [stdout]    2:     0x5d099a86a01b - <unknown>
[INFO] [stdout]    3:     0x5d099a869aff - <unknown>
[INFO] [stdout]    4:     0x5d099a86972a - <unknown>
[INFO] [stdout]    5:     0x5d099a869265 - <unknown>
[INFO] [stdout]    6:     0x5d099a890042 - <unknown>
[INFO] [stdout]    7:     0x5d099a88ffc9 - <unknown>
[INFO] [stdout]    8:     0x5d099a8904cc - <unknown>
[INFO] [stdout]    9:     0x5d099a851eab - <unknown>
[INFO] [stdout]   10:     0x5d099a84ae7a - <unknown>
[INFO] [stdout]   11:     0x5d099a8a937b - <unknown>
[INFO] [stdout]   12:     0x5d099a8a47df - <unknown>
[INFO] [stdout]   13:     0x5d099a8a425c - <unknown>
[INFO] [stdout]   14:     0x5d099a8c426c - <unknown>
[INFO] [stdout]   15:     0x5d099a891f54 - <unknown>
[INFO] [stdout]   16:     0x7f606773ddfa - <unknown>
[INFO] [stdout]   17:     0x7f60677d13d4 - clone
[INFO] [stdout]   18:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout]     tests::bulk_tests::concurrent_queries_share_the_index
[INFO] [stdout] 
[INFO] [stdout] test result: FAILED. 13 passed; 1 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.22s
[INFO] [stdout] 
[INFO] [stderr] error: test failed, to rerun pass `--lib`
[INFO] running `Command { std: "docker" "inspect" "0c49d124f6bae3e719d180209b4ee1a60e4a154f3b827a8e6706147248bb37c6", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "0c49d124f6bae3e719d180209b4ee1a60e4a154f3b827a8e6706147248bb37c6", kill_on_drop: false }`
[INFO] [stdout] 0c49d124f6bae3e719d180209b4ee1a60e4a154f3b827a8e6706147248bb37c6
