[INFO] fetching crate vil_bench_llm 0.4.0...
[INFO] testing vil_bench_llm-0.4.0 against beta-2026-04-21 for beta-1.96-2
[INFO] extracting crate vil_bench_llm 0.4.0 into /workspace/builds/worker-5-tc2/source
[INFO] started tweaking crates.io crate vil_bench_llm 0.4.0
[INFO] finished tweaking crates.io crate vil_bench_llm 0.4.0
[INFO] tweaked toml for crates.io crate vil_bench_llm 0.4.0 written to /workspace/builds/worker-5-tc2/source/Cargo.toml
[INFO] validating manifest of crates.io crate vil_bench_llm 0.4.0 on toolchain beta-2026-04-21
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+beta-2026-04-21" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] crate crates.io crate vil_bench_llm 0.4.0 already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+beta-2026-04-21" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+beta-2026-04-21" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] [stdout] 573ea8ed2171f124f7e272fc418922c38fa5dae6a592f15e9a61d9937bcd0168
[INFO] running `Command { std: "docker" "start" "-a" "573ea8ed2171f124f7e272fc418922c38fa5dae6a592f15e9a61d9937bcd0168", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "573ea8ed2171f124f7e272fc418922c38fa5dae6a592f15e9a61d9937bcd0168", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "573ea8ed2171f124f7e272fc418922c38fa5dae6a592f15e9a61d9937bcd0168", kill_on_drop: false }`
[INFO] [stdout] 573ea8ed2171f124f7e272fc418922c38fa5dae6a592f15e9a61d9937bcd0168
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+beta-2026-04-21" "build" "--frozen" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] ff56b221f2812a7240a613a455c9c66daab2aed0f8cac8ef4b0609cf8b518c29
[INFO] running `Command { std: "docker" "start" "-a" "ff56b221f2812a7240a613a455c9c66daab2aed0f8cac8ef4b0609cf8b518c29", kill_on_drop: false }`
[INFO] [stderr]    Compiling libc v0.2.184
[INFO] [stderr]    Compiling serde_core v1.0.228
[INFO] [stderr]    Compiling serde v1.0.228
[INFO] [stderr]    Compiling typenum v1.19.0
[INFO] [stderr]    Compiling cc v1.2.58
[INFO] [stderr]    Compiling subtle v2.6.1
[INFO] [stderr]    Compiling tracing-attributes v0.1.31
[INFO] [stderr]    Compiling zerocopy-derive v0.8.48
[INFO] [stderr]    Compiling futures-util v0.3.32
[INFO] [stderr]    Compiling regex-syntax v0.8.10
[INFO] [stderr]    Compiling hashbrown v0.14.5
[INFO] [stderr]    Compiling async-trait v0.1.89
[INFO] [stderr]    Compiling rmp v0.8.15
[INFO] [stderr]    Compiling openssl v0.10.76
[INFO] [stderr]    Compiling icu_normalizer v2.2.0
[INFO] [stderr]    Compiling thiserror-impl v2.0.18
[INFO] [stderr]    Compiling utf-8 v0.7.6
[INFO] [stderr]    Compiling ref-cast v1.0.25
[INFO] [stderr]    Compiling crossbeam-queue v0.3.12
[INFO] [stderr]    Compiling ref-cast-impl v1.0.25
[INFO] [stderr]    Compiling indexmap v1.9.3
[INFO] [stderr]    Compiling compression-core v0.4.31
[INFO] [stderr]    Compiling simdutf8 v0.1.5
[INFO] [stderr]    Compiling compression-codecs v0.4.37
[INFO] [stderr]    Compiling generic-array v0.14.7
[INFO] [stderr]    Compiling axum-macros v0.4.2
[INFO] [stderr]    Compiling idna_adapter v1.2.1
[INFO] [stderr]    Compiling pin-project-internal v1.1.11
[INFO] [stderr]    Compiling idna v1.1.0
[INFO] [stderr]    Compiling sonic-simd v0.1.4
[INFO] [stderr]    Compiling regex-automata v0.4.14
[INFO] [stderr]    Compiling parking_lot_core v0.9.12
[INFO] [stderr]    Compiling getrandom v0.2.17
[INFO] [stderr]    Compiling errno v0.3.14
[INFO] [stderr]    Compiling signal-hook-registry v1.4.8
[INFO] [stderr]    Compiling mio v1.2.0
[INFO] [stderr]    Compiling socket2 v0.6.3
[INFO] [stderr]    Compiling parking_lot v0.12.5
[INFO] [stderr]    Compiling rand_core v0.6.4
[INFO] [stderr]    Compiling openssl-sys v0.9.112
[INFO] [stderr]    Compiling block-buffer v0.10.4
[INFO] [stderr]    Compiling dashmap v5.5.3
[INFO] [stderr]    Compiling memmap2 v0.9.10
[INFO] [stderr]    Compiling tokio v1.51.0
[INFO] [stderr]    Compiling crypto-common v0.1.7
[INFO] [stderr]    Compiling nix v0.27.1
[INFO] [stderr]    Compiling digest v0.10.7
[INFO] [stderr]    Compiling tracing v0.1.44
[INFO] [stderr]    Compiling thiserror v2.0.18
[INFO] [stderr]    Compiling socket2 v0.5.10
[INFO] [stderr]    Compiling serde_json v1.0.149
[INFO] [stderr]    Compiling zerocopy v0.8.48
[INFO] [stderr]    Compiling sha1 v0.10.6
[INFO] [stderr]    Compiling serde_path_to_error v0.1.20
[INFO] [stderr]    Compiling url v2.5.8
[INFO] [stderr]    Compiling inout v0.1.4
[INFO] [stderr]    Compiling axum-core v0.4.5
[INFO] [stderr]    Compiling sonic-number v0.1.2
[INFO] [stderr]    Compiling bumpalo v3.20.2
[INFO] [stderr]    Compiling hashbrown v0.12.3
[INFO] [stderr]    Compiling vil_types v0.4.0
[INFO] [stderr]    Compiling tracing-serde v0.2.0
[INFO] [stderr]    Compiling serde_yaml v0.9.34+deprecated
[INFO] [stderr]    Compiling chrono v0.4.44
[INFO] [stderr]    Compiling rmp-serde v1.3.1
[INFO] [stderr]    Compiling serde_urlencoded v0.7.1
[INFO] [stderr]    Compiling faststr v0.2.34
[INFO] [stderr]    Compiling native-tls v0.2.18
[INFO] [stderr]    Compiling rustls-pki-types v1.14.0
[INFO] [stderr]    Compiling vil_shm v0.4.0
[INFO] [stderr]    Compiling vil_obs v0.4.0
[INFO] [stderr]    Compiling vil_queue v0.4.0
[INFO] [stderr]    Compiling matchers v0.2.0
[INFO] [stderr]    Compiling sonic-rs v0.3.17
[INFO] [stderr]    Compiling tracing-subscriber v0.3.23
[INFO] [stderr]    Compiling cipher v0.4.4
[INFO] [stderr]    Compiling pin-project v1.1.11
[INFO] [stderr]    Compiling universal-hash v0.5.1
[INFO] [stderr]    Compiling hdrhistogram v7.5.4
[INFO] [stderr]    Compiling http-range-header v0.4.2
[INFO] [stderr]    Compiling vil_registry v0.4.0
[INFO] [stderr]    Compiling polyval v0.6.2
[INFO] [stderr]    Compiling vil_observer v0.4.0
[INFO] [stderr]    Compiling ghash v0.5.1
[INFO] [stderr]    Compiling getrandom v0.4.2
[INFO] [stderr]    Compiling ctr v0.9.2
[INFO] [stderr]    Compiling aes v0.8.4
[INFO] [stderr]    Compiling aead v0.5.2
[INFO] [stderr]    Compiling futures-executor v0.3.32
[INFO] [stderr]    Compiling vil_connector_macros v0.4.0
[INFO] [stderr]    Compiling strsim v0.11.1
[INFO] [stderr]    Compiling uuid v1.23.0
[INFO] [stderr]    Compiling memchr v2.8.0
[INFO] [stderr]    Compiling darling_core v0.20.11
[INFO] [stderr]    Compiling futures v0.3.32
[INFO] [stderr]    Compiling time-macros v0.2.27
[INFO] [stderr]    Compiling ring v0.17.14
[INFO] [stderr]    Compiling num-integer v0.1.46
[INFO] [stderr]    Compiling aes-gcm v0.10.3
[INFO] [stderr]    Compiling ppv-lite86 v0.2.21
[INFO] [stderr]    Compiling vil_json v0.4.0
[INFO] [stderr]    Compiling proc-macro-error-attr2 v2.0.0
[INFO] [stderr]    Compiling vil_ir v0.4.0
[INFO] [stderr]    Compiling proc-macro-error2 v2.0.1
[INFO] [stderr]    Compiling rand_chacha v0.3.1
[INFO] [stderr]    Compiling num-bigint v0.4.6
[INFO] [stderr]    Compiling serde_spanned v0.6.9
[INFO] [stderr]    Compiling time v0.3.47
[INFO] [stderr]    Compiling toml_datetime v0.6.11
[INFO] [stderr]    Compiling rand v0.8.5
[INFO] [stderr]    Compiling async-stream-impl v0.3.6
[INFO] [stderr]    Compiling vil_capsule v0.4.0
[INFO] [stderr]    Compiling tokio-util v0.7.18
[INFO] [stderr]    Compiling vil_log v0.4.0
[INFO] [stderr]    Compiling tower v0.5.3
[INFO] [stderr]    Compiling vil_net v0.4.0
[INFO] [stderr]    Compiling tungstenite v0.24.0
[INFO] [stderr]    Compiling async-compression v0.4.41
[INFO] [stderr]    Compiling h2 v0.4.13
[INFO] [stderr]    Compiling tower-http v0.5.2
[INFO] [stderr]    Compiling tower v0.4.13
[INFO] [stderr]    Compiling tower-http v0.6.8
[INFO] [stderr]    Compiling base64ct v1.8.3
[INFO] [stderr]    Compiling tokio-tungstenite v0.24.0
[INFO] [stderr]    Compiling vil_rt v0.4.0
[INFO] [stderr]    Compiling vil_sidecar v0.4.0
[INFO] [stderr]    Compiling password-hash v0.5.0
[INFO] [stderr]    Compiling vil_validate v0.4.0
[INFO] [stderr]    Compiling toml_edit v0.22.27
[INFO] [stderr]    Compiling simple_asn1 v0.6.4
[INFO] [stderr]    Compiling async-stream v0.3.6
[INFO] [stderr]    Compiling tokio-stream v0.1.18
[INFO] [stderr]    Compiling darling_macro v0.20.11
[INFO] [stderr]    Compiling regex v1.12.3
[INFO] [stderr]    Compiling blake2 v0.10.6
[INFO] [stderr]    Compiling darling v0.20.11
[INFO] [stderr]    Compiling pem v3.0.6
[INFO] [stderr]    Compiling vil_sdk v0.4.0
[INFO] [stderr]    Compiling validator_derive v0.20.0
[INFO] [stderr]    Compiling vil_macros v0.4.0
[INFO] [stderr]    Compiling argon2 v0.5.3
[INFO] [stderr]    Compiling sha2 v0.10.9
[INFO] [stderr]    Compiling vil_server_macros v0.4.0
[INFO] [stderr]    Compiling tokio-native-tls v0.3.1
[INFO] [stderr]    Compiling jsonwebtoken v9.3.1
[INFO] [stderr]    Compiling vil_engine v0.4.0
[INFO] [stderr]    Compiling validator v0.20.0
[INFO] [stderr]    Compiling toml v0.8.23
[INFO] [stderr]    Compiling vil_server_config v0.4.0
[INFO] [stderr]    Compiling hyper v1.9.0
[INFO] [stderr]    Compiling hyper-util v0.1.20
[INFO] [stderr]    Compiling axum v0.7.9
[INFO] [stderr]    Compiling hyper-tls v0.6.0
[INFO] [stderr]    Compiling reqwest v0.12.28
[INFO] [stderr]    Compiling vil_new_http v0.4.0
[INFO] [stderr]    Compiling vil_server_core v0.4.0
[INFO] [stderr]    Compiling vil_server_mesh v0.4.0
[INFO] [stderr]    Compiling vil_server_db v0.4.0
[INFO] [stderr]    Compiling vil_server_web v0.4.0
[INFO] [stderr]    Compiling vil_server_auth v0.4.0
[INFO] [stderr]    Compiling vil_server v0.4.0
[INFO] [stderr]    Compiling vil_bench_llm v0.4.0 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `dev` profile [unoptimized + debuginfo] target(s) in 1m 21s
[INFO] running `Command { std: "docker" "inspect" "ff56b221f2812a7240a613a455c9c66daab2aed0f8cac8ef4b0609cf8b518c29", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "ff56b221f2812a7240a613a455c9c66daab2aed0f8cac8ef4b0609cf8b518c29", kill_on_drop: false }`
[INFO] [stdout] ff56b221f2812a7240a613a455c9c66daab2aed0f8cac8ef4b0609cf8b518c29
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+beta-2026-04-21" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] d8f2e53a641baf78b057af095af301130f07889d6f3a894633fc66ec7813e989
[INFO] running `Command { std: "docker" "start" "-a" "d8f2e53a641baf78b057af095af301130f07889d6f3a894633fc66ec7813e989", kill_on_drop: false }`
[INFO] [stderr]    Compiling tokio v1.51.0
[INFO] [stderr]    Compiling tokio-util v0.7.18
[INFO] [stderr]    Compiling vil_log v0.4.0
[INFO] [stderr]    Compiling tower v0.5.3
[INFO] [stderr]    Compiling tokio-tungstenite v0.24.0
[INFO] [stderr]    Compiling tokio-native-tls v0.3.1
[INFO] [stderr]    Compiling vil_net v0.4.0
[INFO] [stderr]    Compiling async-compression v0.4.41
[INFO] [stderr]    Compiling tokio-stream v0.1.18
[INFO] [stderr]    Compiling tower-http v0.6.8
[INFO] [stderr]    Compiling h2 v0.4.13
[INFO] [stderr]    Compiling tower-http v0.5.2
[INFO] [stderr]    Compiling tower v0.4.13
[INFO] [stderr]    Compiling vil_rt v0.4.0
[INFO] [stderr]    Compiling vil_sidecar v0.4.0
[INFO] [stderr]    Compiling vil_engine v0.4.0
[INFO] [stderr]    Compiling hyper v1.9.0
[INFO] [stderr]    Compiling hyper-util v0.1.20
[INFO] [stderr]    Compiling hyper-tls v0.6.0
[INFO] [stderr]    Compiling axum v0.7.9
[INFO] [stderr]    Compiling reqwest v0.12.28
[INFO] [stderr]    Compiling vil_observer v0.4.0
[INFO] [stderr]    Compiling vil_new_http v0.4.0
[INFO] [stderr]    Compiling vil_server_core v0.4.0
[INFO] [stderr]    Compiling vil_sdk v0.4.0
[INFO] [stderr]    Compiling vil_server_mesh v0.4.0
[INFO] [stderr]    Compiling vil_server_auth v0.4.0
[INFO] [stderr]    Compiling vil_server_web v0.4.0
[INFO] [stderr]    Compiling vil_server_db v0.4.0
[INFO] [stderr]    Compiling vil_server v0.4.0
[INFO] [stderr]    Compiling vil_bench_llm v0.4.0 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 50.01s
[INFO] running `Command { std: "docker" "inspect" "d8f2e53a641baf78b057af095af301130f07889d6f3a894633fc66ec7813e989", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "d8f2e53a641baf78b057af095af301130f07889d6f3a894633fc66ec7813e989", kill_on_drop: false }`
[INFO] [stdout] d8f2e53a641baf78b057af095af301130f07889d6f3a894633fc66ec7813e989
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+beta-2026-04-21" "test" "--frozen", kill_on_drop: false }`
[INFO] [stdout] a68cb84b71c89ea0fd4fd028100cc7cc2016c6befff69495a239e02e089b7e03
[INFO] running `Command { std: "docker" "start" "-a" "a68cb84b71c89ea0fd4fd028100cc7cc2016c6befff69495a239e02e089b7e03", kill_on_drop: false }`
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 0.45s
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/vil_bench_llm-19b4402a287acedf)
[INFO] [stdout] 
[INFO] [stdout] running 10 tests
[INFO] [stdout] test built_in::tests::fact_bench_case_insensitive ... ok
[INFO] [stdout] test built_in::tests::fact_bench_correct ... ok
[INFO] [stdout] test built_in::tests::math_bench_correct ... ok
[INFO] [stdout] test built_in::tests::math_bench_incorrect ... ok
[INFO] [stdout] test report::tests::report_aggregation ... ok
[INFO] [stdout] test report::tests::empty_report ... ok
[INFO] [stdout] test built_in::tests::logic_bench_correct ... ok
[INFO] [stdout] test suite::tests::empty_suite ... ok
[INFO] [stdout] test suite::tests::suite_runs_all_benchmarks ... ok
[INFO] [stdout] test built_in::tests::logic_bench_cases_non_empty ... ok
[INFO] [stdout] 
[INFO] [stderr]    Doc-tests vil_bench_llm
[INFO] [stdout] test result: ok. 10 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] running 0 tests
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
[INFO] [stdout] 
[INFO] running `Command { std: "docker" "inspect" "a68cb84b71c89ea0fd4fd028100cc7cc2016c6befff69495a239e02e089b7e03", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "a68cb84b71c89ea0fd4fd028100cc7cc2016c6befff69495a239e02e089b7e03", kill_on_drop: false }`
[INFO] [stdout] a68cb84b71c89ea0fd4fd028100cc7cc2016c6befff69495a239e02e089b7e03
