[INFO] fetching crate vil_eval 0.4.0... [INFO] testing vil_eval-0.4.0 against beta-2026-04-21 for beta-1.96-1 [INFO] extracting crate vil_eval 0.4.0 into /workspace/builds/worker-6-tc2/source [INFO] started tweaking crates.io crate vil_eval 0.4.0 [INFO] finished tweaking crates.io crate vil_eval 0.4.0 [INFO] tweaked toml for crates.io crate vil_eval 0.4.0 written to /workspace/builds/worker-6-tc2/source/Cargo.toml [INFO] validating manifest of crates.io crate vil_eval 0.4.0 on toolchain beta-2026-04-21 [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+beta-2026-04-21" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }` [INFO] crate crates.io crate vil_eval 0.4.0 already has a lockfile, it will not be regenerated [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+beta-2026-04-21" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+beta-2026-04-21" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }` [INFO] [stdout] faa6dbb9ed2fc2033256e66b9ae64ad8b10381e4aa84e866a3e0f939e1531e8e [INFO] running `Command { std: "docker" "start" "-a" "faa6dbb9ed2fc2033256e66b9ae64ad8b10381e4aa84e866a3e0f939e1531e8e", kill_on_drop: false }` [INFO] running `Command { std: "docker" "inspect" "faa6dbb9ed2fc2033256e66b9ae64ad8b10381e4aa84e866a3e0f939e1531e8e", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "faa6dbb9ed2fc2033256e66b9ae64ad8b10381e4aa84e866a3e0f939e1531e8e", kill_on_drop: false }` [INFO] [stdout] faa6dbb9ed2fc2033256e66b9ae64ad8b10381e4aa84e866a3e0f939e1531e8e [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+beta-2026-04-21" "build" "--frozen" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] 9fa252de0b0997674546cd01abe5c55149e3acc5007be5e829cc7bd6975cce66 [INFO] running `Command { std: "docker" "start" "-a" "9fa252de0b0997674546cd01abe5c55149e3acc5007be5e829cc7bd6975cce66", kill_on_drop: false }` [INFO] [stderr] Compiling serde_core v1.0.228 [INFO] [stderr] Compiling serde_json v1.0.149 [INFO] [stderr] Compiling num-traits v0.2.19 [INFO] [stderr] Compiling mio v1.2.0 [INFO] [stderr] Compiling subtle v2.6.1 [INFO] [stderr] Compiling crypto-common v0.1.7 [INFO] [stderr] Compiling openssl-sys v0.9.112 [INFO] [stderr] Compiling regex-automata v0.4.14 [INFO] [stderr] Compiling hashbrown v0.14.5 [INFO] [stderr] Compiling rand_chacha v0.3.1 [INFO] [stderr] Compiling nix v0.27.1 [INFO] [stderr] Compiling memmap2 v0.9.10 [INFO] [stderr] Compiling tracing-log v0.2.0 [INFO] [stderr] Compiling openssl v0.10.76 [INFO] [stderr] Compiling openssl-macros v0.1.1 [INFO] [stderr] Compiling simd-adler32 v0.3.9 [INFO] [stderr] Compiling rustc-hash v2.1.2 [INFO] [stderr] Compiling data-encoding v2.10.0 [INFO] [stderr] Compiling miniz_oxide v0.8.9 [INFO] [stderr] Compiling digest v0.10.7 [INFO] [stderr] Compiling rand v0.8.5 [INFO] [stderr] Compiling idna v1.1.0 [INFO] [stderr] Compiling ref-cast-impl v1.0.25 [INFO] [stderr] Compiling socket2 v0.5.10 [INFO] [stderr] Compiling indexmap v1.9.3 [INFO] [stderr] Compiling native-tls v0.2.18 [INFO] [stderr] Compiling sha1 v0.10.6 [INFO] [stderr] Compiling compression-core v0.4.31 [INFO] [stderr] Compiling tokio v1.51.0 [INFO] [stderr] Compiling flate2 v1.1.9 [INFO] [stderr] Compiling dashmap v5.5.3 [INFO] [stderr] Compiling simdutf8 v0.1.5 [INFO] [stderr] Compiling ref-cast v1.0.25 [INFO] [stderr] Compiling url v2.5.8 [INFO] [stderr] Compiling axum-core v0.4.5 [INFO] [stderr] Compiling inout v0.1.4 [INFO] [stderr] Compiling axum-macros v0.4.2 [INFO] [stderr] Compiling tungstenite v0.24.0 [INFO] [stderr] Compiling compression-codecs v0.4.37 [INFO] [stderr] Compiling sonic-simd v0.1.4 [INFO] [stderr] Compiling sonic-number v0.1.2 [INFO] [stderr] Compiling rmp v0.8.15 [INFO] [stderr] Compiling bumpalo v3.20.2 [INFO] [stderr] Compiling hashbrown v0.12.3 [INFO] [stderr] Compiling matchit v0.7.3 [INFO] [stderr] Compiling hdrhistogram v7.5.4 [INFO] [stderr] Compiling cipher v0.4.4 [INFO] [stderr] Compiling universal-hash v0.5.1 [INFO] [stderr] Compiling opaque-debug v0.3.1 [INFO] [stderr] Compiling http-range-header v0.4.2 [INFO] [stderr] Compiling vil_observer v0.4.0 [INFO] [stderr] Compiling serde v1.0.228 [INFO] [stderr] Compiling aead v0.5.2 [INFO] [stderr] Compiling polyval v0.6.2 [INFO] [stderr] Compiling futures-executor v0.3.32 [INFO] [stderr] Compiling vil_connector_macros v0.4.0 [INFO] [stderr] Compiling ctr v0.9.2 [INFO] [stderr] Compiling aes v0.8.4 [INFO] [stderr] Compiling ghash v0.5.1 [INFO] [stderr] Compiling darling_core v0.20.11 [INFO] [stderr] Compiling futures v0.3.32 [INFO] [stderr] Compiling uuid v1.23.0 [INFO] [stderr] Compiling num-conv v0.2.1 [INFO] [stderr] Compiling vil_types v0.4.0 [INFO] [stderr] Compiling serde_yaml v0.9.34+deprecated [INFO] [stderr] Compiling num-integer v0.1.46 [INFO] [stderr] Compiling time-macros v0.2.27 [INFO] [stderr] Compiling ring v0.17.14 [INFO] [stderr] Compiling aes-gcm v0.10.3 [INFO] [stderr] Compiling proc-macro-error-attr2 v2.0.0 [INFO] [stderr] Compiling matchers v0.2.0 [INFO] [stderr] Compiling serde_path_to_error v0.1.20 [INFO] [stderr] Compiling num-bigint v0.4.6 [INFO] [stderr] Compiling async-stream-impl v0.3.6 [INFO] [stderr] Compiling proc-macro-error2 v2.0.1 [INFO] [stderr] Compiling tracing-serde v0.2.0 [INFO] [stderr] Compiling chrono v0.4.44 [INFO] [stderr] Compiling rmp-serde v1.3.1 [INFO] [stderr] Compiling serde_urlencoded v0.7.1 [INFO] [stderr] Compiling faststr v0.2.34 [INFO] [stderr] Compiling time v0.3.47 [INFO] [stderr] Compiling tracing-subscriber v0.3.23 [INFO] [stderr] Compiling vil_shm v0.4.0 [INFO] [stderr] Compiling vil_obs v0.4.0 [INFO] [stderr] Compiling vil_queue v0.4.0 [INFO] [stderr] Compiling sonic-rs v0.3.17 [INFO] [stderr] Compiling vil_registry v0.4.0 [INFO] [stderr] Compiling vil_ir v0.4.0 [INFO] [stderr] Compiling toml_datetime v0.6.11 [INFO] [stderr] Compiling serde_spanned v0.6.9 [INFO] [stderr] Compiling base64ct v1.8.3 [INFO] [stderr] Compiling toml_edit v0.22.27 [INFO] [stderr] Compiling simple_asn1 v0.6.4 [INFO] [stderr] Compiling password-hash v0.5.0 [INFO] [stderr] Compiling async-stream v0.3.6 [INFO] [stderr] Compiling regex v1.12.3 [INFO] [stderr] Compiling blake2 v0.10.6 [INFO] [stderr] Compiling vil_validate v0.4.0 [INFO] [stderr] Compiling pem v3.0.6 [INFO] [stderr] Compiling vil_sdk v0.4.0 [INFO] [stderr] Compiling vil_json v0.4.0 [INFO] [stderr] Compiling sha2 v0.10.9 [INFO] [stderr] Compiling vil_server_macros v0.4.0 [INFO] [stderr] Compiling argon2 v0.5.3 [INFO] [stderr] Compiling vil_macros v0.4.0 [INFO] [stderr] Compiling darling_macro v0.20.11 [INFO] [stderr] Compiling vil_capsule v0.4.0 [INFO] [stderr] Compiling darling v0.20.11 [INFO] [stderr] Compiling validator_derive v0.20.0 [INFO] [stderr] Compiling tokio-util v0.7.18 [INFO] [stderr] Compiling tower v0.5.3 [INFO] [stderr] Compiling vil_log v0.4.0 [INFO] [stderr] Compiling tokio-tungstenite v0.24.0 [INFO] [stderr] Compiling tokio-native-tls v0.3.1 [INFO] [stderr] Compiling vil_net v0.4.0 [INFO] [stderr] Compiling async-compression v0.4.41 [INFO] [stderr] Compiling tokio-stream v0.1.18 [INFO] [stderr] Compiling h2 v0.4.13 [INFO] [stderr] Compiling tower-http v0.5.2 [INFO] [stderr] Compiling tower v0.4.13 [INFO] [stderr] Compiling jsonwebtoken v9.3.1 [INFO] [stderr] Compiling validator v0.20.0 [INFO] [stderr] Compiling tower-http v0.6.8 [INFO] [stderr] Compiling vil_rt v0.4.0 [INFO] [stderr] Compiling vil_sidecar v0.4.0 [INFO] [stderr] Compiling toml v0.8.23 [INFO] [stderr] Compiling vil_server_config v0.4.0 [INFO] [stderr] Compiling vil_engine v0.4.0 [INFO] [stderr] Compiling hyper v1.9.0 [INFO] [stderr] Compiling hyper-util v0.1.20 [INFO] [stderr] Compiling axum v0.7.9 [INFO] [stderr] Compiling hyper-tls v0.6.0 [INFO] [stderr] Compiling reqwest v0.12.28 [INFO] [stderr] Compiling vil_new_http v0.4.0 [INFO] [stderr] Compiling vil_server_core v0.4.0 [INFO] [stderr] Compiling vil_server_db v0.4.0 [INFO] [stderr] Compiling vil_server_web v0.4.0 [INFO] [stderr] Compiling vil_server_auth v0.4.0 [INFO] [stderr] Compiling vil_server_mesh v0.4.0 [INFO] [stderr] Compiling vil_server v0.4.0 [INFO] [stderr] Compiling vil_llm v0.4.0 [INFO] [stderr] Compiling vil_eval v0.4.0 (/opt/rustwide/workdir) [INFO] [stderr] Finished `dev` profile [unoptimized + debuginfo] target(s) in 1m 22s [INFO] running `Command { std: "docker" "inspect" "9fa252de0b0997674546cd01abe5c55149e3acc5007be5e829cc7bd6975cce66", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "9fa252de0b0997674546cd01abe5c55149e3acc5007be5e829cc7bd6975cce66", kill_on_drop: false }` [INFO] [stdout] 9fa252de0b0997674546cd01abe5c55149e3acc5007be5e829cc7bd6975cce66 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+beta-2026-04-21" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] 24070f19971b0e51973fd8c478199f2eb811def7e9e060374ab8d7a611ab3656 [INFO] running `Command { std: "docker" "start" "-a" "24070f19971b0e51973fd8c478199f2eb811def7e9e060374ab8d7a611ab3656", kill_on_drop: false }` [INFO] [stderr] Compiling vil_eval v0.4.0 (/opt/rustwide/workdir) [INFO] [stderr] Finished `test` profile [unoptimized + debuginfo] target(s) in 3.18s [INFO] running `Command { std: "docker" "inspect" "24070f19971b0e51973fd8c478199f2eb811def7e9e060374ab8d7a611ab3656", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "24070f19971b0e51973fd8c478199f2eb811def7e9e060374ab8d7a611ab3656", kill_on_drop: false }` [INFO] [stdout] 24070f19971b0e51973fd8c478199f2eb811def7e9e060374ab8d7a611ab3656 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+beta-2026-04-21" "test" "--frozen", kill_on_drop: false }` [INFO] [stdout] 9d64f5e5de3ecec72ca71a0aabd563d6ada4461b4d3f32576ab986006ff02beb [INFO] running `Command { std: "docker" "start" "-a" "9d64f5e5de3ecec72ca71a0aabd563d6ada4461b4d3f32576ab986006ff02beb", kill_on_drop: false }` [INFO] [stderr] Finished `test` profile [unoptimized + debuginfo] target(s) in 0.44s [INFO] [stderr] Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/vil_eval-b222690409b562c8) [INFO] [stdout] [INFO] [stdout] running 12 tests [INFO] [stdout] test tests::test_answer_length_too_short ... ok [INFO] [stdout] test tests::test_answer_length_good ... ok [INFO] [stdout] test tests::test_answer_relevance_scoring ... ok [INFO] [stdout] test tests::test_context_recall_no_reference ... ok [INFO] [stdout] test tests::test_context_recall_with_reference ... ok [INFO] [stdout] test tests::test_dataset_loading_from_json ... ok [INFO] [stdout] test tests::test_dataset_roundtrip_json ... ok [INFO] [stdout] test tests::test_empty_dataset ... ok [INFO] [stdout] test tests::test_faithfulness_scoring ... ok [INFO] [stdout] test tests::test_report_aggregation ... ok [INFO] [stdout] test tests::test_metric_scores_in_range ... ok [INFO] [stdout] test tests::test_runner_with_multiple_metrics ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 12 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s [INFO] [stdout] [INFO] [stderr] Doc-tests vil_eval [INFO] [stdout] [INFO] [stdout] running 1 test [INFO] [stdout] test src/lib.rs - (line 5) ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 1.24s [INFO] [stdout] [INFO] running `Command { std: "docker" "inspect" "9d64f5e5de3ecec72ca71a0aabd563d6ada4461b4d3f32576ab986006ff02beb", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "9d64f5e5de3ecec72ca71a0aabd563d6ada4461b4d3f32576ab986006ff02beb", kill_on_drop: false }` [INFO] [stdout] 9d64f5e5de3ecec72ca71a0aabd563d6ada4461b4d3f32576ab986006ff02beb