[INFO] fetching crate evalflow 0.1.0...
[INFO] testing evalflow-0.1.0 against 1.99.0-beta.8+cargoflags=--release for beta-release-1.100-2
[INFO] extracting crate evalflow 0.1.0 into /workspace/builds/worker-4-tc1/source
[INFO] started tweaking crates.io crate evalflow 0.1.0
[INFO] removed 0 missing examples
[INFO] removed 0 missing tests
[INFO] finished tweaking crates.io crate evalflow 0.1.0
[INFO] tweaked toml for crates.io crate evalflow 0.1.0 written to /workspace/builds/worker-4-tc1/source/Cargo.toml
[INFO] validating manifest of crates.io crate evalflow 0.1.0 on toolchain 1.99.0-beta.8
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.99.0-beta.8" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] crate crates.io crate evalflow 0.1.0 already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.99.0-beta.8" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-4-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-4-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-m" "1610612736" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:77db811e55d90add9212f6832c23229e3de5f1c1f9905e8cb07319ea15df73ac" "sleep" "infinity", kill_on_drop: false }`
[INFO] [stdout] 78726c89ca3c5253210002de4b093454e0fffa2f2453c24c649fd245239ae13a
[INFO] running `Command { std: "docker" "start" "78726c89ca3c5253210002de4b093454e0fffa2f2453c24c649fd245239ae13a", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "78726c89ca3c5253210002de4b093454e0fffa2f2453c24c649fd245239ae13a", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-w" "/opt/rustwide/workdir" "--user" "0:0" "78726c89ca3c5253210002de4b093454e0fffa2f2453c24c649fd245239ae13a" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.8" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "78726c89ca3c5253210002de4b093454e0fffa2f2453c24c649fd245239ae13a", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "78726c89ca3c5253210002de4b093454e0fffa2f2453c24c649fd245239ae13a" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.8" "build" "--frozen" "--message-format=json" "--release", kill_on_drop: false }`
[INFO] [stderr]    Compiling syn v3.0.3
[INFO] [stderr]    Compiling async-trait v0.1.91
[INFO] [stderr]    Compiling evalflow v0.1.0 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `release` profile [optimized] target(s) in 5.27s
[INFO] running `Command { std: "docker" "inspect" "78726c89ca3c5253210002de4b093454e0fffa2f2453c24c649fd245239ae13a", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "78726c89ca3c5253210002de4b093454e0fffa2f2453c24c649fd245239ae13a" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.8" "test" "--frozen" "--no-run" "--message-format=json" "--release", kill_on_drop: false }`
[INFO] [stderr]    Compiling errno v0.3.14
[INFO] [stderr]    Compiling parking_lot_core v0.9.12
[INFO] [stderr]    Compiling serde v1.0.229
[INFO] [stderr]    Compiling alloca v0.4.0
[INFO] [stderr]    Compiling clap_builder v4.6.6
[INFO] [stderr]    Compiling itertools v0.13.0
[INFO] [stderr]    Compiling tokio-macros v2.7.2
[INFO] [stderr]    Compiling async-trait v0.1.91
[INFO] [stderr]    Compiling page_size v0.6.0
[INFO] [stderr]    Compiling signal-hook-registry v1.4.8
[INFO] [stderr]    Compiling parking_lot v0.12.5
[INFO] [stderr]    Compiling evalflow v0.1.0 (/opt/rustwide/workdir)
[INFO] [stderr]    Compiling tokio v1.53.1
[INFO] [stderr]    Compiling tinytemplate v1.2.1
[INFO] [stderr]    Compiling ciborium v0.2.2
[INFO] [stderr]    Compiling criterion-plot v0.8.2
[INFO] [stderr]    Compiling clap v4.6.6
[INFO] [stderr]    Compiling criterion v0.8.2
[INFO] [stderr]     Finished `release` profile [optimized] target(s) in 36.16s
[INFO] running `Command { std: "docker" "inspect" "78726c89ca3c5253210002de4b093454e0fffa2f2453c24c649fd245239ae13a", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "78726c89ca3c5253210002de4b093454e0fffa2f2453c24c649fd245239ae13a" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.8" "test" "--frozen" "--release", kill_on_drop: false }`
[INFO] [stderr]     Finished `release` profile [optimized] target(s) in 0.10s
[INFO] [stderr]      Running unittests evalflow/eval.rs (/opt/rustwide/target/release/deps/evalflow-73044062cb145e09)
[INFO] [stderr]      Running tests/integration.rs (/opt/rustwide/target/release/deps/integration-77ff481b23b2b850)
[INFO] [stdout] 
[INFO] [stdout] running 0 tests
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] running 7 tests
[INFO] [stdout] test contains_checks_substring_not_equality ... ok
[INFO] [stdout] test average_scores_are_computed_per_metric_across_cases ... ok
[INFO] [stdout] test f1_score_with_no_expected_output_scores_zero ... ok
[INFO] [stdout] test sync_and_async_metrics_can_run_in_the_same_suite ... ok
[INFO] [stdout] test exact_match_scores_one_only_on_exact_equality ... ok
[INFO] [stdout] test f1_score_gives_partial_credit_for_partial_overlap ... ok
[INFO] [stdout] test custom_async_metric_can_use_context_and_explain_its_score ... ok
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 7 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s
[INFO] [stdout] 
[INFO] [stderr]    Doc-tests evalflow
[INFO] [stdout] 
[INFO] [stdout] running 1 test
[INFO] [stdout] test evalflow/../README.md - (line 18) ... ignored
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 0 passed; 0 failed; 1 ignored; 0 measured; 0 filtered out; finished in 0.00s
[INFO] [stdout] 
[INFO] [stdout] all doctests ran in 0.25s; merged doctests compilation took 0.24s
[INFO] running `Command { std: "docker" "inspect" "78726c89ca3c5253210002de4b093454e0fffa2f2453c24c649fd245239ae13a", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "78726c89ca3c5253210002de4b093454e0fffa2f2453c24c649fd245239ae13a", kill_on_drop: false }`
[INFO] [stdout] 78726c89ca3c5253210002de4b093454e0fffa2f2453c24c649fd245239ae13a
