[INFO] cloning repository https://github.com/vihang96/Autoeval
[INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/vihang96/Autoeval" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fvihang96%2FAutoeval", kill_on_drop: false }`
[INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fvihang96%2FAutoeval'...
[INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }`
[INFO] [stdout] 08200fdc609b6fd86863b03dd879c8c90ae27e82
[INFO] testing vihang96/Autoeval against 1.99.0-beta.8+cargoflags=--release for beta-release-1.100-2
[INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fvihang96%2FAutoeval" "/workspace/builds/worker-0-tc1/source", kill_on_drop: false }`
[INFO] [stderr] Cloning into '/workspace/builds/worker-0-tc1/source'...
[INFO] [stderr] done.
[INFO] removed /workspace/builds/worker-0-tc1/source/rust-toolchain.toml
[INFO] started tweaking git repo https://github.com/vihang96/Autoeval
[INFO] finished tweaking git repo https://github.com/vihang96/Autoeval
[INFO] tweaked toml for git repo https://github.com/vihang96/Autoeval written to /workspace/builds/worker-0-tc1/source/Cargo.toml
[INFO] validating manifest of git repo https://github.com/vihang96/Autoeval on toolchain 1.99.0-beta.8
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.99.0-beta.8" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] crate git repo https://github.com/vihang96/Autoeval already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.99.0-beta.8" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] [stderr]     Updating crates.io index
[INFO] [stderr]  Downloading crates ...
[INFO] [stderr]   Downloaded deadpool-sync v0.1.4
[INFO] [stderr]   Downloaded deadpool-sqlite v0.12.1
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-m" "1610612736" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:77db811e55d90add9212f6832c23229e3de5f1c1f9905e8cb07319ea15df73ac" "sleep" "infinity", kill_on_drop: false }`
[INFO] [stdout] 8647f37eb5fa6093e548b9c24c60c29cf0395e47cf5e187c0aae6c2da5d54a30
[INFO] running `Command { std: "docker" "start" "8647f37eb5fa6093e548b9c24c60c29cf0395e47cf5e187c0aae6c2da5d54a30", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "8647f37eb5fa6093e548b9c24c60c29cf0395e47cf5e187c0aae6c2da5d54a30", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-w" "/opt/rustwide/workdir" "--user" "0:0" "8647f37eb5fa6093e548b9c24c60c29cf0395e47cf5e187c0aae6c2da5d54a30" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.8" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "8647f37eb5fa6093e548b9c24c60c29cf0395e47cf5e187c0aae6c2da5d54a30", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "8647f37eb5fa6093e548b9c24c60c29cf0395e47cf5e187c0aae6c2da5d54a30" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.8" "build" "--frozen" "--message-format=json" "--release", kill_on_drop: false }`
[INFO] [stderr]    Compiling bytes v1.12.1
[INFO] [stderr]    Compiling serde_core v1.0.229
[INFO] [stderr]    Compiling serde_json v1.0.151
[INFO] [stderr]    Compiling smallvec v1.15.2
[INFO] [stderr]    Compiling cc v1.4.0
[INFO] [stderr]    Compiling vcpkg v0.2.15
[INFO] [stderr]    Compiling simd-adler32 v0.3.10
[INFO] [stderr]    Compiling adler2 v2.0.1
[INFO] [stderr]    Compiling syn v2.0.119
[INFO] [stderr]    Compiling foldhash v0.1.5
[INFO] [stderr]    Compiling getrandom v0.3.4
[INFO] [stderr]    Compiling serde_derive_internals v0.30.0
[INFO] [stderr]    Compiling ref-cast-impl v1.0.26
[INFO] [stderr]    Compiling dyn-clone v1.0.20
[INFO] [stderr]    Compiling num_cpus v1.17.0
[INFO] [stderr]    Compiling futures-channel v0.3.33
[INFO] [stderr]    Compiling sync_wrapper v1.0.2
[INFO] [stderr]    Compiling fallible-streaming-iterator v0.1.9
[INFO] [stderr]    Compiling fallible-iterator v0.3.0
[INFO] [stderr]    Compiling slab v0.4.12
[INFO] [stderr]    Compiling futures-task v0.3.33
[INFO] [stderr]    Compiling hashbrown v0.15.5
[INFO] [stderr]    Compiling miniz_oxide v0.8.9
[INFO] [stderr]    Compiling compression-core v0.4.32
[INFO] [stderr]    Compiling utf8parse v0.2.2
[INFO] [stderr]    Compiling futures-util v0.3.33
[INFO] [stderr]    Compiling is_terminal_polyfill v1.70.2
[INFO] [stderr]    Compiling anstyle-parse v1.0.0
[INFO] [stderr]    Compiling colorchoice v1.0.5
[INFO] [stderr]    Compiling rand_core v0.9.5
[INFO] [stderr]    Compiling anstyle-query v1.1.5
[INFO] [stderr]    Compiling anstyle v1.0.14
[INFO] [stderr]    Compiling strsim v0.11.1
[INFO] [stderr]    Compiling clap_lex v1.1.0
[INFO] [stderr]    Compiling ref-cast v1.0.26
[INFO] [stderr]    Compiling clap_derive v4.6.4
[INFO] [stderr]    Compiling anyhow v1.0.104
[INFO] [stderr]    Compiling rand_chacha v0.9.0
[INFO] [stderr]    Compiling anstream v1.0.0
[INFO] [stderr]    Compiling flate2 v1.1.9
[INFO] [stderr]    Compiling rand v0.9.5
[INFO] [stderr]    Compiling tokio v1.53.1
[INFO] [stderr]    Compiling http v1.5.0
[INFO] [stderr]    Compiling schemars_derive v1.2.2
[INFO] [stderr]    Compiling hashlink v0.10.0
[INFO] [stderr]    Compiling clap_builder v4.6.6
[INFO] [stderr]    Compiling libsqlite3-sys v0.35.0
[INFO] [stderr]    Compiling compression-codecs v0.4.38
[INFO] [stderr]    Compiling autoeval-agreement v0.1.0 (/opt/rustwide/workdir/crates/agreement)
[INFO] [stderr]    Compiling http-body v1.1.0
[INFO] [stderr]    Compiling http-body-util v0.1.4
[INFO] [stderr]    Compiling serde v1.0.229
[INFO] [stderr]    Compiling serde_path_to_error v0.1.20
[INFO] [stderr]    Compiling serde_urlencoded v0.7.1
[INFO] [stderr]    Compiling clap v4.6.6
[INFO] [stderr]    Compiling tracing-attributes v0.1.31
[INFO] [stderr]    Compiling strum_macros v0.27.2
[INFO] [stderr]    Compiling schemars v1.2.2
[INFO] [stderr]    Compiling tracing v0.1.44
[INFO] [stderr]    Compiling axum-core v0.5.6
[INFO] [stderr]    Compiling tracing-subscriber v0.3.23
[INFO] [stderr]    Compiling strum v0.27.2
[INFO] [stderr]    Compiling autoeval-core v0.1.0 (/opt/rustwide/workdir/crates/core)
[INFO] [stderr]    Compiling autoeval-provider v0.1.0 (/opt/rustwide/workdir/crates/provider)
[INFO] [stderr]    Compiling deadpool-runtime v0.1.4
[INFO] [stderr]    Compiling hyper v1.11.0
[INFO] [stderr]    Compiling tower v0.5.3
[INFO] [stderr]    Compiling async-compression v0.4.43
[INFO] [stderr]    Compiling tokio-util v0.7.19
[INFO] [stderr]    Compiling deadpool v0.12.3
[INFO] [stderr]    Compiling deadpool-sync v0.1.4
[INFO] [stderr]    Compiling tower-http v0.6.11
[INFO] [stderr]    Compiling hyper-util v0.1.20
[INFO] [stderr]    Compiling axum v0.8.9
[INFO] [stderr]    Compiling rusqlite v0.37.0
[INFO] [stderr]    Compiling deadpool-sqlite v0.12.1
[INFO] [stderr]    Compiling autoeval-store v0.1.0 (/opt/rustwide/workdir/crates/store)
[INFO] [stderr]    Compiling autoeval-server v0.1.0 (/opt/rustwide/workdir/crates/server)
[INFO] [stderr]    Compiling autoeval-cli v0.1.0 (/opt/rustwide/workdir/crates/cli)
[INFO] [stderr]     Finished `release` profile [optimized] target(s) in 2m 19s
[INFO] running `Command { std: "docker" "inspect" "8647f37eb5fa6093e548b9c24c60c29cf0395e47cf5e187c0aae6c2da5d54a30", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "8647f37eb5fa6093e548b9c24c60c29cf0395e47cf5e187c0aae6c2da5d54a30" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.8" "test" "--frozen" "--no-run" "--message-format=json" "--release", kill_on_drop: false }`
[INFO] [stderr]    Compiling bitflags v2.13.1
[INFO] [stderr]    Compiling rustix v1.1.4
[INFO] [stderr]    Compiling getrandom v0.4.3
[INFO] [stderr]    Compiling regex-syntax v0.8.11
[INFO] [stderr]    Compiling linux-raw-sys v0.12.1
[INFO] [stderr]    Compiling num-traits v0.2.19
[INFO] [stderr]    Compiling wait-timeout v0.2.1
[INFO] [stderr]    Compiling bit-vec v0.8.0
[INFO] [stderr]    Compiling quick-error v1.2.3
[INFO] [stderr]    Compiling rand_xorshift v0.4.0
[INFO] [stderr]    Compiling unarray v0.1.4
[INFO] [stderr]    Compiling autoeval-provider v0.1.0 (/opt/rustwide/workdir/crates/provider)
[INFO] [stderr]    Compiling autoeval-core v0.1.0 (/opt/rustwide/workdir/crates/core)
[INFO] [stderr]    Compiling bit-set v0.8.0
[INFO] [stderr]    Compiling rusqlite v0.37.0
[INFO] [stderr]    Compiling tower-http v0.6.11
[INFO] [stderr]    Compiling deadpool-sqlite v0.12.1
[INFO] [stderr]    Compiling autoeval-store v0.1.0 (/opt/rustwide/workdir/crates/store)
[INFO] [stderr]    Compiling autoeval-server v0.1.0 (/opt/rustwide/workdir/crates/server)
[INFO] [stderr]    Compiling tempfile v3.27.0
[INFO] [stderr]    Compiling regex-automata v0.4.18
[INFO] [stderr]    Compiling rusty-fork v0.3.1
[INFO] [stderr]    Compiling proptest v1.11.0
[INFO] [stderr]    Compiling matchers v0.2.0
[INFO] [stderr]    Compiling tracing-subscriber v0.3.23
[INFO] [stderr]    Compiling autoeval-cli v0.1.0 (/opt/rustwide/workdir/crates/cli)
[INFO] [stderr]    Compiling autoeval-agreement v0.1.0 (/opt/rustwide/workdir/crates/agreement)
[INFO] [stderr]     Finished `release` profile [optimized] target(s) in 1m 00s
[INFO] running `Command { std: "docker" "inspect" "8647f37eb5fa6093e548b9c24c60c29cf0395e47cf5e187c0aae6c2da5d54a30", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "8647f37eb5fa6093e548b9c24c60c29cf0395e47cf5e187c0aae6c2da5d54a30" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.8" "test" "--frozen" "--release", kill_on_drop: false }`
[INFO] [stderr]     Finished `release` profile [optimized] target(s) in 0.24s
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/release/deps/autoeval_agreement-42980d06da52b8e6)
[INFO] [stdout] 
[INFO] [stdout] running 9 tests
[INFO] [stdout] test tests::perfect_agreement_is_one ... ok
[INFO] [stdout] test bootstrap::tests::percentile_hits_the_ends ... ok
[INFO] [stdout] test tests::select_raters_takes_a_slice ... ok
[INFO] [stdout] test tests::unimplemented_metrics_error_rather_than_panic ... ok
[INFO] [stdout] test tests::skewed_marginals_collapse_kappa_despite_high_agreement ... ok
[INFO] [stdout] test tests::estimate_always_carries_an_interval ... ok
[INFO] [stdout] test bootstrap::tests::interval_is_reproducible_across_runs ... ok
[INFO] [stdout] test tests::cohen_kappa_matches_hand_calculation ... ok
[INFO] [stdout] test tests::percent_agreement_matches_hand_calculation ... ok
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 9 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.02s
[INFO] [stdout] 
[INFO] [stderr]      Running unittests src/main.rs (/opt/rustwide/target/release/deps/autoeval-7d9234ed74482b8a)
[INFO] [stdout] 
[INFO] [stdout] running 0 tests
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
[INFO] [stdout] 
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/release/deps/autoeval_core-d57a94ea4ebf1ed4)
[INFO] [stdout] 
[INFO] [stdout] running 3 tests
[INFO] [stdout] test verdict::tests::continuous_is_representable_but_not_yet_supported ... ok
[INFO] [stdout] test verdict::tests::program_and_human_are_ground_truth_but_judge_is_not ... ok
[INFO] [stdout] test verdict::tests::verdict_round_trips_through_json ... ok
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 3 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.08s
[INFO] [stdout] 
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/release/deps/autoeval_provider-e2b2a3879bbf25de)
[INFO] [stdout] 
[INFO] [stdout] running 1 test
[INFO] [stdout] test capabilities::tests::cache_hit_reflects_read_tokens ... ok
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
[INFO] [stdout] 
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/release/deps/autoeval_server-4922d5228e6874ba)
[INFO] [stdout] 
[INFO] [stdout] running 0 tests
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/release/deps/autoeval_store-56c4fdbe51a8e4bb)
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
[INFO] [stdout] 
[INFO] [stderr]    Doc-tests autoeval_agreement
[INFO] [stdout] 
[INFO] [stdout] running 0 tests
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] running 0 tests
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
[INFO] [stdout] 
[INFO] [stderr]    Doc-tests autoeval_core
[INFO] [stdout] 
[INFO] [stdout] running 0 tests
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
[INFO] [stdout] 
[INFO] [stderr]    Doc-tests autoeval_provider
[INFO] [stdout] 
[INFO] [stdout] running 0 tests
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
[INFO] [stdout] 
[INFO] [stderr]    Doc-tests autoeval_server
[INFO] [stdout] 
[INFO] [stdout] running 0 tests
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
[INFO] [stdout] 
[INFO] [stderr]    Doc-tests autoeval_store
[INFO] [stdout] 
[INFO] [stdout] running 0 tests
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
[INFO] [stdout] 
[INFO] running `Command { std: "docker" "inspect" "8647f37eb5fa6093e548b9c24c60c29cf0395e47cf5e187c0aae6c2da5d54a30", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "8647f37eb5fa6093e548b9c24c60c29cf0395e47cf5e187c0aae6c2da5d54a30", kill_on_drop: false }`
[INFO] [stdout] 8647f37eb5fa6093e548b9c24c60c29cf0395e47cf5e187c0aae6c2da5d54a30
