[INFO] cloning repository https://github.com/kent-tokyo/masstrust [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/kent-tokyo/masstrust" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fkent-tokyo%2Fmasstrust", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fkent-tokyo%2Fmasstrust'... [INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }` [INFO] [stdout] cfc2b4ff4de0381d55b64636ef0714f961293b93 [INFO] testing kent-tokyo/masstrust against 1.99.0-beta.8+cargoflags=--release for beta-release-1.100-3 [INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fkent-tokyo%2Fmasstrust" "/workspace/builds/worker-3-tc1/source", kill_on_drop: false }` [INFO] [stderr] Cloning into '/workspace/builds/worker-3-tc1/source'... [INFO] [stderr] done. [INFO] started tweaking git repo https://github.com/kent-tokyo/masstrust [INFO] finished tweaking git repo https://github.com/kent-tokyo/masstrust [INFO] tweaked toml for git repo https://github.com/kent-tokyo/masstrust written to /workspace/builds/worker-3-tc1/source/Cargo.toml [INFO] validating manifest of git repo https://github.com/kent-tokyo/masstrust on toolchain 1.99.0-beta.8 [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.99.0-beta.8" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }` [INFO] crate git repo https://github.com/kent-tokyo/masstrust already has a lockfile, it will not be regenerated [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.99.0-beta.8" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] [stderr] Updating crates.io index [INFO] [stderr] Downloading crates ... [INFO] [stderr] Downloaded serde_json v1.0.150 [INFO] [stderr] Downloaded windows-interface v0.57.0 [INFO] [stderr] Downloaded windows-implement v0.57.0 [INFO] [stderr] Downloaded async-stream-impl v0.3.6 [INFO] [stderr] Downloaded async-stream v0.3.6 [INFO] [stderr] Downloaded pyo3-macros v0.29.0 [INFO] [stderr] Downloaded quote v1.0.46 [INFO] [stderr] Downloaded debug_unsafe v0.1.4 [INFO] [stderr] Downloaded recursive v0.1.1 [INFO] [stderr] Downloaded now v0.1.3 [INFO] [stderr] Downloaded recursive-proc-macro-impl v0.1.1 [INFO] [stderr] Downloaded polars-schema v0.46.0 [INFO] [stderr] Downloaded unicode-reverse v1.0.9 [INFO] [stderr] Downloaded phf_shared v0.12.1 [INFO] [stderr] Downloaded alloc-no-stdlib v2.0.4 [INFO] [stderr] Downloaded polars-error v0.46.0 [INFO] [stderr] Downloaded wasm-bindgen-shared v0.2.126 [INFO] [stderr] Downloaded wasm-bindgen-macro v0.2.126 [INFO] [stderr] Downloaded alloc-stdlib v0.2.4 [INFO] [stderr] Downloaded fastrand v2.4.1 [INFO] [stderr] Downloaded windows-result v0.1.2 [INFO] [stderr] Downloaded stacker v0.1.24 [INFO] [stderr] Downloaded psm v0.1.31 [INFO] [stderr] Downloaded jobserver v0.1.34 [INFO] [stderr] Downloaded fallible-streaming-iterator v0.1.9 [INFO] [stderr] Downloaded target-lexicon v0.13.5 [INFO] [stderr] Downloaded streaming-decompression v0.1.2 [INFO] [stderr] Downloaded socket2 v0.6.4 [INFO] [stderr] Downloaded either v1.16.0 [INFO] [stderr] Downloaded autocfg v1.5.1 [INFO] [stderr] Downloaded pkg-config v0.3.33 [INFO] [stderr] Downloaded plotters-svg v0.3.7 [INFO] [stderr] Downloaded xxhash-rust v0.8.15 [INFO] [stderr] Downloaded simd-adler32 v0.3.9 [INFO] [stderr] Downloaded plotters-backend v0.3.7 [INFO] [stderr] Downloaded planus v0.3.1 [INFO] [stderr] Downloaded bytemuck_derive v1.10.2 [INFO] [stderr] Downloaded strum_macros v0.26.4 [INFO] [stderr] Downloaded polars-row v0.46.0 [INFO] [stderr] Downloaded zstd-safe v7.2.4 [INFO] [stderr] Downloaded streaming-iterator v0.1.9 [INFO] [stderr] Downloaded lz4 v1.28.1 [INFO] [stderr] Downloaded phf v0.12.1 [INFO] [stderr] Downloaded atoi_simd v0.16.1 [INFO] [stderr] Downloaded polars-utils v0.46.0 [INFO] [stderr] Downloaded pyo3-build-config v0.29.0 [INFO] [stderr] Downloaded array-init-cursor v0.2.1 [INFO] [stderr] Downloaded memmap2 v0.9.11 [INFO] [stderr] Downloaded smallvec v1.15.2 [INFO] [stderr] Downloaded fast-float2 v0.2.3 [INFO] [stderr] Downloaded float-cmp v0.10.0 [INFO] [stderr] Downloaded crossbeam-queue v0.3.12 [INFO] [stderr] Downloaded windows-core v0.57.0 [INFO] [stderr] Downloaded crossbeam-epoch v0.9.20 [INFO] [stderr] Downloaded polars-arrow-format v0.1.0 [INFO] [stderr] Downloaded polars-time v0.46.0 [INFO] [stderr] Downloaded zstd v0.13.3 [INFO] [stderr] Downloaded ethnum v1.5.3 [INFO] [stderr] Downloaded log v0.4.33 [INFO] [stderr] Downloaded snap v1.1.1 [INFO] [stderr] Downloaded polars-parquet-format v0.1.0 [INFO] [stderr] Downloaded polars-json v0.46.0 [INFO] [stderr] Downloaded csv-core v0.1.13 [INFO] [stderr] Downloaded bitflags v2.13.0 [INFO] [stderr] Downloaded ar_archive_writer v0.5.2 [INFO] [stderr] Downloaded wasm-bindgen v0.2.126 [INFO] [stderr] Downloaded bytes v1.12.0 [INFO] [stderr] Downloaded rand_distr v0.4.3 [INFO] [stderr] Downloaded polars-compute v0.46.0 [INFO] [stderr] Downloaded polars-sql v0.46.0 [INFO] [stderr] Downloaded flate2 v1.1.9 [INFO] [stderr] Downloaded memchr v2.8.2 [INFO] [stderr] Downloaded cc v1.2.65 [INFO] [stderr] Downloaded wasm-bindgen-macro-support v0.2.126 [INFO] [stderr] Downloaded bumpalo v3.20.3 [INFO] [stderr] Downloaded js-sys v0.3.103 [INFO] [stderr] Downloaded compact_str v0.8.2 [INFO] [stderr] Downloaded unicode-segmentation v1.13.3 [INFO] [stderr] Downloaded argminmax v0.6.3 [INFO] [stderr] Downloaded mio v1.2.1 [INFO] [stderr] Downloaded value-trait v0.10.1 [INFO] [stderr] Downloaded halfbrown v0.2.5 [INFO] [stderr] Downloaded enum_dispatch v0.3.13 [INFO] [stderr] Downloaded anyhow v1.0.103 [INFO] [stderr] Downloaded pyo3-macros-backend v0.29.0 [INFO] [stderr] Downloaded pyo3-ffi v0.29.0 [INFO] [stderr] Downloaded raw-cpuid v11.6.0 [INFO] [stderr] Downloaded zerocopy-derive v0.8.52 [INFO] [stderr] Downloaded polars-mem-engine v0.46.0 [INFO] [stderr] Downloaded uuid v1.23.4 [INFO] [stderr] Downloaded polars v0.46.0 [INFO] [stderr] Downloaded ntapi v0.4.3 [INFO] [stderr] Downloaded wasip2 v1.0.4+wasi-0.2.12 [INFO] [stderr] Downloaded slotmap v1.1.1 [INFO] [stderr] Downloaded polars-ops v0.46.0 [INFO] [stderr] Downloaded polars-lazy v0.46.0 [INFO] [stderr] Downloaded polars-expr v0.46.0 [INFO] [stderr] Downloaded regex v1.12.4 [INFO] [stderr] Downloaded libm v0.2.16 [INFO] [stderr] Downloaded polars-stream v0.46.0 [INFO] [stderr] Downloaded polars-pipe v0.46.0 [INFO] [stderr] Downloaded typenum v1.20.1 [INFO] [stderr] Downloaded portable-atomic v1.13.1 [INFO] [stderr] Downloaded sysinfo v0.33.1 [INFO] [stderr] Downloaded polars-parquet v0.46.0 [INFO] [stderr] Downloaded brotli-decompressor v4.0.3 [INFO] [stderr] Downloaded risksieve v0.2.0 [INFO] [stderr] Downloaded polars-io v0.46.0 [INFO] [stderr] Downloaded plotters v0.3.7 [INFO] [stderr] Downloaded zlib-rs v0.6.4 [INFO] [stderr] Downloaded chrono v0.4.45 [INFO] [stderr] Downloaded simd-json v0.14.3 [INFO] [stderr] Downloaded syn v2.0.118 [INFO] [stderr] Downloaded sqlparser v0.53.0 [INFO] [stderr] Downloaded polars-plan v0.46.0 [INFO] [stderr] Downloaded zerocopy v0.8.52 [INFO] [stderr] Downloaded polars-arrow v0.46.0 [INFO] [stderr] Downloaded regex-syntax v0.8.11 [INFO] [stderr] Downloaded polars-core v0.46.0 [INFO] [stderr] Downloaded lz4-sys v1.11.1+lz4-1.10.0 [INFO] [stderr] Downloaded web-sys v0.3.103 [INFO] [stderr] Downloaded zstd-sys v2.0.16+zstd.1.5.7 [INFO] [stderr] Downloaded chrono-tz v0.10.4 [INFO] [stderr] Downloaded csv v1.4.0 [INFO] [stderr] Downloaded pyo3 v0.29.0 [INFO] [stderr] Downloaded brotli v7.0.0 [INFO] [stderr] Downloaded windows v0.57.0 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-m" "1610612736" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:77db811e55d90add9212f6832c23229e3de5f1c1f9905e8cb07319ea15df73ac" "sleep" "infinity", kill_on_drop: false }` [INFO] [stdout] 46de9980f38870f89563de1e5ff1c04681cf0913bea878824b11453e423ab565 [INFO] running `Command { std: "docker" "start" "46de9980f38870f89563de1e5ff1c04681cf0913bea878824b11453e423ab565", kill_on_drop: false }` [INFO] running `Command { std: "docker" "inspect" "46de9980f38870f89563de1e5ff1c04681cf0913bea878824b11453e423ab565", kill_on_drop: false }` [INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-w" "/opt/rustwide/workdir" "--user" "0:0" "46de9980f38870f89563de1e5ff1c04681cf0913bea878824b11453e423ab565" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.8" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }` [INFO] running `Command { std: "docker" "inspect" "46de9980f38870f89563de1e5ff1c04681cf0913bea878824b11453e423ab565", kill_on_drop: false }` [INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "46de9980f38870f89563de1e5ff1c04681cf0913bea878824b11453e423ab565" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.8" "build" "--frozen" "--message-format=json" "--release", kill_on_drop: false }` [INFO] [stderr] Compiling proc-macro2 v1.0.106 [INFO] [stderr] Compiling quote v1.0.46 [INFO] [stderr] Compiling unicode-ident v1.0.24 [INFO] [stderr] Compiling target-lexicon v0.13.5 [INFO] [stderr] Compiling serde_core v1.0.228 [INFO] [stderr] Compiling heck v0.5.0 [INFO] [stderr] Compiling memchr v2.8.2 [INFO] [stderr] Compiling zmij v1.0.21 [INFO] [stderr] Compiling itoa v1.0.18 [INFO] [stderr] Compiling libc v0.2.186 [INFO] [stderr] Compiling serde_json v1.0.150 [INFO] [stderr] Compiling utf8parse v0.2.2 [INFO] [stderr] Compiling anstyle-parse v1.0.0 [INFO] [stderr] Compiling serde v1.0.228 [INFO] [stderr] Compiling is_terminal_polyfill v1.70.2 [INFO] [stderr] Compiling colorchoice v1.0.5 [INFO] [stderr] Compiling anstyle-query v1.1.5 [INFO] [stderr] Compiling anstyle v1.0.14 [INFO] [stderr] Compiling ryu v1.0.23 [INFO] [stderr] Compiling csv-core v0.1.13 [INFO] [stderr] Compiling anstream v1.0.0 [INFO] [stderr] Compiling clap_lex v1.1.0 [INFO] [stderr] Compiling pyo3-build-config v0.29.0 [INFO] [stderr] Compiling anyhow v1.0.103 [INFO] [stderr] Compiling strsim v0.11.1 [INFO] [stderr] Compiling syn v2.0.118 [INFO] [stderr] Compiling once_cell v1.21.4 [INFO] [stderr] Compiling clap_builder v4.6.0 [INFO] [stderr] Compiling pyo3-ffi v0.29.0 [INFO] [stderr] Compiling pyo3 v0.29.0 [INFO] [stderr] Compiling csv v1.4.0 [INFO] [stderr] Compiling pyo3-macros-backend v0.29.0 [INFO] [stderr] Compiling thiserror-impl v1.0.69 [INFO] [stderr] Compiling serde_derive v1.0.228 [INFO] [stderr] Compiling clap_derive v4.6.1 [INFO] [stderr] Compiling thiserror v1.0.69 [INFO] [stderr] Compiling clap v4.6.1 [INFO] [stderr] Compiling pyo3-macros v0.29.0 [INFO] [stderr] Compiling masstrust-core v0.3.0 (/opt/rustwide/workdir/crates/masstrust-core) [INFO] [stderr] Compiling masstrust-cli v0.3.0 (/opt/rustwide/workdir/crates/masstrust-cli) [INFO] [stderr] Compiling masstrust-py v0.3.0 (/opt/rustwide/workdir/crates/masstrust-py) [INFO] [stderr] Finished `release` profile [optimized] target(s) in 56.35s [INFO] running `Command { std: "docker" "inspect" "46de9980f38870f89563de1e5ff1c04681cf0913bea878824b11453e423ab565", kill_on_drop: false }` [INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "46de9980f38870f89563de1e5ff1c04681cf0913bea878824b11453e423ab565" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.8" "test" "--frozen" "--no-run" "--message-format=json" "--release", kill_on_drop: false }` [INFO] [stderr] Compiling rustix v1.1.4 [INFO] [stderr] Compiling getrandom v0.4.3 [INFO] [stderr] Compiling linux-raw-sys v0.12.1 [INFO] [stderr] Compiling bitflags v2.13.0 [INFO] [stderr] Compiling fastrand v2.4.1 [INFO] [stderr] Compiling masstrust-py v0.3.0 (/opt/rustwide/workdir/crates/masstrust-py) [INFO] [stderr] Compiling tempfile v3.27.0 [INFO] [stderr] Compiling masstrust-cli v0.3.0 (/opt/rustwide/workdir/crates/masstrust-cli) [INFO] [stderr] Compiling masstrust-core v0.3.0 (/opt/rustwide/workdir/crates/masstrust-core) [INFO] [stderr] Finished `release` profile [optimized] target(s) in 13.01s [INFO] running `Command { std: "docker" "inspect" "46de9980f38870f89563de1e5ff1c04681cf0913bea878824b11453e423ab565", kill_on_drop: false }` [INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "46de9980f38870f89563de1e5ff1c04681cf0913bea878824b11453e423ab565" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.8" "test" "--frozen" "--release", kill_on_drop: false }` [INFO] [stderr] Finished `release` profile [optimized] target(s) in 0.14s [INFO] [stderr] Running unittests src/main.rs (/opt/rustwide/target/release/deps/masstrust-f8c14338f516e002) [INFO] [stdout] [INFO] [stdout] running 0 tests [INFO] [stdout] [INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s [INFO] [stdout] [INFO] [stderr] Running tests/cli.rs (/opt/rustwide/target/release/deps/cli-3520a3b41010fd65) [INFO] [stdout] [INFO] [stdout] running 17 tests [INFO] [stderr] Calibration result (Wrote 2 rows to /tmp/.tmpXeIjgW [INFO] [stderr] Wrote 4 rows to /tmp/.tmpQQtwRu [INFO] [stderr] AURC: 0.145833 [INFO] [stderr] E-AURC: -0.007593 [INFO] [stderr] Calibration result (ScoreGap, empirical): [INFO] [stderr] target error rate: 0.2000 [INFO] [stderr] global threshold: 0.110000 [INFO] [stderr] coverage: 0.5000 (2/4 queries accepted, 50.0%) [INFO] [stderr] Calibration result ( observed risk: 0.ScoreGap0000, (empirical0): [INFO] [stderr] / target error rate: 2 errors) [INFO] [stderr] 0.2000 [INFO] [stderr] global threshold: 0.110000 [INFO] [stderr] coverage: 0.5000 ( AURC: 2/0.4145833 queries accepted, [INFO] [stderr] E-AURC: 50-.0.000%) [INFO] [stderr] 7593 observed risk: [INFO] [stderr] 0. policy written to: see --out [INFO] [stderr] 0000 (0/2 errors) [INFO] [stderr] AURC: 0.145833 [INFO] [stderr] E-AURC: -0.007593 [INFO] [stderr] policy written to: see --out [INFO] [stderr] ScoreGap, empirical): [INFO] [stderr] target error rate: 0.0500 [INFO] [stderr] global threshold: 0.110000 [INFO] [stderr] coverage: 0.5000 (2/4 queries accepted, 50.0%) [INFO] [stderr] observed risk: 0.0000 (0/2 errors) [INFO] [stderr] AURC: 0.145833 [INFO] [stderr] E-AURC: -0.007593 [INFO] [stderr] policy written to: see --out [INFO] [stderr] WARNING: No threshold satisfies error rate 0.0500 on the full dataset. Accepting nothing (threshold = +inf). [INFO] [stderr] Calibration result (ScoreGap, binomial): [INFO] [stderr] target error rate: 0.0500 [INFO] [stderr] global threshold: +inf (no valid threshold found) [INFO] [stderr] coverage: 0.0000 (0 queries accepted) [INFO] [stdout] test test_compare_command ... ok [INFO] [stdout] test test_curve_command ... ok [INFO] [stdout] test test_calibrate_empirical ... ok [INFO] [stderr] Calibration result (ScoreGap, empirical): [INFO] [stderr] target error rate: 0.2000 [INFO] [stderr] global threshold: 0.110000 [INFO] [stderr] coverage: 0.5000 (2/4 queries accepted, 50.0%) [INFO] [stderr] observed risk: 0.0000 (0/2 errors) [INFO] [stderr] AURC: 0.145833 [INFO] [stderr] E-AURC: -0.007593 [INFO] [stderr] policy written to: see --out [INFO] [stdout] test test_calibrate_binomial ... ok [INFO] [stderr] Evaluation result (ScoreGap, fixed threshold from policy): [INFO] [stderr] threshold: 1000000.000000 [INFO] [stderr] coverage: 0.0000 (0/4 queries accepted, 0.0%) [INFO] [stderr] observed risk: n/a (0 accepted) [INFO] [stderr] ABSTAIN-ALL: 0/4 labeled queries met threshold 1000000.000000 — check `masstrust drift` between the calibration and evaluation data, or whether the policy threshold is too strict for this scoring method on this data. [INFO] [stdout] test test_evaluate_abstain_all ... ok [INFO] [stderr] report written to: /tmp/.tmpam46Bu [INFO] [stdout] test test_drift_command ... ok [INFO] [stderr] Calibration result (ScoreGap, empirical): [INFO] [stdout] test test_apply_command ... ok [INFO] [stderr] target error rate: 0.2000 [INFO] [stdout] test test_missing_column_error ... ok [INFO] [stderr] global threshold: 0.110000 [INFO] [stderr] coverage: 0.5000 (2/4 queries accepted, 50.0%) [INFO] [stderr] observed risk: 0.0000 (0/Accepted: 21 errors) [INFO] [stderr] Abstained: 1 (wrote /tmp/.tmp2mAYOP and /tmp/.tmpg83EAw) [INFO] [stderr] AURC: 0.145833 [INFO] [stderr] E-AURC: -0.007593 [INFO] [stderr] policy written to: see --out [INFO] [stderr] Calibration result (ScoreGap, empirical): [INFO] [stderr] target error rate: 0.2000 [INFO] [stderr] global threshold: 0.110000 [INFO] [stderr] coverage: 0.5000 (2/4 queries accepted, 50.0%) [INFO] [stderr] observed risk: 0.0000 (0/2 errors) [INFO] [stderr] AURC: 0.145833 [INFO] [stderr] E-AURC: -0.007593 [INFO] [stderr] policy written to: see --out [INFO] [stderr] drift: medium (KS=0.250, n_cal=4, n_new=2) [INFO] [stderr] Calibration result (ScoreGap, empirical, grouped by adduct): [INFO] [stderr] target error rate: 0.2000 [INFO] [stderr] [[M+H]+] threshold: 0.130000 [INFO] [stderr] [[M+Na]+] threshold: 0.040000 [INFO] [stderr] [[M-H]-] threshold: 0.260000 [INFO] [stderr] global threshold: 0.050000 [INFO] [stderr] coverage: 0.6250 (5/8 queries accepted, 62.5%) [INFO] [stderr] observed risk: 0.2000 (1/5 errors) [INFO] [stderr] AURC: 0.125818 [INFO] [stderr] E-AURC: 0.044571 [INFO] [stderr] policy written to: see --out [INFO] [stdout] test test_evaluate_rejects_grouped_policy ... ok [INFO] [stderr] Evaluation result (ScoreGap, fixed threshold from policy): [INFO] [stdout] test test_unknown_scoring_method_error ... ok [INFO] [stderr] threshold: 0.110000 [INFO] [stdout] test test_validate_split_overlap_exits_1 ... ok [INFO] [stderr] coverage: 0.5000 (4/8 queries accepted, 50.0%) (95% CI [0.1250, 0.8750]) [INFO] [stdout] test test_validate_split_no_overlap ... ok [INFO] [stderr] observed risk: 0.0000 (0/4 errors) (target was 0.2000) (95% CI [0.0000, 0.0000], n=198) (Wilson 95% upper bound: 0.4035) [INFO] [stdout] test test_batch_command ... ok [INFO] [stderr] report written to: /tmp/.tmp9WiOMr [INFO] [stdout] test test_evaluate_command ... ok [INFO] [stderr] Evaluation result (ScoreGap, fixed threshold from policy): [INFO] [stderr] threshold: 0.110000 [INFO] [stderr] coverage: 0.5000 (4/8 queries accepted, 50.0%) [INFO] [stderr] observed risk: 0.0000 (0/4 errors) (target was 0.2000) (Wilson 95% upper bound: 0.4035) [INFO] [stderr] report written to: /tmp/.tmpG8lWTl [INFO] [stdout] test test_evaluate_bootstrap_ci ... ok [INFO] [stdout] test test_validate_split_pool_overlap_only_exits_0 ... ok [INFO] [stdout] test test_batch_no_inputs_error ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 17 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.04s [INFO] [stdout] [INFO] [stderr] Running unittests src/lib.rs (/opt/rustwide/target/release/deps/masstrust_core-73960680faf13eaa) [INFO] [stdout] [INFO] [stdout] running 74 tests [INFO] [stdout] test calibration::binomial::tests::test_conservative_threshold ... ok [INFO] [stdout] test calibration::binomial::tests::test_unsupported_confidence_level ... ok [INFO] [stdout] test calibration::crc::tests::test_empty_curve_returns_none ... ok [INFO] [stdout] test calibration::crc::tests::test_large_n_approaches_empirical ... ok [INFO] [stdout] test calibration::binomial::tests::test_accepted_zero_row_skipped ... ok [INFO] [stdout] test calibration::empirical::tests::test_selects_max_coverage_under_target ... ok [INFO] [stdout] test calibration::empirical::tests::test_empty_curve ... ok [INFO] [stdout] test calibration::crc::tests::test_correction_exceeds_target_returns_none ... ok [INFO] [stdout] test calibration::binomial::tests::test_none_when_nothing_qualifies ... ok [INFO] [stdout] test calibration::grouped::tests::test_grouped_calibration_two_groups ... ok [INFO] [stdout] test calibration::crc::tests::test_crc_more_conservative_than_empirical ... ok [INFO] [stdout] test calibration::grouped::tests::test_no_group_field_excluded ... ok [INFO] [stdout] test calibration::empirical::tests::test_none_when_no_qualifying_row ... ok [INFO] [stdout] test io::tests::test_group_by_query_sorted ... ok [INFO] [stdout] test io::tests::test_read_candidates_empty ... ok [INFO] [stdout] test io::tests::test_read_candidates_optional_columns_absent ... ok [INFO] [stdout] test io::tests::test_read_candidates_missing_required_column ... ok [INFO] [stdout] test io::tests::test_read_candidates_valid ... ok [INFO] [stdout] test metrics::aurc::tests::test_aurc_constant_risk ... ok [INFO] [stdout] test metrics::aurc::tests::test_aurc_empty ... ok [INFO] [stdout] test metrics::aurc::tests::test_aurc_zero_risk ... ok [INFO] [stdout] test metrics::aurc::tests::test_bootstrap_aurc_ci_all_correct ... ok [INFO] [stdout] test metrics::aurc::tests::test_aurc_from_obs_all_correct ... ok [INFO] [stdout] test metrics::aurc::tests::test_aurc_from_obs_matches_compute_aurc ... ok [INFO] [stdout] test metrics::aurc::tests::test_aurc_from_obs_empty ... ok [INFO] [stdout] test metrics::aurc::tests::test_bootstrap_aurc_ci_bounds ... ok [INFO] [stdout] test metrics::aurc::tests::test_bootstrap_aurc_ci_empty ... ok [INFO] [stdout] test metrics::aurc::tests::test_eaurc_nan_on_empty ... ok [INFO] [stdout] test metrics::aurc::tests::test_eaurc_nan_when_unscoreable_queries_present ... ok [INFO] [stdout] test metrics::drift::tests::ks_known_case ... ok [INFO] [stdout] test metrics::aurc::tests::test_eaurc_positive ... ok [INFO] [stdout] test metrics::drift::tests::ks_disjoint_is_one ... ok [INFO] [stdout] test metrics::drift::tests::ks_empty_is_nan ... ok [INFO] [stdout] test metrics::drift::tests::ks_identical_is_zero ... ok [INFO] [stdout] test metrics::risk_coverage::tests::test_all_correct ... ok [INFO] [stdout] test metrics::risk_coverage::tests::test_all_incorrect ... ok [INFO] [stdout] test metrics::risk_coverage::tests::test_basic_curve ... ok [INFO] [stdout] test metrics::risk_coverage::tests::test_tied_confidence_single_row ... ok [INFO] [stdout] test metrics::risk_coverage::tests::test_no_is_correct_excluded ... ok [INFO] [stdout] test policy::tests::test_apply_policy_abstained ... ok [INFO] [stdout] test policy::tests::test_apply_policy_unscoreable_abstains ... ok [INFO] [stdout] test metrics::risk_coverage::tests::test_evaluate_at_threshold_basic ... ok [INFO] [stdout] test metrics::risk_coverage::tests::test_evaluate_at_threshold_unscoreable_query_never_accepted ... ok [INFO] [stdout] test policy::tests::test_apply_policy_accepted ... ok [INFO] [stdout] test scoring::candidate_count::tests::test_four_candidates_returns_quarter ... ok [INFO] [stdout] test metrics::risk_coverage::tests::test_evaluate_at_threshold_excludes_unlabeled_queries ... ok [INFO] [stdout] test policy::tests::test_policy_json_roundtrip_is_bit_exact_for_arithmetic_thresholds ... ok [INFO] [stdout] test metrics::risk_coverage::tests::test_evaluate_at_threshold_no_acceptances ... ok [INFO] [stdout] test scoring::candidate_count::tests::test_one_candidate_returns_one ... ok [INFO] [stdout] test policy::tests::test_policy_json_roundtrip ... ok [INFO] [stdout] test scoring::effective_k::tests::test_missing_prob_returns_none ... ok [INFO] [stdout] test policy::tests::test_unknown_version_error ... ok [INFO] [stdout] test scoring::effective_k::tests::test_uniform_four_returns_quarter ... ok [INFO] [stdout] test scoring::effective_k::tests::test_single_certain_candidate ... ok [INFO] [stdout] test scoring::entropy::tests::test_missing_probability_returns_none ... ok [INFO] [stdout] test scoring::entropy::tests::test_zero_probability_handled ... ok [INFO] [stdout] test scoring::entropy::tests::test_single_candidate ... ok [INFO] [stdout] test scoring::entropy::tests::test_uniform_distribution_low_confidence ... ok [INFO] [stdout] test scoring::entropy::tests::test_concentrated_distribution_high_confidence ... ok [INFO] [stdout] test scoring::margin::tests::test_margin_two_candidates ... ok [INFO] [stdout] test scoring::margin::tests::test_missing_probability_returns_none ... ok [INFO] [stdout] test scoring::score_gap::tests::test_single_candidate_returns_none ... ok [INFO] [stdout] test scoring::max_prob::tests::test_none_when_probability_missing ... ok [INFO] [stdout] test scoring::max_prob::tests::test_none_when_probability_nan ... ok [INFO] [stdout] test scoring::max_prob::tests::test_returns_top1_probability ... ok [INFO] [stdout] test scoring::margin::tests::test_single_candidate_returns_none ... ok [INFO] [stdout] test scoring::score_ratio::tests::test_ratio_two_candidates ... ok [INFO] [stdout] test scoring::score_gap::tests::test_gap_three_candidates ... ok [INFO] [stdout] test scoring::score_gap::tests::test_nan_score_returns_none ... ok [INFO] [stdout] test scoring::topk_gap::tests::test_two_candidates_same_as_score_gap ... ok [INFO] [stdout] test scoring::topk_gap::tests::test_six_candidates_uses_k5 ... ok [INFO] [stderr] Running tests/integration.rs (/opt/rustwide/target/release/deps/integration-37fe9ac3bbd20a53) [INFO] [stdout] test scoring::score_ratio::tests::test_single_candidate_returns_none ... ok [INFO] [stdout] test scoring::topk_gap::tests::test_single_candidate_returns_none ... ok [INFO] [stdout] test scoring::score_ratio::tests::test_zero_denominator_returns_none ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 74 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.04s [INFO] [stdout] [INFO] [stderr] Running unittests src/lib.rs (/opt/rustwide/target/release/deps/masstrust-a02f13d2ab3c0fb3) [INFO] [stdout] [INFO] [stdout] running 4 tests [INFO] [stdout] test test_apply_unlabeled ... ok [INFO] [stdout] test test_full_pipeline_max_prob ... ok [INFO] [stdout] test test_full_pipeline_score_gap ... ok [INFO] [stdout] test test_binomial_calibration_pipeline ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 4 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] running 0 tests [INFO] [stdout] [INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s [INFO] [stdout] [INFO] [stderr] Doc-tests masstrust_core [INFO] [stdout] [INFO] [stdout] running 4 tests [INFO] [stdout] test crates/masstrust-core/src/lib.rs - (line 12) - compile ... ok [INFO] [stdout] test crates/masstrust-core/src/calibration/grouped.rs - calibration::grouped::calibrate_grouped (line 32) - compile ... ok [INFO] [stdout] test crates/masstrust-core/src/scoring/mod.rs - scoring::compute_confidence (line 21) ... ok [INFO] [stdout] test crates/masstrust-core/src/calibration/empirical.rs - calibration::empirical::calibrate (line 10) ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 4 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s [INFO] [stdout] [INFO] [stdout] all doctests ran in 0.50s; merged doctests compilation took 0.48s [INFO] [stderr] Doc-tests masstrust [INFO] [stdout] [INFO] [stdout] running 0 tests [INFO] [stdout] [INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s [INFO] [stdout] [INFO] running `Command { std: "docker" "inspect" "46de9980f38870f89563de1e5ff1c04681cf0913bea878824b11453e423ab565", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "46de9980f38870f89563de1e5ff1c04681cf0913bea878824b11453e423ab565", kill_on_drop: false }` [INFO] [stdout] 46de9980f38870f89563de1e5ff1c04681cf0913bea878824b11453e423ab565