[INFO] fetching crate readback-bench 0.14.0...
[INFO] testing readback-bench-0.14.0 against 1.100.0-beta.1 for beta-1.100-2
[INFO] extracting crate readback-bench 0.14.0 into /workspace/builds/worker-5-tc2/source
[INFO] started tweaking crates.io crate readback-bench 0.14.0
[INFO] removed 0 missing tests
[INFO] finished tweaking crates.io crate readback-bench 0.14.0
[INFO] tweaked toml for crates.io crate readback-bench 0.14.0 written to /workspace/builds/worker-5-tc2/source/Cargo.toml
[INFO] validating manifest of crates.io crate readback-bench 0.14.0 on toolchain 1.100.0-beta.1
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.100.0-beta.1" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] crate crates.io crate readback-bench 0.14.0 already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.100.0-beta.1" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] [stderr] warning: `package.homepage` is redundant with `package.repository`
[INFO] [stderr]   --> Cargo.toml:43:12
[INFO] [stderr]    |
[INFO] [stderr] 43 | homepage = "https://github.com/HarjjotSinghh/readback"
[INFO] [stderr]    |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stderr] ...
[INFO] [stderr] 48 | repository = "https://github.com/HarjjotSinghh/readback"
[INFO] [stderr]    |              -------------------------------------------
[INFO] [stderr]    |
[INFO] [stderr]    = note: `cargo::redundant_homepage` is set to `warn` by default
[INFO] [stderr] help: consider removing `package.homepage`
[INFO] [stderr] warning: `readback-bench` (manifest) generated 1 warning
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-m" "1610612736" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:3111399a4047eeb3a02b7a90e478d715f38a8c6669b5c4b49d30a17385265909" "sleep" "infinity", kill_on_drop: false }`
[INFO] [stdout] 0a7fac3fa8c0999287a547a1f52c6630fdae077e61cb1781a22135e2b9453580
[INFO] running `Command { std: "docker" "start" "0a7fac3fa8c0999287a547a1f52c6630fdae077e61cb1781a22135e2b9453580", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "0a7fac3fa8c0999287a547a1f52c6630fdae077e61cb1781a22135e2b9453580", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-w" "/opt/rustwide/workdir" "--user" "0:0" "0a7fac3fa8c0999287a547a1f52c6630fdae077e61cb1781a22135e2b9453580" "/opt/rustwide/cargo-home/bin/cargo" "+1.100.0-beta.1" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "0a7fac3fa8c0999287a547a1f52c6630fdae077e61cb1781a22135e2b9453580", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "0a7fac3fa8c0999287a547a1f52c6630fdae077e61cb1781a22135e2b9453580" "/opt/rustwide/cargo-home/bin/cargo" "+1.100.0-beta.1" "build" "--frozen" "--message-format=json", kill_on_drop: false }`
[INFO] [stderr] warning: `package.homepage` is redundant with `package.repository`
[INFO] [stderr]   --> Cargo.toml:43:12
[INFO] [stderr]    |
[INFO] [stderr] 43 | homepage = "https://github.com/HarjjotSinghh/readback"
[INFO] [stderr]    |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stderr] ...
[INFO] [stderr] 48 | repository = "https://github.com/HarjjotSinghh/readback"
[INFO] [stderr]    |              -------------------------------------------
[INFO] [stderr]    |
[INFO] [stderr]    = note: `cargo::redundant_homepage` is set to `warn` by default
[INFO] [stderr] help: consider removing `package.homepage`
[INFO] [stderr] warning: `readback-bench` (manifest) generated 1 warning
[INFO] [stderr]    Compiling unicode-ident v1.0.26
[INFO] [stderr]    Compiling is_terminal_polyfill v1.70.2
[INFO] [stderr]    Compiling anstyle v1.0.14
[INFO] [stderr]    Compiling anstyle-query v1.1.5
[INFO] [stderr]    Compiling colorchoice v1.0.5
[INFO] [stderr]    Compiling thiserror v2.0.21
[INFO] [stderr]    Compiling clap_lex v1.1.1
[INFO] [stderr]    Compiling anstyle-parse v1.0.0
[INFO] [stderr]    Compiling anyhow v1.0.104
[INFO] [stderr]    Compiling similar v3.2.0
[INFO] [stderr]    Compiling hound v3.5.1
[INFO] [stderr]    Compiling proc-macro2 v1.0.107
[INFO] [stderr]    Compiling anstream v1.0.0
[INFO] [stderr]    Compiling clap_builder v4.6.7
[INFO] [stderr]    Compiling quote v1.0.47
[INFO] [stderr]    Compiling syn v3.0.6
[INFO] [stderr]    Compiling serde_derive v1.0.229
[INFO] [stderr]    Compiling thiserror-impl v2.0.21
[INFO] [stderr]    Compiling clap_derive v4.6.7
[INFO] [stderr]    Compiling clap v4.6.7
[INFO] [stderr]    Compiling serde v1.0.229
[INFO] [stderr]    Compiling readback-core v0.14.0
[INFO] [stderr]    Compiling readback-bench v0.14.0 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `dev` profile [unoptimized + debuginfo] target(s) in 17.68s
[INFO] running `Command { std: "docker" "inspect" "0a7fac3fa8c0999287a547a1f52c6630fdae077e61cb1781a22135e2b9453580", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "0a7fac3fa8c0999287a547a1f52c6630fdae077e61cb1781a22135e2b9453580" "/opt/rustwide/cargo-home/bin/cargo" "+1.100.0-beta.1" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }`
[INFO] [stderr] warning: `package.homepage` is redundant with `package.repository`
[INFO] [stderr]   --> Cargo.toml:43:12
[INFO] [stderr]    |
[INFO] [stderr] 43 | homepage = "https://github.com/HarjjotSinghh/readback"
[INFO] [stderr]    |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stderr] ...
[INFO] [stderr] 48 | repository = "https://github.com/HarjjotSinghh/readback"
[INFO] [stderr]    |              -------------------------------------------
[INFO] [stderr]    |
[INFO] [stderr]    = note: `cargo::redundant_homepage` is set to `warn` by default
[INFO] [stderr] help: consider removing `package.homepage`
[INFO] [stderr] warning: `readback-bench` (manifest) generated 1 warning
[INFO] [stderr]    Compiling readback-bench v0.14.0 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 1.95s
[INFO] running `Command { std: "docker" "inspect" "0a7fac3fa8c0999287a547a1f52c6630fdae077e61cb1781a22135e2b9453580", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "0a7fac3fa8c0999287a547a1f52c6630fdae077e61cb1781a22135e2b9453580" "/opt/rustwide/cargo-home/bin/cargo" "+1.100.0-beta.1" "test" "--frozen", kill_on_drop: false }`
[INFO] [stderr] warning: `package.homepage` is redundant with `package.repository`
[INFO] [stderr]   --> Cargo.toml:43:12
[INFO] [stderr]    |
[INFO] [stderr] 43 | homepage = "https://github.com/HarjjotSinghh/readback"
[INFO] [stderr]    |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stderr] ...
[INFO] [stderr] 48 | repository = "https://github.com/HarjjotSinghh/readback"
[INFO] [stderr]    |              -------------------------------------------
[INFO] [stderr]    |
[INFO] [stderr]    = note: `cargo::redundant_homepage` is set to `warn` by default
[INFO] [stderr] help: consider removing `package.homepage`
[INFO] [stderr] warning: `readback-bench` (manifest) generated 1 warning
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 0.08s
[INFO] [stdout] 
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/debug/build/readback-bench/a9f11d6a864998ae/out/readback_bench-a9f11d6a864998ae)
[INFO] [stdout] running 43 tests
[INFO] [stdout] test audio::tests::an_asr_command_must_name_the_clip ... ok
[INFO] [stdout] test audio::tests::calibration_copes_with_no_flips_at_all ... ok
[INFO] [stdout] test audio::tests::a_redecode_command_must_name_the_clip ... ok
[INFO] [stdout] test audio::tests::the_manifest_tracks_the_text_dataset ... ok
[INFO] [stdout] test audio::tests::timestamps_are_stripped_from_a_second_decode ... ok
[INFO] [stdout] test audio::tests::the_label_defaults_to_the_program_name ... ok
[INFO] [stdout] test audio::tests::a_threshold_of_zero_marks_everything ... ok
[INFO] [stdout] test audio::tests::a_cleanup_command_must_name_the_text ... ok
[INFO] [stdout] test audio::tests::calibration_separates_catching_from_noise ... ok
[INFO] [stdout] test audio::tests::transcripts_are_parsed_by_shape ... ok
[INFO] [stdout] test dataset::tests::controls_are_present_in_useful_numbers ... ok
[INFO] [stdout] test dataset::tests::case_ids_are_unique ... ok
[INFO] [stdout] test metric::tests::a_dropped_filler_does_not ... ok
[INFO] [stdout] test metric::tests::a_dropped_negation_flips_meaning ... ok
[INFO] [stdout] test dataset::tests::the_bundled_dataset_parses ... ok
[INFO] [stdout] test dataset::tests::baseline_prefers_the_cleanup_output ... ok
[INFO] [stdout] test metric::tests::a_number_swap_is_heavy_but_not_a_flip ... ok
[INFO] [stdout] test metric::tests::an_unknown_capitalised_word_counts_as_a_name ... ok
[INFO] [stdout] test metric::tests::renumbering_does_not_hide_a_real_change ... ok
[INFO] [stdout] test metric::tests::wer_cannot_tell_them_apart_but_cser_can ... ok
[INFO] [stdout] test metric::tests::an_environment_swap_flips_meaning ... ok
[INFO] [stdout] test metric::tests::dropping_a_currency_symbol_still_counts ... ok
[INFO] [stdout] test metric::tests::identical_text_scores_zero ... ok
[INFO] [stdout] test audio::tests::shell_metacharacters_in_a_path_are_neutralised ... ok
[INFO] [stdout] test metric::tests::punctuation_is_not_scored ... ok
[INFO] [stdout] test audio::tests::plain_text_output_is_accepted ... ok
[INFO] [stdout] test runner::tests::a_control_that_was_already_correct_passes_untouched ... ok
[INFO] [stdout] test vad::tests::silence_has_no_speech ... ok
[INFO] [stdout] test vad::tests::one_utterance_becomes_one_region ... ok
[INFO] [stdout] test vad::tests::a_click_is_not_speech ... ok
[INFO] [stdout] test vad::tests::a_long_pause_splits_two_utterances ... ok
[INFO] [stdout] test vad::tests::an_empty_clip_is_handled ... ok
[INFO] [stdout] test vad::tests::a_short_pause_does_not ... ok
[INFO] [stdout] test vad::tests::duration_is_reported_in_milliseconds ... ok
[INFO] [stdout] test audio::tests::a_failing_second_decode_is_simply_no_opinion ... ok
[INFO] [stdout] test audio::tests::an_embedded_quote_cannot_break_out ... ok
[INFO] [stdout] test metric::tests::renumbering_costs_nothing_semantically ... ok
[INFO] [stdout] test audio::tests::empty_output_is_an_error ... ok
[INFO] [stdout] test runner::tests::controls_are_mostly_left_alone ... ok
[INFO] [stdout] test report::tests::markdown_is_a_table ... ok
[INFO] [stdout] test runner::tests::the_bundled_dataset_runs ... ok
[INFO] [stdout] test report::tests::the_rendered_report_names_both_metrics ... ok
[INFO] [stdout] test runner::tests::readback_reduces_silent_meaning_flips ... ok
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 43 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.22s
[INFO] [stdout] 
[INFO] [stderr]      Running unittests src/main.rs (/opt/rustwide/target/debug/build/readback-bench/c03e0c60593a24cb/out/readback_bench-c03e0c60593a24cb)
[INFO] [stdout] 
[INFO] [stderr]      Running tests/audio.rs (/opt/rustwide/target/debug/build/readback-bench/35e83cdca1048ef9/out/audio-35e83cdca1048ef9)
[INFO] [stdout] running 0 tests
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] running 7 tests
[INFO] [stdout] test a_missing_clip_is_reported_clearly ... ok
[INFO] [stdout] test a_correct_transcript_scores_clean_and_passes ... ok
[INFO] [stdout] test a_failing_engine_is_reported_clearly ... ok
[INFO] [stdout] test a_cleanup_command_is_run_over_the_transcript ... ok
[INFO] [stdout] test a_dropped_negation_from_the_engine_is_measured ... ok
[INFO] [stdout] test vad_supplies_speech_regions_from_the_clip ... ok
[INFO] [stdout] test results_aggregate_the_same_way_the_text_run_does ... ok
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 7 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.11s
[INFO] [stdout] 
[INFO] [stderr]    Doc-tests readback_bench
[INFO] [stdout] 
[INFO] [stdout] running 1 test
[INFO] [stdout] test src/lib.rs - (line 8) ... ok
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s
[INFO] [stdout] 
[INFO] [stdout] all doctests ran in 0.61s; merged doctests compilation took 0.58s
[INFO] running `Command { std: "docker" "inspect" "0a7fac3fa8c0999287a547a1f52c6630fdae077e61cb1781a22135e2b9453580", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "0a7fac3fa8c0999287a547a1f52c6630fdae077e61cb1781a22135e2b9453580", kill_on_drop: false }`
[INFO] [stdout] 0a7fac3fa8c0999287a547a1f52c6630fdae077e61cb1781a22135e2b9453580
