[INFO] fetching crate benchit 0.1.2...
[INFO] testing benchit-0.1.2 against 1.99.0-beta.8+cargoflags=--release for beta-release-1.100-3
[INFO] extracting crate benchit 0.1.2 into /workspace/builds/worker-7-tc1/source
[INFO] started tweaking crates.io crate benchit 0.1.2
[INFO] removed 0 missing tests
[INFO] finished tweaking crates.io crate benchit 0.1.2
[INFO] tweaked toml for crates.io crate benchit 0.1.2 written to /workspace/builds/worker-7-tc1/source/Cargo.toml
[INFO] validating manifest of crates.io crate benchit 0.1.2 on toolchain 1.99.0-beta.8
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.99.0-beta.8" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] crate crates.io crate benchit 0.1.2 already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.99.0-beta.8" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-m" "1610612736" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:77db811e55d90add9212f6832c23229e3de5f1c1f9905e8cb07319ea15df73ac" "sleep" "infinity", kill_on_drop: false }`
[INFO] [stdout] 45b971871d9d2e06d9139ba64c14ad78dfab8fe939226f8fc84bc9291a4405f5
[INFO] running `Command { std: "docker" "start" "45b971871d9d2e06d9139ba64c14ad78dfab8fe939226f8fc84bc9291a4405f5", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "45b971871d9d2e06d9139ba64c14ad78dfab8fe939226f8fc84bc9291a4405f5", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-w" "/opt/rustwide/workdir" "--user" "0:0" "45b971871d9d2e06d9139ba64c14ad78dfab8fe939226f8fc84bc9291a4405f5" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.8" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "45b971871d9d2e06d9139ba64c14ad78dfab8fe939226f8fc84bc9291a4405f5", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "45b971871d9d2e06d9139ba64c14ad78dfab8fe939226f8fc84bc9291a4405f5" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.8" "build" "--frozen" "--message-format=json" "--release", kill_on_drop: false }`
[INFO] [stderr]    Compiling benchit v0.1.2 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `release` profile [optimized] target(s) in 1.94s
[INFO] running `Command { std: "docker" "inspect" "45b971871d9d2e06d9139ba64c14ad78dfab8fe939226f8fc84bc9291a4405f5", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "45b971871d9d2e06d9139ba64c14ad78dfab8fe939226f8fc84bc9291a4405f5" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.8" "test" "--frozen" "--no-run" "--message-format=json" "--release", kill_on_drop: false }`
[INFO] [stderr]    Compiling benchit v0.1.2 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `release` profile [optimized] target(s) in 2.79s
[INFO] running `Command { std: "docker" "inspect" "45b971871d9d2e06d9139ba64c14ad78dfab8fe939226f8fc84bc9291a4405f5", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "45b971871d9d2e06d9139ba64c14ad78dfab8fe939226f8fc84bc9291a4405f5" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.8" "test" "--frozen" "--release", kill_on_drop: false }`
[INFO] [stderr]     Finished `release` profile [optimized] target(s) in 0.01s
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/release/deps/benchit-54579b710b2c6119)
[INFO] [stdout] 
[INFO] [stdout] running 34 tests
[INFO] [stdout] test baseline::tests::baseline_names_stay_inside_the_target_directory ... ok
[INFO] [stdout] test cli::tests::filter_is_a_substring_of_group_slash_case ... ok
[INFO] [stdout] test cli::tests::flags_take_values_either_way ... ok
[INFO] [stdout] test cli::tests::cargo_bench_passes_bench_through ... ok
[INFO] [stdout] test cli::tests::defaults_are_the_documented_ones ... ok
[INFO] [stdout] test cli::tests::a_forgotten_value_is_not_swallowed_from_the_next_flag ... ok
[INFO] [stdout] test cli::tests::no_args_is_the_default ... ok
[INFO] [stdout] test cli::tests::quick_shortens_the_budget ... ok
[INFO] [stdout] test report::tests::declared_amounts_are_exact_counts ... ok
[INFO] [stdout] test baseline::tests::round_trips_through_a_file ... ok
[INFO] [stdout] test report::tests::rounding_that_carries_does_not_widen_the_column ... ok
[INFO] [stdout] test report::tests::significant_figures ... ok
[INFO] [stdout] test runner::tests::an_explicit_sample_cap_below_the_floor_is_honoured ... ok
[INFO] [stdout] test runner::tests::samples_fill_the_budget_but_respect_the_floor_and_cap ... ok
[INFO] [stdout] test cli::tests::positional_argument_is_the_filter ... ok
[INFO] [stdout] test baseline::tests::a_name_that_would_corrupt_the_file_is_refused ... ok
[INFO] [stdout] test baseline::tests::the_build_directory_is_the_nearest_one_holding_deps ... ok
[INFO] [stdout] test baseline::tests::a_corrupt_row_is_an_error_not_a_silent_skip ... ok
[INFO] [stdout] test baseline::tests::this_test_binary_resolves_to_the_directory_cargo_built_it_into ... ok
[INFO] [stdout] test cli::tests::bad_input_is_rejected ... ok
[INFO] [stdout] test report::tests::rates_use_binary_bytes_and_si_elements ... ok
[INFO] [stdout] test stats::tests::the_point_always_sits_inside_its_own_band ... ok
[INFO] [stdout] test report::tests::ratios_stay_readable_across_magnitudes ... ok
[INFO] [stdout] test stats::tests::a_short_run_gets_a_median_but_no_band ... ok
[INFO] [stdout] test stats::tests::no_usable_pairs_means_no_ratio ... ok
[INFO] [stdout] test stats::tests::paired_ratios_cancel_a_drifting_machine ... ok
[INFO] [stdout] test stats::tests::quantile_endpoints_and_interpolation ... ok
[INFO] [stdout] test stats::tests::sorting_does_not_disturb_round_order ... ok
[INFO] [stdout] test report::tests::values_below_one_keep_their_significant_digits ... ok
[INFO] [stdout] test stats::tests::stats_read_off_a_sorted_slice ... ok
[INFO] [stdout] test stats::tests::quantile_of_single_sample ... ok
[INFO] [stdout] test baseline::tests::a_filtered_run_keeps_the_cases_it_did_not_measure ... ok
[INFO] [stdout] test report::tests::durations_scale_per_value ... ok
[INFO] [stdout] test cli::tests::a_value_on_a_valueless_flag_is_rejected ... ok
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 34 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s
[INFO] [stdout] 
[INFO] [stderr]      Running tests/harness.rs (/opt/rustwide/target/release/deps/harness-dd379d68d2908411)
[INFO] [stdout] 
[INFO] [stdout] running 21 tests
[INFO] [stdout] test a_panicking_body_does_not_drag_the_whole_schedule_through_the_unwind ... ok
[INFO] [stdout] g/a
[INFO] [stdout] g/b
[INFO] [stdout] test list_mode_measures_nothing ... ok
[INFO] [stdout] g/a
[INFO] [stdout] test a_group_that_measures_nothing_still_hands_back_a_result ... ok
[INFO] [stdout] test a_hand_built_config_with_zero_counts_does_not_panic ... ok
[INFO] [stdout] test the_filter_is_a_substring_of_group_slash_case ... ok
[INFO] [stdout] test finish_does_not_run_the_schedule_twice ... ok
[INFO] [stdout] test no_interleave_runs_each_case_to_completion ... ok
[INFO] [stdout] test iter_with_subtracts_its_own_clock_overhead ... ok
[INFO] [stdout] test a_lone_case_gets_no_ratio_column ... ok
[INFO] [stdout] test throughput_is_reported_as_a_rate ... ok
[INFO] [stdout] test a_case_that_beats_the_reference_keeps_its_digits ... ok
[INFO] [stdout] test interleaving_alternates_between_cases ... ok
[INFO] [stdout] test a_block_size_trades_pairing_for_warmer_caches ... ok
[INFO] [stdout] test iter_with_excludes_setup_from_the_timed_span ... ok
[INFO] [stdout] test a_group_without_a_reference_prints_no_ratio_column ... ok
[INFO] [stdout] test the_ratio_sits_inside_its_own_band ... ok
[INFO] [stdout] test tsv_is_one_row_per_case ... ok
[INFO] [stdout] test finish_hands_back_the_numbers_it_printed ... ok
[INFO] [stdout] test the_report_carries_a_ratio_and_a_measured_band ... FAILED
[INFO] [stdout] test throughput_applies_to_the_cases_registered_after_it ... ok
[INFO] [stdout] test a_group_without_a_reference_leaves_the_tsv_ratio_columns_empty ... ok
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout] 
[INFO] [stdout] ---- the_report_carries_a_ratio_and_a_measured_band stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'the_report_carries_a_ratio_and_a_measured_band' (264) panicked at tests/harness.rs:134:5:
[INFO] [stdout] b should cost about 2x a, got 0.774x
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x623205cb9c01 - <<std[70759c8f55707aa4]::sys::backtrace::BacktraceLock>::print::DisplayBacktrace as core[df12db4294e9bfd3]::fmt::Display>::fmt
[INFO] [stdout]    1:     0x623205ccf7ba - core[df12db4294e9bfd3]::fmt::write
[INFO] [stdout]    2:     0x623205cbec3c - <alloc[2182bb758b4b3781]::vec::Vec<u8> as core[df12db4294e9bfd3]::io::write::Write>::write_fmt
[INFO] [stdout]    3:     0x623205c952b6 - std[70759c8f55707aa4]::panicking::default_hook::{closure#0}
[INFO] [stdout]    4:     0x623205cb1ff9 - std[70759c8f55707aa4]::panicking::default_hook
[INFO] [stdout]    5:     0x623205c3c780 - test[9d35eded1c95d3be]::test_main_inner::<test[9d35eded1c95d3be]::test_main_static::{closure#0}>::{closure#0}
[INFO] [stdout]    6:     0x623205cb21b2 - std[70759c8f55707aa4]::panicking::panic_with_hook
[INFO] [stdout]    7:     0x623205c95362 - std[70759c8f55707aa4]::panicking::panic_handler::{closure#0}
[INFO] [stdout]    8:     0x623205c8de39 - std[70759c8f55707aa4]::sys::backtrace::__rust_end_short_backtrace::<std[70759c8f55707aa4]::panicking::panic_handler::{closure#0}, !>
[INFO] [stdout]    9:     0x623205c95f5d - __rustc[8fa7c3cbc660c2b3]::rust_begin_unwind
[INFO] [stdout]   10:     0x623205ccfeec - core[df12db4294e9bfd3]::panicking::panic_fmt
[INFO] [stdout]   11:     0x623205c26ebd - <harness[311f1a9188c35dd5]::the_report_carries_a_ratio_and_a_measured_band::{closure#0} as core[df12db4294e9bfd3]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]   12:     0x623205c2fa6b - test[9d35eded1c95d3be]::__rust_begin_short_backtrace::<core[df12db4294e9bfd3]::result::Result<(), alloc[2182bb758b4b3781]::string::String>, fn() -> core[df12db4294e9bfd3]::result::Result<(), alloc[2182bb758b4b3781]::string::String>>
[INFO] [stdout]   13:     0x623205c3d0d5 - test[9d35eded1c95d3be]::run_test::{closure#0}
[INFO] [stdout]   14:     0x623205c36994 - std[70759c8f55707aa4]::sys::backtrace::__rust_begin_short_backtrace::<test[9d35eded1c95d3be]::run_test::{closure#1}, ()>
[INFO] [stdout]   15:     0x623205c40232 - <std[70759c8f55707aa4]::thread::lifecycle::spawn_unchecked<test[9d35eded1c95d3be]::run_test::{closure#1}, ()>::{closure#1} as core[df12db4294e9bfd3]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0}
[INFO] [stdout]   16:     0x623205cb9169 - <std[70759c8f55707aa4]::sys::thread::unix::Thread>::new::thread_start
[INFO] [stdout]   17:     0x70dcca82adfa - <unknown>
[INFO] [stdout]   18:     0x70dcca8be3d4 - clone
[INFO] [stdout]   19:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout]     the_report_carries_a_ratio_and_a_measured_band
[INFO] [stdout] 
[INFO] [stdout] test result: FAILED. 20 passed; 1 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.20s
[INFO] [stdout] 
[INFO] [stderr] error: test failed, to rerun pass `--test harness`
[INFO] running `Command { std: "docker" "inspect" "45b971871d9d2e06d9139ba64c14ad78dfab8fe939226f8fc84bc9291a4405f5", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "45b971871d9d2e06d9139ba64c14ad78dfab8fe939226f8fc84bc9291a4405f5", kill_on_drop: false }`
[INFO] [stdout] 45b971871d9d2e06d9139ba64c14ad78dfab8fe939226f8fc84bc9291a4405f5
