[INFO] cloning repository https://github.com/getinclub/template-acted-clean-deploy-lost-events
[INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/getinclub/template-acted-clean-deploy-lost-events" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fgetinclub%2Ftemplate-acted-clean-deploy-lost-events", kill_on_drop: false }`
[INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fgetinclub%2Ftemplate-acted-clean-deploy-lost-events'...
[INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }`
[INFO] [stdout] a26f5f602ea06301c246a2f4c9c214474e99a8cf
[INFO] testing getinclub/template-acted-clean-deploy-lost-events against 1.99.0-beta.8+cargoflags=--release for beta-release-1.100-2
[INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fgetinclub%2Ftemplate-acted-clean-deploy-lost-events" "/workspace/builds/worker-1-tc1/source", kill_on_drop: false }`
[INFO] [stderr] Cloning into '/workspace/builds/worker-1-tc1/source'...
[INFO] [stderr] done.
[INFO] started tweaking git repo https://github.com/getinclub/template-acted-clean-deploy-lost-events
[INFO] finished tweaking git repo https://github.com/getinclub/template-acted-clean-deploy-lost-events
[INFO] tweaked toml for git repo https://github.com/getinclub/template-acted-clean-deploy-lost-events written to /workspace/builds/worker-1-tc1/source/Cargo.toml
[INFO] validating manifest of git repo https://github.com/getinclub/template-acted-clean-deploy-lost-events on toolchain 1.99.0-beta.8
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.99.0-beta.8" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] crate git repo https://github.com/getinclub/template-acted-clean-deploy-lost-events already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.99.0-beta.8" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-m" "1610612736" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:77db811e55d90add9212f6832c23229e3de5f1c1f9905e8cb07319ea15df73ac" "sleep" "infinity", kill_on_drop: false }`
[INFO] [stdout] a0307fb60967c5148d99fc1f39fd6aa6cd84417673827d5717ffd3fa1c033a38
[INFO] running `Command { std: "docker" "start" "a0307fb60967c5148d99fc1f39fd6aa6cd84417673827d5717ffd3fa1c033a38", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "a0307fb60967c5148d99fc1f39fd6aa6cd84417673827d5717ffd3fa1c033a38", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-w" "/opt/rustwide/workdir" "--user" "0:0" "a0307fb60967c5148d99fc1f39fd6aa6cd84417673827d5717ffd3fa1c033a38" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.8" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "a0307fb60967c5148d99fc1f39fd6aa6cd84417673827d5717ffd3fa1c033a38", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "a0307fb60967c5148d99fc1f39fd6aa6cd84417673827d5717ffd3fa1c033a38" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.8" "build" "--frozen" "--message-format=json" "--release", kill_on_drop: false }`
[INFO] [stderr]    Compiling proc-macro2 v1.0.107
[INFO] [stderr]    Compiling unicode-ident v1.0.24
[INFO] [stderr]    Compiling quote v1.0.47
[INFO] [stderr]    Compiling pin-project-lite v0.2.17
[INFO] [stderr]    Compiling syn v3.0.5
[INFO] [stderr]    Compiling tokio-macros v2.7.2
[INFO] [stderr]    Compiling tokio v1.53.1
[INFO] [stderr]    Compiling clean-deploy-lost-events v0.1.0 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `release` profile [optimized] target(s) in 13.19s
[INFO] running `Command { std: "docker" "inspect" "a0307fb60967c5148d99fc1f39fd6aa6cd84417673827d5717ffd3fa1c033a38", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "a0307fb60967c5148d99fc1f39fd6aa6cd84417673827d5717ffd3fa1c033a38" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.8" "test" "--frozen" "--no-run" "--message-format=json" "--release", kill_on_drop: false }`
[INFO] [stderr]    Compiling clean-deploy-lost-events v0.1.0 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `release` profile [optimized] target(s) in 3.07s
[INFO] running `Command { std: "docker" "inspect" "a0307fb60967c5148d99fc1f39fd6aa6cd84417673827d5717ffd3fa1c033a38", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "a0307fb60967c5148d99fc1f39fd6aa6cd84417673827d5717ffd3fa1c033a38" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.8" "test" "--frozen" "--release", kill_on_drop: false }`
[INFO] [stderr]     Finished `release` profile [optimized] target(s) in 0.04s
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/release/deps/clean_deploy_lost_events-e649e161ddeb6b28)
[INFO] [stderr]      Running unittests src/bin/delivery_monitor.rs (/opt/rustwide/target/release/deps/delivery_monitor-e1b536b0d75218b2)
[INFO] [stdout] 
[INFO] [stdout] running 0 tests
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] running 0 tests
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
[INFO] [stdout] 
[INFO] [stderr]      Running tests/delivery_contract.rs (/opt/rustwide/target/release/deps/delivery_contract-e38de8b4cb8e5caf)
[INFO] [stdout] 
[INFO] [stdout] running 9 tests
[INFO] [stdout] test new_work_is_rejected_after_shutdown_starts ... FAILED
[INFO] [stdout] test failed_write_never_receives_success ... FAILED
[INFO] [stdout] test admitted_failures_settle_without_blocking_later_commits ... FAILED
[INFO] [stdout] test shutdown_deadline_is_reported_honestly ... FAILED
[INFO] [stdout] test historical_reconciliation_finds_acknowledged_gaps ... ok
[INFO] [stdout] test canary_has_no_acknowledged_commit_gap ... FAILED
[INFO] [stdout] test success_is_not_returned_before_durable_commit ... FAILED
[INFO] [stdout] test shutdown_drains_all_admitted_healthy_work ... FAILED
[INFO] [stdout] test monitor_reconciles_acknowledged_and_committed_ids ... FAILED
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout] 
[INFO] [stdout] ---- new_work_is_rejected_after_shutdown_starts stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'new_work_is_rejected_after_shutdown_starts' (479) panicked at tests/delivery_contract.rs:78:5:
[INFO] [stdout] assertion `left == right` failed
[INFO] [stdout]   left: Aborted
[INFO] [stdout]  right: Drained
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x565f1c13da51 - <<std[70759c8f55707aa4]::sys::backtrace::BacktraceLock>::print::DisplayBacktrace as core[df12db4294e9bfd3]::fmt::Display>::fmt
[INFO] [stdout]    1:     0x565f1c151d6a - core[df12db4294e9bfd3]::fmt::write
[INFO] [stdout]    2:     0x565f1c141f3c - <alloc[2182bb758b4b3781]::vec::Vec<u8> as core[df12db4294e9bfd3]::io::write::Write>::write_fmt
[INFO] [stdout]    3:     0x565f1c119be6 - std[70759c8f55707aa4]::panicking::default_hook::{closure#0}
[INFO] [stdout]    4:     0x565f1c135ff9 - std[70759c8f55707aa4]::panicking::default_hook
[INFO] [stdout]    5:     0x565f1c0aec40 - test[9d35eded1c95d3be]::test_main_inner::<test[9d35eded1c95d3be]::test_main_static::{closure#0}>::{closure#0}
[INFO] [stdout]    6:     0x565f1c136322 - std[70759c8f55707aa4]::panicking::panic_with_hook
[INFO] [stdout]    7:     0x565f1c119c92 - std[70759c8f55707aa4]::panicking::panic_handler::{closure#0}
[INFO] [stdout]    8:     0x565f1c112a19 - std[70759c8f55707aa4]::sys::backtrace::__rust_end_short_backtrace::<std[70759c8f55707aa4]::panicking::panic_handler::{closure#0}, !>
[INFO] [stdout]    9:     0x565f1c11a88d - __rustc[8fa7c3cbc660c2b3]::rust_begin_unwind
[INFO] [stdout]   10:     0x565f1c1524cc - core[df12db4294e9bfd3]::panicking::panic_fmt
[INFO] [stdout]   11:     0x565f1c1523e3 - core[df12db4294e9bfd3]::panicking::assert_failed_inner
[INFO] [stdout]   12:     0x565f1c09a697 - core[df12db4294e9bfd3]::panicking::assert_failed::<clean_deploy_lost_events[a82657d6d8497540]::ShutdownOutcome, clean_deploy_lost_events[a82657d6d8497540]::ShutdownOutcome>
[INFO] [stdout]   13:     0x565f1c0900e9 - delivery_contract[2173a1c312f677cb]::new_work_is_rejected_after_shutdown_starts::{closure#0}
[INFO] [stdout]   14:     0x565f1c09c686 - <tokio[752aaa5eac1cc697]::runtime::scheduler::current_thread::CoreGuard>::block_on::<core[df12db4294e9bfd3]::pin::Pin<&mut core[df12db4294e9bfd3]::pin::Pin<&mut dyn core[df12db4294e9bfd3]::future::future::Future<Output = ()>>>>
[INFO] [stdout]   15:     0x565f1c09ea36 - tokio[752aaa5eac1cc697]::runtime::context::runtime::enter_runtime::<<tokio[752aaa5eac1cc697]::runtime::scheduler::current_thread::CurrentThread>::block_on<core[df12db4294e9bfd3]::pin::Pin<&mut dyn core[df12db4294e9bfd3]::future::future::Future<Output = ()>>>::{closure#0}, ()>
[INFO] [stdout]   16:     0x565f1c09d536 - <tokio[752aaa5eac1cc697]::runtime::runtime::Runtime>::block_on::<core[df12db4294e9bfd3]::pin::Pin<&mut dyn core[df12db4294e9bfd3]::future::future::Future<Output = ()>>>
[INFO] [stdout]   17:     0x565f1c0923cc - <delivery_contract[2173a1c312f677cb]::new_work_is_rejected_after_shutdown_starts::{closure#0} as core[df12db4294e9bfd3]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]   18:     0x565f1c0a1f2b - test[9d35eded1c95d3be]::__rust_begin_short_backtrace::<core[df12db4294e9bfd3]::result::Result<(), alloc[2182bb758b4b3781]::string::String>, fn() -> core[df12db4294e9bfd3]::result::Result<(), alloc[2182bb758b4b3781]::string::String>>
[INFO] [stdout]   19:     0x565f1c0af595 - test[9d35eded1c95d3be]::run_test::{closure#0}
[INFO] [stdout]   20:     0x565f1c0a8e54 - std[70759c8f55707aa4]::sys::backtrace::__rust_begin_short_backtrace::<test[9d35eded1c95d3be]::run_test::{closure#1}, ()>
[INFO] [stdout]   21:     0x565f1c0b26f2 - <std[70759c8f55707aa4]::thread::lifecycle::spawn_unchecked<test[9d35eded1c95d3be]::run_test::{closure#1}, ()>::{closure#1} as core[df12db4294e9bfd3]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0}
[INFO] [stdout]   22:     0x565f1c13d319 - <std[70759c8f55707aa4]::sys::thread::unix::Thread>::new::thread_start
[INFO] [stdout]   23:     0x74ec8ffbfdfa - <unknown>
[INFO] [stdout]   24:     0x74ec900533d4 - clone
[INFO] [stdout]   25:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] ---- failed_write_never_receives_success stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'failed_write_never_receives_success' (476) panicked at tests/delivery_contract.rs:40:5:
[INFO] [stdout] assertion `left == right` failed
[INFO] [stdout]   left: Ok(())
[INFO] [stdout]  right: Err(CommitFailed(9))
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x565f1c13da51 - <<std[70759c8f55707aa4]::sys::backtrace::BacktraceLock>::print::DisplayBacktrace as core[df12db4294e9bfd3]::fmt::Display>::fmt
[INFO] [stdout]    1:     0x565f1c151d6a - core[df12db4294e9bfd3]::fmt::write
[INFO] [stdout]    2:     0x565f1c141f3c - <alloc[2182bb758b4b3781]::vec::Vec<u8> as core[df12db4294e9bfd3]::io::write::Write>::write_fmt
[INFO] [stdout]    3:     0x565f1c119be6 - std[70759c8f55707aa4]::panicking::default_hook::{closure#0}
[INFO] [stdout]    4:     0x565f1c135ff9 - std[70759c8f55707aa4]::panicking::default_hook
[INFO] [stdout]    5:     0x565f1c0aec40 - test[9d35eded1c95d3be]::test_main_inner::<test[9d35eded1c95d3be]::test_main_static::{closure#0}>::{closure#0}
[INFO] [stdout]    6:     0x565f1c136322 - std[70759c8f55707aa4]::panicking::panic_with_hook
[INFO] [stdout]    7:     0x565f1c119c92 - std[70759c8f55707aa4]::panicking::panic_handler::{closure#0}
[INFO] [stdout]    8:     0x565f1c112a19 - std[70759c8f55707aa4]::sys::backtrace::__rust_end_short_backtrace::<std[70759c8f55707aa4]::panicking::panic_handler::{closure#0}, !>
[INFO] [stdout]    9:     0x565f1c11a88d - __rustc[8fa7c3cbc660c2b3]::rust_begin_unwind
[INFO] [stdout]   10:     0x565f1c1524cc - core[df12db4294e9bfd3]::panicking::panic_fmt
[INFO] [stdout]   11:     0x565f1c1523e3 - core[df12db4294e9bfd3]::panicking::assert_failed_inner
[INFO] [stdout]   12:     0x565f1c09a631 - core[df12db4294e9bfd3]::panicking::assert_failed::<core[df12db4294e9bfd3]::result::Result<(), clean_deploy_lost_events[a82657d6d8497540]::SubmitError>, core[df12db4294e9bfd3]::result::Result<(), clean_deploy_lost_events[a82657d6d8497540]::SubmitError>>
[INFO] [stdout]   13:     0x565f1c08e116 - delivery_contract[2173a1c312f677cb]::failed_write_never_receives_success::{closure#0}
[INFO] [stdout]   14:     0x565f1c09c686 - <tokio[752aaa5eac1cc697]::runtime::scheduler::current_thread::CoreGuard>::block_on::<core[df12db4294e9bfd3]::pin::Pin<&mut core[df12db4294e9bfd3]::pin::Pin<&mut dyn core[df12db4294e9bfd3]::future::future::Future<Output = ()>>>>
[INFO] [stdout]   15:     0x565f1c09ea36 - tokio[752aaa5eac1cc697]::runtime::context::runtime::enter_runtime::<<tokio[752aaa5eac1cc697]::runtime::scheduler::current_thread::CurrentThread>::block_on<core[df12db4294e9bfd3]::pin::Pin<&mut dyn core[df12db4294e9bfd3]::future::future::Future<Output = ()>>>::{closure#0}, ()>
[INFO] [stdout]   16:     0x565f1c09d536 - <tokio[752aaa5eac1cc697]::runtime::runtime::Runtime>::block_on::<core[df12db4294e9bfd3]::pin::Pin<&mut dyn core[df12db4294e9bfd3]::future::future::Future<Output = ()>>>
[INFO] [stdout]   17:     0x565f1c091e8c - <delivery_contract[2173a1c312f677cb]::failed_write_never_receives_success::{closure#0} as core[df12db4294e9bfd3]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]   18:     0x565f1c0a1f2b - test[9d35eded1c95d3be]::__rust_begin_short_backtrace::<core[df12db4294e9bfd3]::result::Result<(), alloc[2182bb758b4b3781]::string::String>, fn() -> core[df12db4294e9bfd3]::result::Result<(), alloc[2182bb758b4b3781]::string::String>>
[INFO] [stdout]   19:     0x565f1c0af595 - test[9d35eded1c95d3be]::run_test::{closure#0}
[INFO] [stdout]   20:     0x565f1c0a8e54 - std[70759c8f55707aa4]::sys::backtrace::__rust_begin_short_backtrace::<test[9d35eded1c95d3be]::run_test::{closure#1}, ()>
[INFO] [stdout]   21:     0x565f1c0b26f2 - <std[70759c8f55707aa4]::thread::lifecycle::spawn_unchecked<test[9d35eded1c95d3be]::run_test::{closure#1}, ()>::{closure#1} as core[df12db4294e9bfd3]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0}
[INFO] [stdout]   22:     0x565f1c13d319 - <std[70759c8f55707aa4]::sys::thread::unix::Thread>::new::thread_start
[INFO] [stdout]   23:     0x74ec8ffbfdfa - <unknown>
[INFO] [stdout]   24:     0x74ec900533d4 - clone
[INFO] [stdout]   25:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] ---- admitted_failures_settle_without_blocking_later_commits stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'admitted_failures_settle_without_blocking_later_commits' (474) panicked at tests/delivery_contract.rs:113:5:
[INFO] [stdout] assertion `left == right` failed
[INFO] [stdout]   left: Ok(())
[INFO] [stdout]  right: Err(CommitFailed(2))
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x565f1c13da51 - <<std[70759c8f55707aa4]::sys::backtrace::BacktraceLock>::print::DisplayBacktrace as core[df12db4294e9bfd3]::fmt::Display>::fmt
[INFO] [stdout]    1:     0x565f1c151d6a - core[df12db4294e9bfd3]::fmt::write
[INFO] [stdout]    2:     0x565f1c141f3c - <alloc[2182bb758b4b3781]::vec::Vec<u8> as core[df12db4294e9bfd3]::io::write::Write>::write_fmt
[INFO] [stdout]    3:     0x565f1c119be6 - std[70759c8f55707aa4]::panicking::default_hook::{closure#0}
[INFO] [stdout]    4:     0x565f1c135ff9 - std[70759c8f55707aa4]::panicking::default_hook
[INFO] [stdout]    5:     0x565f1c0aec40 - test[9d35eded1c95d3be]::test_main_inner::<test[9d35eded1c95d3be]::test_main_static::{closure#0}>::{closure#0}
[INFO] [stdout]    6:     0x565f1c136322 - std[70759c8f55707aa4]::panicking::panic_with_hook
[INFO] [stdout]    7:     0x565f1c119c92 - std[70759c8f55707aa4]::panicking::panic_handler::{closure#0}
[INFO] [stdout]    8:     0x565f1c112a19 - std[70759c8f55707aa4]::sys::backtrace::__rust_end_short_backtrace::<std[70759c8f55707aa4]::panicking::panic_handler::{closure#0}, !>
[INFO] [stdout]    9:     0x565f1c11a88d - __rustc[8fa7c3cbc660c2b3]::rust_begin_unwind
[INFO] [stdout]   10:     0x565f1c1524cc - core[df12db4294e9bfd3]::panicking::panic_fmt
[INFO] [stdout]   11:     0x565f1c1523e3 - core[df12db4294e9bfd3]::panicking::assert_failed_inner
[INFO] [stdout]   12:     0x565f1c09a631 - core[df12db4294e9bfd3]::panicking::assert_failed::<core[df12db4294e9bfd3]::result::Result<(), clean_deploy_lost_events[a82657d6d8497540]::SubmitError>, core[df12db4294e9bfd3]::result::Result<(), clean_deploy_lost_events[a82657d6d8497540]::SubmitError>>
[INFO] [stdout]   13:     0x565f1c0910b6 - delivery_contract[2173a1c312f677cb]::admitted_failures_settle_without_blocking_later_commits::{closure#0}
[INFO] [stdout]   14:     0x565f1c09c686 - <tokio[752aaa5eac1cc697]::runtime::scheduler::current_thread::CoreGuard>::block_on::<core[df12db4294e9bfd3]::pin::Pin<&mut core[df12db4294e9bfd3]::pin::Pin<&mut dyn core[df12db4294e9bfd3]::future::future::Future<Output = ()>>>>
[INFO] [stdout]   15:     0x565f1c09ea36 - tokio[752aaa5eac1cc697]::runtime::context::runtime::enter_runtime::<<tokio[752aaa5eac1cc697]::runtime::scheduler::current_thread::CurrentThread>::block_on<core[df12db4294e9bfd3]::pin::Pin<&mut dyn core[df12db4294e9bfd3]::future::future::Future<Output = ()>>>::{closure#0}, ()>
[INFO] [stdout]   16:     0x565f1c09d536 - <tokio[752aaa5eac1cc697]::runtime::runtime::Runtime>::block_on::<core[df12db4294e9bfd3]::pin::Pin<&mut dyn core[df12db4294e9bfd3]::future::future::Future<Output = ()>>>
[INFO] [stdout]   17:     0x565f1c092e2c - <delivery_contract[2173a1c312f677cb]::admitted_failures_settle_without_blocking_later_commits::{closure#0} as core[df12db4294e9bfd3]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]   18:     0x565f1c0a1f2b - test[9d35eded1c95d3be]::__rust_begin_short_backtrace::<core[df12db4294e9bfd3]::result::Result<(), alloc[2182bb758b4b3781]::string::String>, fn() -> core[df12db4294e9bfd3]::result::Result<(), alloc[2182bb758b4b3781]::string::String>>
[INFO] [stdout]   19:     0x565f1c0af595 - test[9d35eded1c95d3be]::run_test::{closure#0}
[INFO] [stdout]   20:     0x565f1c0a8e54 - std[70759c8f55707aa4]::sys::backtrace::__rust_begin_short_backtrace::<test[9d35eded1c95d3be]::run_test::{closure#1}, ()>
[INFO] [stdout]   21:     0x565f1c0b26f2 - <std[70759c8f55707aa4]::thread::lifecycle::spawn_unchecked<test[9d35eded1c95d3be]::run_test::{closure#1}, ()>::{closure#1} as core[df12db4294e9bfd3]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0}
[INFO] [stdout]   22:     0x565f1c13d319 - <std[70759c8f55707aa4]::sys::thread::unix::Thread>::new::thread_start
[INFO] [stdout]   23:     0x74ec8ffbfdfa - <unknown>
[INFO] [stdout]   24:     0x74ec900533d4 - clone
[INFO] [stdout]   25:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] ---- shutdown_deadline_is_reported_honestly stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'shutdown_deadline_is_reported_honestly' (480) panicked at tests/delivery_contract.rs:96:5:
[INFO] [stdout] assertion `left == right` failed
[INFO] [stdout]   left: Aborted
[INFO] [stdout]  right: TimedOut
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x565f1c13da51 - <<std[70759c8f55707aa4]::sys::backtrace::BacktraceLock>::print::DisplayBacktrace as core[df12db4294e9bfd3]::fmt::Display>::fmt
[INFO] [stdout]    1:     0x565f1c151d6a - core[df12db4294e9bfd3]::fmt::write
[INFO] [stdout]    2:     0x565f1c141f3c - <alloc[2182bb758b4b3781]::vec::Vec<u8> as core[df12db4294e9bfd3]::io::write::Write>::write_fmt
[INFO] [stdout]    3:     0x565f1c119be6 - std[70759c8f55707aa4]::panicking::default_hook::{closure#0}
[INFO] [stdout]    4:     0x565f1c135ff9 - std[70759c8f55707aa4]::panicking::default_hook
[INFO] [stdout]    5:     0x565f1c0aec40 - test[9d35eded1c95d3be]::test_main_inner::<test[9d35eded1c95d3be]::test_main_static::{closure#0}>::{closure#0}
[INFO] [stdout]    6:     0x565f1c136322 - std[70759c8f55707aa4]::panicking::panic_with_hook
[INFO] [stdout]    7:     0x565f1c119c92 - std[70759c8f55707aa4]::panicking::panic_handler::{closure#0}
[INFO] [stdout]    8:     0x565f1c112a19 - std[70759c8f55707aa4]::sys::backtrace::__rust_end_short_backtrace::<std[70759c8f55707aa4]::panicking::panic_handler::{closure#0}, !>
[INFO] [stdout]    9:     0x565f1c11a88d - __rustc[8fa7c3cbc660c2b3]::rust_begin_unwind
[INFO] [stdout]   10:     0x565f1c1524cc - core[df12db4294e9bfd3]::panicking::panic_fmt
[INFO] [stdout]   11:     0x565f1c1523e3 - core[df12db4294e9bfd3]::panicking::assert_failed_inner
[INFO] [stdout]   12:     0x565f1c09a697 - core[df12db4294e9bfd3]::panicking::assert_failed::<clean_deploy_lost_events[a82657d6d8497540]::ShutdownOutcome, clean_deploy_lost_events[a82657d6d8497540]::ShutdownOutcome>
[INFO] [stdout]   13:     0x565f1c08ec93 - delivery_contract[2173a1c312f677cb]::shutdown_deadline_is_reported_honestly::{closure#0}
[INFO] [stdout]   14:     0x565f1c09c686 - <tokio[752aaa5eac1cc697]::runtime::scheduler::current_thread::CoreGuard>::block_on::<core[df12db4294e9bfd3]::pin::Pin<&mut core[df12db4294e9bfd3]::pin::Pin<&mut dyn core[df12db4294e9bfd3]::future::future::Future<Output = ()>>>>
[INFO] [stdout]   15:     0x565f1c09ea36 - tokio[752aaa5eac1cc697]::runtime::context::runtime::enter_runtime::<<tokio[752aaa5eac1cc697]::runtime::scheduler::current_thread::CurrentThread>::block_on<core[df12db4294e9bfd3]::pin::Pin<&mut dyn core[df12db4294e9bfd3]::future::future::Future<Output = ()>>>::{closure#0}, ()>
[INFO] [stdout]   16:     0x565f1c09d536 - <tokio[752aaa5eac1cc697]::runtime::runtime::Runtime>::block_on::<core[df12db4294e9bfd3]::pin::Pin<&mut dyn core[df12db4294e9bfd3]::future::future::Future<Output = ()>>>
[INFO] [stdout]   17:     0x565f1c09212c - <delivery_contract[2173a1c312f677cb]::shutdown_deadline_is_reported_honestly::{closure#0} as core[df12db4294e9bfd3]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]   18:     0x565f1c0a1f2b - test[9d35eded1c95d3be]::__rust_begin_short_backtrace::<core[df12db4294e9bfd3]::result::Result<(), alloc[2182bb758b4b3781]::string::String>, fn() -> core[df12db4294e9bfd3]::result::Result<(), alloc[2182bb758b4b3781]::string::String>>
[INFO] [stdout]   19:     0x565f1c0af595 - test[9d35eded1c95d3be]::run_test::{closure#0}
[INFO] [stdout]   20:     0x565f1c0a8e54 - std[70759c8f55707aa4]::sys::backtrace::__rust_begin_short_backtrace::<test[9d35eded1c95d3be]::run_test::{closure#1}, ()>
[INFO] [stdout]   21:     0x565f1c0b26f2 - <std[70759c8f55707aa4]::thread::lifecycle::spawn_unchecked<test[9d35eded1c95d3be]::run_test::{closure#1}, ()>::{closure#1} as core[df12db4294e9bfd3]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0}
[INFO] [stdout]   22:     0x565f1c13d319 - <std[70759c8f55707aa4]::sys::thread::unix::Thread>::new::thread_start
[INFO] [stdout]   23:     0x74ec8ffbfdfa - <unknown>
[INFO] [stdout]   24:     0x74ec900533d4 - clone
[INFO] [stdout]   25:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] ---- canary_has_no_acknowledged_commit_gap stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'canary_has_no_acknowledged_commit_gap' (475) panicked at tests/delivery_contract.rs:146:5:
[INFO] [stdout] assertion `left == right` failed
[INFO] [stdout]   left: Aborted
[INFO] [stdout]  right: Drained
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x565f1c13da51 - <<std[70759c8f55707aa4]::sys::backtrace::BacktraceLock>::print::DisplayBacktrace as core[df12db4294e9bfd3]::fmt::Display>::fmt
[INFO] [stdout]    1:     0x565f1c151d6a - core[df12db4294e9bfd3]::fmt::write
[INFO] [stdout]    2:     0x565f1c141f3c - <alloc[2182bb758b4b3781]::vec::Vec<u8> as core[df12db4294e9bfd3]::io::write::Write>::write_fmt
[INFO] [stdout]    3:     0x565f1c119be6 - std[70759c8f55707aa4]::panicking::default_hook::{closure#0}
[INFO] [stdout]    4:     0x565f1c135ff9 - std[70759c8f55707aa4]::panicking::default_hook
[INFO] [stdout]    5:     0x565f1c0aec40 - test[9d35eded1c95d3be]::test_main_inner::<test[9d35eded1c95d3be]::test_main_static::{closure#0}>::{closure#0}
[INFO] [stdout]    6:     0x565f1c136322 - std[70759c8f55707aa4]::panicking::panic_with_hook
[INFO] [stdout]    7:     0x565f1c119c92 - std[70759c8f55707aa4]::panicking::panic_handler::{closure#0}
[INFO] [stdout]    8:     0x565f1c112a19 - std[70759c8f55707aa4]::sys::backtrace::__rust_end_short_backtrace::<std[70759c8f55707aa4]::panicking::panic_handler::{closure#0}, !>
[INFO] [stdout]    9:     0x565f1c11a88d - __rustc[8fa7c3cbc660c2b3]::rust_begin_unwind
[INFO] [stdout]   10:     0x565f1c1524cc - core[df12db4294e9bfd3]::panicking::panic_fmt
[INFO] [stdout]   11:     0x565f1c1523e3 - core[df12db4294e9bfd3]::panicking::assert_failed_inner
[INFO] [stdout]   12:     0x565f1c09a697 - core[df12db4294e9bfd3]::panicking::assert_failed::<clean_deploy_lost_events[a82657d6d8497540]::ShutdownOutcome, clean_deploy_lost_events[a82657d6d8497540]::ShutdownOutcome>
[INFO] [stdout]   13:     0x565f1c08e829 - delivery_contract[2173a1c312f677cb]::canary_has_no_acknowledged_commit_gap::{closure#0}
[INFO] [stdout]   14:     0x565f1c09c686 - <tokio[752aaa5eac1cc697]::runtime::scheduler::current_thread::CoreGuard>::block_on::<core[df12db4294e9bfd3]::pin::Pin<&mut core[df12db4294e9bfd3]::pin::Pin<&mut dyn core[df12db4294e9bfd3]::future::future::Future<Output = ()>>>>
[INFO] [stdout]   15:     0x565f1c09ea36 - tokio[752aaa5eac1cc697]::runtime::context::runtime::enter_runtime::<<tokio[752aaa5eac1cc697]::runtime::scheduler::current_thread::CurrentThread>::block_on<core[df12db4294e9bfd3]::pin::Pin<&mut dyn core[df12db4294e9bfd3]::future::future::Future<Output = ()>>>::{closure#0}, ()>
[INFO] [stdout]   16:     0x565f1c09d536 - <tokio[752aaa5eac1cc697]::runtime::runtime::Runtime>::block_on::<core[df12db4294e9bfd3]::pin::Pin<&mut dyn core[df12db4294e9bfd3]::future::future::Future<Output = ()>>>
[INFO] [stdout]   17:     0x565f1c091fdc - <delivery_contract[2173a1c312f677cb]::canary_has_no_acknowledged_commit_gap::{closure#0} as core[df12db4294e9bfd3]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]   18:     0x565f1c0a1f2b - test[9d35eded1c95d3be]::__rust_begin_short_backtrace::<core[df12db4294e9bfd3]::result::Result<(), alloc[2182bb758b4b3781]::string::String>, fn() -> core[df12db4294e9bfd3]::result::Result<(), alloc[2182bb758b4b3781]::string::String>>
[INFO] [stdout]   19:     0x565f1c0af595 - test[9d35eded1c95d3be]::run_test::{closure#0}
[INFO] [stdout]   20:     0x565f1c0a8e54 - std[70759c8f55707aa4]::sys::backtrace::__rust_begin_short_backtrace::<test[9d35eded1c95d3be]::run_test::{closure#1}, ()>
[INFO] [stdout]   21:     0x565f1c0b26f2 - <std[70759c8f55707aa4]::thread::lifecycle::spawn_unchecked<test[9d35eded1c95d3be]::run_test::{closure#1}, ()>::{closure#1} as core[df12db4294e9bfd3]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0}
[INFO] [stdout]   22:     0x565f1c13d319 - <std[70759c8f55707aa4]::sys::thread::unix::Thread>::new::thread_start
[INFO] [stdout]   23:     0x74ec8ffbfdfa - <unknown>
[INFO] [stdout]   24:     0x74ec900533d4 - clone
[INFO] [stdout]   25:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] ---- success_is_not_returned_before_durable_commit stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'success_is_not_returned_before_durable_commit' (482) panicked at tests/delivery_contract.rs:20:5:
[INFO] [stdout] success returned before commit
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x565f1c13da51 - <<std[70759c8f55707aa4]::sys::backtrace::BacktraceLock>::print::DisplayBacktrace as core[df12db4294e9bfd3]::fmt::Display>::fmt
[INFO] [stdout]    1:     0x565f1c151d6a - core[df12db4294e9bfd3]::fmt::write
[INFO] [stdout]    2:     0x565f1c141f3c - <alloc[2182bb758b4b3781]::vec::Vec<u8> as core[df12db4294e9bfd3]::io::write::Write>::write_fmt
[INFO] [stdout]    3:     0x565f1c119be6 - std[70759c8f55707aa4]::panicking::default_hook::{closure#0}
[INFO] [stdout]    4:     0x565f1c135ff9 - std[70759c8f55707aa4]::panicking::default_hook
[INFO] [stdout]    5:     0x565f1c0aec40 - test[9d35eded1c95d3be]::test_main_inner::<test[9d35eded1c95d3be]::test_main_static::{closure#0}>::{closure#0}
[INFO] [stdout]    6:     0x565f1c136322 - std[70759c8f55707aa4]::panicking::panic_with_hook
[INFO] [stdout]    7:     0x565f1c119cc4 - std[70759c8f55707aa4]::panicking::panic_handler::{closure#0}
[INFO] [stdout]    8:     0x565f1c112a19 - std[70759c8f55707aa4]::sys::backtrace::__rust_end_short_backtrace::<std[70759c8f55707aa4]::panicking::panic_handler::{closure#0}, !>
[INFO] [stdout]    9:     0x565f1c11a88d - __rustc[8fa7c3cbc660c2b3]::rust_begin_unwind
[INFO] [stdout]   10:     0x565f1c1524cc - core[df12db4294e9bfd3]::panicking::panic_fmt
[INFO] [stdout]   11:     0x565f1c090a3f - delivery_contract[2173a1c312f677cb]::success_is_not_returned_before_durable_commit::{closure#0}
[INFO] [stdout]   12:     0x565f1c09c686 - <tokio[752aaa5eac1cc697]::runtime::scheduler::current_thread::CoreGuard>::block_on::<core[df12db4294e9bfd3]::pin::Pin<&mut core[df12db4294e9bfd3]::pin::Pin<&mut dyn core[df12db4294e9bfd3]::future::future::Future<Output = ()>>>>
[INFO] [stdout]   13:     0x565f1c09ea36 - tokio[752aaa5eac1cc697]::runtime::context::runtime::enter_runtime::<<tokio[752aaa5eac1cc697]::runtime::scheduler::current_thread::CurrentThread>::block_on<core[df12db4294e9bfd3]::pin::Pin<&mut dyn core[df12db4294e9bfd3]::future::future::Future<Output = ()>>>::{closure#0}, ()>
[INFO] [stdout]   14:     0x565f1c09d536 - <tokio[752aaa5eac1cc697]::runtime::runtime::Runtime>::block_on::<core[df12db4294e9bfd3]::pin::Pin<&mut dyn core[df12db4294e9bfd3]::future::future::Future<Output = ()>>>
[INFO] [stdout]   15:     0x565f1c09251c - <delivery_contract[2173a1c312f677cb]::success_is_not_returned_before_durable_commit::{closure#0} as core[df12db4294e9bfd3]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]   16:     0x565f1c0a1f2b - test[9d35eded1c95d3be]::__rust_begin_short_backtrace::<core[df12db4294e9bfd3]::result::Result<(), alloc[2182bb758b4b3781]::string::String>, fn() -> core[df12db4294e9bfd3]::result::Result<(), alloc[2182bb758b4b3781]::string::String>>
[INFO] [stdout]   17:     0x565f1c0af595 - test[9d35eded1c95d3be]::run_test::{closure#0}
[INFO] [stdout]   18:     0x565f1c0a8e54 - std[70759c8f55707aa4]::sys::backtrace::__rust_begin_short_backtrace::<test[9d35eded1c95d3be]::run_test::{closure#1}, ()>
[INFO] [stdout]   19:     0x565f1c0b26f2 - <std[70759c8f55707aa4]::thread::lifecycle::spawn_unchecked<test[9d35eded1c95d3be]::run_test::{closure#1}, ()>::{closure#1} as core[df12db4294e9bfd3]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0}
[INFO] [stdout]   20:     0x565f1c13d319 - <std[70759c8f55707aa4]::sys::thread::unix::Thread>::new::thread_start
[INFO] [stdout]   21:     0x74ec8ffbfdfa - <unknown>
[INFO] [stdout]   22:     0x74ec900533d4 - clone
[INFO] [stdout]   23:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] ---- shutdown_drains_all_admitted_healthy_work stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'shutdown_drains_all_admitted_healthy_work' (481) panicked at tests/delivery_contract.rs:66:5:
[INFO] [stdout] assertion `left == right` failed
[INFO] [stdout]   left: Aborted
[INFO] [stdout]  right: Drained
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x565f1c13da51 - <<std[70759c8f55707aa4]::sys::backtrace::BacktraceLock>::print::DisplayBacktrace as core[df12db4294e9bfd3]::fmt::Display>::fmt
[INFO] [stdout]    1:     0x565f1c151d6a - core[df12db4294e9bfd3]::fmt::write
[INFO] [stdout]    2:     0x565f1c141f3c - <alloc[2182bb758b4b3781]::vec::Vec<u8> as core[df12db4294e9bfd3]::io::write::Write>::write_fmt
[INFO] [stdout]    3:     0x565f1c119be6 - std[70759c8f55707aa4]::panicking::default_hook::{closure#0}
[INFO] [stdout]    4:     0x565f1c135ff9 - std[70759c8f55707aa4]::panicking::default_hook
[INFO] [stdout]    5:     0x565f1c0aec40 - test[9d35eded1c95d3be]::test_main_inner::<test[9d35eded1c95d3be]::test_main_static::{closure#0}>::{closure#0}
[INFO] [stdout]    6:     0x565f1c136322 - std[70759c8f55707aa4]::panicking::panic_with_hook
[INFO] [stdout]    7:     0x565f1c119c92 - std[70759c8f55707aa4]::panicking::panic_handler::{closure#0}
[INFO] [stdout]    8:     0x565f1c112a19 - std[70759c8f55707aa4]::sys::backtrace::__rust_end_short_backtrace::<std[70759c8f55707aa4]::panicking::panic_handler::{closure#0}, !>
[INFO] [stdout]    9:     0x565f1c11a88d - __rustc[8fa7c3cbc660c2b3]::rust_begin_unwind
[INFO] [stdout]   10:     0x565f1c1524cc - core[df12db4294e9bfd3]::panicking::panic_fmt
[INFO] [stdout]   11:     0x565f1c1523e3 - core[df12db4294e9bfd3]::panicking::assert_failed_inner
[INFO] [stdout]   12:     0x565f1c09a697 - core[df12db4294e9bfd3]::panicking::assert_failed::<clean_deploy_lost_events[a82657d6d8497540]::ShutdownOutcome, clean_deploy_lost_events[a82657d6d8497540]::ShutdownOutcome>
[INFO] [stdout]   13:     0x565f1c08f47b - delivery_contract[2173a1c312f677cb]::shutdown_drains_all_admitted_healthy_work::{closure#0}
[INFO] [stdout]   14:     0x565f1c09c686 - <tokio[752aaa5eac1cc697]::runtime::scheduler::current_thread::CoreGuard>::block_on::<core[df12db4294e9bfd3]::pin::Pin<&mut core[df12db4294e9bfd3]::pin::Pin<&mut dyn core[df12db4294e9bfd3]::future::future::Future<Output = ()>>>>
[INFO] [stdout]   15:     0x565f1c09ea36 - tokio[752aaa5eac1cc697]::runtime::context::runtime::enter_runtime::<<tokio[752aaa5eac1cc697]::runtime::scheduler::current_thread::CurrentThread>::block_on<core[df12db4294e9bfd3]::pin::Pin<&mut dyn core[df12db4294e9bfd3]::future::future::Future<Output = ()>>>::{closure#0}, ()>
[INFO] [stdout]   16:     0x565f1c09d536 - <tokio[752aaa5eac1cc697]::runtime::runtime::Runtime>::block_on::<core[df12db4294e9bfd3]::pin::Pin<&mut dyn core[df12db4294e9bfd3]::future::future::Future<Output = ()>>>
[INFO] [stdout]   17:     0x565f1c09227c - <delivery_contract[2173a1c312f677cb]::shutdown_drains_all_admitted_healthy_work::{closure#0} as core[df12db4294e9bfd3]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]   18:     0x565f1c0a1f2b - test[9d35eded1c95d3be]::__rust_begin_short_backtrace::<core[df12db4294e9bfd3]::result::Result<(), alloc[2182bb758b4b3781]::string::String>, fn() -> core[df12db4294e9bfd3]::result::Result<(), alloc[2182bb758b4b3781]::string::String>>
[INFO] [stdout]   19:     0x565f1c0af595 - test[9d35eded1c95d3be]::run_test::{closure#0}
[INFO] [stdout]   20:     0x565f1c0a8e54 - std[70759c8f55707aa4]::sys::backtrace::__rust_begin_short_backtrace::<test[9d35eded1c95d3be]::run_test::{closure#1}, ()>
[INFO] [stdout]   21:     0x565f1c0b26f2 - <std[70759c8f55707aa4]::thread::lifecycle::spawn_unchecked<test[9d35eded1c95d3be]::run_test::{closure#1}, ()>::{closure#1} as core[df12db4294e9bfd3]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0}
[INFO] [stdout]   22:     0x565f1c13d319 - <std[70759c8f55707aa4]::sys::thread::unix::Thread>::new::thread_start
[INFO] [stdout]   23:     0x74ec8ffbfdfa - <unknown>
[INFO] [stdout]   24:     0x74ec900533d4 - clone
[INFO] [stdout]   25:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] ---- monitor_reconciles_acknowledged_and_committed_ids stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'monitor_reconciles_acknowledged_and_committed_ids' (478) panicked at tests/delivery_contract.rs:158:5:
[INFO] [stdout] monitor found a delivery gap:
[INFO] [stdout] ============================================================
[INFO] [stdout]  ROLLING-DEPLOY DELIVERY MONITOR
[INFO] [stdout] ============================================================
[INFO] [stdout] Before termination:
[INFO] [stdout]   acknowledged IDs: {1001, 1002, 1003, 1005}
[INFO] [stdout]   committed IDs:    {}
[INFO] [stdout]   queued:           4
[INFO] [stdout]   active writes:    1
[INFO] [stdout] 
[INFO] [stdout] Shutdown outcome:           Aborted
[INFO] [stdout] Acknowledged IDs:           {1001, 1002, 1003, 1004, 1005}
[INFO] [stdout] Committed IDs:              {}
[INFO] [stdout] Acknowledged but missing:   {1001, 1002, 1003, 1004, 1005}
[INFO] [stdout] Queued after shutdown:      4
[INFO] [stdout] Active writes after stop:   1
[INFO] [stdout] 
[INFO] [stdout] ❌ CLEAN EXIT LOST ACKNOWLEDGED EVENTS
[INFO] [stdout] The process stopped while acknowledged work was still volatile.
[INFO] [stdout] 
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x565f1c13da51 - <<std[70759c8f55707aa4]::sys::backtrace::BacktraceLock>::print::DisplayBacktrace as core[df12db4294e9bfd3]::fmt::Display>::fmt
[INFO] [stdout]    1:     0x565f1c151d6a - core[df12db4294e9bfd3]::fmt::write
[INFO] [stdout]    2:     0x565f1c141f3c - <alloc[2182bb758b4b3781]::vec::Vec<u8> as core[df12db4294e9bfd3]::io::write::Write>::write_fmt
[INFO] [stdout]    3:     0x565f1c119be6 - std[70759c8f55707aa4]::panicking::default_hook::{closure#0}
[INFO] [stdout]    4:     0x565f1c135ff9 - std[70759c8f55707aa4]::panicking::default_hook
[INFO] [stdout]    5:     0x565f1c0aec40 - test[9d35eded1c95d3be]::test_main_inner::<test[9d35eded1c95d3be]::test_main_static::{closure#0}>::{closure#0}
[INFO] [stdout]    6:     0x565f1c136322 - std[70759c8f55707aa4]::panicking::panic_with_hook
[INFO] [stdout]    7:     0x565f1c119c92 - std[70759c8f55707aa4]::panicking::panic_handler::{closure#0}
[INFO] [stdout]    8:     0x565f1c112a19 - std[70759c8f55707aa4]::sys::backtrace::__rust_end_short_backtrace::<std[70759c8f55707aa4]::panicking::panic_handler::{closure#0}, !>
[INFO] [stdout]    9:     0x565f1c11a88d - __rustc[8fa7c3cbc660c2b3]::rust_begin_unwind
[INFO] [stdout]   10:     0x565f1c1524cc - core[df12db4294e9bfd3]::panicking::panic_fmt
[INFO] [stdout]   11:     0x565f1c092a0f - <delivery_contract[2173a1c312f677cb]::monitor_reconciles_acknowledged_and_committed_ids::{closure#0} as core[df12db4294e9bfd3]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]   12:     0x565f1c0a1f2b - test[9d35eded1c95d3be]::__rust_begin_short_backtrace::<core[df12db4294e9bfd3]::result::Result<(), alloc[2182bb758b4b3781]::string::String>, fn() -> core[df12db4294e9bfd3]::result::Result<(), alloc[2182bb758b4b3781]::string::String>>
[INFO] [stdout]   13:     0x565f1c0af595 - test[9d35eded1c95d3be]::run_test::{closure#0}
[INFO] [stdout]   14:     0x565f1c0a8e54 - std[70759c8f55707aa4]::sys::backtrace::__rust_begin_short_backtrace::<test[9d35eded1c95d3be]::run_test::{closure#1}, ()>
[INFO] [stdout]   15:     0x565f1c0b26f2 - <std[70759c8f55707aa4]::thread::lifecycle::spawn_unchecked<test[9d35eded1c95d3be]::run_test::{closure#1}, ()>::{closure#1} as core[df12db4294e9bfd3]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0}
[INFO] [stdout]   16:     0x565f1c13d319 - <std[70759c8f55707aa4]::sys::thread::unix::Thread>::new::thread_start
[INFO] [stdout]   17:     0x74ec8ffbfdfa - <unknown>
[INFO] [stdout]   18:     0x74ec900533d4 - clone
[INFO] [stdout]   19:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout]     admitted_failures_settle_without_blocking_later_commits
[INFO] [stdout]     canary_has_no_acknowledged_commit_gap
[INFO] [stdout]     failed_write_never_receives_success
[INFO] [stdout]     monitor_reconciles_acknowledged_and_committed_ids
[INFO] [stdout]     new_work_is_rejected_after_shutdown_starts
[INFO] [stdout]     shutdown_deadline_is_reported_honestly
[INFO] [stdout]     shutdown_drains_all_admitted_healthy_work
[INFO] [stdout]     success_is_not_returned_before_durable_commit
[INFO] [stdout] 
[INFO] [stdout] test result: FAILED. 1 passed; 8 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.02s
[INFO] [stdout] 
[INFO] [stderr] error: test failed, to rerun pass `--test delivery_contract`
[INFO] running `Command { std: "docker" "inspect" "a0307fb60967c5148d99fc1f39fd6aa6cd84417673827d5717ffd3fa1c033a38", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "a0307fb60967c5148d99fc1f39fd6aa6cd84417673827d5717ffd3fa1c033a38", kill_on_drop: false }`
[INFO] [stdout] a0307fb60967c5148d99fc1f39fd6aa6cd84417673827d5717ffd3fa1c033a38
