[INFO] fetching crate inferlab-runtime 0.22.0...
[INFO] testing inferlab-runtime-0.22.0 against 1.99.0-beta.8+cargoflags=--release for beta-release-1.100-2
[INFO] extracting crate inferlab-runtime 0.22.0 into /workspace/builds/worker-2-tc1/source
[INFO] started tweaking crates.io crate inferlab-runtime 0.22.0
[INFO] finished tweaking crates.io crate inferlab-runtime 0.22.0
[INFO] tweaked toml for crates.io crate inferlab-runtime 0.22.0 written to /workspace/builds/worker-2-tc1/source/Cargo.toml
[INFO] validating manifest of crates.io crate inferlab-runtime 0.22.0 on toolchain 1.99.0-beta.8
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.99.0-beta.8" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] crate crates.io crate inferlab-runtime 0.22.0 already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.99.0-beta.8" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-m" "1610612736" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:77db811e55d90add9212f6832c23229e3de5f1c1f9905e8cb07319ea15df73ac" "sleep" "infinity", kill_on_drop: false }`
[INFO] [stdout] a63f3a8cc4e34ae867f6aafca970bbf249e69ba97efd20c0af5a6f107cf34197
[INFO] running `Command { std: "docker" "start" "a63f3a8cc4e34ae867f6aafca970bbf249e69ba97efd20c0af5a6f107cf34197", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "a63f3a8cc4e34ae867f6aafca970bbf249e69ba97efd20c0af5a6f107cf34197", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-w" "/opt/rustwide/workdir" "--user" "0:0" "a63f3a8cc4e34ae867f6aafca970bbf249e69ba97efd20c0af5a6f107cf34197" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.8" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "a63f3a8cc4e34ae867f6aafca970bbf249e69ba97efd20c0af5a6f107cf34197", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "a63f3a8cc4e34ae867f6aafca970bbf249e69ba97efd20c0af5a6f107cf34197" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.8" "build" "--frozen" "--message-format=json" "--release", kill_on_drop: false }`
[INFO] [stderr]    Compiling libc v0.2.190
[INFO] [stderr]    Compiling smallvec v1.16.2
[INFO] [stderr]    Compiling syn v3.0.6
[INFO] [stderr]    Compiling futures-util v0.3.34
[INFO] [stderr]    Compiling cfg_aliases v0.2.2
[INFO] [stderr]    Compiling rustix v1.1.5
[INFO] [stderr]    Compiling base64 v0.23.1
[INFO] [stderr]    Compiling rustls-native-certs v0.8.4
[INFO] [stderr]    Compiling linux-raw-sys v0.12.1
[INFO] [stderr]    Compiling digest v0.11.3
[INFO] [stderr]    Compiling base16ct v1.0.0
[INFO] [stderr]    Compiling nix v0.31.3
[INFO] [stderr]    Compiling sha2 v0.11.0
[INFO] [stderr]    Compiling socket2 v0.6.5
[INFO] [stderr]    Compiling mio v1.2.4
[INFO] [stderr]    Compiling getrandom v0.4.3
[INFO] [stderr]    Compiling wait-timeout v0.2.1
[INFO] [stderr]    Compiling jobserver v0.1.35
[INFO] [stderr]    Compiling cc v1.6.0
[INFO] [stderr]    Compiling synstructure v0.14.0
[INFO] [stderr]    Compiling tokio v1.53.2
[INFO] [stderr]    Compiling ctrlc v3.5.2
[INFO] [stderr]    Compiling zerovec-derive v0.11.6
[INFO] [stderr]    Compiling displaydoc v0.2.7
[INFO] [stderr]    Compiling serde_derive v1.0.229
[INFO] [stderr]    Compiling thiserror-impl v2.0.21
[INFO] [stderr]    Compiling zerofrom-derive v0.1.8
[INFO] [stderr]    Compiling yoke-derive v0.8.4
[INFO] [stderr]    Compiling cmake v0.1.58
[INFO] [stderr]    Compiling zerofrom v0.1.8
[INFO] [stderr]    Compiling yoke v0.8.3
[INFO] [stderr]    Compiling zerotrie v0.2.5
[INFO] [stderr]    Compiling aws-lc-sys v0.45.0
[INFO] [stderr]    Compiling zerovec v0.11.8
[INFO] [stderr]    Compiling thiserror v2.0.21
[INFO] [stderr]    Compiling tempfile v3.27.0
[INFO] [stderr]    Compiling tinystr v0.8.4
[INFO] [stderr]    Compiling potential_utf v0.1.6
[INFO] [stderr]    Compiling icu_collections v2.3.0
[INFO] [stderr]    Compiling icu_locale_core v2.3.0
[INFO] [stderr]    Compiling serde v1.0.229
[INFO] [stderr]    Compiling serde_urlencoded v0.7.1
[INFO] [stderr]    Compiling icu_provider v2.3.1
[INFO] [stderr]    Compiling icu_normalizer v2.3.0
[INFO] [stderr]    Compiling icu_properties v2.3.0
[INFO] [stderr]    Compiling idna_adapter v1.2.2
[INFO] [stderr]    Compiling idna v1.1.0
[INFO] [stderr]    Compiling hyper v1.11.1
[INFO] [stderr]    Compiling url v2.5.8
[INFO] [stderr]    Compiling tower v0.5.3
[INFO] [stderr]    Compiling tokio-util v0.7.19
[INFO] [stderr]    Compiling tower-http v0.6.11
[INFO] [stderr]    Compiling hyper-util v0.1.21
[INFO] [stderr]    Compiling aws-lc-rs v1.18.1
[INFO] [stderr]    Compiling rustls v0.23.45
[INFO] [stderr]    Compiling rustls-webpki v0.103.15
[INFO] [stderr]    Compiling tokio-rustls v0.26.6
[INFO] [stderr]    Compiling rustls-platform-verifier v0.7.1
[INFO] [stderr]    Compiling hyper-rustls v0.27.10
[INFO] [stderr]    Compiling reqwest v0.13.5
[INFO] [stderr]    Compiling inferlab-runtime v0.22.0 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `release` profile [optimized] target(s) in 2m 06s
[INFO] running `Command { std: "docker" "inspect" "a63f3a8cc4e34ae867f6aafca970bbf249e69ba97efd20c0af5a6f107cf34197", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "a63f3a8cc4e34ae867f6aafca970bbf249e69ba97efd20c0af5a6f107cf34197" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.8" "test" "--frozen" "--no-run" "--message-format=json" "--release", kill_on_drop: false }`
[INFO] [stderr]    Compiling inferlab-runtime v0.22.0 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `release` profile [optimized] target(s) in 11.33s
[INFO] running `Command { std: "docker" "inspect" "a63f3a8cc4e34ae867f6aafca970bbf249e69ba97efd20c0af5a6f107cf34197", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "a63f3a8cc4e34ae867f6aafca970bbf249e69ba97efd20c0af5a6f107cf34197" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.8" "test" "--frozen" "--release", kill_on_drop: false }`
[INFO] [stderr]     Finished `release` profile [optimized] target(s) in 0.16s
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/release/deps/inferlab_runtime-e2ebf593b1054803)
[INFO] [stdout] 
[INFO] [stdout] running 42 tests
[INFO] [stdout] test server::tests::expired_readiness_owner_prevents_a_fresh_network_attempt ... ok
[INFO] [stdout] test operation_bound::tests::sequential_attempts_consume_one_finite_owner_budget ... ok
[INFO] [stdout] test operation_bound::tests::subordinate_attempt_cap_does_not_classify_the_owner_as_expired ... ok
[INFO] [stdout] test operation_bound::tests::terminal_evidence_distinguishes_finite_and_unbounded_owners ... ok
[INFO] [stdout] test server::tests::expired_readiness_owner_rejects_a_registry_match ... ok
[INFO] [stdout] test container::tests::pending_interruption_terminates_an_unbounded_command ... ok
[INFO] [stdout] test server::tests::cleanup_evidence_without_device_residuals_still_decodes ... ok
[INFO] [stdout] test operation_bound::tests::unbounded_owner_retains_attempt_caps_without_acquiring_a_budget ... ok
[INFO] [stdout] test server::tests::local_launch_refuses_a_data_directory_its_live_owner_still_uses ... ok
[INFO] [stdout] test interrupt::tests::ctrlc_categories_remain_typed ... ok
[INFO] [stdout] test server::tests::local_launch_file_mismatch_fails_before_spawn_without_replacing_it ... ok
[INFO] [stdout] test server::tests::local_launch_file_publication_reuses_the_immutable_target ... ok
[INFO] [stdout] test server::tests::device_residual_evidence_encodes_under_its_outcome_tag ... ok
[INFO] [stdout] test container::tests::blocked_stdin_write_cannot_outlive_the_owner_bound ... ok
[INFO] [stdout] test container::tests::unbounded_command_wait_terminates_when_the_process_exits ... ok
[INFO] [stdout] test server::tests::rejects_a_reused_process_identity ... ok
[INFO] [stdout] test server::tests::local_launch_empties_the_data_directory_before_the_process_starts ... ok
[INFO] [stdout] test container::tests::inherited_output_pipe_cannot_outlive_the_owner_bound ... ok
[INFO] [stdout] test server::tests::process_status_command_cannot_outlive_the_readiness_owner ... ok
[INFO] [stdout] test server::tests::finite_target_registry_attempts_record_the_resolved_attempt_budget ... ok
[INFO] [stdout] test container::tests::env_remove_strips_inherited_variables_from_the_child ... ok
[INFO] [stdout] test server::tests::target_registry_readiness_records_all_expected_targets ... ok
[INFO] [stdout] test server::tests::termination_refuses_a_cohort_inconsistent_orphan_group ... ok
[INFO] [stdout] test server::tests::ssh_cleanup_script_refuses_a_cohort_inconsistent_orphan_group ... ok
[INFO] [stdout] test shell::tests::shell_quote_preserves_single_quotes ... ok
[INFO] [stdout] test server::tests::termination_reaps_orphaned_members_after_the_leader_exits ... FAILED
[INFO] [stdout] test ssh::tests::ssh_argv_leaves_connection_policy_to_openssh_configuration ... ok
[INFO] [stdout] test server::tests::ssh_cleanup_script_kills_a_cohort_consistent_orphan_group ... FAILED
[INFO] [stdout] test server::tests::unbounded_process_status_command_does_not_acquire_a_timeout ... ok
[INFO] [stdout] test server::tests::finite_readiness_accepts_a_response_after_250_milliseconds ... ok
[INFO] [stdout] test ssh::tests::login_shell_teardown_does_not_override_remote_script_result ... ok
[INFO] [stdout] test server::tests::remote_launch_file_script_publishes_stdin_without_replacing_targets ... ok
[INFO] [stdout] test server::tests::registry_membership_is_ready_when_every_target_and_the_served_model_appear ... ok
[INFO] [stdout] test server::tests::target_registry_readiness_rejects_partial_registration ... ok
[INFO] [stdout] test server::tests::registry_attempt_deadline_bounds_a_trickled_body ... ok
[INFO] [stdout] test server::tests::finite_readiness_retries_an_expired_process_status_attempt ... ok
[INFO] [stdout] test server::tests::readiness_attempt_deadline_bounds_a_trickled_status_line ... ok
[INFO] [stdout] test server::tests::registry_membership_records_unexpected_entries_when_only_the_model_list_fails ... ok
[INFO] [stdout] test server::tests::registry_membership_records_missing_targets_and_unexpected_entries ... ok
[INFO] [stdout] test server::tests::readiness_attempt_deadline_includes_the_complete_response_body ... ok
[INFO] [stdout] test server::tests::termination_waits_for_the_group_after_the_launcher_exits ... ok
[INFO] [stdout] test server::tests::cleanup_terminates_a_marked_process_that_left_the_group ... FAILED
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout] 
[INFO] [stdout] ---- server::tests::termination_reaps_orphaned_members_after_the_leader_exits stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'server::tests::termination_reaps_orphaned_members_after_the_leader_exits' (2629) panicked at src/server.rs:1881:9:
[INFO] [stdout] assertion `left == right` failed: the orphaned member was reaped
[INFO] [stdout]   left: Some(23461975)
[INFO] [stdout]  right: None
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x56fad1bed351 - <<std[70759c8f55707aa4]::sys::backtrace::BacktraceLock>::print::DisplayBacktrace as core[df12db4294e9bfd3]::fmt::Display>::fmt
[INFO] [stdout]    1:     0x56fad1c041ba - core[df12db4294e9bfd3]::fmt::write
[INFO] [stdout]    2:     0x56fad1bf259c - <alloc[2182bb758b4b3781]::vec::Vec<u8> as core[df12db4294e9bfd3]::io::write::Write>::write_fmt
[INFO] [stdout]    3:     0x56fad1bc4686 - std[70759c8f55707aa4]::panicking::default_hook::{closure#0}
[INFO] [stdout]    4:     0x56fad1be35e9 - std[70759c8f55707aa4]::panicking::default_hook
[INFO] [stdout]    5:     0x56fad1b762b0 - test[9d35eded1c95d3be]::test_main_inner::<test[9d35eded1c95d3be]::test_main_static::{closure#0}>::{closure#0}
[INFO] [stdout]    6:     0x56fad1be3912 - std[70759c8f55707aa4]::panicking::panic_with_hook
[INFO] [stdout]    7:     0x56fad1bc4732 - std[70759c8f55707aa4]::panicking::panic_handler::{closure#0}
[INFO] [stdout]    8:     0x56fad1bbd019 - std[70759c8f55707aa4]::sys::backtrace::__rust_end_short_backtrace::<std[70759c8f55707aa4]::panicking::panic_handler::{closure#0}, !>
[INFO] [stdout]    9:     0x56fad1bc560d - __rustc[8fa7c3cbc660c2b3]::rust_begin_unwind
[INFO] [stdout]   10:     0x56fad1c0491c - core[df12db4294e9bfd3]::panicking::panic_fmt
[INFO] [stdout]   11:     0x56fad1c04893 - core[df12db4294e9bfd3]::panicking::assert_failed_inner
[INFO] [stdout]   12:     0x56fad179d6d8 - core[df12db4294e9bfd3]::panicking::assert_failed::<core[df12db4294e9bfd3]::option::Option<u64>, core[df12db4294e9bfd3]::option::Option<u64>>
[INFO] [stdout]   13:     0x56fad175c2f6 - inferlab_runtime[8c1f19acf8501ae1]::server::tests::termination_reaps_orphaned_members_after_the_leader_exits
[INFO] [stdout]   14:     0x56fad17c3de5 - <inferlab_runtime[8c1f19acf8501ae1]::server::tests::termination_reaps_orphaned_members_after_the_leader_exits::{closure#0} as core[df12db4294e9bfd3]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]   15:     0x56fad1b6959b - test[9d35eded1c95d3be]::__rust_begin_short_backtrace::<core[df12db4294e9bfd3]::result::Result<(), alloc[2182bb758b4b3781]::string::String>, fn() -> core[df12db4294e9bfd3]::result::Result<(), alloc[2182bb758b4b3781]::string::String>>
[INFO] [stdout]   16:     0x56fad1b76c05 - test[9d35eded1c95d3be]::run_test::{closure#0}
[INFO] [stdout]   17:     0x56fad1b704c4 - std[70759c8f55707aa4]::sys::backtrace::__rust_begin_short_backtrace::<test[9d35eded1c95d3be]::run_test::{closure#1}, ()>
[INFO] [stdout]   18:     0x56fad1b79d62 - <std[70759c8f55707aa4]::thread::lifecycle::spawn_unchecked<test[9d35eded1c95d3be]::run_test::{closure#1}, ()>::{closure#1} as core[df12db4294e9bfd3]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0}
[INFO] [stdout]   19:     0x56fad1bec0c9 - <std[70759c8f55707aa4]::sys::thread::unix::Thread>::new::thread_start
[INFO] [stdout]   20:     0x7836a7195dfa - <unknown>
[INFO] [stdout]   21:     0x7836a72293d4 - clone
[INFO] [stdout]   22:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] ---- server::tests::ssh_cleanup_script_kills_a_cohort_consistent_orphan_group stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'server::tests::ssh_cleanup_script_kills_a_cohort_consistent_orphan_group' (2603) panicked at src/server.rs:1950:9:
[INFO] [stdout] assertion `left == right` failed: the orphaned member was reaped
[INFO] [stdout]   left: Some(23461971)
[INFO] [stdout]  right: None
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x56fad1bed351 - <<std[70759c8f55707aa4]::sys::backtrace::BacktraceLock>::print::DisplayBacktrace as core[df12db4294e9bfd3]::fmt::Display>::fmt
[INFO] [stdout]    1:     0x56fad1c041ba - core[df12db4294e9bfd3]::fmt::write
[INFO] [stdout]    2:     0x56fad1bf259c - <alloc[2182bb758b4b3781]::vec::Vec<u8> as core[df12db4294e9bfd3]::io::write::Write>::write_fmt
[INFO] [stdout]    3:     0x56fad1bc4686 - std[70759c8f55707aa4]::panicking::default_hook::{closure#0}
[INFO] [stdout]    4:     0x56fad1be35e9 - std[70759c8f55707aa4]::panicking::default_hook
[INFO] [stdout]    5:     0x56fad1b762b0 - test[9d35eded1c95d3be]::test_main_inner::<test[9d35eded1c95d3be]::test_main_static::{closure#0}>::{closure#0}
[INFO] [stdout]    6:     0x56fad1be3912 - std[70759c8f55707aa4]::panicking::panic_with_hook
[INFO] [stdout]    7:     0x56fad1bc4732 - std[70759c8f55707aa4]::panicking::panic_handler::{closure#0}
[INFO] [stdout]    8:     0x56fad1bbd019 - std[70759c8f55707aa4]::sys::backtrace::__rust_end_short_backtrace::<std[70759c8f55707aa4]::panicking::panic_handler::{closure#0}, !>
[INFO] [stdout]    9:     0x56fad1bc560d - __rustc[8fa7c3cbc660c2b3]::rust_begin_unwind
[INFO] [stdout]   10:     0x56fad1c0491c - core[df12db4294e9bfd3]::panicking::panic_fmt
[INFO] [stdout]   11:     0x56fad1c04893 - core[df12db4294e9bfd3]::panicking::assert_failed_inner
[INFO] [stdout]   12:     0x56fad179d6d8 - core[df12db4294e9bfd3]::panicking::assert_failed::<core[df12db4294e9bfd3]::option::Option<u64>, core[df12db4294e9bfd3]::option::Option<u64>>
[INFO] [stdout]   13:     0x56fad175bc68 - inferlab_runtime[8c1f19acf8501ae1]::server::tests::ssh_cleanup_script_kills_a_cohort_consistent_orphan_group
[INFO] [stdout]   14:     0x56fad17c3db5 - <inferlab_runtime[8c1f19acf8501ae1]::server::tests::ssh_cleanup_script_kills_a_cohort_consistent_orphan_group::{closure#0} as core[df12db4294e9bfd3]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]   15:     0x56fad1b6959b - test[9d35eded1c95d3be]::__rust_begin_short_backtrace::<core[df12db4294e9bfd3]::result::Result<(), alloc[2182bb758b4b3781]::string::String>, fn() -> core[df12db4294e9bfd3]::result::Result<(), alloc[2182bb758b4b3781]::string::String>>
[INFO] [stdout]   16:     0x56fad1b76c05 - test[9d35eded1c95d3be]::run_test::{closure#0}
[INFO] [stdout]   17:     0x56fad1b704c4 - std[70759c8f55707aa4]::sys::backtrace::__rust_begin_short_backtrace::<test[9d35eded1c95d3be]::run_test::{closure#1}, ()>
[INFO] [stdout]   18:     0x56fad1b79d62 - <std[70759c8f55707aa4]::thread::lifecycle::spawn_unchecked<test[9d35eded1c95d3be]::run_test::{closure#1}, ()>::{closure#1} as core[df12db4294e9bfd3]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0}
[INFO] [stdout]   19:     0x56fad1bec0c9 - <std[70759c8f55707aa4]::sys::thread::unix::Thread>::new::thread_start
[INFO] [stdout]   20:     0x7836a7195dfa - <unknown>
[INFO] [stdout]   21:     0x7836a72293d4 - clone
[INFO] [stdout]   22:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] ---- server::tests::cleanup_terminates_a_marked_process_that_left_the_group stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'server::tests::cleanup_terminates_a_marked_process_that_left_the_group' (2522) panicked at src/server.rs:2056:9:
[INFO] [stdout] assertion `left == right` failed: the escaped process was terminated
[INFO] [stdout]   left: Some(23461966)
[INFO] [stdout]  right: None
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x56fad1bed351 - <<std[70759c8f55707aa4]::sys::backtrace::BacktraceLock>::print::DisplayBacktrace as core[df12db4294e9bfd3]::fmt::Display>::fmt
[INFO] [stdout]    1:     0x56fad1c041ba - core[df12db4294e9bfd3]::fmt::write
[INFO] [stdout]    2:     0x56fad1bf259c - <alloc[2182bb758b4b3781]::vec::Vec<u8> as core[df12db4294e9bfd3]::io::write::Write>::write_fmt
[INFO] [stdout]    3:     0x56fad1bc4686 - std[70759c8f55707aa4]::panicking::default_hook::{closure#0}
[INFO] [stdout]    4:     0x56fad1be35e9 - std[70759c8f55707aa4]::panicking::default_hook
[INFO] [stdout]    5:     0x56fad1b762b0 - test[9d35eded1c95d3be]::test_main_inner::<test[9d35eded1c95d3be]::test_main_static::{closure#0}>::{closure#0}
[INFO] [stdout]    6:     0x56fad1be3912 - std[70759c8f55707aa4]::panicking::panic_with_hook
[INFO] [stdout]    7:     0x56fad1bc4732 - std[70759c8f55707aa4]::panicking::panic_handler::{closure#0}
[INFO] [stdout]    8:     0x56fad1bbd019 - std[70759c8f55707aa4]::sys::backtrace::__rust_end_short_backtrace::<std[70759c8f55707aa4]::panicking::panic_handler::{closure#0}, !>
[INFO] [stdout]    9:     0x56fad1bc560d - __rustc[8fa7c3cbc660c2b3]::rust_begin_unwind
[INFO] [stdout]   10:     0x56fad1c0491c - core[df12db4294e9bfd3]::panicking::panic_fmt
[INFO] [stdout]   11:     0x56fad1c04893 - core[df12db4294e9bfd3]::panicking::assert_failed_inner
[INFO] [stdout]   12:     0x56fad179d6d8 - core[df12db4294e9bfd3]::panicking::assert_failed::<core[df12db4294e9bfd3]::option::Option<u64>, core[df12db4294e9bfd3]::option::Option<u64>>
[INFO] [stdout]   13:     0x56fad1758db9 - inferlab_runtime[8c1f19acf8501ae1]::server::tests::cleanup_terminates_a_marked_process_that_left_the_group
[INFO] [stdout]   14:     0x56fad17c3cb5 - <inferlab_runtime[8c1f19acf8501ae1]::server::tests::cleanup_terminates_a_marked_process_that_left_the_group::{closure#0} as core[df12db4294e9bfd3]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]   15:     0x56fad1b6959b - test[9d35eded1c95d3be]::__rust_begin_short_backtrace::<core[df12db4294e9bfd3]::result::Result<(), alloc[2182bb758b4b3781]::string::String>, fn() -> core[df12db4294e9bfd3]::result::Result<(), alloc[2182bb758b4b3781]::string::String>>
[INFO] [stdout]   16:     0x56fad1b76c05 - test[9d35eded1c95d3be]::run_test::{closure#0}
[INFO] [stdout]   17:     0x56fad1b704c4 - std[70759c8f55707aa4]::sys::backtrace::__rust_begin_short_backtrace::<test[9d35eded1c95d3be]::run_test::{closure#1}, ()>
[INFO] [stdout]   18:     0x56fad1b79d62 - <std[70759c8f55707aa4]::thread::lifecycle::spawn_unchecked<test[9d35eded1c95d3be]::run_test::{closure#1}, ()>::{closure#1} as core[df12db4294e9bfd3]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0}
[INFO] [stdout]   19:     0x56fad1bec0c9 - <std[70759c8f55707aa4]::sys::thread::unix::Thread>::new::thread_start
[INFO] [stdout]   20:     0x7836a7195dfa - <unknown>
[INFO] [stdout]   21:     0x7836a72293d4 - clone
[INFO] [stdout]   22:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout]     server::tests::cleanup_terminates_a_marked_process_that_left_the_group
[INFO] [stdout]     server::tests::ssh_cleanup_script_kills_a_cohort_consistent_orphan_group
[INFO] [stdout]     server::tests::termination_reaps_orphaned_members_after_the_leader_exits
[INFO] [stdout] 
[INFO] [stdout] test result: FAILED. 39 passed; 3 failed; 0 ignored; 0 measured; 0 filtered out; finished in 2.74s
[INFO] [stdout] 
[INFO] [stderr] error: test failed, to rerun pass `--lib`
[INFO] running `Command { std: "docker" "inspect" "a63f3a8cc4e34ae867f6aafca970bbf249e69ba97efd20c0af5a6f107cf34197", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "a63f3a8cc4e34ae867f6aafca970bbf249e69ba97efd20c0af5a6f107cf34197", kill_on_drop: false }`
[INFO] [stdout] a63f3a8cc4e34ae867f6aafca970bbf249e69ba97efd20c0af5a6f107cf34197
