[INFO] fetching crate rex-sm 0.8.0...
[INFO] testing rex-sm-0.8.0 against 1.91.0 for beta-1.92-2
[INFO] extracting crate rex-sm 0.8.0 into /workspace/builds/worker-3-tc1/source
[INFO] started tweaking crates.io crate rex-sm 0.8.0
[INFO] finished tweaking crates.io crate rex-sm 0.8.0
[INFO] tweaked toml for crates.io crate rex-sm 0.8.0 written to /workspace/builds/worker-3-tc1/source/Cargo.toml
[INFO] validating manifest of crates.io crate rex-sm 0.8.0 on toolchain 1.91.0
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.91.0" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] crate crates.io crate rex-sm 0.8.0 already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.91.0" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] [stderr]     Updating crates.io index
[INFO] [stderr]  Downloading crates ...
[INFO] [stderr]   Downloaded smallvec v1.14.0
[INFO] [stderr]   Downloaded uuid v1.13.2
[INFO] [stderr]   Downloaded bigerror v0.9.0
[INFO] [stderr]   Downloaded semver v1.0.25
[INFO] [stderr]   Downloaded async-trait v0.1.86
[INFO] [stderr]   Downloaded error-stack v0.5.0
[INFO] [stderr]   Downloaded miniz_oxide v0.8.4
[INFO] [stderr]   Downloaded bigerror-derive v0.1.0
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:4848fb76d95f26979359cc7e45710b1dbc8f3acb7aeedee7c460d7702230f228" "/opt/rustwide/cargo-home/bin/cargo" "+1.91.0" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] [stdout] 9ce2b19aa892d4880a9d993b15a09e18913eedc6932ed9a31c7fa197155c4a2f
[INFO] running `Command { std: "docker" "start" "-a" "9ce2b19aa892d4880a9d993b15a09e18913eedc6932ed9a31c7fa197155c4a2f", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "9ce2b19aa892d4880a9d993b15a09e18913eedc6932ed9a31c7fa197155c4a2f", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "9ce2b19aa892d4880a9d993b15a09e18913eedc6932ed9a31c7fa197155c4a2f", kill_on_drop: false }`
[INFO] [stdout] 9ce2b19aa892d4880a9d993b15a09e18913eedc6932ed9a31c7fa197155c4a2f
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:4848fb76d95f26979359cc7e45710b1dbc8f3acb7aeedee7c460d7702230f228" "/opt/rustwide/cargo-home/bin/cargo" "+1.91.0" "build" "--frozen" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] 081a2fe2bae25ce74ec53180c409fe10ff61419000db1a338fdfd995a06eb7e9
[INFO] running `Command { std: "docker" "start" "-a" "081a2fe2bae25ce74ec53180c409fe10ff61419000db1a338fdfd995a06eb7e9", kill_on_drop: false }`
[INFO] [stderr]    Compiling proc-macro2 v1.0.93
[INFO] [stderr]    Compiling unicode-ident v1.0.16
[INFO] [stderr]    Compiling libc v0.2.169
[INFO] [stderr]    Compiling semver v1.0.25
[INFO] [stderr]    Compiling lock_api v0.4.12
[INFO] [stderr]    Compiling anyhow v1.0.95
[INFO] [stderr]    Compiling parking_lot_core v0.9.10
[INFO] [stderr]    Compiling once_cell v1.20.3
[INFO] [stderr]    Compiling futures-channel v0.3.31
[INFO] [stderr]    Compiling getrandom v0.3.1
[INFO] [stderr]    Compiling smallvec v1.14.0
[INFO] [stderr]    Compiling tracing-core v0.1.33
[INFO] [stderr]    Compiling thiserror v2.0.11
[INFO] [stderr]    Compiling hashbrown v0.14.5
[INFO] [stderr]    Compiling rustc_version v0.4.1
[INFO] [stderr]    Compiling bs58 v0.5.1
[INFO] [stderr]    Compiling error-stack v0.5.0
[INFO] [stderr]    Compiling quote v1.0.38
[INFO] [stderr]    Compiling syn v2.0.98
[INFO] [stderr]    Compiling uuid v1.13.2
[INFO] [stderr]    Compiling parking_lot v0.12.3
[INFO] [stderr]    Compiling dashmap v6.1.0
[INFO] [stderr]    Compiling futures-macro v0.3.31
[INFO] [stderr]    Compiling derive_more-impl v1.0.0
[INFO] [stderr]    Compiling tokio-macros v2.5.0
[INFO] [stderr]    Compiling tracing-attributes v0.1.28
[INFO] [stderr]    Compiling bigerror-derive v0.1.0
[INFO] [stderr]    Compiling derive_more-impl v2.0.1
[INFO] [stderr]    Compiling thiserror-impl v2.0.11
[INFO] [stderr]    Compiling async-trait v0.1.86
[INFO] [stderr]    Compiling tokio v1.43.0
[INFO] [stderr]    Compiling futures-util v0.3.31
[INFO] [stderr]    Compiling tracing v0.1.41
[INFO] [stderr]    Compiling derive_more v2.0.1
[INFO] [stderr]    Compiling derive_more v1.0.0
[INFO] [stderr]    Compiling bigerror v0.9.0
[INFO] [stderr]    Compiling tokio-stream v0.1.17
[INFO] [stderr]    Compiling futures-executor v0.3.31
[INFO] [stderr]    Compiling futures v0.3.31
[INFO] [stderr]    Compiling rex-sm v0.8.0 (/opt/rustwide/workdir)
[INFO] [stdout] warning: hiding a lifetime that's elided elsewhere is confusing
[INFO] [stdout]   --> src/notification.rs:77:19
[INFO] [stdout]    |
[INFO] [stdout] 77 |     pub fn stream(&self) -> StreamReceiver<Notification<M>> {
[INFO] [stdout]    |                   ^^^^^     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ the same lifetime is hidden here
[INFO] [stdout]    |                   |
[INFO] [stdout]    |                   the lifetime is elided here
[INFO] [stdout]    |
[INFO] [stdout]    = help: the same lifetime is referred to in inconsistent ways, making the signature confusing
[INFO] [stdout]    = note: `#[warn(mismatched_lifetime_syntaxes)]` on by default
[INFO] [stdout] help: use `'_` for type paths
[INFO] [stdout]    |
[INFO] [stdout] 77 |     pub fn stream(&self) -> StreamReceiver<'_, Notification<M>> {
[INFO] [stdout]    |                                            +++
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: hiding a lifetime that's elided elsewhere is confusing
[INFO] [stdout]    --> src/queue.rs:111:25
[INFO] [stdout]     |
[INFO] [stdout] 111 |     pub const fn stream(&self) -> StreamReceiver<T> {
[INFO] [stdout]     |                         ^^^^^     ^^^^^^^^^^^^^^^^^ the same lifetime is hidden here
[INFO] [stdout]     |                         |
[INFO] [stdout]     |                         the lifetime is elided here
[INFO] [stdout]     |
[INFO] [stdout]     = help: the same lifetime is referred to in inconsistent ways, making the signature confusing
[INFO] [stdout] help: use `'_` for type paths
[INFO] [stdout]     |
[INFO] [stdout] 111 |     pub const fn stream(&self) -> StreamReceiver<'_, T> {
[INFO] [stdout]     |                                                  +++
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stderr]     Finished `dev` profile [unoptimized + debuginfo] target(s) in 27.79s
[INFO] running `Command { std: "docker" "inspect" "081a2fe2bae25ce74ec53180c409fe10ff61419000db1a338fdfd995a06eb7e9", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "081a2fe2bae25ce74ec53180c409fe10ff61419000db1a338fdfd995a06eb7e9", kill_on_drop: false }`
[INFO] [stdout] 081a2fe2bae25ce74ec53180c409fe10ff61419000db1a338fdfd995a06eb7e9
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:4848fb76d95f26979359cc7e45710b1dbc8f3acb7aeedee7c460d7702230f228" "/opt/rustwide/cargo-home/bin/cargo" "+1.91.0" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] e139433291f67736ede4941961559e9601e77b0808f77f4b86562f48b3d86f46
[INFO] running `Command { std: "docker" "start" "-a" "e139433291f67736ede4941961559e9601e77b0808f77f4b86562f48b3d86f46", kill_on_drop: false }`
[INFO] [stderr]    Compiling tracing-core v0.1.33
[INFO] [stderr]    Compiling log v0.4.25
[INFO] [stderr]    Compiling derive_more-impl v2.0.1
[INFO] [stderr]    Compiling thread_local v1.1.8
[INFO] [stderr]    Compiling tracing-test-macro v0.2.5
[INFO] [stderr]    Compiling tracing v0.1.41
[INFO] [stderr]    Compiling tracing-log v0.2.0
[INFO] [stderr]    Compiling bigerror v0.9.0
[INFO] [stderr]    Compiling tracing-subscriber v0.3.19
[INFO] [stderr]    Compiling derive_more v2.0.1
[INFO] [stderr]    Compiling rex-sm v0.8.0 (/opt/rustwide/workdir)
[INFO] [stderr]    Compiling tracing-test v0.2.5
[INFO] [stdout] warning: hiding a lifetime that's elided elsewhere is confusing
[INFO] [stdout]   --> src/notification.rs:77:19
[INFO] [stdout]    |
[INFO] [stdout] 77 |     pub fn stream(&self) -> StreamReceiver<Notification<M>> {
[INFO] [stdout]    |                   ^^^^^     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ the same lifetime is hidden here
[INFO] [stdout]    |                   |
[INFO] [stdout]    |                   the lifetime is elided here
[INFO] [stdout]    |
[INFO] [stdout]    = help: the same lifetime is referred to in inconsistent ways, making the signature confusing
[INFO] [stdout]    = note: `#[warn(mismatched_lifetime_syntaxes)]` on by default
[INFO] [stdout] help: use `'_` for type paths
[INFO] [stdout]    |
[INFO] [stdout] 77 |     pub fn stream(&self) -> StreamReceiver<'_, Notification<M>> {
[INFO] [stdout]    |                                            +++
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: hiding a lifetime that's elided elsewhere is confusing
[INFO] [stdout]    --> src/queue.rs:111:25
[INFO] [stdout]     |
[INFO] [stdout] 111 |     pub const fn stream(&self) -> StreamReceiver<T> {
[INFO] [stdout]     |                         ^^^^^     ^^^^^^^^^^^^^^^^^ the same lifetime is hidden here
[INFO] [stdout]     |                         |
[INFO] [stdout]     |                         the lifetime is elided here
[INFO] [stdout]     |
[INFO] [stdout]     = help: the same lifetime is referred to in inconsistent ways, making the signature confusing
[INFO] [stdout] help: use `'_` for type paths
[INFO] [stdout]     |
[INFO] [stdout] 111 |     pub const fn stream(&self) -> StreamReceiver<'_, T> {
[INFO] [stdout]     |                                                  +++
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: hiding a lifetime that's elided elsewhere is confusing
[INFO] [stdout]   --> src/notification.rs:77:19
[INFO] [stdout]    |
[INFO] [stdout] 77 |     pub fn stream(&self) -> StreamReceiver<Notification<M>> {
[INFO] [stdout]    |                   ^^^^^     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ the same lifetime is hidden here
[INFO] [stdout]    |                   |
[INFO] [stdout]    |                   the lifetime is elided here
[INFO] [stdout]    |
[INFO] [stdout]    = help: the same lifetime is referred to in inconsistent ways, making the signature confusing
[INFO] [stdout]    = note: `#[warn(mismatched_lifetime_syntaxes)]` on by default
[INFO] [stdout] help: use `'_` for type paths
[INFO] [stdout]    |
[INFO] [stdout] 77 |     pub fn stream(&self) -> StreamReceiver<'_, Notification<M>> {
[INFO] [stdout]    |                                            +++
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: hiding a lifetime that's elided elsewhere is confusing
[INFO] [stdout]    --> src/queue.rs:111:25
[INFO] [stdout]     |
[INFO] [stdout] 111 |     pub const fn stream(&self) -> StreamReceiver<T> {
[INFO] [stdout]     |                         ^^^^^     ^^^^^^^^^^^^^^^^^ the same lifetime is hidden here
[INFO] [stdout]     |                         |
[INFO] [stdout]     |                         the lifetime is elided here
[INFO] [stdout]     |
[INFO] [stdout]     = help: the same lifetime is referred to in inconsistent ways, making the signature confusing
[INFO] [stdout] help: use `'_` for type paths
[INFO] [stdout]     |
[INFO] [stdout] 111 |     pub const fn stream(&self) -> StreamReceiver<'_, T> {
[INFO] [stdout]     |                                                  +++
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 13.17s
[INFO] running `Command { std: "docker" "inspect" "e139433291f67736ede4941961559e9601e77b0808f77f4b86562f48b3d86f46", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "e139433291f67736ede4941961559e9601e77b0808f77f4b86562f48b3d86f46", kill_on_drop: false }`
[INFO] [stdout] e139433291f67736ede4941961559e9601e77b0808f77f4b86562f48b3d86f46
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:4848fb76d95f26979359cc7e45710b1dbc8f3acb7aeedee7c460d7702230f228" "/opt/rustwide/cargo-home/bin/cargo" "+1.91.0" "test" "--frozen", kill_on_drop: false }`
[INFO] [stdout] 72930b1ed98ba6eec0b50b435bd2e283bf4a0268257727c679047b24b8245cc3
[INFO] running `Command { std: "docker" "start" "-a" "72930b1ed98ba6eec0b50b435bd2e283bf4a0268257727c679047b24b8245cc3", kill_on_drop: false }`
[INFO] [stderr] warning: hiding a lifetime that's elided elsewhere is confusing
[INFO] [stderr]   --> src/notification.rs:77:19
[INFO] [stderr]    |
[INFO] [stderr] 77 |     pub fn stream(&self) -> StreamReceiver<Notification<M>> {
[INFO] [stderr]    |                   ^^^^^     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ the same lifetime is hidden here
[INFO] [stderr]    |                   |
[INFO] [stderr]    |                   the lifetime is elided here
[INFO] [stderr]    |
[INFO] [stderr]    = help: the same lifetime is referred to in inconsistent ways, making the signature confusing
[INFO] [stderr]    = note: `#[warn(mismatched_lifetime_syntaxes)]` on by default
[INFO] [stderr] help: use `'_` for type paths
[INFO] [stderr]    |
[INFO] [stderr] 77 |     pub fn stream(&self) -> StreamReceiver<'_, Notification<M>> {
[INFO] [stderr]    |                                            +++
[INFO] [stderr] 
[INFO] [stderr] warning: hiding a lifetime that's elided elsewhere is confusing
[INFO] [stderr]    --> src/queue.rs:111:25
[INFO] [stderr]     |
[INFO] [stderr] 111 |     pub const fn stream(&self) -> StreamReceiver<T> {
[INFO] [stderr]     |                         ^^^^^     ^^^^^^^^^^^^^^^^^ the same lifetime is hidden here
[INFO] [stderr]     |                         |
[INFO] [stderr]     |                         the lifetime is elided here
[INFO] [stderr]     |
[INFO] [stderr]     = help: the same lifetime is referred to in inconsistent ways, making the signature confusing
[INFO] [stderr] help: use `'_` for type paths
[INFO] [stderr]     |
[INFO] [stderr] 111 |     pub const fn stream(&self) -> StreamReceiver<'_, T> {
[INFO] [stderr]     |                                                  +++
[INFO] [stderr] 
[INFO] [stderr] warning: `rex-sm` (lib) generated 2 warnings (run `cargo fix --lib -p rex-sm` to apply 2 suggestions)
[INFO] [stderr] warning: `rex-sm` (lib test) generated 2 warnings (2 duplicates)
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 0.20s
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/rex-1e1b290994639e50)
[INFO] [stdout] 
[INFO] [stdout] running 12 tests
[INFO] [stdout] test node::tests::insert_child_state ... ok
[INFO] [stdout] test queue::tests::streamable_deque ... ok
[INFO] [stdout] test notification::tests::route_to_timeout_manager ... ok
[INFO] [stdout] test manager::tests::state_machine ... ok
[INFO] [stdout] test ingress::tests::route_to_network ... ok
[INFO] [stdout] test ingress::tests::rex_builder ... ok
[INFO] [stdout] test ingress::tests::route_from_network ... ok
[INFO] [stdout] test timeout::tests::timeout_cancellation ... ok
[INFO] [stdout] test timeout::tests::partial_timeout_cancellation ... ok
[INFO] [stdout] test timeout::tests::timeout_to_signal ... ok
[INFO] [stdout] test manager::tests::pong_timeout ... ok
[INFO] [stderr] error: test failed, to rerun pass `--lib`
[INFO] [stdout] test manager::tests::ping_timeout ... FAILED
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout] 
[INFO] [stdout] ---- manager::tests::ping_timeout stdout ----
[INFO] [stdout] 2025-11-05T04:59:17.252673Z DEBUG ping_timeout: rex::notification: spawning="NotificationManager.processors"
[INFO] [stdout] 2025-11-05T04:59:17.252764Z  INFO ping_timeout:ping: rex::manager::tests: PINGING msg=0
[INFO] [stdout] 2025-11-05T04:59:17.252827Z  INFO ping_timeout:pong{id=Pong<PG7QCgDPCuyoV8qJ2ZbJvk>}: rex::manager::tests: HOLDING msg=5
[INFO] [stdout] 2025-11-05T04:59:17.252862Z TRACE ping_timeout: rex::notification: notification=Notification(GameMsg(UnaryRequest { id: StateId { kind: Pong, uuid: b44526b6-9aff-4535-aa1c-01703a7d15c1 }, op: Set(Instant { tv_sec: 12148, tv_nsec: 527303383 }) }))
[INFO] [stdout] 2025-11-05T04:59:17.252887Z TRACE ping_timeout: rex::notification: notification=Notification(GameMsg(UnaryRequest { id: StateId { kind: Pong, uuid: b44526b6-9aff-4535-aa1c-01703a7d15c1 }, op: Retain(Hold(Packet { msg: 5, sender: StateId { kind: Ping, uuid: 99ab992a-97df-4f47-bbdc-d564912dad26 }, who_holds: WhoHolds(Some(Pong)) }), Instant { tv_sec: 12148, tv_nsec: 521332952 }) }))
[INFO] [stdout] 2025-11-05T04:59:17.252928Z  WARN ping_timeout:set_timeout{id=Pong<PG7QCgDPCuyoV8qJ2ZbJvk>}: rex::timeout: setting short timeout duration=10ms
[INFO] [stdout] 2025-11-05T04:59:17.252974Z  WARN ping_timeout:retain{id=Pong<PG7QCgDPCuyoV8qJ2ZbJvk>}: rex::timeout: setting short timeout duration=4ms
[INFO] [stdout] 2025-11-05T04:59:17.265582Z  WARN ping_timeout: rex::timeout: timed out id=Pong<PG7QCgDPCuyoV8qJ2ZbJvk>
[INFO] [stdout] 2025-11-05T04:59:17.265798Z  WARN ping_timeout:pong{id=Pong<PG7QCgDPCuyoV8qJ2ZbJvk>}: rex::manager::tests: Ignoring input due to invalid state state=Pong(Failed)
[INFO] [stdout] 2025-11-05T04:59:17.265858Z ERROR ping_timeout:menu: rex::manager::tests: Encountered Failure! input=FailedPong
[INFO] [stdout] 2025-11-05T04:59:17.265914Z TRACE ping_timeout: rex::notification: notification=Notification(GameMsg(UnaryRequest { id: StateId { kind: Ping, uuid: 99ab992a-97df-4f47-bbdc-d564912dad26 }, op: Cancel }))
[INFO] [stdout] 2025-11-05T04:59:17.265952Z TRACE ping_timeout: rex::notification: notification=Notification(GameMsg(UnaryRequest { id: StateId { kind: Pong, uuid: b44526b6-9aff-4535-aa1c-01703a7d15c1 }, op: Cancel }))
[INFO] [stdout] 2025-11-05T04:59:17.265968Z TRACE ping_timeout: rex::notification: notification=Notification(GameMsg(UnaryRequest { id: StateId { kind: Menu, uuid: deafb91e-336b-42b0-bca3-b607392b162a }, op: Cancel }))
[INFO] [stdout] 
[INFO] [stdout] thread 'manager::tests::ping_timeout' (20) panicked at src/manager.rs:929:9:
[INFO] [stdout] assertion `left == right` failed
[INFO] [stdout]   left: FailedPing
[INFO] [stdout]  right: FailedPong
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x609a43e58722 - std::backtrace_rs::backtrace::libunwind::trace::h62f3c6bea0fedab3
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9
[INFO] [stdout]    1:     0x609a43e58722 - std::backtrace_rs::backtrace::trace_unsynchronized::hc41aaca6c0af0bde
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14
[INFO] [stdout]    2:     0x609a43e58722 - std::sys::backtrace::_print_fmt::h33ac2b97007106cc
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/std/src/sys/backtrace.rs:66:9
[INFO] [stdout]    3:     0x609a43e58722 - <std::sys::backtrace::BacktraceLock::print::DisplayBacktrace as core::fmt::Display>::fmt::h4e0a3aeea0f9c085
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/std/src/sys/backtrace.rs:39:26
[INFO] [stdout]    4:     0x609a43e69dff - core::fmt::rt::Argument::fmt::h1edd6a3e00b22f10
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/core/src/fmt/rt.rs:173:76
[INFO] [stdout]    5:     0x609a43e69dff - core::fmt::write::hecf68a131630c74d
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/core/src/fmt/mod.rs:1468:25
[INFO] [stdout]    6:     0x609a43e242b1 - std::io::default_write_fmt::ha6b238eff7f0ef8a
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/std/src/io/mod.rs:639:11
[INFO] [stdout]    7:     0x609a43e242b1 - std::io::Write::write_fmt::h9846fe3d2a36c1ea
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/std/src/io/mod.rs:1954:13
[INFO] [stdout]    8:     0x609a43e305c2 - std::sys::backtrace::BacktraceLock::print::h75160192768e5621
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/std/src/sys/backtrace.rs:42:9
[INFO] [stdout]    9:     0x609a43e35ccf - std::panicking::default_hook::{{closure}}::h14d82797cfb1ddcb
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/std/src/panicking.rs:301:27
[INFO] [stdout]   10:     0x609a43e35b61 - std::panicking::default_hook::h63f9bf8161c5d325
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/std/src/panicking.rs:325:9
[INFO] [stdout]   11:     0x609a43b2537e - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::hb8126f8384f98101
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/alloc/src/boxed.rs:1999:9
[INFO] [stdout]   12:     0x609a43b2537e - test::test_main_with_exit_callback::{{closure}}::hae96ae0cd2f2ce70
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/test/src/lib.rs:145:21
[INFO] [stdout]   13:     0x609a43e3643f - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::ha703f6686c81d0c6
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/alloc/src/boxed.rs:1999:9
[INFO] [stdout]   14:     0x609a43e3643f - std::panicking::panic_with_hook::h3173740e06bd0752
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/std/src/panicking.rs:842:13
[INFO] [stdout]   15:     0x609a43e361ea - std::panicking::panic_handler::{{closure}}::hbac492c61eb56a87
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/std/src/panicking.rs:707:13
[INFO] [stdout]   16:     0x609a43e30709 - std::sys::backtrace::__rust_end_short_backtrace::haa3eac3df9535320
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/std/src/sys/backtrace.rs:174:18
[INFO] [stdout]   17:     0x609a43e188dd - __rustc[de0091b922c53d7e]::rust_begin_unwind
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/std/src/panicking.rs:698:5
[INFO] [stdout]   18:     0x609a43e73c70 - core::panicking::panic_fmt::h5138da2ef87be35b
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/core/src/panicking.rs:75:14
[INFO] [stdout]   19:     0x609a43e73a73 - core::panicking::assert_failed_inner::h1c85740028aaa416
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/core/src/panicking.rs:439:17
[INFO] [stdout]   20:     0x609a43acd842 - core::panicking::assert_failed::h4ce29d562b04e9bd
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/core/src/panicking.rs:394:5
[INFO] [stdout]   21:     0x609a43aeb211 - rex::manager::tests::ping_timeout::{{closure}}::hae94c2c581057812
[INFO] [stdout]                                at /opt/rustwide/workdir/src/manager.rs:929:9
[INFO] [stdout]   22:     0x609a43a3b492 - <core::pin::Pin<P> as core::future::future::Future>::poll::h40791c1a5a65644d
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/core/src/future/future.rs:133:9
[INFO] [stdout]   23:     0x609a43a3b38d - <core::pin::Pin<P> as core::future::future::Future>::poll::h159f8ad6ce3d5593
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/core/src/future/future.rs:133:9
[INFO] [stdout]   24:     0x609a43aab81d - tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::{{closure}}::{{closure}}::hfb6034e9d2796dd0
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/scheduler/current_thread/mod.rs:729:73
[INFO] [stdout]   25:     0x609a43aab71b - tokio::runtime::coop::with_budget::hf2c2d72348ee39f6
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/coop.rs:107:5
[INFO] [stdout]   26:     0x609a43aab71b - tokio::runtime::coop::budget::h0a7d8e07449cd2c8
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/coop.rs:73:5
[INFO] [stdout]   27:     0x609a43aab71b - tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::{{closure}}::hb12ced69d30ec2c3
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/scheduler/current_thread/mod.rs:729:25
[INFO] [stdout]   28:     0x609a43aa88a0 - tokio::runtime::scheduler::current_thread::Context::enter::ha42d7c22ae8e4393
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/scheduler/current_thread/mod.rs:428:19
[INFO] [stdout]   29:     0x609a43aaa1bd - tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::h65041a6ddba19cd2
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/scheduler/current_thread/mod.rs:728:44
[INFO] [stdout]   30:     0x609a43aa9e84 - tokio::runtime::scheduler::current_thread::CoreGuard::enter::{{closure}}::h76f309a1d9b600bd
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/scheduler/current_thread/mod.rs:807:68
[INFO] [stdout]   31:     0x609a43a3a78b - tokio::runtime::context::scoped::Scoped<T>::set::hb3a16175109bbf48
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/context/scoped.rs:40:9
[INFO] [stdout]   32:     0x609a43a07db9 - tokio::runtime::context::set_scheduler::{{closure}}::h80e7c5bf48600fbe
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/context.rs:180:38
[INFO] [stdout]   33:     0x609a43aa2f92 - std::thread::local::LocalKey<T>::try_with::hc352ef7abcfafd8c
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/std/src/thread/local.rs:315:12
[INFO] [stdout]   34:     0x609a43aa0d8e - std::thread::local::LocalKey<T>::with::h654078e83bfc2d0e
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/std/src/thread/local.rs:279:20
[INFO] [stdout]   35:     0x609a43a07d2d - tokio::runtime::context::set_scheduler::h6870fd7502f2639e
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/context.rs:180:17
[INFO] [stdout]   36:     0x609a43aa9c10 - tokio::runtime::scheduler::current_thread::CoreGuard::enter::hc76a94b3335a6433
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/scheduler/current_thread/mod.rs:807:27
[INFO] [stdout]   37:     0x609a43aa9f03 - tokio::runtime::scheduler::current_thread::CoreGuard::block_on::hb0ef04f133579b1e
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/scheduler/current_thread/mod.rs:716:24
[INFO] [stdout]   38:     0x609a43aa4346 - tokio::runtime::scheduler::current_thread::CurrentThread::block_on::{{closure}}::hb4da9fceabc5a6cd
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/scheduler/current_thread/mod.rs:196:33
[INFO] [stdout]   39:     0x609a43a583a2 - tokio::runtime::context::runtime::enter_runtime::h82bd0dd56466a1e6
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/context/runtime.rs:65:16
[INFO] [stdout]   40:     0x609a43aa3d21 - tokio::runtime::scheduler::current_thread::CurrentThread::block_on::h4e9d3b8529a29b39
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/scheduler/current_thread/mod.rs:184:9
[INFO] [stdout]   41:     0x609a43a3a9ba - tokio::runtime::runtime::Runtime::block_on_inner::h49f012ac366b7895
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/runtime.rs:368:52
[INFO] [stdout]   42:     0x609a43a3ab77 - tokio::runtime::runtime::Runtime::block_on::hb21cd46b513bc061
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/runtime.rs:342:18
[INFO] [stdout]   43:     0x609a43aea15d - rex::manager::tests::ping_timeout::hf78aaf7138978324
[INFO] [stdout]                                at /opt/rustwide/workdir/src/manager.rs:929:81
[INFO] [stdout]   44:     0x609a43aea1f7 - rex::manager::tests::ping_timeout::{{closure}}::h644c294684785ef9
[INFO] [stdout]                                at /opt/rustwide/workdir/src/manager.rs:900:28
[INFO] [stdout]   45:     0x609a43a66646 - core::ops::function::FnOnce::call_once::h89813f992e3acdab
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   46:     0x609a43b2515b - core::ops::function::FnOnce::call_once::h8f50ae93d93b62b4
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   47:     0x609a43b2515b - test::__rust_begin_short_backtrace::h447963718d05a644
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/test/src/lib.rs:663:18
[INFO] [stdout]   48:     0x609a43b3ad95 - test::run_test_in_process::{{closure}}::hf890ba4755ca86c0
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/test/src/lib.rs:686:74
[INFO] [stdout]   49:     0x609a43b3ad95 - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::h31e4b2860e583faa
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/core/src/panic/unwind_safe.rs:274:9
[INFO] [stdout]   50:     0x609a43b3ad95 - std::panicking::catch_unwind::do_call::hec7cdbbe797e2cab
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/std/src/panicking.rs:590:40
[INFO] [stdout]   51:     0x609a43b3ad95 - std::panicking::catch_unwind::h24d3b93458b5ba67
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/std/src/panicking.rs:553:19
[INFO] [stdout]   52:     0x609a43b3ad95 - std::panic::catch_unwind::h46eeec7cf9c9336c
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/std/src/panic.rs:359:14
[INFO] [stdout]   53:     0x609a43b3ad95 - test::run_test_in_process::h290de6e559006104
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/test/src/lib.rs:686:27
[INFO] [stdout]   54:     0x609a43b3ad95 - test::run_test::{{closure}}::h26eeb2c5f7e9a995
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/test/src/lib.rs:607:43
[INFO] [stdout]   55:     0x609a43b11594 - test::run_test::{{closure}}::h85af00882daabeaa
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/test/src/lib.rs:637:41
[INFO] [stdout]   56:     0x609a43b11594 - std::sys::backtrace::__rust_begin_short_backtrace::h9d9305dda51fa5f2
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/std/src/sys/backtrace.rs:158:18
[INFO] [stdout]   57:     0x609a43b14f3a - std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}}::hc6aada8b43f0527b
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/std/src/thread/mod.rs:559:17
[INFO] [stdout]   58:     0x609a43b14f3a - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::ha89fe5505c1206f5
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/core/src/panic/unwind_safe.rs:274:9
[INFO] [stdout]   59:     0x609a43b14f3a - std::panicking::catch_unwind::do_call::he3e0bef721d99583
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/std/src/panicking.rs:590:40
[INFO] [stdout]   60:     0x609a43b14f3a - std::panicking::catch_unwind::ha8241964d3d773cd
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/std/src/panicking.rs:553:19
[INFO] [stdout]   61:     0x609a43b14f3a - std::panic::catch_unwind::ha8554bc7696cae72
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/std/src/panic.rs:359:14
[INFO] [stdout]   62:     0x609a43b14f3a - std::thread::Builder::spawn_unchecked_::{{closure}}::he06f1f62b4c90f8d
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/std/src/thread/mod.rs:557:30
[INFO] [stdout]   63:     0x609a43b14f3a - core::ops::function::FnOnce::call_once{{vtable.shim}}::ha7fd20ecae19b9b9
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   64:     0x609a43e2b8ef - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h43642ed9c40e0ab2
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/alloc/src/boxed.rs:1985:9
[INFO] [stdout]   65:     0x609a43e2b8ef - std::sys::thread::unix::Thread::new::thread_start::h38da0f633f090ce2
[INFO] [stdout]                                at /rustc/f8297e351a40c1439a467bbbb6879088047f50b3/library/std/src/sys/thread/unix.rs:126:17
[INFO] [stdout]   66:     0x7f8e48b47aa4 - <unknown>
[INFO] [stdout]   67:     0x7f8e48bd4a64 - clone
[INFO] [stdout]   68:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout]     manager::tests::ping_timeout
[INFO] [stdout] 
[INFO] [stdout] test result: FAILED. 11 passed; 1 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.17s
[INFO] [stdout] 
[INFO] running `Command { std: "docker" "inspect" "72930b1ed98ba6eec0b50b435bd2e283bf4a0268257727c679047b24b8245cc3", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "72930b1ed98ba6eec0b50b435bd2e283bf4a0268257727c679047b24b8245cc3", kill_on_drop: false }`
[INFO] [stdout] 72930b1ed98ba6eec0b50b435bd2e283bf4a0268257727c679047b24b8245cc3
