[INFO] cloning repository https://github.com/maackle/p2p-raft [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/maackle/p2p-raft" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fmaackle%2Fp2p-raft", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fmaackle%2Fp2p-raft'... [INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }` [INFO] [stdout] 120d3c4ecf4fde42bbace80a9833a7b7fe7891b4 [INFO] testing maackle/p2p-raft against try#16fbf98f22730e073c09e7b03f0eafb87a295545 for pr-145628 [INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fmaackle%2Fp2p-raft" "/workspace/builds/worker-6-tc2/source", kill_on_drop: false }` [INFO] [stderr] Cloning into '/workspace/builds/worker-6-tc2/source'... [INFO] [stderr] done. [INFO] removed /workspace/builds/worker-6-tc2/source/rust-toolchain.toml [INFO] started tweaking git repo https://github.com/maackle/p2p-raft [INFO] finished tweaking git repo https://github.com/maackle/p2p-raft [INFO] tweaked toml for git repo https://github.com/maackle/p2p-raft written to /workspace/builds/worker-6-tc2/source/Cargo.toml [INFO] validating manifest of git repo https://github.com/maackle/p2p-raft on toolchain 16fbf98f22730e073c09e7b03f0eafb87a295545 [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+16fbf98f22730e073c09e7b03f0eafb87a295545" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }` [INFO] crate git repo https://github.com/maackle/p2p-raft already has a lockfile, it will not be regenerated [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+16fbf98f22730e073c09e7b03f0eafb87a295545" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:7ad1b28ee6f5f7f699f6cf7015098d6ccdd96d6f2d78dd06228f5b4c9faf309c" "/opt/rustwide/cargo-home/bin/cargo" "+16fbf98f22730e073c09e7b03f0eafb87a295545" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }` [INFO] [stdout] b99947476087148035bcfc7ee0f80eb0d9dd0f88859318b77254608e98dd3e1a [INFO] running `Command { std: "docker" "start" "-a" "b99947476087148035bcfc7ee0f80eb0d9dd0f88859318b77254608e98dd3e1a", kill_on_drop: false }` [INFO] running `Command { std: "docker" "inspect" "b99947476087148035bcfc7ee0f80eb0d9dd0f88859318b77254608e98dd3e1a", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "b99947476087148035bcfc7ee0f80eb0d9dd0f88859318b77254608e98dd3e1a", kill_on_drop: false }` [INFO] [stdout] b99947476087148035bcfc7ee0f80eb0d9dd0f88859318b77254608e98dd3e1a [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:7ad1b28ee6f5f7f699f6cf7015098d6ccdd96d6f2d78dd06228f5b4c9faf309c" "/opt/rustwide/cargo-home/bin/cargo" "+16fbf98f22730e073c09e7b03f0eafb87a295545" "build" "--frozen" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] 1200e889733852a24adfbc498dd356a68f635da240963f0394639c9c7a8307d9 [INFO] running `Command { std: "docker" "start" "-a" "1200e889733852a24adfbc498dd356a68f635da240963f0394639c9c7a8307d9", kill_on_drop: false }` [INFO] [stderr] Compiling proc-macro2 v1.0.94 [INFO] [stderr] Compiling unicode-ident v1.0.18 [INFO] [stderr] Compiling autocfg v1.4.0 [INFO] [stderr] Compiling libc v0.2.171 [INFO] [stderr] Compiling zerocopy v0.8.24 [INFO] [stderr] Compiling pin-project-lite v0.2.16 [INFO] [stderr] Compiling once_cell v1.21.2 [INFO] [stderr] Compiling smallvec v1.14.0 [INFO] [stderr] Compiling futures-sink v0.3.31 [INFO] [stderr] Compiling futures-core v0.3.31 [INFO] [stderr] Compiling getrandom v0.3.2 [INFO] [stderr] Compiling serde v1.0.219 [INFO] [stderr] Compiling anyhow v1.0.97 [INFO] [stderr] Compiling anstyle-parse v0.2.6 [INFO] [stderr] Compiling colorchoice v1.0.3 [INFO] [stderr] Compiling futures-io v0.3.31 [INFO] [stderr] Compiling is_terminal_polyfill v1.70.1 [INFO] [stderr] Compiling futures-channel v0.3.31 [INFO] [stderr] Compiling rust_decimal v1.37.1 [INFO] [stderr] Compiling semver v1.0.26 [INFO] [stderr] Compiling unicode-segmentation v1.12.0 [INFO] [stderr] Compiling anstyle-query v1.1.2 [INFO] [stderr] Compiling anstyle v1.0.10 [INFO] [stderr] Compiling tracing-core v0.1.33 [INFO] [stderr] Compiling iana-time-zone v0.1.62 [INFO] [stderr] Compiling futures-task v0.3.31 [INFO] [stderr] Compiling thiserror v1.0.69 [INFO] [stderr] Compiling convert_case v0.6.0 [INFO] [stderr] Compiling bytes v1.10.1 [INFO] [stderr] Compiling unicode-xid v0.2.6 [INFO] [stderr] Compiling lock_api v0.4.12 [INFO] [stderr] Compiling num-traits v0.2.19 [INFO] [stderr] Compiling slab v0.4.9 [INFO] [stderr] Compiling clap_lex v0.7.4 [INFO] [stderr] Compiling arrayvec v0.7.6 [INFO] [stderr] Compiling anstream v0.6.18 [INFO] [stderr] Compiling utf8-width v0.1.7 [INFO] [stderr] Compiling regex-syntax v0.8.5 [INFO] [stderr] Compiling maplit v1.0.2 [INFO] [stderr] Compiling serde_json v1.0.140 [INFO] [stderr] Compiling itoa v1.0.15 [INFO] [stderr] Compiling clap_builder v4.5.34 [INFO] [stderr] Compiling ryu v1.0.20 [INFO] [stderr] Compiling quote v1.0.40 [INFO] [stderr] Compiling log v0.4.27 [INFO] [stderr] Compiling sharded-slab v0.1.7 [INFO] [stderr] Compiling thread_local v1.1.8 [INFO] [stderr] Compiling either v1.15.0 [INFO] [stderr] Compiling syn v2.0.100 [INFO] [stderr] Compiling tracing-log v0.2.0 [INFO] [stderr] Compiling parking_lot_core v0.9.10 [INFO] [stderr] Compiling mio v1.0.3 [INFO] [stderr] Compiling socket2 v0.5.8 [INFO] [stderr] Compiling parking_lot v0.12.3 [INFO] [stderr] Compiling signal-hook-registry v1.4.2 [INFO] [stderr] Compiling rand_core v0.9.3 [INFO] [stderr] Compiling chrono v0.4.40 [INFO] [stderr] Compiling getrandom v0.2.15 [INFO] [stderr] Compiling itertools v0.14.0 [INFO] [stderr] Compiling rand_core v0.6.4 [INFO] [stderr] Compiling byte-unit v5.1.6 [INFO] [stderr] Compiling ppv-lite86 v0.2.21 [INFO] [stderr] Compiling regex-automata v0.4.9 [INFO] [stderr] Compiling rand_chacha v0.9.0 [INFO] [stderr] Compiling rand_chacha v0.3.1 [INFO] [stderr] Compiling rand v0.9.0 [INFO] [stderr] Compiling rand v0.8.5 [INFO] [stderr] Compiling nanoid v0.4.0 [INFO] [stderr] Compiling regex v1.11.1 [INFO] [stderr] Compiling serde_derive v1.0.219 [INFO] [stderr] Compiling tracing-attributes v0.1.28 [INFO] [stderr] Compiling futures-macro v0.3.31 [INFO] [stderr] Compiling pin-project-internal v1.1.10 [INFO] [stderr] Compiling tokio-macros v2.5.0 [INFO] [stderr] Compiling derive_more-impl v1.0.0 [INFO] [stderr] Compiling clap_derive v4.5.32 [INFO] [stderr] Compiling thiserror-impl v1.0.69 [INFO] [stderr] Compiling openraft-macros v0.10.0 (https://github.com/maackle/openraft?branch=forking#bfb27ecb) [INFO] [stderr] Compiling futures-util v0.3.31 [INFO] [stderr] Compiling tracing v0.1.41 [INFO] [stderr] Compiling tracing-subscriber v0.3.19 [INFO] [stderr] Compiling tokio v1.44.1 [INFO] [stderr] Compiling pin-project v1.1.10 [INFO] [stderr] Compiling clap v4.5.34 [INFO] [stderr] Compiling tracing-futures v0.2.5 [INFO] [stderr] Compiling derive_more v1.0.0 [INFO] [stderr] Compiling futures-executor v0.3.31 [INFO] [stderr] Compiling futures v0.3.31 [INFO] [stderr] Compiling anyerror v0.1.13 [INFO] [stderr] Compiling validit v0.2.4 [INFO] [stderr] Compiling openraft v0.10.0 (https://github.com/maackle/openraft?branch=forking#bfb27ecb) [INFO] [stderr] Compiling tokio-util v0.7.14 [INFO] [stderr] Compiling openraft-memstore v0.10.0 (https://github.com/maackle/openraft?branch=forking#bfb27ecb) [INFO] [stderr] Compiling p2p-raft-memstore v0.1.0 (/opt/rustwide/workdir/crates/p2p-raft-memstore) [INFO] [stderr] Compiling p2p-raft v0.1.0 (/opt/rustwide/workdir/crates/p2p-raft) [INFO] [stderr] Finished `dev` profile [unoptimized + debuginfo] target(s) in 54.45s [INFO] running `Command { std: "docker" "inspect" "1200e889733852a24adfbc498dd356a68f635da240963f0394639c9c7a8307d9", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "1200e889733852a24adfbc498dd356a68f635da240963f0394639c9c7a8307d9", kill_on_drop: false }` [INFO] [stdout] 1200e889733852a24adfbc498dd356a68f635da240963f0394639c9c7a8307d9 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:7ad1b28ee6f5f7f699f6cf7015098d6ccdd96d6f2d78dd06228f5b4c9faf309c" "/opt/rustwide/cargo-home/bin/cargo" "+16fbf98f22730e073c09e7b03f0eafb87a295545" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] 7a4e61120ec9e2b2ad1e08cd68d439cf3b14023c7aef56cc32b57082f04596f0 [INFO] running `Command { std: "docker" "start" "-a" "7a4e61120ec9e2b2ad1e08cd68d439cf3b14023c7aef56cc32b57082f04596f0", kill_on_drop: false }` [INFO] [stderr] Compiling p2p-raft-memstore v0.1.0 (/opt/rustwide/workdir/crates/p2p-raft-memstore) [INFO] [stderr] Compiling p2p-raft v0.1.0 (/opt/rustwide/workdir/crates/p2p-raft) [INFO] [stderr] Finished `test` profile [unoptimized + debuginfo] target(s) in 29.77s [INFO] running `Command { std: "docker" "inspect" "7a4e61120ec9e2b2ad1e08cd68d439cf3b14023c7aef56cc32b57082f04596f0", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "7a4e61120ec9e2b2ad1e08cd68d439cf3b14023c7aef56cc32b57082f04596f0", kill_on_drop: false }` [INFO] [stdout] 7a4e61120ec9e2b2ad1e08cd68d439cf3b14023c7aef56cc32b57082f04596f0 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:7ad1b28ee6f5f7f699f6cf7015098d6ccdd96d6f2d78dd06228f5b4c9faf309c" "/opt/rustwide/cargo-home/bin/cargo" "+16fbf98f22730e073c09e7b03f0eafb87a295545" "test" "--frozen", kill_on_drop: false }` [INFO] [stdout] da5eb1aa068a446eb086f3eef8b54eda5927bdb8e49ff4104e3b1a2c2ec96a52 [INFO] running `Command { std: "docker" "start" "-a" "da5eb1aa068a446eb086f3eef8b54eda5927bdb8e49ff4104e3b1a2c2ec96a52", kill_on_drop: false }` [INFO] [stderr] Finished `test` profile [unoptimized + debuginfo] target(s) in 0.27s [INFO] [stderr] Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/p2p_raft-2f760d90f1e921be) [INFO] [stdout] [INFO] [stderr] Running tests/logs.rs (/opt/rustwide/target/debug/deps/logs-3a93b6d66b4daa7e) [INFO] [stdout] running 0 tests [INFO] [stdout] [INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] running 1 test [INFO] [stderr] Running tests/partitions.rs (/opt/rustwide/target/debug/deps/partitions-7bfc97f4a6cd22e6) [INFO] [stdout] test test_prev_op_log_id ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 2.66s [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] running 5 tests [INFO] [stdout] test startup_race ... ok [INFO] [stdout] test natural_startup ... ok [INFO] [stdout] test join_later ... ok [INFO] [stdout] test join_errors ... ok [INFO] [stdout] test shrink_and_grow_and_shrink ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 5 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 14.14s [INFO] [stdout] [INFO] [stderr] Running tests/signals.rs (/opt/rustwide/target/debug/deps/signals-89e6995e1e22e4bc) [INFO] [stdout] [INFO] [stdout] running 1 test [INFO] [stdout] 2025-08-31T10:31:46.069448Z ERROR p2p_raft::testing::network: crates/p2p-raft/src/testing/network.rs:75: simulated network partition [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error::::msg [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/backtrace.rs:27:14 [INFO] [stdout] 1: anyhow::__private::format_err [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/lib.rs:692:13 [INFO] [stdout] 2: p2p_raft::testing::router::RouterNode::route::{{closure}} [INFO] [stdout] at ./src/testing/router.rs:195:28 [INFO] [stdout] 3: >::append_entries::{{closure}} [INFO] [stdout] at ./src/testing/network.rs:71:14 [INFO] [stdout] 4: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/time/timeout.rs:202:42 [INFO] [stdout] 5: openraft::core::heartbeat::worker::HeartbeatWorker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/core/heartbeat/worker.rs:91:89 [INFO] [stdout] 6: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tracing-0.1.41/src/instrument.rs:321:15 [INFO] [stdout] 7: as core::future::future::Future>::poll [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/future/future.rs:133:9 [INFO] [stdout] 8: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 9: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 10: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 11: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 12: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 13: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 14: __rust_try [INFO] [stdout] 15: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 16: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 17: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 18: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 19: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 20: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 21: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 22: tokio::runtime::task::LocalNotified::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:463:13 [INFO] [stdout] 23: tokio::runtime::scheduler::multi_thread::worker::Context::run_task::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:600:18 [INFO] [stdout] 24: tokio::task::coop::with_budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:167:5 [INFO] [stdout] 25: tokio::task::coop::budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:133:5 [INFO] [stdout] 26: tokio::runtime::scheduler::multi_thread::worker::Context::run_task [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:594:9 [INFO] [stdout] 27: tokio::runtime::scheduler::multi_thread::worker::Context::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:542:29 [INFO] [stdout] 28: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:507:24 [INFO] [stdout] 29: tokio::runtime::context::scoped::Scoped::set [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/scoped.rs:40:9 [INFO] [stdout] 30: tokio::runtime::context::set_scheduler::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:38 [INFO] [stdout] 31: std::thread::local::LocalKey::try_with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:315:12 [INFO] [stdout] 32: std::thread::local::LocalKey::with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:279:20 [INFO] [stdout] 33: tokio::runtime::context::set_scheduler [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:17 [INFO] [stdout] 34: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:502:9 [INFO] [stdout] 35: tokio::runtime::context::runtime::enter_runtime [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/runtime.rs:65:16 [INFO] [stdout] 36: tokio::runtime::scheduler::multi_thread::worker::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:494:5 [INFO] [stdout] 37: tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:460:45 [INFO] [stdout] 38: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/task.rs:42:21 [INFO] [stdout] 39: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 40: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 41: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 42: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 43: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 44: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 45: __rust_try [INFO] [stdout] 46: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 47: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 48: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 49: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 50: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 51: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 52: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 53: tokio::runtime::task::UnownedTask::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:500:13 [INFO] [stdout] 54: tokio::runtime::blocking::pool::Task::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:161:19 [INFO] [stdout] 55: tokio::runtime::blocking::pool::Inner::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:511:22 [INFO] [stdout] 56: tokio::runtime::blocking::pool::Spawner::spawn_thread::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:469:47 [INFO] [stdout] 57: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 58: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 59: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 60: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 61: __rust_try [INFO] [stdout] 62: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 63: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 64: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 65: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 66: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 67: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 68: [INFO] [stdout] 69: clone [INFO] [stdout] 2025-08-31T10:31:46.167095Z ERROR p2p_raft::testing::network: crates/p2p-raft/src/testing/network.rs:75: simulated network partition [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error::::msg [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/backtrace.rs:27:14 [INFO] [stdout] 1: anyhow::__private::format_err [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/lib.rs:692:13 [INFO] [stdout] 2: p2p_raft::testing::router::RouterNode::route::{{closure}} [INFO] [stdout] at ./src/testing/router.rs:195:28 [INFO] [stdout] 3: >::append_entries::{{closure}} [INFO] [stdout] at ./src/testing/network.rs:71:14 [INFO] [stdout] 4: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/time/timeout.rs:202:42 [INFO] [stdout] 5: openraft::core::heartbeat::worker::HeartbeatWorker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/core/heartbeat/worker.rs:91:89 [INFO] [stdout] 6: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tracing-0.1.41/src/instrument.rs:321:15 [INFO] [stdout] 7: as core::future::future::Future>::poll [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/future/future.rs:133:9 [INFO] [stdout] 8: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 9: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 10: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 11: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 12: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 13: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 14: __rust_try [INFO] [stdout] 15: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 16: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 17: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 18: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 19: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 20: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 21: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 22: tokio::runtime::task::LocalNotified::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:463:13 [INFO] [stdout] 23: tokio::runtime::scheduler::multi_thread::worker::Context::run_task::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:600:18 [INFO] [stdout] 24: tokio::task::coop::with_budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:167:5 [INFO] [stdout] 25: tokio::task::coop::budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:133:5 [INFO] [stdout] 26: tokio::runtime::scheduler::multi_thread::worker::Context::run_task [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:594:9 [INFO] [stdout] 27: tokio::runtime::scheduler::multi_thread::worker::Context::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:542:29 [INFO] [stdout] 28: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:507:24 [INFO] [stdout] 29: tokio::runtime::context::scoped::Scoped::set [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/scoped.rs:40:9 [INFO] [stdout] 30: tokio::runtime::context::set_scheduler::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:38 [INFO] [stdout] 31: std::thread::local::LocalKey::try_with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:315:12 [INFO] [stdout] 32: std::thread::local::LocalKey::with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:279:20 [INFO] [stdout] 33: tokio::runtime::context::set_scheduler [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:17 [INFO] [stdout] 34: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:502:9 [INFO] [stdout] 35: tokio::runtime::context::runtime::enter_runtime [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/runtime.rs:65:16 [INFO] [stdout] 36: tokio::runtime::scheduler::multi_thread::worker::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:494:5 [INFO] [stdout] 37: tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:460:45 [INFO] [stdout] 38: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/task.rs:42:21 [INFO] [stdout] 39: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 40: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 41: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 42: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 43: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 44: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 45: __rust_try [INFO] [stdout] 46: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 47: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 48: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 49: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 50: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 51: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 52: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 53: tokio::runtime::task::UnownedTask::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:500:13 [INFO] [stdout] 54: tokio::runtime::blocking::pool::Task::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:161:19 [INFO] [stdout] 55: tokio::runtime::blocking::pool::Inner::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:511:22 [INFO] [stdout] 56: tokio::runtime::blocking::pool::Spawner::spawn_thread::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:469:47 [INFO] [stdout] 57: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 58: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 59: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 60: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 61: __rust_try [INFO] [stdout] 62: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 63: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 64: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 65: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 66: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 67: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 68: [INFO] [stdout] 69: clone [INFO] [stdout] 2025-08-31T10:31:46.221359Z ERROR p2p_raft::testing::network: crates/p2p-raft/src/testing/network.rs:75: simulated network partition [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error::::msg [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/backtrace.rs:27:14 [INFO] [stdout] 1: anyhow::__private::format_err [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/lib.rs:692:13 [INFO] [stdout] 2: p2p_raft::testing::router::RouterNode::route::{{closure}} [INFO] [stdout] at ./src/testing/router.rs:195:28 [INFO] [stdout] 3: >::append_entries::{{closure}} [INFO] [stdout] at ./src/testing/network.rs:71:14 [INFO] [stdout] 4: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/time/timeout.rs:202:42 [INFO] [stdout] 5: openraft::core::heartbeat::worker::HeartbeatWorker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/core/heartbeat/worker.rs:91:89 [INFO] [stdout] 6: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tracing-0.1.41/src/instrument.rs:321:15 [INFO] [stdout] 7: as core::future::future::Future>::poll [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/future/future.rs:133:9 [INFO] [stdout] 8: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 9: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 10: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 11: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 12: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 13: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 14: __rust_try [INFO] [stdout] 15: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 16: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 17: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 18: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 19: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 20: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 21: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 22: tokio::runtime::task::LocalNotified::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:463:13 [INFO] [stdout] 23: tokio::runtime::scheduler::multi_thread::worker::Context::run_task::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:600:18 [INFO] [stdout] 24: tokio::task::coop::with_budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:167:5 [INFO] [stdout] 25: tokio::task::coop::budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:133:5 [INFO] [stdout] 26: tokio::runtime::scheduler::multi_thread::worker::Context::run_task [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:594:9 [INFO] [stdout] 27: tokio::runtime::scheduler::multi_thread::worker::Context::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:542:29 [INFO] [stdout] 28: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:507:24 [INFO] [stdout] 29: tokio::runtime::context::scoped::Scoped::set [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/scoped.rs:40:9 [INFO] [stdout] 30: tokio::runtime::context::set_scheduler::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:38 [INFO] [stdout] 31: std::thread::local::LocalKey::try_with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:315:12 [INFO] [stdout] 32: std::thread::local::LocalKey::with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:279:20 [INFO] [stdout] 33: tokio::runtime::context::set_scheduler [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:17 [INFO] [stdout] 34: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:502:9 [INFO] [stdout] 35: tokio::runtime::context::runtime::enter_runtime [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/runtime.rs:65:16 [INFO] [stdout] 36: tokio::runtime::scheduler::multi_thread::worker::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:494:5 [INFO] [stdout] 37: tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:460:45 [INFO] [stdout] 38: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/task.rs:42:21 [INFO] [stdout] 39: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 40: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 41: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 42: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 43: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 44: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 45: __rust_try [INFO] [stdout] 46: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 47: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 48: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 49: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 50: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 51: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 52: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 53: tokio::runtime::task::UnownedTask::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:500:13 [INFO] [stdout] 54: tokio::runtime::blocking::pool::Task::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:161:19 [INFO] [stdout] 55: tokio::runtime::blocking::pool::Inner::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:511:22 [INFO] [stdout] 56: tokio::runtime::blocking::pool::Spawner::spawn_thread::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:469:47 [INFO] [stdout] 57: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 58: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 59: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 60: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 61: __rust_try [INFO] [stdout] 62: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 63: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 64: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 65: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 66: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 67: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 68: [INFO] [stdout] 69: clone [INFO] [stdout] 2025-08-31T10:31:46.297701Z ERROR p2p_raft::testing::network: crates/p2p-raft/src/testing/network.rs:75: simulated network partition [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error::::msg [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/backtrace.rs:27:14 [INFO] [stdout] 1: anyhow::__private::format_err [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/lib.rs:692:13 [INFO] [stdout] 2: p2p_raft::testing::router::RouterNode::route::{{closure}} [INFO] [stdout] at ./src/testing/router.rs:195:28 [INFO] [stdout] 3: >::append_entries::{{closure}} [INFO] [stdout] at ./src/testing/network.rs:71:14 [INFO] [stdout] 4: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/time/timeout.rs:202:42 [INFO] [stdout] 5: openraft::core::heartbeat::worker::HeartbeatWorker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/core/heartbeat/worker.rs:91:89 [INFO] [stdout] 6: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tracing-0.1.41/src/instrument.rs:321:15 [INFO] [stdout] 7: as core::future::future::Future>::poll [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/future/future.rs:133:9 [INFO] [stdout] 8: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 9: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 10: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 11: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 12: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 13: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 14: __rust_try [INFO] [stdout] 15: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 16: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 17: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 18: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 19: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 20: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 21: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 22: tokio::runtime::task::LocalNotified::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:463:13 [INFO] [stdout] 23: tokio::runtime::scheduler::multi_thread::worker::Context::run_task::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:600:18 [INFO] [stdout] 24: tokio::task::coop::with_budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:167:5 [INFO] [stdout] 25: tokio::task::coop::budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:133:5 [INFO] [stdout] 26: tokio::runtime::scheduler::multi_thread::worker::Context::run_task [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:594:9 [INFO] [stdout] 27: tokio::runtime::scheduler::multi_thread::worker::Context::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:554:29 [INFO] [stdout] 28: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:507:24 [INFO] [stdout] 29: tokio::runtime::context::scoped::Scoped::set [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/scoped.rs:40:9 [INFO] [stdout] 30: tokio::runtime::context::set_scheduler::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:38 [INFO] [stdout] 31: std::thread::local::LocalKey::try_with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:315:12 [INFO] [stdout] 32: std::thread::local::LocalKey::with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:279:20 [INFO] [stdout] 33: tokio::runtime::context::set_scheduler [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:17 [INFO] [stdout] 34: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:502:9 [INFO] [stdout] 35: tokio::runtime::context::runtime::enter_runtime [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/runtime.rs:65:16 [INFO] [stdout] 36: tokio::runtime::scheduler::multi_thread::worker::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:494:5 [INFO] [stdout] 37: tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:460:45 [INFO] [stdout] 38: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/task.rs:42:21 [INFO] [stdout] 39: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 40: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 41: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 42: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 43: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 44: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 45: __rust_try [INFO] [stdout] 46: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 47: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 48: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 49: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 50: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 51: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 52: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 53: tokio::runtime::task::UnownedTask::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:500:13 [INFO] [stdout] 54: tokio::runtime::blocking::pool::Task::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:161:19 [INFO] [stdout] 55: tokio::runtime::blocking::pool::Inner::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:511:22 [INFO] [stdout] 56: tokio::runtime::blocking::pool::Spawner::spawn_thread::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:469:47 [INFO] [stdout] 57: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 58: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 59: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 60: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 61: __rust_try [INFO] [stdout] 62: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 63: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 64: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 65: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 66: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 67: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 68: [INFO] [stdout] 69: clone [INFO] [stdout] 2025-08-31T10:31:46.374086Z ERROR p2p_raft::testing::network: crates/p2p-raft/src/testing/network.rs:75: simulated network partition [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error::::msg [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/backtrace.rs:27:14 [INFO] [stdout] 1: anyhow::__private::format_err [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/lib.rs:692:13 [INFO] [stdout] 2: p2p_raft::testing::router::RouterNode::route::{{closure}} [INFO] [stdout] at ./src/testing/router.rs:195:28 [INFO] [stdout] 3: >::append_entries::{{closure}} [INFO] [stdout] at ./src/testing/network.rs:71:14 [INFO] [stdout] 4: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/time/timeout.rs:202:42 [INFO] [stdout] 5: openraft::core::heartbeat::worker::HeartbeatWorker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/core/heartbeat/worker.rs:91:89 [INFO] [stdout] 6: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tracing-0.1.41/src/instrument.rs:321:15 [INFO] [stdout] 7: as core::future::future::Future>::poll [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/future/future.rs:133:9 [INFO] [stdout] 8: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 9: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 10: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 11: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 12: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 13: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 14: __rust_try [INFO] [stdout] 15: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 16: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 17: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 18: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 19: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 20: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 21: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 22: tokio::runtime::task::LocalNotified::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:463:13 [INFO] [stdout] 23: tokio::runtime::scheduler::multi_thread::worker::Context::run_task::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:600:18 [INFO] [stdout] 24: tokio::task::coop::with_budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:167:5 [INFO] [stdout] 25: tokio::task::coop::budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:133:5 [INFO] [stdout] 26: tokio::runtime::scheduler::multi_thread::worker::Context::run_task [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:594:9 [INFO] [stdout] 27: tokio::runtime::scheduler::multi_thread::worker::Context::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:542:29 [INFO] [stdout] 28: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:507:24 [INFO] [stdout] 29: tokio::runtime::context::scoped::Scoped::set [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/scoped.rs:40:9 [INFO] [stdout] 30: tokio::runtime::context::set_scheduler::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:38 [INFO] [stdout] 31: std::thread::local::LocalKey::try_with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:315:12 [INFO] [stdout] 32: std::thread::local::LocalKey::with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:279:20 [INFO] [stdout] 33: tokio::runtime::context::set_scheduler [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:17 [INFO] [stdout] 34: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:502:9 [INFO] [stdout] 35: tokio::runtime::context::runtime::enter_runtime [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/runtime.rs:65:16 [INFO] [stdout] 36: tokio::runtime::scheduler::multi_thread::worker::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:494:5 [INFO] [stdout] 37: tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:460:45 [INFO] [stdout] 38: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/task.rs:42:21 [INFO] [stdout] 39: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 40: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 41: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 42: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 43: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 44: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 45: __rust_try [INFO] [stdout] 46: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 47: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 48: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 49: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 50: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 51: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 52: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 53: tokio::runtime::task::UnownedTask::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:500:13 [INFO] [stdout] 54: tokio::runtime::blocking::pool::Task::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:161:19 [INFO] [stdout] 55: tokio::runtime::blocking::pool::Inner::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:511:22 [INFO] [stdout] 56: tokio::runtime::blocking::pool::Spawner::spawn_thread::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:469:47 [INFO] [stdout] 57: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 58: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 59: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 60: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 61: __rust_try [INFO] [stdout] 62: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 63: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 64: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 65: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 66: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 67: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 68: [INFO] [stdout] 69: clone [INFO] [stdout] 2025-08-31T10:31:46.450092Z ERROR p2p_raft::testing::network: crates/p2p-raft/src/testing/network.rs:75: simulated network partition [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error::::msg [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/backtrace.rs:27:14 [INFO] [stdout] 1: anyhow::__private::format_err [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/lib.rs:692:13 [INFO] [stdout] 2: p2p_raft::testing::router::RouterNode::route::{{closure}} [INFO] [stdout] at ./src/testing/router.rs:195:28 [INFO] [stdout] 3: >::append_entries::{{closure}} [INFO] [stdout] at ./src/testing/network.rs:71:14 [INFO] [stdout] 4: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/time/timeout.rs:202:42 [INFO] [stdout] 5: openraft::core::heartbeat::worker::HeartbeatWorker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/core/heartbeat/worker.rs:91:89 [INFO] [stdout] 6: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tracing-0.1.41/src/instrument.rs:321:15 [INFO] [stdout] 7: as core::future::future::Future>::poll [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/future/future.rs:133:9 [INFO] [stdout] 8: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 9: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 10: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 11: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 12: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 13: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 14: __rust_try [INFO] [stdout] 15: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 16: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 17: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 18: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 19: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 20: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 21: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 22: tokio::runtime::task::LocalNotified::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:463:13 [INFO] [stdout] 23: tokio::runtime::scheduler::multi_thread::worker::Context::run_task::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:600:18 [INFO] [stdout] 24: tokio::task::coop::with_budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:167:5 [INFO] [stdout] 25: tokio::task::coop::budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:133:5 [INFO] [stdout] 26: tokio::runtime::scheduler::multi_thread::worker::Context::run_task [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:594:9 [INFO] [stdout] 27: tokio::runtime::scheduler::multi_thread::worker::Context::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:554:29 [INFO] [stdout] 28: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:507:24 [INFO] [stdout] 29: tokio::runtime::context::scoped::Scoped::set [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/scoped.rs:40:9 [INFO] [stdout] 30: tokio::runtime::context::set_scheduler::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:38 [INFO] [stdout] 31: std::thread::local::LocalKey::try_with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:315:12 [INFO] [stdout] 32: std::thread::local::LocalKey::with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:279:20 [INFO] [stdout] 33: tokio::runtime::context::set_scheduler [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:17 [INFO] [stdout] 34: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:502:9 [INFO] [stdout] 35: tokio::runtime::context::runtime::enter_runtime [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/runtime.rs:65:16 [INFO] [stdout] 36: tokio::runtime::scheduler::multi_thread::worker::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:494:5 [INFO] [stdout] 37: tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:460:45 [INFO] [stdout] 38: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/task.rs:42:21 [INFO] [stdout] 39: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 40: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 41: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 42: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 43: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 44: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 45: __rust_try [INFO] [stdout] 46: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 47: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 48: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 49: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 50: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 51: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 52: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 53: tokio::runtime::task::UnownedTask::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:500:13 [INFO] [stdout] 54: tokio::runtime::blocking::pool::Task::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:161:19 [INFO] [stdout] 55: tokio::runtime::blocking::pool::Inner::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:511:22 [INFO] [stdout] 56: tokio::runtime::blocking::pool::Spawner::spawn_thread::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:469:47 [INFO] [stdout] 57: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 58: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 59: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 60: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 61: __rust_try [INFO] [stdout] 62: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 63: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 64: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 65: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 66: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 67: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 68: [INFO] [stdout] 69: clone [INFO] [stdout] 2025-08-31T10:31:46.526535Z ERROR p2p_raft::testing::network: crates/p2p-raft/src/testing/network.rs:75: simulated network partition [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error::::msg [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/backtrace.rs:27:14 [INFO] [stdout] 1: anyhow::__private::format_err [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/lib.rs:692:13 [INFO] [stdout] 2: p2p_raft::testing::router::RouterNode::route::{{closure}} [INFO] [stdout] at ./src/testing/router.rs:195:28 [INFO] [stdout] 3: >::append_entries::{{closure}} [INFO] [stdout] at ./src/testing/network.rs:71:14 [INFO] [stdout] 4: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/time/timeout.rs:202:42 [INFO] [stdout] 5: openraft::core::heartbeat::worker::HeartbeatWorker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/core/heartbeat/worker.rs:91:89 [INFO] [stdout] 6: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tracing-0.1.41/src/instrument.rs:321:15 [INFO] [stdout] 7: as core::future::future::Future>::poll [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/future/future.rs:133:9 [INFO] [stdout] 8: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 9: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 10: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 11: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 12: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 13: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 14: __rust_try [INFO] [stdout] 15: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 16: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 17: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 18: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 19: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 20: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 21: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 22: tokio::runtime::task::LocalNotified::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:463:13 [INFO] [stdout] 23: tokio::runtime::scheduler::multi_thread::worker::Context::run_task::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:600:18 [INFO] [stdout] 24: tokio::task::coop::with_budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:167:5 [INFO] [stdout] 25: tokio::task::coop::budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:133:5 [INFO] [stdout] 26: tokio::runtime::scheduler::multi_thread::worker::Context::run_task [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:594:9 [INFO] [stdout] 27: tokio::runtime::scheduler::multi_thread::worker::Context::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:554:29 [INFO] [stdout] 28: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:507:24 [INFO] [stdout] 29: tokio::runtime::context::scoped::Scoped::set [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/scoped.rs:40:9 [INFO] [stdout] 30: tokio::runtime::context::set_scheduler::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:38 [INFO] [stdout] 31: std::thread::local::LocalKey::try_with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:315:12 [INFO] [stdout] 32: std::thread::local::LocalKey::with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:279:20 [INFO] [stdout] 33: tokio::runtime::context::set_scheduler [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:17 [INFO] [stdout] 34: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:502:9 [INFO] [stdout] 35: tokio::runtime::context::runtime::enter_runtime [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/runtime.rs:65:16 [INFO] [stdout] 36: tokio::runtime::scheduler::multi_thread::worker::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:494:5 [INFO] [stdout] 37: tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:460:45 [INFO] [stdout] 38: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/task.rs:42:21 [INFO] [stdout] 39: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 40: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 41: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 42: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 43: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 44: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 45: __rust_try [INFO] [stdout] 46: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 47: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 48: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 49: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 50: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 51: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 52: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 53: tokio::runtime::task::UnownedTask::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:500:13 [INFO] [stdout] 54: tokio::runtime::blocking::pool::Task::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:161:19 [INFO] [stdout] 55: tokio::runtime::blocking::pool::Inner::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:511:22 [INFO] [stdout] 56: tokio::runtime::blocking::pool::Spawner::spawn_thread::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:469:47 [INFO] [stdout] 57: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 58: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 59: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 60: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 61: __rust_try [INFO] [stdout] 62: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 63: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 64: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 65: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 66: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 67: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 68: [INFO] [stdout] 69: clone [INFO] [stdout] 2025-08-31T10:31:46.607364Z ERROR p2p_raft::testing::network: crates/p2p-raft/src/testing/network.rs:75: simulated network partition [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error::::msg [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/backtrace.rs:27:14 [INFO] [stdout] 1: anyhow::__private::format_err [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/lib.rs:692:13 [INFO] [stdout] 2: p2p_raft::testing::router::RouterNode::route::{{closure}} [INFO] [stdout] at ./src/testing/router.rs:195:28 [INFO] [stdout] 3: >::append_entries::{{closure}} [INFO] [stdout] at ./src/testing/network.rs:71:14 [INFO] [stdout] 4: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/time/timeout.rs:202:42 [INFO] [stdout] 5: openraft::core::heartbeat::worker::HeartbeatWorker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/core/heartbeat/worker.rs:91:89 [INFO] [stdout] 6: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tracing-0.1.41/src/instrument.rs:321:15 [INFO] [stdout] 7: as core::future::future::Future>::poll [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/future/future.rs:133:9 [INFO] [stdout] 8: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 9: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 10: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 11: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 12: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 13: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 14: __rust_try [INFO] [stdout] 15: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 16: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 17: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 18: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 19: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 20: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 21: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 22: tokio::runtime::task::LocalNotified::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:463:13 [INFO] [stdout] 23: tokio::runtime::scheduler::multi_thread::worker::Context::run_task::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:600:18 [INFO] [stdout] 24: tokio::task::coop::with_budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:167:5 [INFO] [stdout] 25: tokio::task::coop::budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:133:5 [INFO] [stdout] 26: tokio::runtime::scheduler::multi_thread::worker::Context::run_task [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:594:9 [INFO] [stdout] 27: tokio::runtime::scheduler::multi_thread::worker::Context::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:554:29 [INFO] [stdout] 28: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:507:24 [INFO] [stdout] 29: tokio::runtime::context::scoped::Scoped::set [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/scoped.rs:40:9 [INFO] [stdout] 30: tokio::runtime::context::set_scheduler::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:38 [INFO] [stdout] 31: std::thread::local::LocalKey::try_with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:315:12 [INFO] [stdout] 32: std::thread::local::LocalKey::with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:279:20 [INFO] [stdout] 33: tokio::runtime::context::set_scheduler [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:17 [INFO] [stdout] 34: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:502:9 [INFO] [stdout] 35: tokio::runtime::context::runtime::enter_runtime [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/runtime.rs:65:16 [INFO] [stdout] 36: tokio::runtime::scheduler::multi_thread::worker::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:494:5 [INFO] [stdout] 37: tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:460:45 [INFO] [stdout] 38: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/task.rs:42:21 [INFO] [stdout] 39: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 40: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 41: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 42: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 43: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 44: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 45: __rust_try [INFO] [stdout] 46: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 47: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 48: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 49: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 50: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 51: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 52: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 53: tokio::runtime::task::UnownedTask::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:500:13 [INFO] [stdout] 54: tokio::runtime::blocking::pool::Task::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:161:19 [INFO] [stdout] 55: tokio::runtime::blocking::pool::Inner::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:511:22 [INFO] [stdout] 56: tokio::runtime::blocking::pool::Spawner::spawn_thread::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:469:47 [INFO] [stdout] 57: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 58: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 59: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 60: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 61: __rust_try [INFO] [stdout] 62: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 63: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 64: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 65: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 66: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 67: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 68: [INFO] [stdout] 69: clone [INFO] [stdout] 2025-08-31T10:31:46.611311Z ERROR p2p_raft::testing::network: crates/p2p-raft/src/testing/network.rs:75: simulated network partition [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error::::msg [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/backtrace.rs:27:14 [INFO] [stdout] 1: anyhow::__private::format_err [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/lib.rs:692:13 [INFO] [stdout] 2: p2p_raft::testing::router::RouterNode::route::{{closure}} [INFO] [stdout] at ./src/testing/router.rs:195:28 [INFO] [stdout] 3: >::append_entries::{{closure}} [INFO] [stdout] at ./src/testing/network.rs:71:14 [INFO] [stdout] 4: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/time/timeout.rs:202:42 [INFO] [stdout] 5: openraft::core::heartbeat::worker::HeartbeatWorker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/core/heartbeat/worker.rs:91:89 [INFO] [stdout] 6: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tracing-0.1.41/src/instrument.rs:321:15 [INFO] [stdout] 7: as core::future::future::Future>::poll [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/future/future.rs:133:9 [INFO] [stdout] 8: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 9: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 10: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 11: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 12: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 13: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 14: __rust_try [INFO] [stdout] 15: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 16: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 17: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 18: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 19: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 20: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 21: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 22: tokio::runtime::task::LocalNotified::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:463:13 [INFO] [stdout] 23: tokio::runtime::scheduler::multi_thread::worker::Context::run_task::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:600:18 [INFO] [stdout] 24: tokio::task::coop::with_budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:167:5 [INFO] [stdout] 25: tokio::task::coop::budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:133:5 [INFO] [stdout] 26: tokio::runtime::scheduler::multi_thread::worker::Context::run_task [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:594:9 [INFO] [stdout] 27: tokio::runtime::scheduler::multi_thread::worker::Context::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:554:29 [INFO] [stdout] 28: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:507:24 [INFO] [stdout] 29: tokio::runtime::context::scoped::Scoped::set [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/scoped.rs:40:9 [INFO] [stdout] 30: tokio::runtime::context::set_scheduler::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:38 [INFO] [stdout] 31: std::thread::local::LocalKey::try_with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:315:12 [INFO] [stdout] 32: std::thread::local::LocalKey::with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:279:20 [INFO] [stdout] 33: tokio::runtime::context::set_scheduler [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:17 [INFO] [stdout] 34: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:502:9 [INFO] [stdout] 35: tokio::runtime::context::runtime::enter_runtime [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/runtime.rs:65:16 [INFO] [stdout] 36: tokio::runtime::scheduler::multi_thread::worker::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:494:5 [INFO] [stdout] 37: tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:460:45 [INFO] [stdout] 38: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/task.rs:42:21 [INFO] [stdout] 39: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 40: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 41: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 42: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 43: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 44: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 45: __rust_try [INFO] [stdout] 46: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 47: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 48: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 49: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 50: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 51: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 52: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 53: tokio::runtime::task::UnownedTask::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:500:13 [INFO] [stdout] 54: tokio::runtime::blocking::pool::Task::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:161:19 [INFO] [stdout] 55: tokio::runtime::blocking::pool::Inner::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:511:22 [INFO] [stdout] 56: tokio::runtime::blocking::pool::Spawner::spawn_thread::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:469:47 [INFO] [stdout] 57: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 58: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 59: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 60: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 61: __rust_try [INFO] [stdout] 62: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 63: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 64: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 65: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 66: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 67: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 68: [INFO] [stdout] 69: clone [INFO] [stdout] 2025-08-31T10:31:46.612352Z ERROR p2p_raft::testing::network: crates/p2p-raft/src/testing/network.rs:75: simulated network partition [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error::::msg [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/backtrace.rs:27:14 [INFO] [stdout] 1: anyhow::__private::format_err [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/lib.rs:692:13 [INFO] [stdout] 2: p2p_raft::testing::router::RouterNode::route::{{closure}} [INFO] [stdout] at ./src/testing/router.rs:195:28 [INFO] [stdout] 3: >::append_entries::{{closure}} [INFO] [stdout] at ./src/testing/network.rs:71:14 [INFO] [stdout] 4: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/time/timeout.rs:202:42 [INFO] [stdout] 5: openraft::replication::ReplicationCore::send_log_entries::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/replication/mod.rs:439:89 [INFO] [stdout] 6: openraft::replication::ReplicationCore::send_log_entries::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/replication/mod.rs:368:5 [INFO] [stdout] 7: openraft::replication::ReplicationCore::main::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/replication/mod.rs:240:54 [INFO] [stdout] 8: openraft::replication::ReplicationCore::main::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/replication/mod.rs:212:5 [INFO] [stdout] 9: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tracing-futures-0.2.5/src/lib.rs:283:20 [INFO] [stdout] 10: as core::future::future::Future>::poll [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/future/future.rs:133:9 [INFO] [stdout] 11: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 12: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 13: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 14: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 15: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 16: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 17: __rust_try [INFO] [stdout] 18: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 19: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 20: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 21: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 22: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 23: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 24: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 25: tokio::runtime::task::LocalNotified::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:463:13 [INFO] [stdout] 26: tokio::runtime::scheduler::multi_thread::worker::Context::run_task::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:600:18 [INFO] [stdout] 27: tokio::task::coop::with_budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:167:5 [INFO] [stdout] 28: tokio::task::coop::budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:133:5 [INFO] [stdout] 29: tokio::runtime::scheduler::multi_thread::worker::Context::run_task [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:594:9 [INFO] [stdout] 30: tokio::runtime::scheduler::multi_thread::worker::Context::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:542:29 [INFO] [stdout] 31: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:507:24 [INFO] [stdout] 32: tokio::runtime::context::scoped::Scoped::set [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/scoped.rs:40:9 [INFO] [stdout] 33: tokio::runtime::context::set_scheduler::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:38 [INFO] [stdout] 34: std::thread::local::LocalKey::try_with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:315:12 [INFO] [stdout] 35: std::thread::local::LocalKey::with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:279:20 [INFO] [stdout] 36: tokio::runtime::context::set_scheduler [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:17 [INFO] [stdout] 37: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:502:9 [INFO] [stdout] 38: tokio::runtime::context::runtime::enter_runtime [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/runtime.rs:65:16 [INFO] [stdout] 39: tokio::runtime::scheduler::multi_thread::worker::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:494:5 [INFO] [stdout] 40: tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:460:45 [INFO] [stdout] 41: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/task.rs:42:21 [INFO] [stdout] 42: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 43: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 44: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 45: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 46: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 47: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 48: __rust_try [INFO] [stdout] 49: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 50: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 51: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 52: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 53: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 54: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 55: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 56: tokio::runtime::task::UnownedTask::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:500:13 [INFO] [stdout] 57: tokio::runtime::blocking::pool::Task::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:161:19 [INFO] [stdout] 58: tokio::runtime::blocking::pool::Inner::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:511:22 [INFO] [stdout] 59: tokio::runtime::blocking::pool::Spawner::spawn_thread::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:469:47 [INFO] [stdout] 60: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 61: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 62: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 63: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 64: __rust_try [INFO] [stdout] 65: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 66: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 67: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 68: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 69: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 70: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 71: [INFO] [stdout] 72: clone [INFO] [stdout] 2025-08-31T10:31:46.683809Z ERROR p2p_raft::testing::network: crates/p2p-raft/src/testing/network.rs:75: simulated network partition [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error::::msg [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/backtrace.rs:27:14 [INFO] [stdout] 1: anyhow::__private::format_err [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/lib.rs:692:13 [INFO] [stdout] 2: p2p_raft::testing::router::RouterNode::route::{{closure}} [INFO] [stdout] at ./src/testing/router.rs:195:28 [INFO] [stdout] 3: >::append_entries::{{closure}} [INFO] [stdout] at ./src/testing/network.rs:71:14 [INFO] [stdout] 4: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/time/timeout.rs:202:42 [INFO] [stdout] 5: openraft::core::heartbeat::worker::HeartbeatWorker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/core/heartbeat/worker.rs:91:89 [INFO] [stdout] 6: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tracing-0.1.41/src/instrument.rs:321:15 [INFO] [stdout] 7: as core::future::future::Future>::poll [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/future/future.rs:133:9 [INFO] [stdout] 8: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 9: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 10: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 11: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 12: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 13: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 14: __rust_try [INFO] [stdout] 15: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 16: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 17: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 18: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 19: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 20: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 21: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 22: tokio::runtime::task::LocalNotified::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:463:13 [INFO] [stdout] 23: tokio::runtime::scheduler::multi_thread::worker::Context::run_task::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:600:18 [INFO] [stdout] 24: tokio::task::coop::with_budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:167:5 [INFO] [stdout] 25: tokio::task::coop::budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:133:5 [INFO] [stdout] 26: tokio::runtime::scheduler::multi_thread::worker::Context::run_task [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:594:9 [INFO] [stdout] 27: tokio::runtime::scheduler::multi_thread::worker::Context::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:542:29 [INFO] [stdout] 28: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:507:24 [INFO] [stdout] 29: tokio::runtime::context::scoped::Scoped::set [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/scoped.rs:40:9 [INFO] [stdout] 30: tokio::runtime::context::set_scheduler::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:38 [INFO] [stdout] 31: std::thread::local::LocalKey::try_with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:315:12 [INFO] [stdout] 32: std::thread::local::LocalKey::with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:279:20 [INFO] [stdout] 33: tokio::runtime::context::set_scheduler [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:17 [INFO] [stdout] 34: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:502:9 [INFO] [stdout] 35: tokio::runtime::context::runtime::enter_runtime [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/runtime.rs:65:16 [INFO] [stdout] 36: tokio::runtime::scheduler::multi_thread::worker::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:494:5 [INFO] [stdout] 37: tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:460:45 [INFO] [stdout] 38: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/task.rs:42:21 [INFO] [stdout] 39: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 40: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 41: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 42: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 43: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 44: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 45: __rust_try [INFO] [stdout] 46: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 47: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 48: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 49: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 50: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 51: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 52: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 53: tokio::runtime::task::UnownedTask::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:500:13 [INFO] [stdout] 54: tokio::runtime::blocking::pool::Task::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:161:19 [INFO] [stdout] 55: tokio::runtime::blocking::pool::Inner::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:511:22 [INFO] [stdout] 56: tokio::runtime::blocking::pool::Spawner::spawn_thread::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:469:47 [INFO] [stdout] 57: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 58: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 59: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 60: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 61: __rust_try [INFO] [stdout] 62: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 63: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 64: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 65: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 66: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 67: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 68: [INFO] [stdout] 69: clone [INFO] [stdout] 2025-08-31T10:31:46.759917Z ERROR p2p_raft::testing::network: crates/p2p-raft/src/testing/network.rs:75: simulated network partition [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error::::msg [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/backtrace.rs:27:14 [INFO] [stdout] 1: anyhow::__private::format_err [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/lib.rs:692:13 [INFO] [stdout] 2: p2p_raft::testing::router::RouterNode::route::{{closure}} [INFO] [stdout] at ./src/testing/router.rs:195:28 [INFO] [stdout] 3: >::append_entries::{{closure}} [INFO] [stdout] at ./src/testing/network.rs:71:14 [INFO] [stdout] 4: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/time/timeout.rs:202:42 [INFO] [stdout] 5: openraft::core::heartbeat::worker::HeartbeatWorker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/core/heartbeat/worker.rs:91:89 [INFO] [stdout] 6: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tracing-0.1.41/src/instrument.rs:321:15 [INFO] [stdout] 7: as core::future::future::Future>::poll [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/future/future.rs:133:9 [INFO] [stdout] 8: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 9: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 10: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 11: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 12: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 13: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 14: __rust_try [INFO] [stdout] 15: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 16: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 17: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 18: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 19: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 20: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 21: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 22: tokio::runtime::task::LocalNotified::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:463:13 [INFO] [stdout] 23: tokio::runtime::scheduler::multi_thread::worker::Context::run_task::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:600:18 [INFO] [stdout] 24: tokio::task::coop::with_budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:167:5 [INFO] [stdout] 25: tokio::task::coop::budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:133:5 [INFO] [stdout] 26: tokio::runtime::scheduler::multi_thread::worker::Context::run_task [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:594:9 [INFO] [stdout] 27: tokio::runtime::scheduler::multi_thread::worker::Context::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:542:29 [INFO] [stdout] 28: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:507:24 [INFO] [stdout] 29: tokio::runtime::context::scoped::Scoped::set [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/scoped.rs:40:9 [INFO] [stdout] 30: tokio::runtime::context::set_scheduler::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:38 [INFO] [stdout] 31: std::thread::local::LocalKey::try_with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:315:12 [INFO] [stdout] 32: std::thread::local::LocalKey::with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:279:20 [INFO] [stdout] 33: tokio::runtime::context::set_scheduler [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:17 [INFO] [stdout] 34: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:502:9 [INFO] [stdout] 35: tokio::runtime::context::runtime::enter_runtime [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/runtime.rs:65:16 [INFO] [stdout] 36: tokio::runtime::scheduler::multi_thread::worker::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:494:5 [INFO] [stdout] 37: tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:460:45 [INFO] [stdout] 38: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/task.rs:42:21 [INFO] [stdout] 39: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 40: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 41: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 42: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 43: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 44: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 45: __rust_try [INFO] [stdout] 46: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 47: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 48: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 49: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 50: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 51: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 52: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 53: tokio::runtime::task::UnownedTask::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:500:13 [INFO] [stdout] 54: tokio::runtime::blocking::pool::Task::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:161:19 [INFO] [stdout] 55: tokio::runtime::blocking::pool::Inner::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:511:22 [INFO] [stdout] 56: tokio::runtime::blocking::pool::Spawner::spawn_thread::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:469:47 [INFO] [stdout] 57: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 58: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 59: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 60: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 61: __rust_try [INFO] [stdout] 62: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 63: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 64: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 65: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 66: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 67: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 68: [INFO] [stdout] 69: clone [INFO] [stdout] 2025-08-31T10:31:46.836870Z ERROR p2p_raft::testing::network: crates/p2p-raft/src/testing/network.rs:75: simulated network partition [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error::::msg [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/backtrace.rs:27:14 [INFO] [stdout] 1: anyhow::__private::format_err [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/lib.rs:692:13 [INFO] [stdout] 2: p2p_raft::testing::router::RouterNode::route::{{closure}} [INFO] [stdout] at ./src/testing/router.rs:195:28 [INFO] [stdout] 3: >::append_entries::{{closure}} [INFO] [stdout] at ./src/testing/network.rs:71:14 [INFO] [stdout] 4: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/time/timeout.rs:202:42 [INFO] [stdout] 5: openraft::core::heartbeat::worker::HeartbeatWorker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/core/heartbeat/worker.rs:91:89 [INFO] [stdout] 6: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tracing-0.1.41/src/instrument.rs:321:15 [INFO] [stdout] 7: as core::future::future::Future>::poll [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/future/future.rs:133:9 [INFO] [stdout] 8: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 9: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 10: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 11: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 12: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 13: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 14: __rust_try [INFO] [stdout] 15: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 16: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 17: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 18: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 19: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 20: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 21: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 22: tokio::runtime::task::LocalNotified::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:463:13 [INFO] [stdout] 23: tokio::runtime::scheduler::multi_thread::worker::Context::run_task::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:600:18 [INFO] [stdout] 24: tokio::task::coop::with_budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:167:5 [INFO] [stdout] 25: tokio::task::coop::budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:133:5 [INFO] [stdout] 26: tokio::runtime::scheduler::multi_thread::worker::Context::run_task [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:594:9 [INFO] [stdout] 27: tokio::runtime::scheduler::multi_thread::worker::Context::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:554:29 [INFO] [stdout] 28: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:507:24 [INFO] [stdout] 29: tokio::runtime::context::scoped::Scoped::set [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/scoped.rs:40:9 [INFO] [stdout] 30: tokio::runtime::context::set_scheduler::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:38 [INFO] [stdout] 31: std::thread::local::LocalKey::try_with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:315:12 [INFO] [stdout] 32: std::thread::local::LocalKey::with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:279:20 [INFO] [stdout] 33: tokio::runtime::context::set_scheduler [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:17 [INFO] [stdout] 34: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:502:9 [INFO] [stdout] 35: tokio::runtime::context::runtime::enter_runtime [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/runtime.rs:65:16 [INFO] [stdout] 36: tokio::runtime::scheduler::multi_thread::worker::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:494:5 [INFO] [stdout] 37: tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:460:45 [INFO] [stdout] 38: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/task.rs:42:21 [INFO] [stdout] 39: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 40: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 41: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 42: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 43: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 44: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 45: __rust_try [INFO] [stdout] 46: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 47: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 48: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 49: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 50: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 51: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 52: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 53: tokio::runtime::task::UnownedTask::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:500:13 [INFO] [stdout] 54: tokio::runtime::blocking::pool::Task::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:161:19 [INFO] [stdout] 55: tokio::runtime::blocking::pool::Inner::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:511:22 [INFO] [stdout] 56: tokio::runtime::blocking::pool::Spawner::spawn_thread::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:469:47 [INFO] [stdout] 57: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 58: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 59: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 60: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 61: __rust_try [INFO] [stdout] 62: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 63: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 64: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 65: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 66: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 67: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 68: [INFO] [stdout] 69: clone [INFO] [stdout] 2025-08-31T10:31:46.911874Z ERROR p2p_raft::testing::network: crates/p2p-raft/src/testing/network.rs:75: simulated network partition [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error::::msg [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/backtrace.rs:27:14 [INFO] [stdout] 1: anyhow::__private::format_err [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/lib.rs:692:13 [INFO] [stdout] 2: p2p_raft::testing::router::RouterNode::route::{{closure}} [INFO] [stdout] at ./src/testing/router.rs:195:28 [INFO] [stdout] 3: >::append_entries::{{closure}} [INFO] [stdout] at ./src/testing/network.rs:71:14 [INFO] [stdout] 4: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/time/timeout.rs:202:42 [INFO] [stdout] 5: openraft::core::heartbeat::worker::HeartbeatWorker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/core/heartbeat/worker.rs:91:89 [INFO] [stdout] 6: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tracing-0.1.41/src/instrument.rs:321:15 [INFO] [stdout] 7: as core::future::future::Future>::poll [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/future/future.rs:133:9 [INFO] [stdout] 8: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 9: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 10: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 11: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 12: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 13: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 14: __rust_try [INFO] [stdout] 15: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 16: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 17: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 18: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 19: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 20: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 21: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 22: tokio::runtime::task::LocalNotified::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:463:13 [INFO] [stdout] 23: tokio::runtime::scheduler::multi_thread::worker::Context::run_task::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:600:18 [INFO] [stdout] 24: tokio::task::coop::with_budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:167:5 [INFO] [stdout] 25: tokio::task::coop::budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:133:5 [INFO] [stdout] 26: tokio::runtime::scheduler::multi_thread::worker::Context::run_task [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:594:9 [INFO] [stdout] 27: tokio::runtime::scheduler::multi_thread::worker::Context::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:554:29 [INFO] [stdout] 28: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:507:24 [INFO] [stdout] 29: tokio::runtime::context::scoped::Scoped::set [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/scoped.rs:40:9 [INFO] [stdout] 30: tokio::runtime::context::set_scheduler::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:38 [INFO] [stdout] 31: std::thread::local::LocalKey::try_with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:315:12 [INFO] [stdout] 32: std::thread::local::LocalKey::with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:279:20 [INFO] [stdout] 33: tokio::runtime::context::set_scheduler [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:17 [INFO] [stdout] 34: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:502:9 [INFO] [stdout] 35: tokio::runtime::context::runtime::enter_runtime [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/runtime.rs:65:16 [INFO] [stdout] 36: tokio::runtime::scheduler::multi_thread::worker::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:494:5 [INFO] [stdout] 37: tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:460:45 [INFO] [stdout] 38: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/task.rs:42:21 [INFO] [stdout] 39: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 40: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 41: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 42: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 43: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 44: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 45: __rust_try [INFO] [stdout] 46: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 47: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 48: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 49: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 50: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 51: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 52: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 53: tokio::runtime::task::UnownedTask::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:500:13 [INFO] [stdout] 54: tokio::runtime::blocking::pool::Task::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:161:19 [INFO] [stdout] 55: tokio::runtime::blocking::pool::Inner::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:511:22 [INFO] [stdout] 56: tokio::runtime::blocking::pool::Spawner::spawn_thread::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:469:47 [INFO] [stdout] 57: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 58: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 59: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 60: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 61: __rust_try [INFO] [stdout] 62: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 63: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 64: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 65: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 66: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 67: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 68: [INFO] [stdout] 69: clone [INFO] [stdout] 2025-08-31T10:31:46.987950Z ERROR p2p_raft::testing::network: crates/p2p-raft/src/testing/network.rs:75: simulated network partition [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error::::msg [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/backtrace.rs:27:14 [INFO] [stdout] 1: anyhow::__private::format_err [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/lib.rs:692:13 [INFO] [stdout] 2: p2p_raft::testing::router::RouterNode::route::{{closure}} [INFO] [stdout] at ./src/testing/router.rs:195:28 [INFO] [stdout] 3: >::append_entries::{{closure}} [INFO] [stdout] at ./src/testing/network.rs:71:14 [INFO] [stdout] 4: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/time/timeout.rs:202:42 [INFO] [stdout] 5: openraft::core::heartbeat::worker::HeartbeatWorker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/core/heartbeat/worker.rs:91:89 [INFO] [stdout] 6: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tracing-0.1.41/src/instrument.rs:321:15 [INFO] [stdout] 7: as core::future::future::Future>::poll [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/future/future.rs:133:9 [INFO] [stdout] 8: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 9: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 10: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 11: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 12: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 13: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 14: __rust_try [INFO] [stdout] 15: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 16: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 17: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 18: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 19: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 20: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 21: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 22: tokio::runtime::task::LocalNotified::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:463:13 [INFO] [stdout] 23: tokio::runtime::scheduler::multi_thread::worker::Context::run_task::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:600:18 [INFO] [stdout] 24: tokio::task::coop::with_budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:167:5 [INFO] [stdout] 25: tokio::task::coop::budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:133:5 [INFO] [stdout] 26: tokio::runtime::scheduler::multi_thread::worker::Context::run_task [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:594:9 [INFO] [stdout] 27: tokio::runtime::scheduler::multi_thread::worker::Context::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:542:29 [INFO] [stdout] 28: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:507:24 [INFO] [stdout] 29: tokio::runtime::context::scoped::Scoped::set [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/scoped.rs:40:9 [INFO] [stdout] 30: tokio::runtime::context::set_scheduler::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:38 [INFO] [stdout] 31: std::thread::local::LocalKey::try_with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:315:12 [INFO] [stdout] 32: std::thread::local::LocalKey::with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:279:20 [INFO] [stdout] 33: tokio::runtime::context::set_scheduler [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:17 [INFO] [stdout] 34: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:502:9 [INFO] [stdout] 35: tokio::runtime::context::runtime::enter_runtime [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/runtime.rs:65:16 [INFO] [stdout] 36: tokio::runtime::scheduler::multi_thread::worker::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:494:5 [INFO] [stdout] 37: tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:460:45 [INFO] [stdout] 38: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/task.rs:42:21 [INFO] [stdout] 39: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 40: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 41: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 42: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 43: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 44: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 45: __rust_try [INFO] [stdout] 46: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 47: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 48: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 49: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 50: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 51: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 52: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 53: tokio::runtime::task::UnownedTask::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:500:13 [INFO] [stdout] 54: tokio::runtime::blocking::pool::Task::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:161:19 [INFO] [stdout] 55: tokio::runtime::blocking::pool::Inner::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:511:22 [INFO] [stdout] 56: tokio::runtime::blocking::pool::Spawner::spawn_thread::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:469:47 [INFO] [stdout] 57: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 58: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 59: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 60: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 61: __rust_try [INFO] [stdout] 62: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 63: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 64: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 65: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 66: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 67: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 68: [INFO] [stdout] 69: clone [INFO] [stdout] 2025-08-31T10:31:47.063925Z ERROR p2p_raft::testing::network: crates/p2p-raft/src/testing/network.rs:75: simulated network partition [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error::::msg [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/backtrace.rs:27:14 [INFO] [stdout] 1: anyhow::__private::format_err [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/lib.rs:692:13 [INFO] [stdout] 2: p2p_raft::testing::router::RouterNode::route::{{closure}} [INFO] [stdout] at ./src/testing/router.rs:195:28 [INFO] [stdout] 3: >::append_entries::{{closure}} [INFO] [stdout] at ./src/testing/network.rs:71:14 [INFO] [stdout] 4: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/time/timeout.rs:202:42 [INFO] [stdout] 5: openraft::core::heartbeat::worker::HeartbeatWorker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/core/heartbeat/worker.rs:91:89 [INFO] [stdout] 6: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tracing-0.1.41/src/instrument.rs:321:15 [INFO] [stdout] 7: as core::future::future::Future>::poll [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/future/future.rs:133:9 [INFO] [stdout] 8: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 9: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 10: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 11: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 12: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 13: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 14: __rust_try [INFO] [stdout] 15: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 16: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 17: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 18: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 19: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 20: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 21: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 22: tokio::runtime::task::LocalNotified::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:463:13 [INFO] [stdout] 23: tokio::runtime::scheduler::multi_thread::worker::Context::run_task::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:600:18 [INFO] [stdout] 24: tokio::task::coop::with_budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:167:5 [INFO] [stdout] 25: tokio::task::coop::budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:133:5 [INFO] [stdout] 26: tokio::runtime::scheduler::multi_thread::worker::Context::run_task [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:594:9 [INFO] [stdout] 27: tokio::runtime::scheduler::multi_thread::worker::Context::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:542:29 [INFO] [stdout] 28: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:507:24 [INFO] [stdout] 29: tokio::runtime::context::scoped::Scoped::set [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/scoped.rs:40:9 [INFO] [stdout] 30: tokio::runtime::context::set_scheduler::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:38 [INFO] [stdout] 31: std::thread::local::LocalKey::try_with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:315:12 [INFO] [stdout] 32: std::thread::local::LocalKey::with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:279:20 [INFO] [stdout] 33: tokio::runtime::context::set_scheduler [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:17 [INFO] [stdout] 34: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:502:9 [INFO] [stdout] 35: tokio::runtime::context::runtime::enter_runtime [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/runtime.rs:65:16 [INFO] [stdout] 36: tokio::runtime::scheduler::multi_thread::worker::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:494:5 [INFO] [stdout] 37: tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:460:45 [INFO] [stdout] 38: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/task.rs:42:21 [INFO] [stdout] 39: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 40: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 41: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 42: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 43: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 44: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 45: __rust_try [INFO] [stdout] 46: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 47: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 48: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 49: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 50: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 51: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 52: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 53: tokio::runtime::task::UnownedTask::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:500:13 [INFO] [stdout] 54: tokio::runtime::blocking::pool::Task::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:161:19 [INFO] [stdout] 55: tokio::runtime::blocking::pool::Inner::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:511:22 [INFO] [stdout] 56: tokio::runtime::blocking::pool::Spawner::spawn_thread::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:469:47 [INFO] [stdout] 57: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 58: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 59: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 60: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 61: __rust_try [INFO] [stdout] 62: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 63: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 64: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 65: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 66: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 67: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 68: [INFO] [stdout] 69: clone [INFO] [stdout] 2025-08-31T10:31:47.114603Z ERROR p2p_raft::testing::network: crates/p2p-raft/src/testing/network.rs:75: simulated network partition [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error::::msg [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/backtrace.rs:27:14 [INFO] [stdout] 1: anyhow::__private::format_err [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/lib.rs:692:13 [INFO] [stdout] 2: p2p_raft::testing::router::RouterNode::route::{{closure}} [INFO] [stdout] at ./src/testing/router.rs:195:28 [INFO] [stdout] 3: >::append_entries::{{closure}} [INFO] [stdout] at ./src/testing/network.rs:71:14 [INFO] [stdout] 4: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/time/timeout.rs:202:42 [INFO] [stdout] 5: openraft::replication::ReplicationCore::send_log_entries::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/replication/mod.rs:439:89 [INFO] [stdout] 6: openraft::replication::ReplicationCore::send_log_entries::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/replication/mod.rs:368:5 [INFO] [stdout] 7: openraft::replication::ReplicationCore::main::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/replication/mod.rs:240:54 [INFO] [stdout] 8: openraft::replication::ReplicationCore::main::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/replication/mod.rs:212:5 [INFO] [stdout] 9: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tracing-futures-0.2.5/src/lib.rs:283:20 [INFO] [stdout] 10: as core::future::future::Future>::poll [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/future/future.rs:133:9 [INFO] [stdout] 11: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 12: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 13: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 14: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 15: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 16: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 17: __rust_try [INFO] [stdout] 18: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 19: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 20: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 21: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 22: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 23: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 24: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 25: tokio::runtime::task::LocalNotified::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:463:13 [INFO] [stdout] 26: tokio::runtime::scheduler::multi_thread::worker::Context::run_task::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:600:18 [INFO] [stdout] 27: tokio::task::coop::with_budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:167:5 [INFO] [stdout] 28: tokio::task::coop::budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:133:5 [INFO] [stdout] 29: tokio::runtime::scheduler::multi_thread::worker::Context::run_task [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:594:9 [INFO] [stdout] 30: tokio::runtime::scheduler::multi_thread::worker::Context::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:542:29 [INFO] [stdout] 31: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:507:24 [INFO] [stdout] 32: tokio::runtime::context::scoped::Scoped::set [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/scoped.rs:40:9 [INFO] [stdout] 33: tokio::runtime::context::set_scheduler::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:38 [INFO] [stdout] 34: std::thread::local::LocalKey::try_with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:315:12 [INFO] [stdout] 35: std::thread::local::LocalKey::with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:279:20 [INFO] [stdout] 36: tokio::runtime::context::set_scheduler [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:17 [INFO] [stdout] 37: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:502:9 [INFO] [stdout] 38: tokio::runtime::context::runtime::enter_runtime [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/runtime.rs:65:16 [INFO] [stdout] 39: tokio::runtime::scheduler::multi_thread::worker::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:494:5 [INFO] [stdout] 40: tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:460:45 [INFO] [stdout] 41: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/task.rs:42:21 [INFO] [stdout] 42: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 43: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 44: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 45: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 46: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 47: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 48: __rust_try [INFO] [stdout] 49: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 50: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 51: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 52: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 53: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 54: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 55: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 56: tokio::runtime::task::UnownedTask::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:500:13 [INFO] [stdout] 57: tokio::runtime::blocking::pool::Task::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:161:19 [INFO] [stdout] 58: tokio::runtime::blocking::pool::Inner::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:511:22 [INFO] [stdout] 59: tokio::runtime::blocking::pool::Spawner::spawn_thread::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:469:47 [INFO] [stdout] 60: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 61: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 62: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 63: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 64: __rust_try [INFO] [stdout] 65: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 66: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 67: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 68: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 69: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 70: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 71: [INFO] [stdout] 72: clone [INFO] [stdout] 2025-08-31T10:31:47.140707Z ERROR p2p_raft::testing::network: crates/p2p-raft/src/testing/network.rs:75: simulated network partition [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error::::msg [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/backtrace.rs:27:14 [INFO] [stdout] 1: anyhow::__private::format_err [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/lib.rs:692:13 [INFO] [stdout] 2: p2p_raft::testing::router::RouterNode::route::{{closure}} [INFO] [stdout] at ./src/testing/router.rs:195:28 [INFO] [stdout] 3: >::append_entries::{{closure}} [INFO] [stdout] at ./src/testing/network.rs:71:14 [INFO] [stdout] 4: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/time/timeout.rs:202:42 [INFO] [stdout] 5: openraft::core::heartbeat::worker::HeartbeatWorker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/core/heartbeat/worker.rs:91:89 [INFO] [stdout] 6: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tracing-0.1.41/src/instrument.rs:321:15 [INFO] [stdout] 7: as core::future::future::Future>::poll [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/future/future.rs:133:9 [INFO] [stdout] 8: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 9: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 10: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 11: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 12: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 13: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 14: __rust_try [INFO] [stdout] 15: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 16: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 17: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 18: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 19: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 20: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 21: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 22: tokio::runtime::task::LocalNotified::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:463:13 [INFO] [stdout] 23: tokio::runtime::scheduler::multi_thread::worker::Context::run_task::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:600:18 [INFO] [stdout] 24: tokio::task::coop::with_budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:167:5 [INFO] [stdout] 25: tokio::task::coop::budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:133:5 [INFO] [stdout] 26: tokio::runtime::scheduler::multi_thread::worker::Context::run_task [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:594:9 [INFO] [stdout] 27: tokio::runtime::scheduler::multi_thread::worker::Context::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:542:29 [INFO] [stdout] 28: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:507:24 [INFO] [stdout] 29: tokio::runtime::context::scoped::Scoped::set [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/scoped.rs:40:9 [INFO] [stdout] 30: tokio::runtime::context::set_scheduler::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:38 [INFO] [stdout] 31: std::thread::local::LocalKey::try_with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:315:12 [INFO] [stdout] 32: std::thread::local::LocalKey::with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:279:20 [INFO] [stdout] 33: tokio::runtime::context::set_scheduler [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:17 [INFO] [stdout] 34: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:502:9 [INFO] [stdout] 35: tokio::runtime::context::runtime::enter_runtime [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/runtime.rs:65:16 [INFO] [stdout] 36: tokio::runtime::scheduler::multi_thread::worker::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:494:5 [INFO] [stdout] 37: tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:460:45 [INFO] [stdout] 38: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/task.rs:42:21 [INFO] [stdout] 39: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 40: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 41: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 42: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 43: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 44: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 45: __rust_try [INFO] [stdout] 46: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 47: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 48: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 49: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 50: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 51: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 52: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 53: tokio::runtime::task::UnownedTask::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:500:13 [INFO] [stdout] 54: tokio::runtime::blocking::pool::Task::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:161:19 [INFO] [stdout] 55: tokio::runtime::blocking::pool::Inner::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:511:22 [INFO] [stdout] 56: tokio::runtime::blocking::pool::Spawner::spawn_thread::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:469:47 [INFO] [stdout] 57: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 58: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 59: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 60: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 61: __rust_try [INFO] [stdout] 62: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 63: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 64: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 65: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 66: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 67: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 68: [INFO] [stdout] 69: clone [INFO] [stdout] 2025-08-31T10:31:47.217532Z ERROR p2p_raft::testing::network: crates/p2p-raft/src/testing/network.rs:75: simulated network partition [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error::::msg [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/backtrace.rs:27:14 [INFO] [stdout] 1: anyhow::__private::format_err [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/lib.rs:692:13 [INFO] [stdout] 2: p2p_raft::testing::router::RouterNode::route::{{closure}} [INFO] [stdout] at ./src/testing/router.rs:195:28 [INFO] [stdout] 3: >::append_entries::{{closure}} [INFO] [stdout] at ./src/testing/network.rs:71:14 [INFO] [stdout] 4: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/time/timeout.rs:202:42 [INFO] [stdout] 5: openraft::core::heartbeat::worker::HeartbeatWorker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/core/heartbeat/worker.rs:91:89 [INFO] [stdout] 6: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tracing-0.1.41/src/instrument.rs:321:15 [INFO] [stdout] 7: as core::future::future::Future>::poll [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/future/future.rs:133:9 [INFO] [stdout] 8: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 9: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 10: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 11: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 12: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 13: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 14: __rust_try [INFO] [stdout] 15: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 16: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 17: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 18: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 19: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 20: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 21: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 22: tokio::runtime::task::LocalNotified::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:463:13 [INFO] [stdout] 23: tokio::runtime::scheduler::multi_thread::worker::Context::run_task::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:600:18 [INFO] [stdout] 24: tokio::task::coop::with_budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:167:5 [INFO] [stdout] 25: tokio::task::coop::budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:133:5 [INFO] [stdout] 26: tokio::runtime::scheduler::multi_thread::worker::Context::run_task [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:594:9 [INFO] [stdout] 27: tokio::runtime::scheduler::multi_thread::worker::Context::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:542:29 [INFO] [stdout] 28: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:507:24 [INFO] [stdout] 29: tokio::runtime::context::scoped::Scoped::set [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/scoped.rs:40:9 [INFO] [stdout] 30: tokio::runtime::context::set_scheduler::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:38 [INFO] [stdout] 31: std::thread::local::LocalKey::try_with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:315:12 [INFO] [stdout] 32: std::thread::local::LocalKey::with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:279:20 [INFO] [stdout] 33: tokio::runtime::context::set_scheduler [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:17 [INFO] [stdout] 34: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:502:9 [INFO] [stdout] 35: tokio::runtime::context::runtime::enter_runtime [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/runtime.rs:65:16 [INFO] [stdout] 36: tokio::runtime::scheduler::multi_thread::worker::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:494:5 [INFO] [stdout] 37: tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:460:45 [INFO] [stdout] 38: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/task.rs:42:21 [INFO] [stdout] 39: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 40: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 41: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 42: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 43: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 44: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 45: __rust_try [INFO] [stdout] 46: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 47: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 48: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 49: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 50: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 51: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 52: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 53: tokio::runtime::task::UnownedTask::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:500:13 [INFO] [stdout] 54: tokio::runtime::blocking::pool::Task::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:161:19 [INFO] [stdout] 55: tokio::runtime::blocking::pool::Inner::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:511:22 [INFO] [stdout] 56: tokio::runtime::blocking::pool::Spawner::spawn_thread::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:469:47 [INFO] [stdout] 57: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 58: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 59: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 60: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 61: __rust_try [INFO] [stdout] 62: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 63: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 64: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 65: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 66: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 67: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 68: [INFO] [stdout] 69: clone [INFO] [stdout] 2025-08-31T10:31:47.221326Z ERROR p2p_raft::testing::network: crates/p2p-raft/src/testing/network.rs:75: simulated network partition [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error::::msg [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/backtrace.rs:27:14 [INFO] [stdout] 1: anyhow::__private::format_err [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/lib.rs:692:13 [INFO] [stdout] 2: p2p_raft::testing::router::RouterNode::route::{{closure}} [INFO] [stdout] at ./src/testing/router.rs:195:28 [INFO] [stdout] 3: >::append_entries::{{closure}} [INFO] [stdout] at ./src/testing/network.rs:71:14 [INFO] [stdout] 4: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/time/timeout.rs:202:42 [INFO] [stdout] 5: openraft::replication::ReplicationCore::send_log_entries::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/replication/mod.rs:439:89 [INFO] [stdout] 6: openraft::replication::ReplicationCore::send_log_entries::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/replication/mod.rs:368:5 [INFO] [stdout] 7: openraft::replication::ReplicationCore::main::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/replication/mod.rs:240:54 [INFO] [stdout] 8: openraft::replication::ReplicationCore::main::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/replication/mod.rs:212:5 [INFO] [stdout] 9: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tracing-futures-0.2.5/src/lib.rs:283:20 [INFO] [stdout] 10: as core::future::future::Future>::poll [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/future/future.rs:133:9 [INFO] [stdout] 11: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 12: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 13: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 14: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 15: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 16: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 17: __rust_try [INFO] [stdout] 18: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 19: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 20: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 21: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 22: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 23: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 24: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 25: tokio::runtime::task::LocalNotified::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:463:13 [INFO] [stdout] 26: tokio::runtime::scheduler::multi_thread::worker::Context::run_task::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:600:18 [INFO] [stdout] 27: tokio::task::coop::with_budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:167:5 [INFO] [stdout] 28: tokio::task::coop::budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:133:5 [INFO] [stdout] 29: tokio::runtime::scheduler::multi_thread::worker::Context::run_task [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:594:9 [INFO] [stdout] 30: tokio::runtime::scheduler::multi_thread::worker::Context::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:542:29 [INFO] [stdout] 31: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:507:24 [INFO] [stdout] 32: tokio::runtime::context::scoped::Scoped::set [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/scoped.rs:40:9 [INFO] [stdout] 33: tokio::runtime::context::set_scheduler::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:38 [INFO] [stdout] 34: std::thread::local::LocalKey::try_with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:315:12 [INFO] [stdout] 35: std::thread::local::LocalKey::with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:279:20 [INFO] [stdout] 36: tokio::runtime::context::set_scheduler [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:17 [INFO] [stdout] 37: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:502:9 [INFO] [stdout] 38: tokio::runtime::context::runtime::enter_runtime [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/runtime.rs:65:16 [INFO] [stdout] 39: tokio::runtime::scheduler::multi_thread::worker::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:494:5 [INFO] [stdout] 40: tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:460:45 [INFO] [stdout] 41: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/task.rs:42:21 [INFO] [stdout] 42: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 43: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 44: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 45: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 46: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 47: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 48: __rust_try [INFO] [stdout] 49: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 50: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 51: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 52: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 53: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 54: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 55: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 56: tokio::runtime::task::UnownedTask::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:500:13 [INFO] [stdout] 57: tokio::runtime::blocking::pool::Task::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:161:19 [INFO] [stdout] 58: tokio::runtime::blocking::pool::Inner::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:511:22 [INFO] [stdout] 59: tokio::runtime::blocking::pool::Spawner::spawn_thread::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:469:47 [INFO] [stdout] 60: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 61: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 62: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 63: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 64: __rust_try [INFO] [stdout] 65: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 66: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 67: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 68: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 69: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 70: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 71: [INFO] [stdout] 72: clone [INFO] [stdout] 2025-08-31T10:31:47.221896Z ERROR p2p_raft::testing::network: crates/p2p-raft/src/testing/network.rs:75: simulated network partition [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error::::msg [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/backtrace.rs:27:14 [INFO] [stdout] 1: anyhow::__private::format_err [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/lib.rs:692:13 [INFO] [stdout] 2: p2p_raft::testing::router::RouterNode::route::{{closure}} [INFO] [stdout] at ./src/testing/router.rs:195:28 [INFO] [stdout] 3: >::append_entries::{{closure}} [INFO] [stdout] at ./src/testing/network.rs:71:14 [INFO] [stdout] 4: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/time/timeout.rs:202:42 [INFO] [stdout] 5: openraft::core::heartbeat::worker::HeartbeatWorker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/core/heartbeat/worker.rs:91:89 [INFO] [stdout] 6: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tracing-0.1.41/src/instrument.rs:321:15 [INFO] [stdout] 7: as core::future::future::Future>::poll [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/future/future.rs:133:9 [INFO] [stdout] 8: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 9: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 10: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 11: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 12: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 13: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 14: __rust_try [INFO] [stdout] 15: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 16: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 17: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 18: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 19: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 20: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 21: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 22: tokio::runtime::task::LocalNotified::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:463:13 [INFO] [stdout] 23: tokio::runtime::scheduler::multi_thread::worker::Context::run_task::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:600:18 [INFO] [stdout] 24: tokio::task::coop::with_budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:167:5 [INFO] [stdout] 25: tokio::task::coop::budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:133:5 [INFO] [stdout] 26: tokio::runtime::scheduler::multi_thread::worker::Context::run_task [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:594:9 [INFO] [stdout] 27: tokio::runtime::scheduler::multi_thread::worker::Context::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:554:29 [INFO] [stdout] 28: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:507:24 [INFO] [stdout] 29: tokio::runtime::context::scoped::Scoped::set [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/scoped.rs:40:9 [INFO] [stdout] 30: tokio::runtime::context::set_scheduler::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:38 [INFO] [stdout] 31: std::thread::local::LocalKey::try_with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:315:12 [INFO] [stdout] 32: std::thread::local::LocalKey::with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:279:20 [INFO] [stdout] 33: tokio::runtime::context::set_scheduler [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:17 [INFO] [stdout] 34: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:502:9 [INFO] [stdout] 35: tokio::runtime::context::runtime::enter_runtime [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/runtime.rs:65:16 [INFO] [stdout] 36: tokio::runtime::scheduler::multi_thread::worker::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:494:5 [INFO] [stdout] 37: tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:460:45 [INFO] [stdout] 38: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/task.rs:42:21 [INFO] [stdout] 39: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 40: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 41: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 42: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 43: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 44: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 45: __rust_try [INFO] [stdout] 46: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 47: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 48: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 49: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 50: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 51: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 52: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 53: tokio::runtime::task::UnownedTask::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:500:13 [INFO] [stdout] 54: tokio::runtime::blocking::pool::Task::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:161:19 [INFO] [stdout] 55: tokio::runtime::blocking::pool::Inner::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:511:22 [INFO] [stdout] 56: tokio::runtime::blocking::pool::Spawner::spawn_thread::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:469:47 [INFO] [stdout] 57: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 58: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 59: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 60: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 61: __rust_try [INFO] [stdout] 62: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 63: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 64: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 65: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 66: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 67: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 68: [INFO] [stdout] 69: clone [INFO] [stdout] 2025-08-31T10:31:47.294650Z ERROR p2p_raft::testing::network: crates/p2p-raft/src/testing/network.rs:75: simulated network partition [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error::::msg [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/backtrace.rs:27:14 [INFO] [stdout] 1: anyhow::__private::format_err [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/lib.rs:692:13 [INFO] [stdout] 2: p2p_raft::testing::router::RouterNode::route::{{closure}} [INFO] [stdout] at ./src/testing/router.rs:195:28 [INFO] [stdout] 3: >::append_entries::{{closure}} [INFO] [stdout] at ./src/testing/network.rs:71:14 [INFO] [stdout] 4: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/time/timeout.rs:202:42 [INFO] [stdout] 5: openraft::core::heartbeat::worker::HeartbeatWorker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/core/heartbeat/worker.rs:91:89 [INFO] [stdout] 6: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tracing-0.1.41/src/instrument.rs:321:15 [INFO] [stdout] 7: as core::future::future::Future>::poll [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/future/future.rs:133:9 [INFO] [stdout] 8: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 9: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 10: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 11: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 12: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 13: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 14: __rust_try [INFO] [stdout] 15: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 16: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 17: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 18: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 19: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 20: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 21: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 22: tokio::runtime::task::LocalNotified::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:463:13 [INFO] [stdout] 23: tokio::runtime::scheduler::multi_thread::worker::Context::run_task::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:600:18 [INFO] [stdout] 24: tokio::task::coop::with_budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:167:5 [INFO] [stdout] 25: tokio::task::coop::budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:133:5 [INFO] [stdout] 26: tokio::runtime::scheduler::multi_thread::worker::Context::run_task [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:594:9 [INFO] [stdout] 27: tokio::runtime::scheduler::multi_thread::worker::Context::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:542:29 [INFO] [stdout] 28: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:507:24 [INFO] [stdout] 29: tokio::runtime::context::scoped::Scoped::set [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/scoped.rs:40:9 [INFO] [stdout] 30: tokio::runtime::context::set_scheduler::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:38 [INFO] [stdout] 31: std::thread::local::LocalKey::try_with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:315:12 [INFO] [stdout] 32: std::thread::local::LocalKey::with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:279:20 [INFO] [stdout] 33: tokio::runtime::context::set_scheduler [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:17 [INFO] [stdout] 34: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:502:9 [INFO] [stdout] 35: tokio::runtime::context::runtime::enter_runtime [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/runtime.rs:65:16 [INFO] [stdout] 36: tokio::runtime::scheduler::multi_thread::worker::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:494:5 [INFO] [stdout] 37: tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:460:45 [INFO] [stdout] 38: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/task.rs:42:21 [INFO] [stdout] 39: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 40: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 41: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 42: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 43: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 44: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 45: __rust_try [INFO] [stdout] 46: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 47: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 48: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 49: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 50: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 51: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 52: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 53: tokio::runtime::task::UnownedTask::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:500:13 [INFO] [stdout] 54: tokio::runtime::blocking::pool::Task::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:161:19 [INFO] [stdout] 55: tokio::runtime::blocking::pool::Inner::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:511:22 [INFO] [stdout] 56: tokio::runtime::blocking::pool::Spawner::spawn_thread::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:469:47 [INFO] [stdout] 57: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 58: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 59: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 60: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 61: __rust_try [INFO] [stdout] 62: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 63: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 64: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 65: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 66: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 67: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 68: [INFO] [stdout] 69: clone [INFO] [stdout] 2025-08-31T10:31:47.297195Z ERROR p2p_raft::testing::network: crates/p2p-raft/src/testing/network.rs:123: simulated network partition [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error::::msg [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/backtrace.rs:27:14 [INFO] [stdout] 1: anyhow::__private::format_err [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/lib.rs:692:13 [INFO] [stdout] 2: p2p_raft::testing::router::RouterNode::route::{{closure}} [INFO] [stdout] at ./src/testing/router.rs:195:28 [INFO] [stdout] 3: >::vote::{{closure}} [INFO] [stdout] at ./src/testing/network.rs:119:14 [INFO] [stdout] 4: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/time/timeout.rs:202:42 [INFO] [stdout] 5: openraft::core::raft_core::RaftCore::spawn_parallel_vote_requests::{{closure}}::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/core/raft_core.rs:1037:80 [INFO] [stdout] 6: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tracing-0.1.41/src/instrument.rs:321:15 [INFO] [stdout] 7: as core::future::future::Future>::poll [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/future/future.rs:133:9 [INFO] [stdout] 8: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 9: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 10: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 11: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 12: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 13: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 14: __rust_try [INFO] [stdout] 15: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 16: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 17: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 18: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 19: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 20: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 21: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 22: tokio::runtime::task::LocalNotified::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:463:13 [INFO] [stdout] 23: tokio::runtime::scheduler::multi_thread::worker::Context::run_task::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:600:18 [INFO] [stdout] 24: tokio::task::coop::with_budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:167:5 [INFO] [stdout] 25: tokio::task::coop::budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:133:5 [INFO] [stdout] 26: tokio::runtime::scheduler::multi_thread::worker::Context::run_task [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:594:9 [INFO] [stdout] 27: tokio::runtime::scheduler::multi_thread::worker::Context::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:542:29 [INFO] [stdout] 28: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:507:24 [INFO] [stdout] 29: tokio::runtime::context::scoped::Scoped::set [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/scoped.rs:40:9 [INFO] [stdout] 30: tokio::runtime::context::set_scheduler::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:38 [INFO] [stdout] 31: std::thread::local::LocalKey::try_with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:315:12 [INFO] [stdout] 32: std::thread::local::LocalKey::with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:279:20 [INFO] [stdout] 33: tokio::runtime::context::set_scheduler [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:17 [INFO] [stdout] 34: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:502:9 [INFO] [stdout] 35: tokio::runtime::context::runtime::enter_runtime [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/runtime.rs:65:16 [INFO] [stdout] 36: tokio::runtime::scheduler::multi_thread::worker::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:494:5 [INFO] [stdout] 37: tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:460:45 [INFO] [stdout] 38: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/task.rs:42:21 [INFO] [stdout] 39: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 40: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 41: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 42: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 43: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 44: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 45: __rust_try [INFO] [stdout] 46: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 47: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 48: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 49: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 50: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 51: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 52: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 53: tokio::runtime::task::UnownedTask::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:500:13 [INFO] [stdout] 54: tokio::runtime::blocking::pool::Task::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:161:19 [INFO] [stdout] 55: tokio::runtime::blocking::pool::Inner::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:511:22 [INFO] [stdout] 56: tokio::runtime::blocking::pool::Spawner::spawn_thread::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:469:47 [INFO] [stdout] 57: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 58: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 59: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 60: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 61: __rust_try [INFO] [stdout] 62: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 63: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 64: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 65: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 66: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 67: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 68: [INFO] [stdout] 69: clone [INFO] [stdout] 2025-08-31T10:31:47.300978Z ERROR p2p_raft::testing::network: crates/p2p-raft/src/testing/network.rs:123: simulated network partition [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error::::msg [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/backtrace.rs:27:14 [INFO] [stdout] 1: anyhow::__private::format_err [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/lib.rs:692:13 [INFO] [stdout] 2: p2p_raft::testing::router::RouterNode::route::{{closure}} [INFO] [stdout] at ./src/testing/router.rs:195:28 [INFO] [stdout] 3: >::vote::{{closure}} [INFO] [stdout] at ./src/testing/network.rs:119:14 [INFO] [stdout] 4: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/time/timeout.rs:202:42 [INFO] [stdout] 5: openraft::core::raft_core::RaftCore::spawn_parallel_vote_requests::{{closure}}::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/core/raft_core.rs:1037:80 [INFO] [stdout] 6: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tracing-0.1.41/src/instrument.rs:321:15 [INFO] [stdout] 7: as core::future::future::Future>::poll [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/future/future.rs:133:9 [INFO] [stdout] 8: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 9: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 10: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 11: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 12: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 13: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 14: __rust_try [INFO] [stdout] 15: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 16: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 17: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 18: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 19: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 20: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 21: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 22: tokio::runtime::task::LocalNotified::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:463:13 [INFO] [stdout] 23: tokio::runtime::scheduler::multi_thread::worker::Context::run_task::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:600:18 [INFO] [stdout] 24: tokio::task::coop::with_budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:167:5 [INFO] [stdout] 25: tokio::task::coop::budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:133:5 [INFO] [stdout] 26: tokio::runtime::scheduler::multi_thread::worker::Context::run_task [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:594:9 [INFO] [stdout] 27: tokio::runtime::scheduler::multi_thread::worker::Context::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:554:29 [INFO] [stdout] 28: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:507:24 [INFO] [stdout] 29: tokio::runtime::context::scoped::Scoped::set [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/scoped.rs:40:9 [INFO] [stdout] 30: tokio::runtime::context::set_scheduler::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:38 [INFO] [stdout] 31: std::thread::local::LocalKey::try_with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:315:12 [INFO] [stdout] 32: std::thread::local::LocalKey::with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:279:20 [INFO] [stdout] 33: tokio::runtime::context::set_scheduler [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:17 [INFO] [stdout] 34: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:502:9 [INFO] [stdout] 35: tokio::runtime::context::runtime::enter_runtime [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/runtime.rs:65:16 [INFO] [stdout] 36: tokio::runtime::scheduler::multi_thread::worker::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:494:5 [INFO] [stdout] 37: tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:460:45 [INFO] [stdout] 38: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/task.rs:42:21 [INFO] [stdout] 39: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 40: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 41: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 42: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 43: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 44: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 45: __rust_try [INFO] [stdout] 46: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 47: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 48: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 49: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 50: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 51: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 52: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 53: tokio::runtime::task::UnownedTask::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:500:13 [INFO] [stdout] 54: tokio::runtime::blocking::pool::Task::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:161:19 [INFO] [stdout] 55: tokio::runtime::blocking::pool::Inner::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:511:22 [INFO] [stdout] 56: tokio::runtime::blocking::pool::Spawner::spawn_thread::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:469:47 [INFO] [stdout] 57: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 58: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 59: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 60: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 61: __rust_try [INFO] [stdout] 62: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 63: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 64: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 65: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 66: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 67: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 68: [INFO] [stdout] 69: clone [INFO] [stdout] 2025-08-31T10:31:47.297315Z ERROR p2p_raft::testing::network: crates/p2p-raft/src/testing/network.rs:123: simulated network partition [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error::::msg [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/backtrace.rs:27:14 [INFO] [stdout] 1: anyhow::__private::format_err [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.97/src/lib.rs:692:13 [INFO] [stdout] 2: p2p_raft::testing::router::RouterNode::route::{{closure}} [INFO] [stdout] at ./src/testing/router.rs:195:28 [INFO] [stdout] 3: >::vote::{{closure}} [INFO] [stdout] at ./src/testing/network.rs:119:14 [INFO] [stdout] 4: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/time/timeout.rs:202:42 [INFO] [stdout] 5: openraft::core::raft_core::RaftCore::spawn_parallel_vote_requests::{{closure}}::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/git/checkouts/openraft-43a4ed3c0fbb0185/bfb27ec/openraft/src/core/raft_core.rs:1037:80 [INFO] [stdout] 6: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tracing-0.1.41/src/instrument.rs:321:15 [INFO] [stdout] 7: as core::future::future::Future>::poll [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/future/future.rs:133:9 [INFO] [stdout] 8: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 9: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 10: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 11: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 12: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 13: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 14: __rust_try [INFO] [stdout] 15: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 16: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 17: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 18: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 19: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 20: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 21: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 22: tokio::runtime::task::LocalNotified::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:463:13 [INFO] [stdout] 23: tokio::runtime::scheduler::multi_thread::worker::Context::run_task::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:600:18 [INFO] [stdout] 24: tokio::task::coop::with_budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:167:5 [INFO] [stdout] 25: tokio::task::coop::budget [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/task/coop/mod.rs:133:5 [INFO] [stdout] 26: tokio::runtime::scheduler::multi_thread::worker::Context::run_task [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:594:9 [INFO] [stdout] 27: tokio::runtime::scheduler::multi_thread::worker::Context::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:554:29 [INFO] [stdout] 28: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:507:24 [INFO] [stdout] 29: tokio::runtime::context::scoped::Scoped::set [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/scoped.rs:40:9 [INFO] [stdout] 30: tokio::runtime::context::set_scheduler::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:38 [INFO] [stdout] 31: std::thread::local::LocalKey::try_with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:315:12 [INFO] [stdout] 32: std::thread::local::LocalKey::with [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/local.rs:279:20 [INFO] [stdout] 33: tokio::runtime::context::set_scheduler [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context.rs:180:17 [INFO] [stdout] 34: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:502:9 [INFO] [stdout] 35: tokio::runtime::context::runtime::enter_runtime [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/context/runtime.rs:65:16 [INFO] [stdout] 36: tokio::runtime::scheduler::multi_thread::worker::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:494:5 [INFO] [stdout] 37: tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/scheduler/multi_thread/worker.rs:460:45 [INFO] [stdout] 38: as core::future::future::Future>::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/task.rs:42:21 [INFO] [stdout] 39: tokio::runtime::task::core::Core::poll::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:331:24 [INFO] [stdout] 40: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/loom/std/unsafe_cell.rs:16:9 [INFO] [stdout] 41: tokio::runtime::task::core::Core::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/core.rs:320:30 [INFO] [stdout] 42: tokio::runtime::task::harness::poll_future::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:532:30 [INFO] [stdout] 43: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 44: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 45: __rust_try [INFO] [stdout] 46: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 47: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 48: tokio::runtime::task::harness::poll_future [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:520:18 [INFO] [stdout] 49: tokio::runtime::task::harness::Harness::poll_inner [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:209:27 [INFO] [stdout] 50: tokio::runtime::task::harness::Harness::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/harness.rs:154:20 [INFO] [stdout] 51: tokio::runtime::task::raw::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:271:13 [INFO] [stdout] 52: tokio::runtime::task::raw::RawTask::poll [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/raw.rs:201:18 [INFO] [stdout] 53: tokio::runtime::task::UnownedTask::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/task/mod.rs:500:13 [INFO] [stdout] 54: tokio::runtime::blocking::pool::Task::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:161:19 [INFO] [stdout] 55: tokio::runtime::blocking::pool::Inner::run [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:511:22 [INFO] [stdout] 56: tokio::runtime::blocking::pool::Spawner::spawn_thread::{{closure}} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.1/src/runtime/blocking/pool.rs:469:47 [INFO] [stdout] 57: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 58: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 59: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/panic/unwind_safe.rs:272:9 [INFO] [stdout] 60: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:590:40 [INFO] [stdout] 61: __rust_try [INFO] [stdout] 62: std::panicking::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panicking.rs:553:19 [INFO] [stdout] 63: std::panic::catch_unwind [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/panic.rs:359:14 [INFO] [stdout] 64: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 65: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 66: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 67: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/16fbf98f22730e073c09e7b03f0eafb87a295545/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 68: [INFO] [stdout] 69: clone [INFO] [stdout] test receive_signals ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 2.85s [INFO] [stdout] [INFO] [stderr] Running tests/snapshots.rs (/opt/rustwide/target/debug/deps/snapshots-38f5e1721e510bb8) [INFO] [stdout] [INFO] [stdout] running 1 test [INFO] [stdout] test test_snapshot ... ignored, waiting on resolution of https://github.com/databendlabs/openraft/issues/1333#issuecomment-2705359074 [INFO] [stdout] [INFO] [stdout] test result: ok. 0 passed; 0 failed; 1 ignored; 0 measured; 0 filtered out; finished in 0.00s [INFO] [stdout] [INFO] [stderr] Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/p2p_raft_memstore-2330b04d75063b63) [INFO] [stdout] [INFO] [stdout] running 0 tests [INFO] [stdout] [INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s [INFO] [stdout] [INFO] [stderr] Doc-tests p2p_raft [INFO] [stdout] [INFO] [stdout] running 0 tests [INFO] [stdout] [INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s [INFO] [stdout] [INFO] [stderr] Doc-tests p2p_raft_memstore [INFO] [stdout] [INFO] [stdout] running 0 tests [INFO] [stdout] [INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s [INFO] [stdout] [INFO] running `Command { std: "docker" "inspect" "da5eb1aa068a446eb086f3eef8b54eda5927bdb8e49ff4104e3b1a2c2ec96a52", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "da5eb1aa068a446eb086f3eef8b54eda5927bdb8e49ff4104e3b1a2c2ec96a52", kill_on_drop: false }` [INFO] [stdout] da5eb1aa068a446eb086f3eef8b54eda5927bdb8e49ff4104e3b1a2c2ec96a52