[INFO] cloning repository https://github.com/platy/raft
[INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/platy/raft" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fplaty%2Fraft", kill_on_drop: false }`
[INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fplaty%2Fraft'...
[INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }`
[INFO] [stdout] 435acea89117ed6cc90b70e2e3794d1bcba6cc56
[INFO] testing platy/raft against master#1ef7943ee607160a564655b6596f83670ef95df5 for pr-146098-6
[INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fplaty%2Fraft" "/workspace/builds/worker-4-tc1/source", kill_on_drop: false }`
[INFO] [stderr] Cloning into '/workspace/builds/worker-4-tc1/source'...
[INFO] [stderr] done.
[INFO] started tweaking git repo https://github.com/platy/raft
[INFO] finished tweaking git repo https://github.com/platy/raft
[INFO] tweaked toml for git repo https://github.com/platy/raft written to /workspace/builds/worker-4-tc1/source/Cargo.toml
[INFO] validating manifest of git repo https://github.com/platy/raft on toolchain 1ef7943ee607160a564655b6596f83670ef95df5
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1ef7943ee607160a564655b6596f83670ef95df5" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] crate git repo https://github.com/platy/raft already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1ef7943ee607160a564655b6596f83670ef95df5" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] [stderr]     Blocking waiting for file lock on package cache
[INFO] [stderr]     Updating crates.io index
[INFO] [stderr]     Blocking waiting for file lock on package cache
[INFO] [stderr]  Downloading crates ...
[INFO] [stderr]   Downloaded pin-project v0.4.22
[INFO] [stderr]   Downloaded instant v0.1.6
[INFO] [stderr]   Downloaded adler v0.2.3
[INFO] [stderr]   Downloaded actix-threadpool v0.3.3
[INFO] [stderr]   Downloaded resolv-conf v0.6.3
[INFO] [stderr]   Downloaded async-trait v0.1.36
[INFO] [stderr]   Downloaded widestring v0.4.2
[INFO] [stderr]   Downloaded miniz_oxide v0.4.0
[INFO] [stderr]   Downloaded derive_more v0.99.9
[INFO] [stderr]   Downloaded backtrace v0.3.50
[INFO] [stderr]   Downloaded crossbeam-channel v0.4.3
[INFO] [stderr]   Downloaded serde v1.0.114
[INFO] [stderr]   Downloaded syn v1.0.34
[INFO] [stderr]   Downloaded serde_derive v1.0.114
[INFO] [stderr]   Downloaded object v0.20.0
[INFO] [stderr]   Downloaded pin-project-internal v0.4.22
[INFO] [stderr]   Downloaded addr2line v0.13.0
[INFO] [stderr]   Downloaded smallvec v1.4.1
[INFO] [stderr]   Downloaded random-number-macro-impl v0.1.3
[INFO] [stderr]   Downloaded random-number v0.1.3
[INFO] [stderr]   Downloaded libc v0.2.73
[INFO] [stderr]   Downloaded gimli v0.22.0
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-4-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-4-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:4848fb76d95f26979359cc7e45710b1dbc8f3acb7aeedee7c460d7702230f228" "/opt/rustwide/cargo-home/bin/cargo" "+1ef7943ee607160a564655b6596f83670ef95df5" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] [stdout] 9e3f69032af6b35e6bb6c0e73b9256f6aa3d543f1f80af4904f3a61c3fa7a452
[INFO] running `Command { std: "docker" "start" "-a" "9e3f69032af6b35e6bb6c0e73b9256f6aa3d543f1f80af4904f3a61c3fa7a452", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "9e3f69032af6b35e6bb6c0e73b9256f6aa3d543f1f80af4904f3a61c3fa7a452", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "9e3f69032af6b35e6bb6c0e73b9256f6aa3d543f1f80af4904f3a61c3fa7a452", kill_on_drop: false }`
[INFO] [stdout] 9e3f69032af6b35e6bb6c0e73b9256f6aa3d543f1f80af4904f3a61c3fa7a452
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-4-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-4-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:4848fb76d95f26979359cc7e45710b1dbc8f3acb7aeedee7c460d7702230f228" "/opt/rustwide/cargo-home/bin/cargo" "+1ef7943ee607160a564655b6596f83670ef95df5" "build" "--frozen" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] b4839e6d5c38858af6ad043a3292e50ba6147db0f64e27b739c0dc20372776ee
[INFO] running `Command { std: "docker" "start" "-a" "b4839e6d5c38858af6ad043a3292e50ba6147db0f64e27b739c0dc20372776ee", kill_on_drop: false }`
[INFO] [stderr]    Compiling libc v0.2.73
[INFO] [stderr]    Compiling proc-macro2 v1.0.18
[INFO] [stderr]    Compiling unicode-xid v0.2.1
[INFO] [stderr]    Compiling syn v1.0.34
[INFO] [stderr]    Compiling memchr v2.3.3
[INFO] [stderr]    Compiling slab v0.4.2
[INFO] [stderr]    Compiling futures-core v0.3.5
[INFO] [stderr]    Compiling log v0.4.11
[INFO] [stderr]    Compiling pin-project-internal v0.4.22
[INFO] [stderr]    Compiling futures-sink v0.3.5
[INFO] [stderr]    Compiling proc-macro-hack v0.5.16
[INFO] [stderr]    Compiling smallvec v1.4.1
[INFO] [stderr]    Compiling proc-macro-nested v0.1.6
[INFO] [stderr]    Compiling once_cell v1.4.0
[INFO] [stderr]    Compiling futures-io v0.3.5
[INFO] [stderr]    Compiling arc-swap v0.4.7
[INFO] [stderr]    Compiling futures-channel v0.3.5
[INFO] [stderr]    Compiling futures-task v0.3.5
[INFO] [stderr]    Compiling tinyvec v0.3.3
[INFO] [stderr]    Compiling ppv-lite86 v0.2.8
[INFO] [stderr]    Compiling pin-project-lite v0.1.7
[INFO] [stderr]    Compiling unicode-bidi v0.3.4
[INFO] [stderr]    Compiling unicode-segmentation v1.6.0
[INFO] [stderr]    Compiling adler v0.2.3
[INFO] [stderr]    Compiling autocfg v1.0.0
[INFO] [stderr]    Compiling gimli v0.22.0
[INFO] [stderr]    Compiling instant v0.1.6
[INFO] [stderr]    Compiling miniz_oxide v0.4.0
[INFO] [stderr]    Compiling lock_api v0.4.1
[INFO] [stderr]    Compiling match_cfg v0.1.0
[INFO] [stderr]    Compiling heck v0.3.1
[INFO] [stderr]    Compiling object v0.20.0
[INFO] [stderr]    Compiling rustc-demangle v0.1.16
[INFO] [stderr]    Compiling serde_derive v1.0.114
[INFO] [stderr]    Compiling linked-hash-map v0.5.3
[INFO] [stderr]    Compiling quick-error v1.2.3
[INFO] [stderr]    Compiling lock_api v0.3.4
[INFO] [stderr]    Compiling copyless v0.1.5
[INFO] [stderr]    Compiling unicode-normalization v0.1.13
[INFO] [stderr]    Compiling crossbeam-utils v0.7.2
[INFO] [stderr]    Compiling lru-cache v0.1.2
[INFO] [stderr]    Compiling serde v1.0.114
[INFO] [stderr]    Compiling quote v1.0.7
[INFO] [stderr]    Compiling net2 v0.2.34
[INFO] [stderr]    Compiling iovec v0.1.4
[INFO] [stderr]    Compiling getrandom v0.1.14
[INFO] [stderr]    Compiling signal-hook-registry v1.2.0
[INFO] [stderr]    Compiling num_cpus v1.13.0
[INFO] [stderr]    Compiling parking_lot_core v0.8.0
[INFO] [stderr]    Compiling hostname v0.3.1
[INFO] [stderr]    Compiling parking_lot_core v0.7.2
[INFO] [stderr]    Compiling rand_core v0.5.1
[INFO] [stderr]    Compiling parking_lot v0.11.0
[INFO] [stderr]    Compiling resolv-conf v0.6.3
[INFO] [stderr]    Compiling threadpool v1.8.1
[INFO] [stderr]    Compiling mio v0.6.22
[INFO] [stderr]    Compiling rand_chacha v0.2.2
[INFO] [stderr]    Compiling parking_lot v0.10.2
[INFO] [stderr]    Compiling rand v0.7.3
[INFO] [stderr]    Compiling idna v0.2.0
[INFO] [stderr]    Compiling crossbeam-channel v0.4.3
[INFO] [stderr]    Compiling mio-uds v0.6.8
[INFO] [stderr]    Compiling tokio v0.2.22
[INFO] [stderr]    Compiling url v2.1.1
[INFO] [stderr]    Compiling addr2line v0.13.0
[INFO] [stderr]    Compiling backtrace v0.3.50
[INFO] [stderr]    Compiling tokio-util v0.3.1
[INFO] [stderr]    Compiling futures-macro v0.3.5
[INFO] [stderr]    Compiling thiserror-impl v1.0.20
[INFO] [stderr]    Compiling enum-as-inner v0.3.2
[INFO] [stderr]    Compiling derive_more v0.99.9
[INFO] [stderr]    Compiling async-trait v0.1.36
[INFO] [stderr]    Compiling actix-macros v0.1.2
[INFO] [stderr]    Compiling random-number-macro-impl v0.1.3
[INFO] [stderr]    Compiling actix_derive v0.5.0
[INFO] [stderr]    Compiling random-number v0.1.3
[INFO] [stderr]    Compiling thiserror v1.0.20
[INFO] [stderr]    Compiling pin-project v0.4.22
[INFO] [stderr]    Compiling futures-util v0.3.5
[INFO] [stderr]    Compiling actix-threadpool v0.3.3
[INFO] [stderr]    Compiling futures-executor v0.3.5
[INFO] [stderr]    Compiling actix-rt v1.1.1
[INFO] [stderr]    Compiling futures v0.3.5
[INFO] [stderr]    Compiling trust-dns-proto v0.19.5
[INFO] [stderr]    Compiling trust-dns-resolver v0.19.5
[INFO] [stderr]    Compiling actix v0.10.0-alpha.3
[INFO] [stderr]    Compiling raft v0.1.0 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `dev` profile [unoptimized + debuginfo] target(s) in 19.06s
[INFO] running `Command { std: "docker" "inspect" "b4839e6d5c38858af6ad043a3292e50ba6147db0f64e27b739c0dc20372776ee", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "b4839e6d5c38858af6ad043a3292e50ba6147db0f64e27b739c0dc20372776ee", kill_on_drop: false }`
[INFO] [stdout] b4839e6d5c38858af6ad043a3292e50ba6147db0f64e27b739c0dc20372776ee
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-4-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-4-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:4848fb76d95f26979359cc7e45710b1dbc8f3acb7aeedee7c460d7702230f228" "/opt/rustwide/cargo-home/bin/cargo" "+1ef7943ee607160a564655b6596f83670ef95df5" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] daaeec562dd246f18fea85d0f5e25bafa23ea0997a73ab9343c4457bd39d9b0a
[INFO] running `Command { std: "docker" "start" "-a" "daaeec562dd246f18fea85d0f5e25bafa23ea0997a73ab9343c4457bd39d9b0a", kill_on_drop: false }`
[INFO] [stderr]    Compiling raft v0.1.0 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 0.88s
[INFO] running `Command { std: "docker" "inspect" "daaeec562dd246f18fea85d0f5e25bafa23ea0997a73ab9343c4457bd39d9b0a", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "daaeec562dd246f18fea85d0f5e25bafa23ea0997a73ab9343c4457bd39d9b0a", kill_on_drop: false }`
[INFO] [stdout] daaeec562dd246f18fea85d0f5e25bafa23ea0997a73ab9343c4457bd39d9b0a
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-4-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-4-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:4848fb76d95f26979359cc7e45710b1dbc8f3acb7aeedee7c460d7702230f228" "/opt/rustwide/cargo-home/bin/cargo" "+1ef7943ee607160a564655b6596f83670ef95df5" "test" "--frozen", kill_on_drop: false }`
[INFO] [stdout] 6b4654f3c55b35876d8fe768f91fbe8377f841f76e03899599cc5b710571e61c
[INFO] running `Command { std: "docker" "start" "-a" "6b4654f3c55b35876d8fe768f91fbe8377f841f76e03899599cc5b710571e61c", kill_on_drop: false }`
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 0.07s
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/raft-957b43610ba3e6f1)
[INFO] [stdout] 
[INFO] [stdout] running 47 tests
[INFO] [stdout] test log::test_vec::cmp_equal ... ok
[INFO] [stdout] test log::test_vec::cmp_greater ... ok
[INFO] [stdout] test log::test_vec::cmp_less ... ok
[INFO] [stdout] test log::test_vec::log_term_matches_matches ... ok
[INFO] [stdout] test log::test_vec::log_term_matches_not_exist ... ok
[INFO] [stdout] test log::test_vec::log_term_matches_wrong_term ... ok
[INFO] [stdout] test log::test_vec::truncate_if_different_and_append_append_if_empty ... ok
[INFO] [stdout] test log::test_vec::truncate_if_different_and_append_append_if_extending ... ok
[INFO] [stdout] test log::test_vec::truncate_if_different_and_append_nothing_if_no_new_items ... ok
[INFO] [stdout] test log::test_vec::truncate_if_different_and_append_replace_if_different ... ok
[INFO] [stdout] test log::test_vec::truncate_if_different_and_append_truncate_if_second_different ... ok
[INFO] [stdout] test log::test_vec::truncate_if_different_and_append_truncate_if_different ... ok
[INFO] [stdout] test server::all_server_rules::apply_commited ... ok
[INFO] [stdout] test server::all_server_rules::request_updates_term ... ok
[INFO] [stdout] test server::candidate_rules::become_leader ... ok
[INFO] [stdout] test server::candidate_rules::election_timeout ... ok
[INFO] [stdout] test server::candidate_rules::new_leader_appends_entries ... ok
[INFO] [stdout] test server::candidate_rules::old_leader_appends_entries ... ok
[INFO] [stdout] test server::follower_to_candidate_rules::election_timeout ... ok
[INFO] [stdout] test server::leader_rules::whole_handle_client_command ... ok
[INFO] [stdout] test state::test_append_entries::impl1 ... ok
[INFO] [stdout] test state::test_append_entries::impl2_no_entry ... ok
[INFO] [stdout] test state::test_append_entries::impl2_no_term_match ... ok
[INFO] [stdout] test state::test_append_entries::impl3_first_doesnt_match ... ok
[INFO] [stdout] test state::test_append_entries::impl3_second_doesnt_match ... ok
[INFO] [stdout] test state::test_append_entries::impl4 ... ok
[INFO] [stdout] test state::test_append_entries::impl5_leader_commit ... ok
[INFO] [stdout] test state::test_append_entries::impl5_leader_commit_passes ... ok
[INFO] [stdout] test state::test_leader_state::initial ... ok
[INFO] [stdout] test state::test_leader_state::match_index_increases ... ok
[INFO] [stdout] test state::test_persistent_state::default ... ok
[INFO] [stdout] test state::test_request_vote::impl1 ... ok
[INFO] [stdout] test state::test_request_vote::impl2_novote_log_longer ... ok
[INFO] [stdout] test state::test_volatile_state::commit_index_increases ... ok
[INFO] [stdout] test state::test_volatile_state::default ... ok
[INFO] [stdout] test state::test_volatile_state::last_applied_increases ... ok
[INFO] [stdout] test state::test_request_vote::impl2_voted_log_shorter ... ok
[INFO] [stdout] test state::test_request_vote::impl2_novote_log_same ... ok
[INFO] [stdout] test state::test_persistent_state::current_term_increases ... ok
[INFO] [stdout] test state::test_append_entries::impl3_4 ... ok
[INFO] [stdout] test state::test_request_vote::impl2_votedother_log_same ... ok
[INFO] [stdout] test state::test_leader_state::majority_match ... ok
[INFO] [stdout] test log::test_vec::truncate_if_different_and_append_panics_if_prev_too_high - should panic ... ok
[INFO] [stdout] test state::test_leader_state::match_index_increases_monotonically - should panic ... ok
[INFO] [stdout] test state::test_persistent_state::current_term_increases_monotonically - should panic ... ok
[INFO] [stdout] test state::test_volatile_state::last_applied_increases_monotonically - should panic ... ok
[INFO] [stdout] test state::test_volatile_state::commit_index_increases_monotonically - should panic ... ok
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 47 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.04s
[INFO] [stdout] 
[INFO] [stderr]      Running tests/cluster.rs (/opt/rustwide/target/debug/deps/cluster-64ec980059bd1528)
[INFO] [stdout] 
[INFO] [stdout] running 4 tests
[INFO] [stdout] test test_cluster_1 ... ok
[INFO] [stdout] test test_cluster_5 ... ok
[INFO] [stdout] test test_cluster_2 ... FAILED
[INFO] [stdout] test test_cluster_20 ... ok
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout] 
[INFO] [stdout] ---- test_cluster_2 stdout ----
[INFO] [stdout] applied Ok(Err(NotLeader))
[INFO] [stdout] 
[INFO] [stdout] thread 'test_cluster_2' (74) panicked at tests/cluster.rs:467:9:
[INFO] [stdout] assertion `left == right` failed
[INFO] [stdout]   left: Err(NotLeader)
[INFO] [stdout]  right: Ok(CommandApplied(3))
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x64eb4838ea92 - std::backtrace_rs::backtrace::libunwind::trace::h786de35fecf3582f
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9
[INFO] [stdout]    1:     0x64eb4838ea92 - std::backtrace_rs::backtrace::trace_unsynchronized::h4a7da1a2a64387f1
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14
[INFO] [stdout]    2:     0x64eb4838ea92 - std::sys::backtrace::_print_fmt::h6bd7d500070c788c
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/std/src/sys/backtrace.rs:66:9
[INFO] [stdout]    3:     0x64eb4838ea92 - <std::sys::backtrace::BacktraceLock::print::DisplayBacktrace as core::fmt::Display>::fmt::h6d82c1afff976903
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/std/src/sys/backtrace.rs:39:26
[INFO] [stdout]    4:     0x64eb4839f33f - core::fmt::rt::Argument::fmt::hc4ce6d643d397690
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/core/src/fmt/rt.rs:173:76
[INFO] [stdout]    5:     0x64eb4839f33f - core::fmt::write::hb1e7ca88b6a3936e
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/core/src/fmt/mod.rs:1469:25
[INFO] [stdout]    6:     0x64eb4835c043 - std::io::default_write_fmt::haffd49d96f1984a8
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/std/src/io/mod.rs:639:11
[INFO] [stdout]    7:     0x64eb4835c043 - std::io::Write::write_fmt::h027871c57cf57c01
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/std/src/io/mod.rs:1954:13
[INFO] [stdout]    8:     0x64eb48368192 - std::sys::backtrace::BacktraceLock::print::ha2430613ee79d059
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/std/src/sys/backtrace.rs:42:9
[INFO] [stdout]    9:     0x64eb4836ccef - std::panicking::default_hook::{{closure}}::hdbd2db9e5c303cf6
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/std/src/panicking.rs:301:27
[INFO] [stdout]   10:     0x64eb4836cb81 - std::panicking::default_hook::hed93c70cba5fdcf0
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/std/src/panicking.rs:325:9
[INFO] [stdout]   11:     0x64eb4826f83e - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::hd0ee8b569efc6a07
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/alloc/src/boxed.rs:2099:9
[INFO] [stdout]   12:     0x64eb4826f83e - test::test_main_with_exit_callback::{{closure}}::hf10864b576ecd15d
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/test/src/lib.rs:145:21
[INFO] [stdout]   13:     0x64eb4836d2ff - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::h3a55ca34534c0d00
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/alloc/src/boxed.rs:2099:9
[INFO] [stdout]   14:     0x64eb4836d2ff - std::panicking::panic_with_hook::h3862d766c2cec19b
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/std/src/panicking.rs:842:13
[INFO] [stdout]   15:     0x64eb4836d15a - std::panicking::panic_handler::{{closure}}::hb95eb402b5e28ee1
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/std/src/panicking.rs:707:13
[INFO] [stdout]   16:     0x64eb483682d9 - std::sys::backtrace::__rust_end_short_backtrace::hf73a26dc1835d85a
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/std/src/sys/backtrace.rs:174:18
[INFO] [stdout]   17:     0x64eb4835093d - __rustc[6ed5915ee467787]::rust_begin_unwind
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/std/src/panicking.rs:698:5
[INFO] [stdout]   18:     0x64eb483a7130 - core::panicking::panic_fmt::h3454303eb8e6f7cd
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/core/src/panicking.rs:80:14
[INFO] [stdout]   19:     0x64eb483a6ee3 - core::panicking::assert_failed_inner::hdcc703ae7c807131
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/core/src/panicking.rs:444:17
[INFO] [stdout]   20:     0x64eb4821e4d8 - core::panicking::assert_failed::h7ea4a3c689d39a21
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/core/src/panicking.rs:399:5
[INFO] [stdout]   21:     0x64eb481fc4d7 - cluster::test_cluster_2::{{closure}}::h4f9f0bb39fbe23bb
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/cluster.rs:467:9
[INFO] [stdout]   22:     0x64eb48247486 - <tokio::task::local::RunUntil<T> as core::future::future::Future>::poll::{{closure}}::{{closure}}::h5546ea3d2d07dc19
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-0.2.22/src/task/local.rs:528:67
[INFO] [stdout]   23:     0x64eb48200540 - tokio::coop::with_budget::{{closure}}::h7f6abc59667efd8e
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-0.2.22/src/coop.rs:127:9
[INFO] [stdout]   24:     0x64eb481e40f5 - std::thread::local::LocalKey<T>::try_with::h9b4522e06fc6c66a
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/std/src/thread/local.rs:508:12
[INFO] [stdout]   25:     0x64eb481e180e - std::thread::local::LocalKey<T>::with::h4be4c4730b8ac268
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/std/src/thread/local.rs:472:20
[INFO] [stdout]   26:     0x64eb48246f12 - tokio::coop::with_budget::h004d7b5477742eef
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-0.2.22/src/coop.rs:120:13
[INFO] [stdout]   27:     0x64eb48246f12 - tokio::coop::budget::h4b6e190260eba6af
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-0.2.22/src/coop.rs:96:5
[INFO] [stdout]   28:     0x64eb48246f12 - <tokio::task::local::RunUntil<T> as core::future::future::Future>::poll::{{closure}}::h753949e37532bce9
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-0.2.22/src/task/local.rs:528:42
[INFO] [stdout]   29:     0x64eb48244f4d - tokio::macros::scoped_tls::ScopedKey<T>::set::h1b0c8a159b06599f
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-0.2.22/src/macros/scoped_tls.rs:63:9
[INFO] [stdout]   30:     0x64eb482441c7 - tokio::task::local::LocalSet::with::h4949bb1fbb27fdb5
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-0.2.22/src/task/local.rs:442:17
[INFO] [stdout]   31:     0x64eb48246b1b - <tokio::task::local::RunUntil<T> as core::future::future::Future>::poll::h53ac45056727cd7f
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-0.2.22/src/task/local.rs:518:22
[INFO] [stdout]   32:     0x64eb48244add - tokio::task::local::LocalSet::run_until::{{closure}}::h88270c2423f8141b
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-0.2.22/src/task/local.rs:392:19
[INFO] [stdout]   33:     0x64eb4821264d - tokio::runtime::basic_scheduler::BasicScheduler<P>::block_on::{{closure}}::{{closure}}::hf07df0bf133726f1
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-0.2.22/src/runtime/basic_scheduler.rs:131:74
[INFO] [stdout]   34:     0x64eb482007a0 - tokio::coop::with_budget::{{closure}}::hb5f0526216c0fc99
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-0.2.22/src/coop.rs:127:9
[INFO] [stdout]   35:     0x64eb481e2ba5 - std::thread::local::LocalKey<T>::try_with::h2a1efd494aabb977
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/std/src/thread/local.rs:508:12
[INFO] [stdout]   36:     0x64eb481e150e - std::thread::local::LocalKey<T>::with::h125e9a2878b62c0c
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/std/src/thread/local.rs:472:20
[INFO] [stdout]   37:     0x64eb48211640 - tokio::coop::with_budget::h4f4a2c6ba4771bd9
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-0.2.22/src/coop.rs:120:13
[INFO] [stdout]   38:     0x64eb48211640 - tokio::coop::budget::h6944e95ae469f2ab
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-0.2.22/src/coop.rs:96:5
[INFO] [stdout]   39:     0x64eb48211640 - tokio::runtime::basic_scheduler::BasicScheduler<P>::block_on::{{closure}}::hacde90d838424570
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-0.2.22/src/runtime/basic_scheduler.rs:131:35
[INFO] [stdout]   40:     0x64eb4821359e - tokio::runtime::basic_scheduler::enter::{{closure}}::h7e4b9517e0c4f30b
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-0.2.22/src/runtime/basic_scheduler.rs:213:29
[INFO] [stdout]   41:     0x64eb482456c7 - tokio::macros::scoped_tls::ScopedKey<T>::set::hfbad47bfcaa97518
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-0.2.22/src/macros/scoped_tls.rs:63:9
[INFO] [stdout]   42:     0x64eb48213155 - tokio::runtime::basic_scheduler::enter::hc937fee6f1601502
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-0.2.22/src/runtime/basic_scheduler.rs:213:13
[INFO] [stdout]   43:     0x64eb48210490 - tokio::runtime::basic_scheduler::BasicScheduler<P>::block_on::h724644fd5b82e068
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-0.2.22/src/runtime/basic_scheduler.rs:123:9
[INFO] [stdout]   44:     0x64eb482415e2 - tokio::runtime::Runtime::block_on::{{closure}}::hfe0446ee0059fad2
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-0.2.22/src/runtime/mod.rs:444:39
[INFO] [stdout]   45:     0x64eb4821b4cb - tokio::runtime::context::enter::h84d6fde19bc0199e
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-0.2.22/src/runtime/context.rs:72:5
[INFO] [stdout]   46:     0x64eb4824ef3a - tokio::runtime::handle::Handle::enter::hae06a090bc1a4dc8
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-0.2.22/src/runtime/handle.rs:76:9
[INFO] [stdout]   47:     0x64eb482411fa - tokio::runtime::Runtime::block_on::h6388c8df67a2d8c2
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-0.2.22/src/runtime/mod.rs:441:21
[INFO] [stdout]   48:     0x64eb4824424b - tokio::task::local::LocalSet::block_on::h0e8e13ba744496d6
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-0.2.22/src/task/local.rs:353:12
[INFO] [stdout]   49:     0x64eb4820493a - actix_rt::runtime::Runtime::block_on::he42444d9e0a044b4
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/actix-rt-1.1.1/src/runtime.rs:89:20
[INFO] [stdout]   50:     0x64eb481f369d - actix_rt::builder::SystemRunner::block_on::h3c2d02cd3e99b589
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/actix-rt-1.1.1/src/builder.rs:187:27
[INFO] [stdout]   51:     0x64eb481fbe9a - cluster::test_cluster_2::h8acf01d5434ca66a
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/cluster.rs:462:12
[INFO] [stdout]   52:     0x64eb481fbee7 - cluster::test_cluster_2::{{closure}}::h3a128206face8f86
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/cluster.rs:453:20
[INFO] [stdout]   53:     0x64eb4823b5c6 - core::ops::function::FnOnce::call_once::hb0ec337271a07f30
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   54:     0x64eb4826f61b - core::ops::function::FnOnce::call_once::ha729ee35d2fab541
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   55:     0x64eb4826f61b - test::__rust_begin_short_backtrace::ha40f4db8207e1111
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/test/src/lib.rs:663:18
[INFO] [stdout]   56:     0x64eb4828369d - test::run_test_in_process::{{closure}}::hc1b77cda5d44f0f3
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/test/src/lib.rs:686:74
[INFO] [stdout]   57:     0x64eb4828369d - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::h1dbea1de64785521
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/core/src/panic/unwind_safe.rs:274:9
[INFO] [stdout]   58:     0x64eb4828369d - std::panicking::catch_unwind::do_call::hd5febe9affd5a1b3
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/std/src/panicking.rs:590:40
[INFO] [stdout]   59:     0x64eb4828369d - std::panicking::catch_unwind::h51ea89627559b6f4
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/std/src/panicking.rs:553:19
[INFO] [stdout]   60:     0x64eb4828369d - std::panic::catch_unwind::hb8b8c2367cae3d66
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/std/src/panic.rs:359:14
[INFO] [stdout]   61:     0x64eb4828369d - test::run_test_in_process::ha5b55801407ea100
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/test/src/lib.rs:686:27
[INFO] [stdout]   62:     0x64eb4828369d - test::run_test::{{closure}}::h0b9d4072b527abf5
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/test/src/lib.rs:607:43
[INFO] [stdout]   63:     0x64eb4825cbb4 - test::run_test::{{closure}}::hb1056b5731205822
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/test/src/lib.rs:637:41
[INFO] [stdout]   64:     0x64eb4825cbb4 - std::sys::backtrace::__rust_begin_short_backtrace::hb61ff5a34023c7ef
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/std/src/sys/backtrace.rs:158:18
[INFO] [stdout]   65:     0x64eb482604ea - std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}}::hb0a83c0e8b353cff
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/std/src/thread/mod.rs:562:17
[INFO] [stdout]   66:     0x64eb482604ea - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::hb4f32cb008535298
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/core/src/panic/unwind_safe.rs:274:9
[INFO] [stdout]   67:     0x64eb482604ea - std::panicking::catch_unwind::do_call::h16d110e4fc35789a
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/std/src/panicking.rs:590:40
[INFO] [stdout]   68:     0x64eb482604ea - std::panicking::catch_unwind::hea9118f355699c4b
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/std/src/panicking.rs:553:19
[INFO] [stdout]   69:     0x64eb482604ea - std::panic::catch_unwind::hf4b3c2a06d3f42f5
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/std/src/panic.rs:359:14
[INFO] [stdout]   70:     0x64eb482604ea - std::thread::Builder::spawn_unchecked_::{{closure}}::h3f4cb733a52d53d5
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/std/src/thread/mod.rs:560:30
[INFO] [stdout]   71:     0x64eb482604ea - core::ops::function::FnOnce::call_once{{vtable.shim}}::h4052f0967b37caeb
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   72:     0x64eb483636cf - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h7ec433abd3f148b4
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/alloc/src/boxed.rs:2085:9
[INFO] [stdout]   73:     0x64eb483636cf - std::sys::thread::unix::Thread::new::thread_start::he514622d3d7ba65c
[INFO] [stdout]                                at /rustc/1ef7943ee607160a564655b6596f83670ef95df5/library/std/src/sys/thread/unix.rs:124:17
[INFO] [stdout]   74:     0x7529960c4aa4 - <unknown>
[INFO] [stdout]   75:     0x752996151a64 - clone
[INFO] [stdout]   76:                0x0 - <unknown>
[INFO] [stdout] Panic in Arbiter thread.
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout]     test_cluster_2
[INFO] [stdout] 
[INFO] [stdout] test result: FAILED. 3 passed; 1 failed; 0 ignored; 0 measured; 0 filtered out; finished in 5.00s
[INFO] [stdout] 
[INFO] [stderr] error: test failed, to rerun pass `--test cluster`
[INFO] running `Command { std: "docker" "inspect" "6b4654f3c55b35876d8fe768f91fbe8377f841f76e03899599cc5b710571e61c", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "6b4654f3c55b35876d8fe768f91fbe8377f841f76e03899599cc5b710571e61c", kill_on_drop: false }`
[INFO] [stdout] 6b4654f3c55b35876d8fe768f91fbe8377f841f76e03899599cc5b710571e61c
