[INFO] fetching crate kaya-sim 0.2.1...
[INFO] testing kaya-sim-0.2.1 against 1.99.0-beta.8+cargoflags=--release for beta-release-1.100-2
[INFO] extracting crate kaya-sim 0.2.1 into /workspace/builds/worker-3-tc1/source
[INFO] started tweaking crates.io crate kaya-sim 0.2.1
[INFO] finished tweaking crates.io crate kaya-sim 0.2.1
[INFO] tweaked toml for crates.io crate kaya-sim 0.2.1 written to /workspace/builds/worker-3-tc1/source/Cargo.toml
[INFO] validating manifest of crates.io crate kaya-sim 0.2.1 on toolchain 1.99.0-beta.8
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.99.0-beta.8" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] crate crates.io crate kaya-sim 0.2.1 already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.99.0-beta.8" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] [stderr]     Updating crates.io index
[INFO] [stderr]  Downloading crates ...
[INFO] [stderr]   Downloaded kaya-wal v0.2.1
[INFO] [stderr]   Downloaded kaya-core v0.2.1
[INFO] [stderr]   Downloaded kaya-raft v0.2.1
[INFO] [stderr]   Downloaded kaya-io v0.2.1
[INFO] [stderr]   Downloaded lz4_flex v0.11.6
[INFO] [stderr]   Downloaded kaya-engine v0.2.1
[INFO] [stderr]   Downloaded cc v1.2.64
[INFO] [stderr]   Downloaded kaya-lsm v0.2.1
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-m" "1610612736" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:77db811e55d90add9212f6832c23229e3de5f1c1f9905e8cb07319ea15df73ac" "sleep" "infinity", kill_on_drop: false }`
[INFO] [stdout] 83a23e92408429f290427cb32039412b7b5bb8b843ac12a9ad07b7d30545059d
[INFO] running `Command { std: "docker" "start" "83a23e92408429f290427cb32039412b7b5bb8b843ac12a9ad07b7d30545059d", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "83a23e92408429f290427cb32039412b7b5bb8b843ac12a9ad07b7d30545059d", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-w" "/opt/rustwide/workdir" "--user" "0:0" "83a23e92408429f290427cb32039412b7b5bb8b843ac12a9ad07b7d30545059d" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.8" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "83a23e92408429f290427cb32039412b7b5bb8b843ac12a9ad07b7d30545059d", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "83a23e92408429f290427cb32039412b7b5bb8b843ac12a9ad07b7d30545059d" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.8" "build" "--frozen" "--message-format=json" "--release", kill_on_drop: false }`
[INFO] [stderr]    Compiling typenum v1.20.1
[INFO] [stderr]    Compiling libc v0.2.186
[INFO] [stderr]    Compiling shlex v2.0.1
[INFO] [stderr]    Compiling pkg-config v0.3.33
[INFO] [stderr]    Compiling errno v0.3.14
[INFO] [stderr]    Compiling zstd-safe v7.2.4
[INFO] [stderr]    Compiling mio v1.2.0
[INFO] [stderr]    Compiling getrandom v0.2.17
[INFO] [stderr]    Compiling socket2 v0.6.3
[INFO] [stderr]    Compiling pin-project-lite v0.2.17
[INFO] [stderr]    Compiling bytes v1.11.1
[INFO] [stderr]    Compiling twox-hash v2.1.2
[INFO] [stderr]    Compiling zmij v1.0.21
[INFO] [stderr]    Compiling quote v1.0.45
[INFO] [stderr]    Compiling serde_core v1.0.228
[INFO] [stderr]    Compiling serde_json v1.0.149
[INFO] [stderr]    Compiling lz4_flex v0.11.6
[INFO] [stderr]    Compiling itoa v1.0.18
[INFO] [stderr]    Compiling signal-hook-registry v1.4.8
[INFO] [stderr]    Compiling memchr v2.8.0
[INFO] [stderr]    Compiling rand_core v0.6.4
[INFO] [stderr]    Compiling syn v2.0.117
[INFO] [stderr]    Compiling generic-array v0.14.7
[INFO] [stderr]    Compiling crypto-common v0.1.7
[INFO] [stderr]    Compiling inout v0.1.4
[INFO] [stderr]    Compiling universal-hash v0.5.1
[INFO] [stderr]    Compiling cipher v0.4.4
[INFO] [stderr]    Compiling aead v0.5.2
[INFO] [stderr]    Compiling ctr v0.9.2
[INFO] [stderr]    Compiling aes v0.8.4
[INFO] [stderr]    Compiling polyval v0.6.2
[INFO] [stderr]    Compiling ghash v0.5.1
[INFO] [stderr]    Compiling jobserver v0.1.34
[INFO] [stderr]    Compiling cc v1.2.64
[INFO] [stderr]    Compiling aes-gcm v0.10.3
[INFO] [stderr]    Compiling zstd-sys v2.0.16+zstd.1.5.7
[INFO] [stderr]    Compiling thiserror-impl v1.0.69
[INFO] [stderr]    Compiling thiserror v1.0.69
[INFO] [stderr]    Compiling kaya-core v0.2.1
[INFO] [stderr]    Compiling tokio-macros v2.7.0
[INFO] [stderr]    Compiling tokio v1.52.3
[INFO] [stderr]    Compiling kaya-raft v0.2.1
[INFO] [stderr]    Compiling kaya-io v0.2.1
[INFO] [stderr]    Compiling kaya-wal v0.2.1
[INFO] [stderr]    Compiling zstd v0.13.3
[INFO] [stderr]    Compiling kaya-lsm v0.2.1
[INFO] [stderr]    Compiling kaya-engine v0.2.1
[INFO] [stderr]    Compiling kaya-sim v0.2.1 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `release` profile [optimized] target(s) in 1m 25s
[INFO] running `Command { std: "docker" "inspect" "83a23e92408429f290427cb32039412b7b5bb8b843ac12a9ad07b7d30545059d", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "83a23e92408429f290427cb32039412b7b5bb8b843ac12a9ad07b7d30545059d" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.8" "test" "--frozen" "--no-run" "--message-format=json" "--release", kill_on_drop: false }`
[INFO] [stderr]    Compiling kaya-sim v0.2.1 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `release` profile [optimized] target(s) in 18.21s
[INFO] running `Command { std: "docker" "inspect" "83a23e92408429f290427cb32039412b7b5bb8b843ac12a9ad07b7d30545059d", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "83a23e92408429f290427cb32039412b7b5bb8b843ac12a9ad07b7d30545059d" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.8" "test" "--frozen" "--release", kill_on_drop: false }`
[INFO] [stderr]     Finished `release` profile [optimized] target(s) in 0.06s
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/release/deps/kaya_sim-02989aed5b259cc7)
[INFO] [stdout] 
[INFO] [stdout] running 63 tests
[INFO] [stdout] test cluster::tests::election_safe_under_network_latency ... ok
[INFO] [stdout] test cluster::tests::cluster_disk_full_election_stable ... ok
[INFO] [stdout] test cluster::tests::log_replication ... ok
[INFO] [stdout] test cluster::tests::election_safety_with_faults ... ok
[INFO] [stdout] test cluster::tests::partition_isolated_minority_cannot_lead ... ok
[INFO] [stdout] test cluster::tests::move_range_preserves_writes_across_cutover ... ok
[INFO] [stdout] test cluster::tests::raft_command_put_delete_converges ... ok
[INFO] [stdout] test cluster::tests::range_meta_replicates_and_survives_crash ... ok
[INFO] [stdout] test cluster::tests::partition_rejoin_catches_up ... ok
[INFO] [stdout] test clock_skew::tests::cluster_clock_skew_election_stable ... ok
[INFO] [stdout] test cluster::tests::joint_consensus_adds_fourth_voter ... ok
[INFO] [stdout] test cluster::tests::leader_elected_5_nodes ... ok
[INFO] [stdout] test cluster::tests::election_safety_multi_seed ... ok
[INFO] [stdout] test linear::tests::concurrent_overlapping_put_get_consistent ... ok
[INFO] [stdout] test cluster::tests::leader_elected_3_nodes ... ok
[INFO] [stdout] test cluster::tests::status_role_accessible ... ok
[INFO] [stdout] test cluster::tests::engine_backed_snapshot_catches_up_follower ... ok
[INFO] [stdout] test cluster::tests::quorum_commit_requires_majority_in_five_node_cluster ... ok
[INFO] [stdout] test linear::tests::concurrent_stale_read_after_completed_write_is_violation ... ok
[INFO] [stdout] test cluster::tests::range_meta_snapshot_catches_up_follower ... ok
[INFO] [stdout] test cluster::tests::read_index_quorum_confirmation ... ok
[INFO] [stdout] test linear::tests::mus_scan_fabricated_pair_is_scan_only ... ok
[INFO] [stdout] test linear::tests::mus_scan_missing_put_is_mixed_partition ... ok
[INFO] [stdout] test cluster::tests::snapshot_compacts_log ... ok
[INFO] [stdout] test linear::tests::stale_read_is_violation ... ok
[INFO] [stdout] test cluster::tests::apply_records_capture_engine_lsn ... ok
[INFO] [stdout] test linear::tests::mus_empty_on_linearizable_history ... ok
[INFO] [stdout] test cluster::tests::election_safe_under_reorder_and_latency ... ok
[INFO] [stdout] test linear::tests::scan_missing_entry_is_violation ... ok
[INFO] [stdout] test linear::tests::mus_cap_skips_oversize_universe ... ok
[INFO] [stdout] test linear::tests::mus_enumerates_independent_multi_key_violations ... ok
[INFO] [stdout] test cluster::tests::asymmetric_partition_preserves_election_safety ... ok
[INFO] [stdout] test model::tests::all_commit_timestamps_sorted_unique ... ok
[INFO] [stdout] test cluster::tests::election_safety_no_faults ... ok
[INFO] [stdout] test model::tests::apply_log_entry_synthetic_seq ... ok
[INFO] [stdout] test model::tests::tombstone_hides_newer_but_not_older_snapshot ... ok
[INFO] [stdout] test model::tests::scan_prefix_latest_and_at ... ok
[INFO] [stdout] test rng::tests::deterministic_across_instances ... ok
[INFO] [stdout] test tests::sim_large_seed_burn_in ... ignored
[INFO] [stdout] test rng::tests::weighted_index_in_range ... ok
[INFO] [stdout] test clock_skew::tests::cluster_clock_skew_multi_node_stable ... ok
[INFO] [stdout] test wgl_jsonl::tests::parse_hex_keys_and_error_result ... ok
[INFO] [stdout] test linear::tests::sequential_put_get_consistent ... ok
[INFO] [stdout] test wgl_jsonl::tests::parse_put_get_delete_scan_and_null_miss ... ok
[INFO] [stdout] test runner::mvcc_tests::mvcc_multi_version_put_crash_get_at_matches_model ... ok
[INFO] [stdout] test wgl_jsonl::tests::parse_rejects_unknown_field_and_op ... ok
[INFO] [stdout] test rng::tests::zero_seed_does_not_get_stuck ... ok
[INFO] [stdout] test linear::tests::scan_consistent_with_model ... ok
[INFO] [stdout] test wgl_jsonl::tests::parse_auto_ticks_when_interval_omitted ... ok
[INFO] [stdout] test model::tests::put_after_delete_is_visible_again ... ok
[INFO] [stdout] test model::tests::multi_version_put_get_at ... ok
[INFO] [stdout] test wgl_jsonl::tests::report_json_and_greedy_on_put_then_miss ... ok
[INFO] [stdout] test runner::mvcc_tests::mvcc_delete_then_crash_snapshot_sees_old_put ... ok
[INFO] [stdout] test wgl_jsonl::tests::report_json_linearizable ... ok
[INFO] [stdout] test wgl_jsonl::tests::parse_rejects_inverted_interval ... ok
[INFO] [stdout] test linear::tests::error_results_are_non_constraining ... ok
[INFO] [stdout] test wgl_jsonl::tests::parse_rejects_missing_result_and_bad_hex ... ok
[INFO] [stdout] test linear::tests::minimal_counterexample_shrinks_irrelevant_ops ... ok
[INFO] [stdout] test linear::tests::sequential_put_delete_get_consistent ... ok
[INFO] [stdout] test tests::sim_replay_no_divergence ... ok
[INFO] [stdout] test cluster::tests::move_range_no_lost_or_duplicated_keys_across_crash ... ok
[INFO] [stderr] error: package ID specification `kaya-server` did not match any packages
[INFO] [stdout] test tests::test_jepsen_node_controller_lifecycle ... FAILED
[INFO] [stdout] test tests::sim_small_seed_suite ... ok
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout] 
[INFO] [stdout] ---- tests::test_jepsen_node_controller_lifecycle stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'tests::test_jepsen_node_controller_lifecycle' (1214) panicked at src/lib.rs:192:13:
[INFO] [stdout] failed to build kayadb-server binary
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x56c871590211 - <<std[70759c8f55707aa4]::sys::backtrace::BacktraceLock>::print::DisplayBacktrace as core[df12db4294e9bfd3]::fmt::Display>::fmt
[INFO] [stdout]    1:     0x56c8715a68fa - core[df12db4294e9bfd3]::fmt::write
[INFO] [stdout]    2:     0x56c871594d7c - <alloc[2182bb758b4b3781]::vec::Vec<u8> as core[df12db4294e9bfd3]::io::write::Write>::write_fmt
[INFO] [stdout]    3:     0x56c871569e46 - std[70759c8f55707aa4]::panicking::default_hook::{closure#0}
[INFO] [stdout]    4:     0x56c871587809 - std[70759c8f55707aa4]::panicking::default_hook
[INFO] [stdout]    5:     0x56c8713f1300 - test[9d35eded1c95d3be]::test_main_inner::<test[9d35eded1c95d3be]::test_main_static::{closure#0}>::{closure#0}
[INFO] [stdout]    6:     0x56c871587b32 - std[70759c8f55707aa4]::panicking::panic_with_hook
[INFO] [stdout]    7:     0x56c871569f24 - std[70759c8f55707aa4]::panicking::panic_handler::{closure#0}
[INFO] [stdout]    8:     0x56c871562aa9 - std[70759c8f55707aa4]::sys::backtrace::__rust_end_short_backtrace::<std[70759c8f55707aa4]::panicking::panic_handler::{closure#0}, !>
[INFO] [stdout]    9:     0x56c87156acdd - __rustc[8fa7c3cbc660c2b3]::rust_begin_unwind
[INFO] [stdout]   10:     0x56c8715a705c - core[df12db4294e9bfd3]::panicking::panic_fmt
[INFO] [stdout]   11:     0x56c87138f7ad - <kaya_sim[56187234ed9da6dc]::tests::test_jepsen_node_controller_lifecycle::{closure#0} as core[df12db4294e9bfd3]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]   12:     0x56c8713e45eb - test[9d35eded1c95d3be]::__rust_begin_short_backtrace::<core[df12db4294e9bfd3]::result::Result<(), alloc[2182bb758b4b3781]::string::String>, fn() -> core[df12db4294e9bfd3]::result::Result<(), alloc[2182bb758b4b3781]::string::String>>
[INFO] [stdout]   13:     0x56c8713f1c55 - test[9d35eded1c95d3be]::run_test::{closure#0}
[INFO] [stdout]   14:     0x56c8713eb514 - std[70759c8f55707aa4]::sys::backtrace::__rust_begin_short_backtrace::<test[9d35eded1c95d3be]::run_test::{closure#1}, ()>
[INFO] [stdout]   15:     0x56c8713f4db2 - <std[70759c8f55707aa4]::thread::lifecycle::spawn_unchecked<test[9d35eded1c95d3be]::run_test::{closure#1}, ()>::{closure#1} as core[df12db4294e9bfd3]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0}
[INFO] [stdout]   16:     0x56c87158f369 - <std[70759c8f55707aa4]::sys::thread::unix::Thread>::new::thread_start
[INFO] [stdout]   17:     0x7e833c1cfdfa - <unknown>
[INFO] [stdout]   18:     0x7e833c2633d4 - clone
[INFO] [stdout]   19:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout]     tests::test_jepsen_node_controller_lifecycle
[INFO] [stdout] 
[INFO] [stdout] test result: FAILED. 61 passed; 1 failed; 1 ignored; 0 measured; 0 filtered out; finished in 6.30s
[INFO] [stdout] 
[INFO] [stderr] error: test failed, to rerun pass `--lib`
[INFO] running `Command { std: "docker" "inspect" "83a23e92408429f290427cb32039412b7b5bb8b843ac12a9ad07b7d30545059d", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "83a23e92408429f290427cb32039412b7b5bb8b843ac12a9ad07b7d30545059d", kill_on_drop: false }`
[INFO] [stdout] 83a23e92408429f290427cb32039412b7b5bb8b843ac12a9ad07b7d30545059d
