[INFO] fetching crate oximedia-distributed 0.1.3... [INFO] testing oximedia-distributed-0.1.3 against try#dec9417b8611e34e787a3e4c37686b5131f9e5c5 for pr-154210-2 [INFO] extracting crate oximedia-distributed 0.1.3 into /workspace/builds/worker-3-tc2/source [INFO] started tweaking crates.io crate oximedia-distributed 0.1.3 [INFO] finished tweaking crates.io crate oximedia-distributed 0.1.3 [INFO] tweaked toml for crates.io crate oximedia-distributed 0.1.3 written to /workspace/builds/worker-3-tc2/source/Cargo.toml [INFO] validating manifest of crates.io crate oximedia-distributed 0.1.3 on toolchain dec9417b8611e34e787a3e4c37686b5131f9e5c5 [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+dec9417b8611e34e787a3e4c37686b5131f9e5c5" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }` [INFO] crate crates.io crate oximedia-distributed 0.1.3 already has a lockfile, it will not be regenerated [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+dec9417b8611e34e787a3e4c37686b5131f9e5c5" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+dec9417b8611e34e787a3e4c37686b5131f9e5c5" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }` [INFO] [stdout] a682e3f03d1212abc0c69d581cbb9e6232704ff8ac8834043861faa867ab9e34 [INFO] running `Command { std: "docker" "start" "-a" "a682e3f03d1212abc0c69d581cbb9e6232704ff8ac8834043861faa867ab9e34", kill_on_drop: false }` [INFO] running `Command { std: "docker" "inspect" "a682e3f03d1212abc0c69d581cbb9e6232704ff8ac8834043861faa867ab9e34", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "a682e3f03d1212abc0c69d581cbb9e6232704ff8ac8834043861faa867ab9e34", kill_on_drop: false }` [INFO] [stdout] a682e3f03d1212abc0c69d581cbb9e6232704ff8ac8834043861faa867ab9e34 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+dec9417b8611e34e787a3e4c37686b5131f9e5c5" "build" "--frozen" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] b135eafca2b8f8b7a8725431c22ea9c51e78b41c87e4df8dfe3c9613c4f3a6d9 [INFO] running `Command { std: "docker" "start" "-a" "b135eafca2b8f8b7a8725431c22ea9c51e78b41c87e4df8dfe3c9613c4f3a6d9", kill_on_drop: false }` [INFO] [stderr] Compiling parking_lot_core v0.9.12 [INFO] [stderr] Compiling serde_core v1.0.228 [INFO] [stderr] Compiling tracing-attributes v0.1.31 [INFO] [stderr] Compiling slab v0.4.12 [INFO] [stderr] Compiling anyhow v1.0.102 [INFO] [stderr] Compiling either v1.15.0 [INFO] [stderr] Compiling http v1.4.0 [INFO] [stderr] Compiling bitflags v2.11.1 [INFO] [stderr] Compiling futures-channel v0.3.32 [INFO] [stderr] Compiling rustix v1.1.4 [INFO] [stderr] Compiling pulldown-cmark v0.13.3 [INFO] [stderr] Compiling foldhash v0.1.5 [INFO] [stderr] Compiling regex-syntax v0.8.10 [INFO] [stderr] Compiling linux-raw-sys v0.12.1 [INFO] [stderr] Compiling bytes v1.11.1 [INFO] [stderr] Compiling unicase v2.9.0 [INFO] [stderr] Compiling hashbrown v0.15.5 [INFO] [stderr] Compiling getrandom v0.4.2 [INFO] [stderr] Compiling prettyplease v0.2.37 [INFO] [stderr] Compiling parking_lot v0.12.5 [INFO] [stderr] Compiling itertools v0.14.0 [INFO] [stderr] Compiling futures-util v0.3.32 [INFO] [stderr] Compiling icu_normalizer v2.2.0 [INFO] [stderr] Compiling indexmap v2.14.0 [INFO] [stderr] Compiling tokio v1.52.0 [INFO] [stderr] Compiling fastrand v2.4.1 [INFO] [stderr] Compiling once_cell v1.21.4 [INFO] [stderr] Compiling simd-adler32 v0.3.9 [INFO] [stderr] Compiling fixedbitset v0.5.7 [INFO] [stderr] Compiling crossbeam-deque v0.8.6 [INFO] [stderr] Compiling idna_adapter v1.2.1 [INFO] [stderr] Compiling miniz_oxide v0.8.9 [INFO] [stderr] Compiling idna v1.1.0 [INFO] [stderr] Compiling rayon-core v1.13.0 [INFO] [stderr] Compiling http-body v1.0.1 [INFO] [stderr] Compiling petgraph v0.8.3 [INFO] [stderr] Compiling http-body-util v0.1.3 [INFO] [stderr] Compiling pulldown-cmark-to-cmark v22.0.0 [INFO] [stderr] Compiling sys-info v0.9.1 [INFO] [stderr] Compiling tonic-build v0.14.5 [INFO] [stderr] Compiling pin-project-internal v1.1.11 [INFO] [stderr] Compiling axum-core v0.5.6 [INFO] [stderr] Compiling matchit v0.8.4 [INFO] [stderr] Compiling tracing v0.1.44 [INFO] [stderr] Compiling url v2.5.8 [INFO] [stderr] Compiling rayon v1.12.0 [INFO] [stderr] Compiling flate2 v1.1.9 [INFO] [stderr] Compiling rand v0.9.4 [INFO] [stderr] Compiling fdeflate v0.3.7 [INFO] [stderr] Compiling tempfile v3.27.0 [INFO] [stderr] Compiling regex-automata v0.4.14 [INFO] [stderr] Compiling oxiarc-core v0.2.6 [INFO] [stderr] Compiling futures-io v0.3.32 [INFO] [stderr] Compiling prost-derive v0.14.3 [INFO] [stderr] Compiling hashbrown v0.14.5 [INFO] [stderr] Compiling pin-project v1.1.11 [INFO] [stderr] Compiling hostname v0.4.2 [INFO] [stderr] Compiling num_cpus v1.17.0 [INFO] [stderr] Compiling oxiarc-deflate v0.2.6 [INFO] [stderr] Compiling dashmap v6.1.0 [INFO] [stderr] Compiling serde v1.0.228 [INFO] [stderr] Compiling uuid v1.23.0 [INFO] [stderr] Compiling serde_json v1.0.149 [INFO] [stderr] Compiling png v0.18.1 [INFO] [stderr] Compiling moka v0.12.15 [INFO] [stderr] Compiling prost v0.14.3 [INFO] [stderr] Compiling oximedia-core v0.1.3 [INFO] [stderr] Compiling chrono v0.4.44 [INFO] [stderr] Compiling prost-types v0.14.3 [INFO] [stderr] Compiling regex v1.12.3 [INFO] [stderr] Compiling jpeg-decoder v0.3.2 [INFO] [stderr] Compiling prost-build v0.14.3 [INFO] [stderr] Compiling tonic-prost-build v0.14.5 [INFO] [stderr] Compiling tokio-util v0.7.18 [INFO] [stderr] Compiling tokio-stream v0.1.18 [INFO] [stderr] Compiling hickory-proto v0.25.2 [INFO] [stderr] Compiling oximedia-io v0.1.3 [INFO] [stderr] Compiling oximedia-distributed v0.1.3 (/opt/rustwide/workdir) [INFO] [stderr] Compiling h2 v0.4.13 [INFO] [stderr] Compiling tower v0.5.3 [INFO] [stderr] Compiling oximedia-codec v0.1.3 [INFO] [stderr] Compiling axum v0.8.9 [INFO] [stderr] Compiling hickory-resolver v0.25.2 [INFO] [stderr] Compiling hyper v1.9.0 [INFO] [stderr] Compiling hyper-util v0.1.20 [INFO] [stderr] Compiling hyper-timeout v0.5.2 [INFO] [stderr] Compiling tonic v0.14.5 [INFO] [stderr] Compiling tonic-prost v0.14.5 [INFO] [stderr] Finished `dev` profile [unoptimized + debuginfo] target(s) in 1m 04s [INFO] running `Command { std: "docker" "inspect" "b135eafca2b8f8b7a8725431c22ea9c51e78b41c87e4df8dfe3c9613c4f3a6d9", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "b135eafca2b8f8b7a8725431c22ea9c51e78b41c87e4df8dfe3c9613c4f3a6d9", kill_on_drop: false }` [INFO] [stdout] b135eafca2b8f8b7a8725431c22ea9c51e78b41c87e4df8dfe3c9613c4f3a6d9 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+dec9417b8611e34e787a3e4c37686b5131f9e5c5" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] 506747753f33a27d2f14397f0b0cd6ab5e3750026296ce1127704ee53bc1c097 [INFO] running `Command { std: "docker" "start" "-a" "506747753f33a27d2f14397f0b0cd6ab5e3750026296ce1127704ee53bc1c097", kill_on_drop: false }` [INFO] [stderr] Compiling oximedia-distributed v0.1.3 (/opt/rustwide/workdir) [INFO] [stderr] Finished `test` profile [unoptimized + debuginfo] target(s) in 11.02s [INFO] running `Command { std: "docker" "inspect" "506747753f33a27d2f14397f0b0cd6ab5e3750026296ce1127704ee53bc1c097", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "506747753f33a27d2f14397f0b0cd6ab5e3750026296ce1127704ee53bc1c097", kill_on_drop: false }` [INFO] [stdout] 506747753f33a27d2f14397f0b0cd6ab5e3750026296ce1127704ee53bc1c097 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+dec9417b8611e34e787a3e4c37686b5131f9e5c5" "test" "--frozen", kill_on_drop: false }` [INFO] [stdout] 0f8352df0eb3088feb77b311db279d6671fd9f9bac8ee7811f3fbad545d61f5e [INFO] running `Command { std: "docker" "start" "-a" "0f8352df0eb3088feb77b311db279d6671fd9f9bac8ee7811f3fbad545d61f5e", kill_on_drop: false }` [INFO] [stderr] Finished `test` profile [unoptimized + debuginfo] target(s) in 0.36s [INFO] [stderr] Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/oximedia_distributed-434f3c5a8ca84aa0) [INFO] [stdout] [INFO] [stdout] running 658 tests [INFO] [stdout] test audit_log::tests::test_convenience_worker_and_leader_logs ... ok [INFO] [stdout] test audit_log::tests::test_builder_with_metadata ... ok [INFO] [stdout] test audit_log::tests::test_query_by_kind ... ok [INFO] [stdout] test audit_log::tests::test_query_by_target ... ok [INFO] [stdout] test audit_log::tests::test_max_entries_eviction ... ok [INFO] [stdout] test audit_log::tests::test_sequence_numbers_are_monotonic ... ok [INFO] [stdout] test backpressure::tests::test_aggregator_evict_stale ... ok [INFO] [stdout] test backpressure::tests::test_aggregator_max_level_selects_worst ... ok [INFO] [stdout] test audit_log::tests::test_recent_entries ... ok [INFO] [stdout] test backpressure::tests::test_backpressure_from_fill_ratio_critical ... ok [INFO] [stdout] test audit_log::tests::test_clear ... ok [INFO] [stdout] test backpressure::tests::test_aggregator_recommended_rate_minimum ... ok [INFO] [stdout] test audit_log::tests::test_query_by_min_severity ... ok [INFO] [stdout] test audit_log::tests::test_min_severity_filter ... ok [INFO] [stdout] test backpressure::tests::test_aggregator_mean_fill_ratio ... ok [INFO] [stdout] test audit_log::tests::test_query_by_actor ... ok [INFO] [stdout] test backpressure::tests::test_aggregator_empty_max_level_is_none ... ok [INFO] [stdout] test audit_log::tests::test_append_and_len ... ok [INFO] [stdout] test backpressure::tests::test_aggregator_count_at_or_above ... ok [INFO] [stdout] test audit_log::tests::test_get_by_sequence ... ok [INFO] [stdout] test backpressure::tests::test_backpressure_from_fill_ratio_high ... ok [INFO] [stdout] test backpressure::tests::test_backpressure_from_fill_ratio_low ... ok [INFO] [stdout] test backpressure::tests::test_backpressure_from_fill_ratio_medium ... ok [INFO] [stdout] test backpressure::tests::test_backpressure_from_fill_ratio_none ... ok [INFO] [stdout] test backpressure::tests::test_backpressure_rate_multiplier_critical ... ok [INFO] [stdout] test backpressure::tests::test_backpressure_rate_multiplier_none ... ok [INFO] [stdout] test backpressure::tests::test_credit_account_consume_fail_when_empty ... ok [INFO] [stdout] test backpressure::tests::test_credit_account_consume_success ... ok [INFO] [stdout] test backpressure::tests::test_credit_account_grant_capped_at_max ... ok [INFO] [stdout] test backpressure::tests::test_credit_account_grant_increases_balance ... ok [INFO] [stdout] test backpressure::tests::test_credit_account_may_send ... ok [INFO] [stdout] test backpressure::tests::test_token_bucket_consume_fail_insufficient ... ok [INFO] [stdout] test backpressure::tests::test_credit_account_starts_at_zero ... ok [INFO] [stdout] test backpressure::tests::test_token_bucket_refills_over_time ... ok [INFO] [stdout] test backpressure::tests::test_token_bucket_is_full_initially ... ok [INFO] [stdout] test backpressure::tests::test_token_bucket_starts_full ... ok [INFO] [stdout] test checkpointing::tests::test_checkpoint_id_to_string ... ok [INFO] [stdout] test checkpointing::tests::test_latest_for_job ... ok [INFO] [stdout] test checkpointing::tests::test_purge_old_no_op_when_few ... ok [INFO] [stdout] test checkpointing::tests::test_purge_old_keeps_n ... ok [INFO] [stdout] test checkpointing::tests::test_recovery_estimate ... ok [INFO] [stdout] test circuit_breaker::tests::test_circuit_event_display ... ok [INFO] [stdout] test checkpointing::tests::test_store_load_missing ... ok [INFO] [stdout] test circuit_breaker::tests::test_circuit_starts_closed ... ok [INFO] [stdout] test circuit_breaker::tests::test_circuit_state_display ... ok [INFO] [stdout] test backpressure::tests::test_token_bucket_consume_success ... ok [INFO] [stdout] test backpressure::tests::test_token_bucket_does_not_exceed_capacity ... ok [INFO] [stdout] test checkpointing::tests::test_latest_for_job_missing ... ok [INFO] [stdout] test checkpointing::tests::test_store_save_and_load ... ok [INFO] [stdout] test checkpointing::tests::test_checkpoint_id_display ... ok [INFO] [stdout] test circuit_breaker::tests::test_config_defaults ... ok [INFO] [stdout] test circuit_breaker::tests::test_closed_allows_requests ... ok [INFO] [stdout] test circuit_breaker::tests::test_config_builder ... ok [INFO] [stdout] test circuit_breaker::tests::test_consecutive_failures_trip ... ok [INFO] [stdout] test checkpointing::tests::test_recovery_planner_finds_latest ... ok [INFO] [stdout] test checkpointing::tests::test_recovery_planner_no_checkpoint ... ok [INFO] [stdout] test checkpointing::tests::test_checkpoint_with_metadata ... ok [INFO] [stdout] test circuit_breaker::tests::test_events_emitted ... ok [INFO] [stdout] test circuit_breaker::tests::test_failure_rate_threshold ... ok [INFO] [stdout] test circuit_breaker::tests::test_force_reset ... ok [INFO] [stdout] test circuit_breaker::tests::test_half_open_failure_reopens ... ok [INFO] [stdout] test circuit_breaker::tests::test_open_rejects_requests ... ok [INFO] [stdout] test circuit_breaker::tests::test_half_open_success_closes ... ok [INFO] [stdout] test circuit_breaker::tests::test_half_open_allows_limited_requests ... ok [INFO] [stdout] test circuit_breaker::tests::test_sliding_window_empty ... ok [INFO] [stdout] test circuit_breaker::tests::test_open_to_half_open_transition ... ok [INFO] [stdout] test circuit_breaker::tests::test_sliding_window_reset ... ok [INFO] [stdout] test cluster::tests::test_cluster_topology_add_node ... ok [INFO] [stdout] test circuit_breaker::tests::test_sliding_window_failure_rate ... ok [INFO] [stdout] test cluster::tests::test_cluster_topology_find_leader ... ok [INFO] [stdout] test cluster::tests::test_cluster_node_is_stale ... ok [INFO] [stdout] test cluster::tests::test_cluster_topology_healthy_nodes ... ok [INFO] [stdout] test circuit_breaker::tests::test_success_resets_failure_count ... ok [INFO] [stdout] test cluster::tests::test_cluster_topology_stale_nodes ... ok [INFO] [stdout] test cluster::tests::test_cluster_topology_add_node_replaces_existing ... ok [INFO] [stdout] test cluster::tests::test_node_health_display ... ok [INFO] [stdout] test cluster::tests::test_node_health_is_active ... ok [INFO] [stdout] test cluster::tests::test_node_role_can_vote ... ok [INFO] [stdout] test cluster::tests::test_cluster_topology_no_leader ... ok [INFO] [stdout] test cluster::tests::test_node_role_display ... ok [INFO] [stdout] test compaction::tests::test_compact_no_matching_entries ... ok [INFO] [stdout] test cluster::tests::test_node_role_is_leader ... ok [INFO] [stdout] test cluster::tests::test_cluster_topology_has_quorum ... ok [INFO] [stdout] test compaction::tests::test_compact_removes_entries_up_to_index ... ok [INFO] [stdout] test compaction::tests::test_install_snapshot_stale_does_not_clear_all ... ok [INFO] [stdout] test compaction::tests::test_install_snapshot_truncates_older_log ... ok [INFO] [stdout] test connection_pool::tests::test_config_builder ... ok [INFO] [stdout] test connection_pool::tests::test_config_defaults ... ok [INFO] [stdout] test connection_pool::tests::test_config_max_connections_minimum_one ... ok [INFO] [stdout] test connection_pool::tests::test_connection_expiry ... ok [INFO] [stdout] test connection_pool::tests::test_connection_state ... ok [INFO] [stdout] test compaction::tests::test_compact_all_entries ... ok [INFO] [stdout] test compaction::tests::test_compact_empty_log ... ok [INFO] [stdout] test connection_pool::tests::test_pool_checkin_nonexistent ... ok [INFO] [stdout] test connection_pool::tests::test_pool_checkout_and_checkin ... ok [INFO] [stdout] test connection_pool::tests::test_pool_creates_on_demand ... ok [INFO] [stdout] test cluster::tests::test_cluster_topology_no_quorum ... ok [INFO] [stdout] test connection_pool::tests::test_pool_execute_with_retry_exhausted ... ok [INFO] [stdout] test connection_pool::tests::test_pool_initialize ... ok [INFO] [stdout] test connection_pool::tests::test_pool_health_check_replenishes_min_idle ... ok [INFO] [stdout] test connection_pool::tests::test_pool_health_check_removes_expired ... ok [INFO] [stdout] test connection_pool::tests::test_retry_policy_delay ... ok [INFO] [stdout] test connection_pool::tests::test_pool_execute_with_retry_fails_then_succeeds ... ok [INFO] [stdout] test connection_pool::tests::test_pool_multiple_checkouts ... ok [INFO] [stdout] test cluster::tests::test_cluster_topology_remove_node ... ok [INFO] [stdout] test connection_pool::tests::test_pool_shutdown ... ok [INFO] [stdout] test connection_pool::tests::test_pool_health_check_removes_broken ... ok [INFO] [stdout] test connection_pool::tests::test_pool_mark_broken_nonexistent ... ok [INFO] [stdout] test cluster::tests::test_cluster_topology_quorum_size ... ok [INFO] [stdout] test connection_pool::tests::test_pool_execute_with_retry_success ... ok [INFO] [stdout] test connection_pool::tests::test_pool_mark_broken ... ok [INFO] [stdout] test connection_pool::tests::test_retry_policy_delay_capped ... ok [INFO] [stdout] test consensus::tests::test_election_timer_reset ... ok [INFO] [stdout] test consensus::tests::test_become_leader ... ok [INFO] [stdout] test connection_pool::tests::test_pool_exhaustion ... ok [INFO] [stdout] test consensus::tests::test_election_timer_expired ... ok [INFO] [stdout] test connection_pool::tests::test_retry_policy_should_retry ... ok [INFO] [stdout] test consensus::tests::test_become_candidate ... ok [INFO] [stdout] test connection_pool::tests::test_pool_stats ... ok [INFO] [stdout] test connection_pool::tests::test_pool_reuses_idle_connections ... ok [INFO] [stdout] test consensus::tests::test_node_id_display ... ok [INFO] [stdout] test consensus::tests::test_node_initial_state ... ok [INFO] [stdout] test consensus::tests::test_raft_role_can_vote ... ok [INFO] [stdout] test consensus::tests::test_raft_term_ordering ... ok [INFO] [stdout] test consensus::tests::test_vote_request_deny_already_voted ... ok [INFO] [stdout] test consensus::tests::test_raft_log_append_and_entry_at ... ok [INFO] [stdout] test consensus::tests::test_vote_request_grant ... ok [INFO] [stdout] test coordinator::tests::test_load_balancing_strategies ... ok [INFO] [stdout] test consensus::tests::test_step_down ... ok [INFO] [stdout] test coordinator::tests::test_worker_status_conversion ... ok [INFO] [stdout] test consensus::tests::test_vote_request_deny_lower_term ... ok [INFO] [stdout] test consensus::tests::test_raft_term_increment ... ok [INFO] [stdout] test discovery::tests::test_capacity_stats ... ok [INFO] [stdout] test coordinator::tests::test_coordinator_creation ... ok [INFO] [stdout] test discovery::tests::test_worker_capabilities ... ok [INFO] [stdout] test discovery::tests::test_health_status ... ok [INFO] [stdout] test discovery::tests::test_geo_location ... ok [INFO] [stdout] test discovery::tests::test_worker_registration ... ok [INFO] [stdout] test discovery::tests::test_discovery_service_creation ... ok [INFO] [stdout] test distributed_enhancements::tests::test_backpressure_allows_up_to_max ... ok [INFO] [stdout] test discovery::tests::test_health_check_stats ... ok [INFO] [stdout] test consensus::tests::test_vote_deny_stale_log ... ok [INFO] [stdout] test discovery::tests::test_discovery_config ... ok [INFO] [stdout] test distributed_enhancements::tests::test_backpressure_complete_frees_slot ... ok [INFO] [stdout] test distributed_enhancements::tests::test_backpressure_pending_count ... ok [INFO] [stdout] test distributed_enhancements::tests::test_checkpoint_independent_per_node ... ok [INFO] [stdout] test distributed_enhancements::tests::test_checkpoint_latest ... ok [INFO] [stdout] test distributed_enhancements::tests::test_checkpoint_sequence_increments ... ok [INFO] [stdout] test distributed_enhancements::tests::test_circuit_breaker_opens_after_threshold ... ok [INFO] [stdout] test distributed_enhancements::tests::test_hash_ring_empty_returns_none ... ok [INFO] [stdout] test distributed_enhancements::tests::test_raft_vote_granted_when_term_greater ... ok [INFO] [stdout] test distributed_enhancements::tests::test_service_registry_register_and_discover ... ok [INFO] [stdout] test distributed_enhancements::tests::test_replication_manager_fewer_nodes_than_factor ... ok [INFO] [stdout] test distributed_enhancements::tests::test_raft_vote_denied_already_voted ... ok [INFO] [stdout] test distributed_enhancements::tests::test_replication_manager_selects_factor_nodes ... ok [INFO] [stdout] test distributed_enhancements::tests::test_hash_ring_remove_node ... ok [INFO] [stdout] test distributed_enhancements::tests::test_raft_vote_denied_stale_term ... ok [INFO] [stdout] test distributed_enhancements::tests::test_circuit_breaker_reset ... ok [INFO] [stdout] test distributed_enhancements::tests::test_hash_ring_single_node_owns_all ... ok [INFO] [stdout] test distributed_enhancements::tests::test_hash_ring_get_node_returns_same_for_same_key ... ok [INFO] [stdout] test distributed_enhancements::tests::test_circuit_breaker_success_resets_count ... ok [INFO] [stdout] test distributed_enhancements::tests::test_raft_vote_new_term_clears_old_vote ... ok [INFO] [stdout] test distributed_enhancements::tests::test_raft_vote_same_candidate_ok ... ok [INFO] [stdout] test distributed_enhancements::tests::test_service_registry_missing_returns_none ... ok [INFO] [stdout] test distributed_enhancements::tests::test_replication_manager_lookup ... ok [INFO] [stdout] test distributed_enhancements::tests::test_shard_map_insert_get ... ok [INFO] [stdout] test distributed_enhancements::tests::test_wsq_steal_fifo ... ok [INFO] [stdout] test fault_tolerance::tests::test_circuit_breaker_initial_state ... ok [INFO] [stdout] test fault_tolerance::tests::test_circuit_breaker_blocked_when_open ... ok [INFO] [stdout] test fault_tolerance::tests::test_circuit_breaker_half_open_after_timeout ... ok [INFO] [stdout] test fault_tolerance::tests::test_all_failure_types ... ok [INFO] [stdout] test fault_tolerance::tests::test_circuit_breaker_resets_on_success ... ok [INFO] [stdout] test fault_tolerance::tests::test_multiple_failures_same_node ... ok [INFO] [stdout] test fault_tolerance::tests::test_fault_manager_active_failures_partial ... ok [INFO] [stdout] test fault_tolerance::tests::test_fault_manager_is_node_healthy_unknown ... ok [INFO] [stdout] test fault_tolerance::tests::test_fault_manager_is_node_unhealthy_after_failures ... ok [INFO] [stdout] test fault_tolerance::tests::test_circuit_breaker_trips_on_threshold ... ok [INFO] [stdout] test heartbeat::tests::test_alive_nodes_list ... ok [INFO] [stdout] test fault_tolerance::tests::test_fault_manager_node_recovered ... ok [INFO] [stdout] test fault_tolerance::tests::test_fault_manager_recovery_re_enables ... ok [INFO] [stdout] test distributed_enhancements::tests::test_service_registry_expired ... ok [INFO] [stdout] test distributed_enhancements::tests::test_wsq_len_and_empty ... ok [INFO] [stdout] test heartbeat::tests::test_check_no_changes_for_fresh_nodes ... ok [INFO] [stdout] test distributed_enhancements::tests::test_wsq_push_pop_lifo ... ok [INFO] [stdout] test fault_tolerance::tests::test_fault_manager_report_failure ... ok [INFO] [stdout] test distributed_enhancements::tests::test_shard_map_uniform_distribution ... ok [INFO] [stdout] test heartbeat::tests::test_dead_nodes_initially_empty ... ok [INFO] [stdout] test job_dag::tests::test_cycle_detection ... ok [INFO] [stdout] test heartbeat::tests::test_deregister_removes_node ... ok [INFO] [stdout] test heartbeat::tests::test_heartbeat_known_node_returns_true ... ok [INFO] [stdout] test heartbeat::tests::test_heartbeat_unknown_node_returns_false ... ok [INFO] [stdout] test job_dag::tests::test_empty_dag_topological_order ... ok [INFO] [stdout] test job_dag::tests::test_missing_node_rejected ... ok [INFO] [stdout] test job_dag::tests::test_no_cycle_in_linear_dag ... ok [INFO] [stdout] test heartbeat::tests::test_initial_liveness_is_alive ... ok [INFO] [stdout] test heartbeat::tests::test_record_heartbeat_resets_missed_count ... ok [INFO] [stdout] test heartbeat::tests::test_elapsed_since_heartbeat_is_small ... ok [INFO] [stdout] test heartbeat::tests::test_heartbeat_config_default_values ... ok [INFO] [stdout] test heartbeat::tests::test_liveness_unknown_node_is_none ... ok [INFO] [stdout] test heartbeat::tests::test_node_heartbeat_record_new ... ok [INFO] [stdout] test heartbeat::tests::test_register_adds_node ... ok [INFO] [stdout] test job_dag::tests::test_add_node_and_edge ... ok [INFO] [stdout] test distributed_enhancements::tests::test_shard_assign_basic ... ok [INFO] [stdout] test heartbeat::tests::test_suspect_before_dead_threshold ... ok [INFO] [stdout] test job_preemption::tests::test_always_preemption_policy ... ok [INFO] [stdout] test job_preemption::tests::test_cancel_finished_fails ... ok [INFO] [stdout] test job_preemption::tests::test_cancel_queued_job ... ok [INFO] [stdout] test job_preemption::tests::test_finish_schedules_next_from_queue ... ok [INFO] [stdout] test job_preemption::tests::test_cancel_running_schedules_next ... ok [INFO] [stdout] test job_preemption::tests::test_no_preemption_with_never_policy ... ok [INFO] [stdout] test job_preemption::tests::test_duplicate_submit_fails ... ok [INFO] [stdout] test job_dag::tests::test_predecessors ... ok [INFO] [stdout] test job_dag::tests::test_self_loop_rejected ... ok [INFO] [stdout] test job_dag::tests::test_topological_order_diamond ... ok [INFO] [stdout] test job_dag::tests::test_topological_order_linear ... ok [INFO] [stdout] test job_preemption::tests::test_active_count ... ok [INFO] [stdout] test job_dag::tests::test_unreachable_nodes_empty_for_dag ... ok [INFO] [stdout] test job_preemption::tests::test_finish_non_running_fails ... ok [INFO] [stdout] test job_tracker::tests::test_cancel_job ... ok [INFO] [stdout] test job_tracker::tests::test_complete_job ... ok [INFO] [stdout] test job_preemption::tests::test_submit_queues_when_capacity_full_no_preemption ... ok [INFO] [stdout] test job_preemption::tests::test_submit_runs_immediately_when_capacity_available ... ok [INFO] [stdout] test job_preemption::tests::test_preempted_job_resumes_after_preemptor_finishes ... ok [INFO] [stdout] test job_tracker::tests::test_completion_rate_all_complete ... ok [INFO] [stdout] test job_preemption::tests::test_preemption_higher_priority ... ok [INFO] [stdout] test job_tracker::tests::test_assign_job ... ok [INFO] [stdout] test job_tracker::tests::test_started_at_set_on_first_progress ... ok [INFO] [stdout] test job_tracker::tests::test_completion_rate_empty ... ok [INFO] [stdout] test job_tracker::tests::test_completion_rate_partial ... ok [INFO] [stdout] test job_tracker::tests::test_tracker_failed_jobs ... ok [INFO] [stdout] test job_tracker::tests::test_eta_at_100_pct_is_zero ... ok [INFO] [stdout] test job_tracker::tests::test_total_jobs ... ok [INFO] [stdout] test job_tracker::tests::test_eta_two_samples_estimates ... ok [INFO] [stdout] test job_tracker::tests::test_new_job_queued ... ok [INFO] [stdout] test job_tracker::tests::test_progress_clamped_above_100 ... ok [INFO] [stdout] test job_tracker::tests::test_progress_clamps ... ok [INFO] [stdout] test job_tracker::tests::test_progress_pct_completed_is_100 ... ok [INFO] [stdout] test job_tracker::tests::test_eta_single_sample_returns_none ... ok [INFO] [stdout] test job_tracker::tests::test_tracker_submit_and_get ... ok [INFO] [stdout] test leader_election::tests::test_become_follower ... ok [INFO] [stdout] test leader_election::tests::test_is_candidate ... ok [INFO] [stdout] test leader_election::tests::test_is_leader ... ok [INFO] [stdout] test leader_election::tests::test_node_vote_invalid_empty_ids ... ok [INFO] [stdout] test job_tracker::tests::test_eta_zero_delta_returns_none ... ok [INFO] [stdout] test job_tracker::tests::test_fail_job ... ok [INFO] [stdout] test leader_election::tests::test_start_election_clears_votes ... ok [INFO] [stdout] test job_tracker::tests::test_tracker_queued_jobs ... ok [INFO] [stdout] test job_tracker::tests::test_tracker_running_jobs ... ok [INFO] [stdout] test leader_election::tests::test_start_election_increments_term ... ok [INFO] [stdout] test leader_election::tests::test_election_state_labels ... ok [INFO] [stdout] test lease::tests::test_expiry_none_before_grant ... ok [INFO] [stdout] test leader_election::tests::test_node_vote_invalid_self_vote ... ok [INFO] [stdout] test lease::tests::test_expiry_some_after_grant ... ok [INFO] [stdout] test leader_election::tests::test_not_timed_out_before_deadline ... ok [INFO] [stdout] test leader_election::tests::test_quorum_calculation ... ok [INFO] [stdout] test leader_election::tests::test_record_vote_accepted ... ok [INFO] [stdout] test leader_election::tests::test_winner_after_majority ... ok [INFO] [stdout] test leader_election::tests::test_node_vote_is_valid ... ok [INFO] [stdout] test job_tracker::tests::test_progress_pct_queued_is_zero ... ok [INFO] [stdout] test job_tracker::tests::test_tracker_get_mut ... ok [INFO] [stdout] test lease::tests::test_new_lease_is_not_valid ... ok [INFO] [stdout] test lease::tests::test_remaining_ms_after_expiry ... ok [INFO] [stdout] test lease::tests::test_overflow_safe ... ok [INFO] [stdout] test lease::tests::test_remaining_ms_before_expiry ... ok [INFO] [stdout] test lease::tests::test_invalidate_clears_lease ... ok [INFO] [stdout] test lease::tests::test_lease_expires ... ok [INFO] [stdout] test leader_election::tests::test_record_vote_duplicate_rejected ... ok [INFO] [stdout] test job_tracker::tests::test_progress_pct_running ... ok [INFO] [stdout] test lease::tests::test_zero_duration_expires_immediately ... ok [INFO] [stdout] test load_balancer::tests::test_consistent_hash_empty ... ok [INFO] [stdout] test load_balancer::tests::test_add_multiple_workers ... ok [INFO] [stdout] test load_balancer::tests::test_is_overloaded ... ok [INFO] [stdout] test load_balancer::tests::test_consistent_hash_single_worker ... ok [INFO] [stdout] test load_balancer::tests::test_load_score_full_load ... ok [INFO] [stdout] test load_balancer::tests::test_least_connections ... ok [INFO] [stdout] test load_balancer::tests::test_load_score_zero_load ... ok [INFO] [stdout] test load_balancer::tests::test_no_workers_returns_none ... ok [INFO] [stdout] test load_balancer::tests::test_resource_aware_picks_lowest_load ... ok [INFO] [stdout] test load_balancer::tests::test_round_robin_cycles ... ok [INFO] [stdout] test load_balancer::tests::test_remove_worker ... ok [INFO] [stdout] test load_balancer::tests::test_update_load ... ok [INFO] [stdout] test membership::tests::test_add_and_remove_sequence ... ok [INFO] [stdout] test load_balancer::tests::test_weighted_round_robin ... ok [INFO] [stdout] test membership::tests::test_add_node ... ok [INFO] [stdout] test membership::tests::test_add_duplicate_node_is_noop ... ok [INFO] [stdout] test membership::tests::test_contains ... ok [INFO] [stdout] test load_balancer::tests::test_consistent_hash_stable ... ok [INFO] [stdout] test membership::tests::test_new_deduplicates_and_sorts ... ok [INFO] [stdout] test membership::tests::test_membership_maintained_sorted_after_add ... ok [INFO] [stdout] test membership::tests::test_quorum_size ... ok [INFO] [stdout] test membership::tests::test_remove_absent_node_is_noop ... ok [INFO] [stdout] test membership::tests::test_remove_node ... ok [INFO] [stdout] test lease::tests::test_renew_extends_lease ... ok [INFO] [stdout] test membership::tests::test_set_members_replaces_all ... ok [INFO] [stdout] test lease::tests::test_renew_makes_lease_valid ... ok [INFO] [stdout] test message_bus::tests::test_bus_message_age ... ok [INFO] [stdout] test membership::tests::test_len_and_is_empty ... ok [INFO] [stdout] test leader_election::tests::test_is_timed_out ... ok [INFO] [stdout] test message_bus::tests::test_message_type_is_task_event ... ok [INFO] [stdout] test message_bus::tests::test_message_type_topics ... ok [INFO] [stdout] test message_bus::tests::test_pending_count ... ok [INFO] [stdout] test message_bus::tests::test_multiple_subscribers ... ok [INFO] [stdout] test message_bus::tests::test_publish_no_subscribers ... ok [INFO] [stdout] test message_bus::tests::test_subscribe_and_publish ... ok [INFO] [stdout] test message_bus::tests::test_subscribe_filters_by_type ... ok [INFO] [stdout] test message_bus::tests::test_unsubscribe ... ok [INFO] [stdout] test message_bus::tests::test_message_type_is_node_event ... ok [INFO] [stdout] test message_queue::tests::test_drain_expired ... ok [INFO] [stdout] test message_bus::tests::test_bus_message_with_correlation ... ok [INFO] [stdout] test message_bus::tests::test_bus_message_with_header ... ok [INFO] [stdout] test message_bus::tests::test_bus_stats ... ok [INFO] [stdout] test message_bus::tests::test_clear_mailboxes ... ok [INFO] [stdout] test message_bus::tests::test_mailbox_size_limit ... ok [INFO] [stdout] test message_bus::tests::test_bus_message_creation ... ok [INFO] [stdout] test message_queue::tests::test_message_not_expired_within_ttl ... ok [INFO] [stdout] test message_queue::tests::test_message_not_expired_without_ttl ... ok [INFO] [stdout] test message_queue::tests::test_message_payload_len ... ok [INFO] [stdout] test message_queue::tests::test_priority_escalate ... ok [INFO] [stdout] test message_queue::tests::test_priority_numeric_values ... ok [INFO] [stdout] test message_queue::tests::test_priority_ordering ... ok [INFO] [stdout] test message_queue::tests::test_queue_capacity_overflow ... ok [INFO] [stdout] test message_queue::tests::test_queue_dequeue_priority_order ... ok [INFO] [stdout] test message_queue::tests::test_queue_enqueue_and_len ... ok [INFO] [stdout] test message_queue::tests::test_queue_enqueued_total ... ok [INFO] [stdout] test message_queue::tests::test_queue_peek_priority ... ok [INFO] [stdout] test metrics_aggregator::tests::test_aggregate_empty ... ok [INFO] [stdout] test metrics_aggregator::tests::test_aggregate_mean ... ok [INFO] [stdout] test metrics_aggregator::tests::test_alert_above_fires ... ok [INFO] [stdout] test metrics_aggregator::tests::test_aggregate_min_max ... ok [INFO] [stdout] test metrics_aggregator::tests::test_alert_below_fires ... ok [INFO] [stdout] test metrics_aggregator::tests::test_aggregate_sum ... ok [INFO] [stdout] test metrics_aggregator::tests::test_alert_does_not_fire_when_ok ... ok [INFO] [stdout] test metrics_aggregator::tests::test_aggregate_p50 ... ok [INFO] [stdout] test message_queue::tests::test_message_is_expired_after_ttl ... ok [INFO] [stdout] test node_health::tests::test_health_status_can_accept_work ... ok [INFO] [stdout] test metrics_aggregator::tests::test_record_and_query ... ok [INFO] [stdout] test metrics_aggregator::tests::test_query_windowed ... ok [INFO] [stdout] test node_health::tests::test_available_nodes ... ok [INFO] [stdout] test node_health::tests::test_nodes_with_status ... ok [INFO] [stdout] test node_health::tests::test_overloaded_detection ... ok [INFO] [stdout] test node_health::tests::test_node_health_check_success ... ok [INFO] [stdout] test node_health::tests::test_registry_recovery ... ok [INFO] [stdout] test node_health::tests::test_registry_register_and_status ... ok [INFO] [stdout] test node_health::tests::test_health_check_config_defaults ... ok [INFO] [stdout] test node_health::tests::test_overloaded_marks_degraded ... ok [INFO] [stdout] test node_health::tests::test_node_health_check_failure ... ok [INFO] [stdout] test node_health::tests::test_health_status_is_alive ... ok [INFO] [stdout] test node_health::tests::test_set_maintenance ... ok [INFO] [stdout] test node_health::tests::test_registry_failure_escalation ... ok [INFO] [stdout] test node_health::tests::test_registry_unregister ... ok [INFO] [stdout] test node_registry::tests::test_node_info_has_tag ... ok [INFO] [stdout] test node_registry::tests::test_registry_available_workers ... ok [INFO] [stdout] test node_health::tests::test_set_draining ... ok [INFO] [stdout] test node_registry::tests::test_node_info_initial_status_healthy ... ok [INFO] [stdout] test node_registry::tests::test_registry_by_tag ... ok [INFO] [stdout] test node_registry::tests::test_degraded_is_available ... ok [INFO] [stdout] test node_registry::tests::test_registry_deregister ... ok [INFO] [stdout] test node_registry::tests::test_node_role_as_str ... ok [INFO] [stdout] test node_registry::tests::test_registry_by_role ... ok [INFO] [stdout] test node_registry::tests::test_healthy_is_available ... ok [INFO] [stdout] test node_registry::tests::test_node_info_age_ms ... ok [INFO] [stdout] test node_registry::tests::test_registry_empty ... ok [INFO] [stdout] test node_registry::tests::test_registry_register_and_get ... ok [INFO] [stdout] test node_registry::tests::test_registry_register_replaces_existing ... ok [INFO] [stdout] test node_registry::tests::test_registry_status_summary ... ok [INFO] [stdout] test node_registry::tests::test_suspended_not_available ... ok [INFO] [stdout] test node_registry::tests::test_node_info_touch_updates_status ... ok [INFO] [stdout] test node_topology::tests::test_cost_ordering ... ok [INFO] [stdout] test node_topology::tests::test_location_tier_display ... ok [INFO] [stdout] test node_topology::tests::test_nodes_in_data_center ... ok [INFO] [stdout] test node_topology::tests::test_nodes_in_region ... ok [INFO] [stdout] test node_topology::tests::test_nodes_with_data ... ok [INFO] [stdout] test node_registry::tests::test_registry_evict_stale ... ok [INFO] [stdout] test node_topology::tests::test_rank_by_locality ... ok [INFO] [stdout] test node_registry::tests::test_registry_remove_node_soft_delete ... ok [INFO] [stdout] test node_topology::tests::test_regions_list ... ok [INFO] [stdout] test job_tracker::tests::test_update_progress ... ok [INFO] [stdout] test metrics_aggregator::tests::test_cluster_metrics_compute ... ok [INFO] [stdout] test lease::tests::test_remaining_ms_not_granted ... ok [INFO] [stdout] test node_registry::tests::test_removed_not_available ... ok [INFO] [stdout] test node_topology::tests::test_node_local_data_operations ... ok [INFO] [stdout] test node_topology::tests::test_tier_same_dc ... ok [INFO] [stdout] test node_topology::tests::test_tier_same_host ... ok [INFO] [stdout] test node_topology::tests::test_tier_same_rack ... ok [INFO] [stdout] test node_topology::tests::test_set_available ... ok [INFO] [stdout] test partition::tests::test_cluster_node_weight_clamped ... ok [INFO] [stdout] test node_topology::tests::test_tier_same_region ... ok [INFO] [stdout] test partition::tests::test_fnv1a_hash_deterministic ... ok [INFO] [stdout] test node_topology::tests::test_topology_manager_add_remove ... ok [INFO] [stdout] test partition::tests::test_get_node_returns_some ... ok [INFO] [stdout] test partition::tests::test_add_node_increases_vnode_count ... ok [INFO] [stdout] test partition::tests::test_remove_node_decreases_vnode_count ... ok [INFO] [stdout] test node_topology::tests::test_tier_remote ... ok [INFO] [stdout] test raft_primitives::tests::test_raft_log_append_and_get ... ok [INFO] [stdout] test partition::tests::test_fnv1a_hash_different_inputs ... ok [INFO] [stdout] test partition::tests::test_partition_table_empty_nodes ... ok [INFO] [stdout] test partition::tests::test_partition_table_all_partitions_assigned ... ok [INFO] [stdout] test partition::tests::test_partitions_for_node_coverage ... ok [INFO] [stdout] test partition::tests::test_partition_table_owner_of_out_of_range ... ok [INFO] [stdout] test partition::tests::test_get_node_empty_ring_returns_none ... ok [INFO] [stdout] test partition::tests::test_rebalance_after_node_removal ... ok [INFO] [stdout] test partition::tests::test_consistent_hashing_same_key_same_node ... ok [INFO] [stdout] test raft_primitives::tests::test_log_entry_is_valid ... ok [INFO] [stdout] test raft_primitives::tests::test_raft_log_committed_entries ... ok [INFO] [stdout] test raft_primitives::tests::test_raft_log_get_invalid_index ... ok [INFO] [stdout] test raft_primitives::tests::test_raft_log_get_valid_index ... ok [INFO] [stdout] test raft_primitives::tests::test_raft_role_display ... ok [INFO] [stdout] test raft_primitives::tests::test_raft_log_truncate_after ... ok [INFO] [stdout] test raft_primitives::tests::test_raft_state_become_candidate ... ok [INFO] [stdout] test raft_primitives::tests::test_raft_state_apply_up_to ... ok [INFO] [stdout] test raft_primitives::tests::test_raft_role_can_accept_writes ... ok [INFO] [stdout] test raft_primitives::tests::test_raft_state_update_commit_index ... ok [INFO] [stdout] test replication::tests::test_commit_up_to_capped_at_last_index ... ok [INFO] [stdout] test raft_primitives::tests::test_raft_state_initial ... ok [INFO] [stdout] test replication::tests::test_log_entry_new ... ok [INFO] [stdout] test replication::tests::test_has_quorum ... ok [INFO] [stdout] test replication::tests::test_quorum_majority_odd_cluster ... ok [INFO] [stdout] test replication::tests::test_commit_and_apply ... ok [INFO] [stdout] test replication::tests::test_replicated_log_append_increments_index ... ok [INFO] [stdout] test replication::tests::test_quorum_majority_even_cluster ... ok [INFO] [stdout] test raft_primitives::tests::test_raft_state_become_follower ... ok [INFO] [stdout] test raft_primitives::tests::test_raft_state_become_leader ... ok [INFO] [stdout] test replication::tests::test_replicated_log_compaction ... ok [INFO] [stdout] test replication::tests::test_replicated_log_get_entry ... ok [INFO] [stdout] test replication::tests::test_replicated_log_last_index_and_term ... ok [INFO] [stdout] test replication::tests::test_replicated_log_get_missing ... ok [INFO] [stdout] test replication::tests::test_term_tracker_grant_vote_once ... ok [INFO] [stdout] test replication::tests::test_term_tracker_initial_state ... ok [INFO] [stdout] test replication::tests::test_term_tracker_vote_cleared_on_term_advance ... ok [INFO] [stdout] test resource_quota::tests::test_acquire_denied_when_full ... ok [INFO] [stdout] test resource_quota::tests::test_acquire_and_release ... ok [INFO] [stdout] test resource_quota::tests::test_check_within_quota ... ok [INFO] [stdout] test resource_quota::tests::test_cpu_utilisation ... ok [INFO] [stdout] test raft_primitives::tests::test_raft_state_advance_term ... ok [INFO] [stdout] test resource_quota::tests::test_global_usage_tracking ... ok [INFO] [stdout] test resource_quota::tests::test_memory_utilisation ... ok [INFO] [stdout] test resource_quota::tests::test_register_and_count ... ok [INFO] [stdout] test resource_quota::tests::test_zero_usage ... ok [INFO] [stdout] test resource_quota::tests::test_quota_violation_display ... ok [INFO] [stdout] test scheduler::tests::test_backfilling ... ok [INFO] [stdout] test resource_quota::tests::test_unregister ... ok [INFO] [stdout] test scheduler::tests::test_priority_scheduling ... ok [INFO] [stdout] test segment::tests::test_gop_detector ... ok [INFO] [stdout] test scheduler::tests::test_resource_allocation ... ok [INFO] [stdout] test scheduler::tests::test_scheduler_creation ... ok [INFO] [stdout] test resource_quota::tests::test_unknown_consumer_check_fails ... ok [INFO] [stdout] test scheduler::tests::test_scheduling_builder ... ok [INFO] [stdout] test segment_merge::tests::test_manifest_creation_and_completeness ... ok [INFO] [stdout] test segment_merge::tests::test_manifest_rejects_duplicate_index ... ok [INFO] [stdout] test segment_merge::tests::test_manifest_register_and_complete ... ok [INFO] [stdout] test segment::tests::test_gop_info ... ok [INFO] [stdout] test segment::tests::test_segment_reassembler ... ok [INFO] [stdout] test segment::tests::test_time_based_segmentation ... ok [INFO] [stdout] test segment_merge::tests::test_merge_ignores_gaps_with_ignore_policy ... ok [INFO] [stdout] test resource_quota::tests::test_check_exceeds_cpu ... ok [INFO] [stdout] test resource_quota::tests::test_check_exceeds_memory ... ok [INFO] [stdout] test resource_quota::tests::test_default_limits ... ok [INFO] [stdout] test scheduler::tests::test_fifo_scheduling ... ok [INFO] [stdout] test segment::tests::test_video_info_creation ... ok [INFO] [stdout] test segment::tests::test_concatenation_strategies ... ok [INFO] [stdout] test segment_merge::tests::test_merge_rejects_unvalidated_segment ... ok [INFO] [stdout] test segment_merge::tests::test_total_byte_size ... ok [INFO] [stdout] test shard::tests::test_catalog_shards_for_node ... ok [INFO] [stdout] test shard::tests::test_catalog_empty ... ok [INFO] [stdout] test shard::tests::test_catalog_total_size_bytes ... ok [INFO] [stdout] test shard::tests::test_catalog_upsert_and_get ... ok [INFO] [stdout] test shard::tests::test_catalog_upsert_updates_existing ... ok [INFO] [stdout] test segment_merge::tests::test_manifest_rejects_out_of_range_index ... ok [INFO] [stdout] test segment_merge::tests::test_merge_incomplete_manifest_fails ... ok [INFO] [stdout] test segment_merge::tests::test_merge_no_gaps ... ok [INFO] [stdout] test shard::tests::test_ring_distribution_two_nodes ... ok [INFO] [stdout] test segment_merge::tests::test_merge_small_gap_within_tolerance ... ok [INFO] [stdout] test segment_merge::tests::test_merge_strict_rejects_gap ... ok [INFO] [stdout] test segment_merge::tests::test_ordered_segments_returns_sorted ... ok [INFO] [stdout] test shard::tests::test_ring_empty_returns_none ... ok [INFO] [stdout] test segment_merge::tests::test_manifest_rejects_wrong_job_id ... ok [INFO] [stdout] test scheduler::tests::test_policy_migration ... ok [INFO] [stdout] test shard::tests::test_shard_key_different_keys_different_hashes ... ok [INFO] [stdout] test shard::tests::test_shard_key_hash64_deterministic ... ok [INFO] [stdout] test shard::tests::test_shard_metadata_complete_migration ... ok [INFO] [stdout] test shard::tests::test_shard_metadata_begin_migration ... ok [INFO] [stdout] test replication::tests::test_term_tracker_advance_term ... ok [INFO] [stdout] test shard::tests::test_ring_nodes_list ... ok [INFO] [stdout] test shard::tests::test_ring_physical_node_count ... ok [INFO] [stdout] test shard::tests::test_ring_remove_node ... ok [INFO] [stdout] test shard_map::tests::test_batch_assign ... ok [INFO] [stdout] test shard::tests::test_ring_single_node_always_assigned ... ok [INFO] [stdout] test shard::tests::test_shard_metadata_initial_state ... ok [INFO] [stdout] test shard_map::tests::test_node_id_with_weight ... ok [INFO] [stdout] test shard::tests::test_ring_virtual_node_count ... ok [INFO] [stdout] test shard_map::tests::test_default_config ... ok [INFO] [stdout] test shard_map::tests::test_shard_map_empty ... ok [INFO] [stdout] test shard_map::tests::test_shard_map_add_node ... ok [INFO] [stdout] test shard_map::tests::test_node_id_display ... ok [INFO] [stdout] test shard_map::tests::test_shard_map_default_trait ... ok [INFO] [stdout] test shard_map::tests::test_shard_map_lookup_single_node ... ok [INFO] [stdout] test shard_map::tests::test_shard_map_lookup_deterministic ... ok [INFO] [stdout] test shard_map::tests::test_node_id_creation ... ok [INFO] [stdout] test shard_map::tests::test_shard_map_node_ids ... ok [INFO] [stdout] test shard_map::tests::test_shard_map_remove_node ... ok [INFO] [stdout] test shard_map::tests::test_batch_assign_empty_ring ... ok [INFO] [stdout] test shard_map::tests::test_shard_map_load_factor_empty ... ok [INFO] [stdout] test shard_map::tests::test_shard_map_distribution ... ok [INFO] [stdout] test shard_map::tests::test_shard_map_load_factor ... ok [INFO] [stdout] test snapshot_store::tests::test_snapshot_checksum ... ok [INFO] [stdout] test snapshot_store::tests::test_snapshot_id_is_newer_than ... ok [INFO] [stdout] test snapshot_store::tests::test_snapshot_id_ordering ... ok [INFO] [stdout] test snapshot_store::tests::test_snapshot_is_stale_at ... ok [INFO] [stdout] test snapshot_store::tests::test_snapshot_size_bytes ... ok [INFO] [stdout] test shard_map::tests::test_weighted_nodes ... ok [INFO] [stdout] test shard_map::tests::test_shard_map_remove_nonexistent ... ok [INFO] [stdout] test snapshot_store::tests::test_snapshot_id_display ... ok [INFO] [stdout] test snapshot_store::tests::test_snapshot_id_is_valid ... ok [INFO] [stdout] test snapshot_store::tests::test_store_retain_latest ... ok [INFO] [stdout] test snapshot_store::tests::test_store_save_and_load ... ok [INFO] [stdout] test snapshot_store::tests::test_store_all_ids_ordered ... ok [INFO] [stdout] test snapshot_store::tests::test_store_latest ... ok [INFO] [stdout] test snapshot_store::tests::test_store_prune_old ... ok [INFO] [stdout] test snapshot_store::tests::test_store_replace_updates_bytes ... ok [INFO] [stdout] test task_distribution::tests::test_affinity_capped_at_one ... ok [INFO] [stdout] test task_distribution::tests::test_affinity_fails_cpu ... ok [INFO] [stdout] test snapshot_store::tests::test_store_total_bytes ... ok [INFO] [stdout] test snapshot_store::tests::test_store_count ... ok [INFO] [stdout] test task_distribution::tests::test_affinity_fails_memory ... ok [INFO] [stdout] test task_distribution::tests::test_affinity_gpu_bonus ... ok [INFO] [stdout] test task_distribution::tests::test_affinity_meets_minimums ... ok [INFO] [stdout] test task_distribution::tests::test_affinity_tag_bonus ... ok [INFO] [stdout] test task_distribution::tests::test_migration_planner_no_migrations_balanced ... ok [INFO] [stdout] test task_distribution::tests::test_migration_planner_suggests_migrations ... ok [INFO] [stdout] test task_distribution::tests::test_workload_balancer_gpu_task ... ok [INFO] [stdout] test task_distribution::tests::test_workload_balancer_selects_best ... ok [INFO] [stdout] test task_distribution::tests::test_workload_balancer_no_capable_worker ... ok [INFO] [stdout] test task_priority_queue::tests::test_capacity_limit ... ok [INFO] [stdout] test task_priority_queue::tests::test_apply_aging ... ok [INFO] [stdout] test task_priority_queue::tests::test_drain_priority ... ok [INFO] [stdout] test task_priority_queue::tests::test_deadline_tasks_preferred ... ok [INFO] [stdout] test task_priority_queue::tests::test_clear ... ok [INFO] [stdout] test task_priority_queue::tests::test_new_queue_is_empty ... ok [INFO] [stdout] test task_priority_queue::tests::test_pop_order_by_priority ... ok [INFO] [stdout] test task_queue::tests::test_queue_counters ... ok [INFO] [stdout] test task_priority_queue::tests::test_would_preempt_logic ... ok [INFO] [stdout] test task_priority_queue::tests::test_earlier_deadline_first ... ok [INFO] [stdout] test task_queue::tests::test_queue_drain ... ok [INFO] [stdout] test task_queue::tests::test_queue_capacity_limit ... ok [INFO] [stdout] test task_priority_queue::tests::test_peek ... ok [INFO] [stdout] test task_priority_queue::tests::test_priority_display ... ok [INFO] [stdout] test task_priority_queue::tests::test_preempt_not_triggered_when_not_at_capacity ... ok [INFO] [stdout] test task_priority_queue::tests::test_priority_weight ... ok [INFO] [stdout] test task_priority_queue::tests::test_push_and_pop_single ... ok [INFO] [stdout] test task_priority_queue::tests::test_same_priority_earlier_submit_first ... ok [INFO] [stdout] test task_priority_queue::tests::test_preempt_replaces_lowest_priority ... ok [INFO] [stdout] test task_priority_queue::tests::test_remove_expired ... ok [INFO] [stdout] test task_priority_queue::tests::test_preempt_unlimited_queue_returns_none ... ok [INFO] [stdout] test task_priority_queue::tests::test_preempt_not_triggered_equal_priority ... ok [INFO] [stdout] test task_priority_queue::tests::test_with_estimated_duration ... ok [INFO] [stdout] test task_queue::tests::test_queue_fifo_within_same_priority ... ok [INFO] [stdout] test task_queue::tests::test_task_mark_failed ... ok [INFO] [stdout] test task_queue::tests::test_task_lifecycle ... ok [INFO] [stdout] test task_queue::tests::test_queue_peek ... ok [INFO] [stdout] test task_queue::tests::test_queue_priority_order ... ok [INFO] [stdout] test task_queue::tests::test_queue_remove_expired ... ok [INFO] [stdout] test task_queue::tests::test_task_creation ... ok [INFO] [stdout] test task_queue::tests::test_task_priority_is_higher_than ... ok [INFO] [stdout] test task_retry::tests::test_attempt_record_is_success ... ok [INFO] [stdout] test task_retry::tests::test_backoff_strategy_display ... ok [INFO] [stdout] test task_queue::tests::test_task_retry ... ok [INFO] [stdout] test task_queue::tests::test_task_with_deadline ... ok [INFO] [stdout] test task_retry::tests::test_attempt_outcome_display ... ok [INFO] [stdout] test task_queue::tests::test_queue_enqueue_dequeue ... ok [INFO] [stdout] test task_queue::tests::test_task_priority_ordering ... ok [INFO] [stdout] test task_retry::tests::test_can_retry ... ok [INFO] [stdout] test task_retry::tests::test_exponential_backoff ... ok [INFO] [stdout] test task_retry::tests::test_exponential_backoff_cap ... ok [INFO] [stdout] test task_retry::tests::test_jitter_capped_at_100 ... ok [INFO] [stdout] test tests::test_advance_job_lifecycle ... ok [INFO] [stdout] test tests::test_cancel_completed_job_fails ... ok [INFO] [stdout] test tests::test_cancel_nonexistent_job_fails ... ok [INFO] [stdout] test tests::test_cancel_job ... ok [INFO] [stdout] test task_retry::tests::test_jitter_config ... ok [INFO] [stdout] test task_retry::tests::test_retry_policy_default ... ok [INFO] [stdout] test task_retry::tests::test_retry_tracker_cancelled ... ok [INFO] [stdout] test task_retry::tests::test_retry_tracker_exhausted ... ok [INFO] [stdout] test task_retry::tests::test_retry_tracker_non_retryable_code ... ok [INFO] [stdout] test task_retry::tests::test_retry_tracker_success_first_attempt ... ok [INFO] [stdout] test task_retry::tests::test_retry_tracker_fail_then_succeed ... ok [INFO] [stdout] test task_retry::tests::test_linear_backoff ... ok [INFO] [stdout] test task_retry::tests::test_retry_decision_display ... ok [INFO] [stdout] test task_retry::tests::test_constant_backoff ... ok [INFO] [stdout] test task_retry::tests::test_retryable_codes_default_all ... ok [INFO] [stdout] test task_retry::tests::test_retry_tracker_total_durations ... ok [INFO] [stdout] test task_retry::tests::test_retryable_codes_specific ... ok [INFO] [stdout] test tests::test_concurrency_limit ... ok [INFO] [stdout] test tests::test_job_priority_ordering ... ok [INFO] [stdout] test tests::test_fail_without_fault_tolerance ... ok [INFO] [stdout] test tests::test_encoder_creation ... ok [INFO] [stdout] test tests::test_concurrency_freed_after_cancel ... ok [INFO] [stdout] test tests::test_list_jobs ... ok [INFO] [stdout] test tests::test_default_config ... ok [INFO] [stdout] test tests::test_submit_rejects_empty_output_url ... ok [INFO] [stdout] test tests::test_submit_and_query_job ... ok [INFO] [stdout] test tests::test_submit_rejects_empty_codec ... ok [INFO] [stdout] test tests::test_fail_job_with_retry ... ok [INFO] [stdout] test tests::test_submit_rejects_empty_source_url ... ok [INFO] [stdout] test twopc::tests::test_abort_after_no_vote ... ok [INFO] [stdout] test tests::test_job_count ... ok [INFO] [stdout] test twopc::tests::test_abort_after_prepare ... ok [INFO] [stdout] test twopc::tests::test_abort_terminal_state_returns_false ... ok [INFO] [stdout] test twopc::tests::test_commit_after_prepare_succeeds ... ok [INFO] [stdout] test tests::test_status_nonexistent_job_fails ... ok [INFO] [stdout] test weighted_round_robin::tests::test_empty_returns_none ... ok [INFO] [stdout] test weighted_round_robin::tests::test_is_empty_and_len ... ok [INFO] [stdout] test weighted_round_robin::tests::test_remove_nonexistent_returns_false ... ok [INFO] [stdout] test twopc::tests::test_empty_participants_commit ... ok [INFO] [stdout] test twopc::tests::test_new_state_is_idle ... ok [INFO] [stdout] test weighted_round_robin::tests::test_remove_worker ... ok [INFO] [stdout] test twopc::tests::test_no_vote_prevents_commit ... ok [INFO] [stdout] test tests::test_submit_rejects_duplicate_id ... ok [INFO] [stdout] test tests::test_submit_past_deadline_rejected ... ok [INFO] [stdout] test twopc::tests::test_vote_counts ... ok [INFO] [stdout] test weighted_round_robin::tests::test_basic_selection_returns_a_worker ... ok [INFO] [stdout] test twopc::tests::test_prepare_transitions_to_preparing ... ok [INFO] [stdout] test twopc::tests::test_record_vote_unknown_participant ... ok [INFO] [stdout] test twopc::tests::test_record_vote_wrong_state ... ok [INFO] [stdout] test twopc::tests::test_reset_allows_reuse ... ok [INFO] [stdout] test weighted_round_robin::tests::test_single_worker_always_selected ... ok [INFO] [stdout] test work_stealing::tests::test_scheduler_add_queue ... ok [INFO] [stdout] test weighted_round_robin::tests::test_update_weight ... ok [INFO] [stdout] test work_stealing::tests::test_scheduler_busiest_owner ... ok [INFO] [stdout] test work_stealing::tests::test_scheduler_pop_for ... ok [INFO] [stdout] test weighted_round_robin::tests::test_weight_of ... ok [INFO] [stdout] test weighted_round_robin::tests::test_proportion_matches_weights ... ok [INFO] [stdout] test work_stealing::tests::test_scheduler_total_pending ... ok [INFO] [stdout] test work_stealing::tests::test_stealable_task_is_high_priority ... ok [INFO] [stdout] test work_stealing::tests::test_work_queue_high_priority_tasks ... ok [INFO] [stdout] test work_stealing::tests::test_scheduler_steal_from_empty ... ok [INFO] [stdout] test work_stealing::tests::test_work_queue_len_and_is_empty ... ok [INFO] [stdout] test work_stealing::tests::test_scheduler_idlest_owner ... ok [INFO] [stdout] test work_stealing::tests::test_work_queue_push_pop_lifo ... ok [INFO] [stdout] test work_stealing::tests::test_scheduler_steal_from ... ok [INFO] [stdout] test work_stealing::tests::test_work_queue_steal_fifo ... ok [INFO] [stdout] test worker::tests::test_worker_metrics ... ok [INFO] [stdout] test weighted_round_robin::tests::test_zero_weight_excluded ... ok [INFO] [stdout] test work_stealing::tests::test_scheduler_submit_task ... ok [INFO] [stdout] test worker::tests::test_worker_status_conversion ... ok [INFO] [stdout] test worker_draining::tests::test_deregister ... ok [INFO] [stdout] test worker::tests::test_worker_config_default ... ok [INFO] [stdout] test worker::tests::test_worker_capabilities_detection ... ok [INFO] [stdout] test worker_draining::tests::test_drain_completes_when_tasks_finish ... ok [INFO] [stdout] test worker_draining::tests::test_drain_with_no_tasks_immediately_drained ... ok [INFO] [stdout] test worker_draining::tests::test_register_and_active_state ... ok [INFO] [stdout] test worker_draining::tests::test_active_workers_excludes_draining ... ok [INFO] [stdout] test worker_draining::tests::test_force_drain_discards_tasks ... ok [INFO] [stdout] test worker_draining::tests::test_already_draining_error ... ok [INFO] [stdout] test worker_draining::tests::test_assign_task_success ... ok [INFO] [stdout] test worker_draining::tests::test_assign_task_to_draining_fails ... ok [INFO] [stdout] test work_stealing::tests::test_scheduler_steal_from_missing_queue ... ok [INFO] [stdout] test worker_draining::tests::test_unknown_worker_errors ... ok [INFO] [stderr] Doc-tests oximedia_distributed [INFO] [stdout] test tests::test_job_timeout_detection ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 658 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.11s [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] running 1 test [INFO] [stdout] test src/weighted_round_robin.rs - weighted_round_robin::WeightedRoundRobin (line 27) ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 1.22s [INFO] [stdout] [INFO] running `Command { std: "docker" "inspect" "0f8352df0eb3088feb77b311db279d6671fd9f9bac8ee7811f3fbad545d61f5e", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "0f8352df0eb3088feb77b311db279d6671fd9f9bac8ee7811f3fbad545d61f5e", kill_on_drop: false }` [INFO] [stdout] 0f8352df0eb3088feb77b311db279d6671fd9f9bac8ee7811f3fbad545d61f5e