[INFO] fetching crate oxigdal-cluster 0.1.3... [INFO] testing oxigdal-cluster-0.1.3 against try#dec9417b8611e34e787a3e4c37686b5131f9e5c5 for pr-154210-2 [INFO] extracting crate oxigdal-cluster 0.1.3 into /workspace/builds/worker-6-tc2/source [INFO] started tweaking crates.io crate oxigdal-cluster 0.1.3 [INFO] removed 0 missing tests [INFO] finished tweaking crates.io crate oxigdal-cluster 0.1.3 [INFO] tweaked toml for crates.io crate oxigdal-cluster 0.1.3 written to /workspace/builds/worker-6-tc2/source/Cargo.toml [INFO] validating manifest of crates.io crate oxigdal-cluster 0.1.3 on toolchain dec9417b8611e34e787a3e4c37686b5131f9e5c5 [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+dec9417b8611e34e787a3e4c37686b5131f9e5c5" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }` [INFO] crate crates.io crate oxigdal-cluster 0.1.3 already has a lockfile, it will not be regenerated [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+dec9417b8611e34e787a3e4c37686b5131f9e5c5" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+dec9417b8611e34e787a3e4c37686b5131f9e5c5" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }` [INFO] [stdout] 915bb847f6b6669e3ad7f1f11eb22b82eb1a0c3139479457a32a0e120afb6cb6 [INFO] running `Command { std: "docker" "start" "-a" "915bb847f6b6669e3ad7f1f11eb22b82eb1a0c3139479457a32a0e120afb6cb6", kill_on_drop: false }` [INFO] running `Command { std: "docker" "inspect" "915bb847f6b6669e3ad7f1f11eb22b82eb1a0c3139479457a32a0e120afb6cb6", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "915bb847f6b6669e3ad7f1f11eb22b82eb1a0c3139479457a32a0e120afb6cb6", kill_on_drop: false }` [INFO] [stdout] 915bb847f6b6669e3ad7f1f11eb22b82eb1a0c3139479457a32a0e120afb6cb6 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+dec9417b8611e34e787a3e4c37686b5131f9e5c5" "build" "--frozen" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] 6b2bc71a89f7d6a37b1647e3e82cb9ce3e60f34593e144f774d5e03cd2cc39f6 [INFO] running `Command { std: "docker" "start" "-a" "6b2bc71a89f7d6a37b1647e3e82cb9ce3e60f34593e144f774d5e03cd2cc39f6", kill_on_drop: false }` [INFO] [stderr] Compiling syn v2.0.117 [INFO] [stderr] Compiling serde v1.0.228 [INFO] [stderr] Compiling libm v0.2.16 [INFO] [stderr] Compiling hashbrown v0.16.1 [INFO] [stderr] Compiling num-traits v0.2.19 [INFO] [stderr] Compiling zerocopy v0.8.47 [INFO] [stderr] Compiling parking_lot_core v0.9.12 [INFO] [stderr] Compiling arrow-schema v58.0.0 [INFO] [stderr] Compiling getrandom v0.3.4 [INFO] [stderr] Compiling lexical-util v1.0.7 [INFO] [stderr] Compiling anyhow v1.0.102 [INFO] [stderr] Compiling sync_wrapper v1.0.2 [INFO] [stderr] Compiling flatbuffers v25.12.19 [INFO] [stderr] Compiling matchit v0.8.4 [INFO] [stderr] Compiling getrandom v0.4.2 [INFO] [stderr] Compiling hashbrown v0.14.5 [INFO] [stderr] Compiling parking_lot v0.12.5 [INFO] [stderr] Compiling uuid v1.22.0 [INFO] [stderr] Compiling serde_json v1.0.149 [INFO] [stderr] Compiling num_cpus v1.17.0 [INFO] [stderr] Compiling sysinfo v0.38.4 [INFO] [stderr] Compiling indexmap v2.13.0 [INFO] [stderr] Compiling lru v0.16.3 [INFO] [stderr] Compiling lexical-write-integer v1.0.6 [INFO] [stderr] Compiling lexical-parse-integer v1.0.6 [INFO] [stderr] Compiling dashmap v6.1.0 [INFO] [stderr] Compiling lexical-write-float v1.0.6 [INFO] [stderr] Compiling lexical-parse-float v1.0.6 [INFO] [stderr] Compiling lexical-core v1.0.6 [INFO] [stderr] Compiling num-integer v0.1.46 [INFO] [stderr] Compiling num-complex v0.4.6 [INFO] [stderr] Compiling atoi v2.0.0 [INFO] [stderr] Compiling num-bigint v0.4.6 [INFO] [stderr] Compiling serde_derive v1.0.228 [INFO] [stderr] Compiling tokio-macros v2.6.1 [INFO] [stderr] Compiling zerocopy-derive v0.8.47 [INFO] [stderr] Compiling futures-macro v0.3.32 [INFO] [stderr] Compiling tracing-attributes v0.1.31 [INFO] [stderr] Compiling pin-project-internal v1.1.11 [INFO] [stderr] Compiling prost-derive v0.14.3 [INFO] [stderr] Compiling thiserror-impl v2.0.18 [INFO] [stderr] Compiling async-trait v0.1.89 [INFO] [stderr] Compiling futures-util v0.3.32 [INFO] [stderr] Compiling pin-project v1.1.11 [INFO] [stderr] Compiling tracing v0.1.44 [INFO] [stderr] Compiling thiserror v2.0.18 [INFO] [stderr] Compiling oxiarc-core v0.2.6 [INFO] [stderr] Compiling oxiarc-zstd v0.2.6 [INFO] [stderr] Compiling bytes v1.11.1 [INFO] [stderr] Compiling chrono v0.4.44 [INFO] [stderr] Compiling http v1.4.0 [INFO] [stderr] Compiling tokio v1.50.0 [INFO] [stderr] Compiling prost v0.14.3 [INFO] [stderr] Compiling prost-types v0.14.3 [INFO] [stderr] Compiling futures-executor v0.3.32 [INFO] [stderr] Compiling http-body v1.0.1 [INFO] [stderr] Compiling futures v0.3.32 [INFO] [stderr] Compiling http-body-util v0.1.3 [INFO] [stderr] Compiling axum-core v0.5.6 [INFO] [stderr] Compiling half v2.7.1 [INFO] [stderr] Compiling ahash v0.8.12 [INFO] [stderr] Compiling arrow-buffer v58.0.0 [INFO] [stderr] Compiling arrow-data v58.0.0 [INFO] [stderr] Compiling arrow-array v58.0.0 [INFO] [stderr] Compiling tokio-util v0.7.18 [INFO] [stderr] Compiling tokio-stream v0.1.18 [INFO] [stderr] Compiling h2 v0.4.13 [INFO] [stderr] Compiling tower v0.5.3 [INFO] [stderr] Compiling arrow-select v58.0.0 [INFO] [stderr] Compiling axum v0.8.8 [INFO] [stderr] Compiling arrow-ord v58.0.0 [INFO] [stderr] Compiling arrow-ipc v58.0.0 [INFO] [stderr] Compiling hyper v1.8.1 [INFO] [stderr] Compiling arrow-cast v58.0.0 [INFO] [stderr] Compiling hyper-util v0.1.20 [INFO] [stderr] Compiling hyper-timeout v0.5.2 [INFO] [stderr] Compiling tonic v0.14.5 [INFO] [stderr] Compiling tonic-prost v0.14.5 [INFO] [stderr] Compiling arrow-flight v58.0.0 [INFO] [stderr] Compiling oxigdal-cluster v0.1.3 (/opt/rustwide/workdir) [INFO] [stderr] Finished `dev` profile [unoptimized + debuginfo] target(s) in 1m 31s [INFO] running `Command { std: "docker" "inspect" "6b2bc71a89f7d6a37b1647e3e82cb9ce3e60f34593e144f774d5e03cd2cc39f6", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "6b2bc71a89f7d6a37b1647e3e82cb9ce3e60f34593e144f774d5e03cd2cc39f6", kill_on_drop: false }` [INFO] [stdout] 6b2bc71a89f7d6a37b1647e3e82cb9ce3e60f34593e144f774d5e03cd2cc39f6 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+dec9417b8611e34e787a3e4c37686b5131f9e5c5" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] 020843c11f3b59e5110dc3f5cabd327c5086c0e811a5c3e845dfbfb66aaa2f5b [INFO] running `Command { std: "docker" "start" "-a" "020843c11f3b59e5110dc3f5cabd327c5086c0e811a5c3e845dfbfb66aaa2f5b", kill_on_drop: false }` [INFO] [stderr] Compiling num-traits v0.2.19 [INFO] [stderr] Compiling getrandom v0.3.4 [INFO] [stderr] Compiling bitflags v2.11.0 [INFO] [stderr] Compiling serde v1.0.228 [INFO] [stderr] Compiling tracing v0.1.44 [INFO] [stderr] Compiling itertools v0.14.0 [INFO] [stderr] Compiling cc v1.2.57 [INFO] [stderr] Compiling regex-automata v0.4.14 [INFO] [stderr] Compiling ciborium-io v0.2.2 [INFO] [stderr] Compiling plotters-backend v0.3.7 [INFO] [stderr] Compiling anstyle v1.0.14 [INFO] [stderr] Compiling clap_lex v1.1.0 [INFO] [stderr] Compiling ppv-lite86 v0.2.21 [INFO] [stderr] Compiling wait-timeout v0.2.1 [INFO] [stderr] Compiling cast v0.3.0 [INFO] [stderr] Compiling bit-vec v0.8.0 [INFO] [stderr] Compiling quick-error v1.2.3 [INFO] [stderr] Compiling rustix v1.1.4 [INFO] [stderr] Compiling flatbuffers v25.12.19 [INFO] [stderr] Compiling criterion-plot v0.8.2 [INFO] [stderr] Compiling bit-set v0.8.0 [INFO] [stderr] Compiling ahash v0.8.12 [INFO] [stderr] Compiling rand_core v0.9.5 [INFO] [stderr] Compiling clap_builder v4.6.0 [INFO] [stderr] Compiling plotters-svg v0.3.7 [INFO] [stderr] Compiling tracing-log v0.2.0 [INFO] [stderr] Compiling page_size v0.6.0 [INFO] [stderr] Compiling anes v0.1.6 [INFO] [stderr] Compiling oorandom v11.1.5 [INFO] [stderr] Compiling unarray v0.1.4 [INFO] [stderr] Compiling rand v0.9.2 [INFO] [stderr] Compiling rand_xorshift v0.4.0 [INFO] [stderr] Compiling rand_chacha v0.9.0 [INFO] [stderr] Compiling bytes v1.11.1 [INFO] [stderr] Compiling tinytemplate v1.2.1 [INFO] [stderr] Compiling tokio v1.50.0 [INFO] [stderr] Compiling http v1.4.0 [INFO] [stderr] Compiling half v2.7.1 [INFO] [stderr] Compiling num-integer v0.1.46 [INFO] [stderr] Compiling chrono v0.4.44 [INFO] [stderr] Compiling num-complex v0.4.6 [INFO] [stderr] Compiling atoi v2.0.0 [INFO] [stderr] Compiling plotters v0.3.7 [INFO] [stderr] Compiling ciborium-ll v0.2.2 [INFO] [stderr] Compiling alloca v0.4.0 [INFO] [stderr] Compiling prost-derive v0.14.3 [INFO] [stderr] Compiling num-bigint v0.4.6 [INFO] [stderr] Compiling ciborium v0.2.2 [INFO] [stderr] Compiling tempfile v3.27.0 [INFO] [stderr] Compiling http-body v1.0.1 [INFO] [stderr] Compiling rusty-fork v0.3.1 [INFO] [stderr] Compiling http-body-util v0.1.3 [INFO] [stderr] Compiling proptest v1.10.0 [INFO] [stderr] Compiling axum-core v0.5.6 [INFO] [stderr] Compiling matchers v0.2.0 [INFO] [stderr] Compiling regex v1.12.3 [INFO] [stderr] Compiling tracing-subscriber v0.3.23 [INFO] [stderr] Compiling prost v0.14.3 [INFO] [stderr] Compiling arrow-buffer v58.0.0 [INFO] [stderr] Compiling clap v4.6.0 [INFO] [stderr] Compiling criterion v0.8.2 [INFO] [stderr] Compiling prost-types v0.14.3 [INFO] [stderr] Compiling arrow-data v58.0.0 [INFO] [stderr] Compiling arrow-array v58.0.0 [INFO] [stderr] Compiling tokio-util v0.7.18 [INFO] [stderr] Compiling tokio-stream v0.1.18 [INFO] [stderr] Compiling h2 v0.4.13 [INFO] [stderr] Compiling tower v0.5.3 [INFO] [stderr] Compiling arrow-select v58.0.0 [INFO] [stderr] Compiling axum v0.8.8 [INFO] [stderr] Compiling arrow-ord v58.0.0 [INFO] [stderr] Compiling arrow-ipc v58.0.0 [INFO] [stderr] Compiling hyper v1.8.1 [INFO] [stderr] Compiling hyper-util v0.1.20 [INFO] [stderr] Compiling arrow-cast v58.0.0 [INFO] [stderr] Compiling hyper-timeout v0.5.2 [INFO] [stderr] Compiling tonic v0.14.5 [INFO] [stderr] Compiling tonic-prost v0.14.5 [INFO] [stderr] Compiling arrow-flight v58.0.0 [INFO] [stderr] Compiling oxigdal-cluster v0.1.3 (/opt/rustwide/workdir) [INFO] [stderr] Finished `test` profile [unoptimized + debuginfo] target(s) in 1m 30s [INFO] running `Command { std: "docker" "inspect" "020843c11f3b59e5110dc3f5cabd327c5086c0e811a5c3e845dfbfb66aaa2f5b", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "020843c11f3b59e5110dc3f5cabd327c5086c0e811a5c3e845dfbfb66aaa2f5b", kill_on_drop: false }` [INFO] [stdout] 020843c11f3b59e5110dc3f5cabd327c5086c0e811a5c3e845dfbfb66aaa2f5b [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+dec9417b8611e34e787a3e4c37686b5131f9e5c5" "test" "--frozen", kill_on_drop: false }` [INFO] [stdout] 97f53257cf6aa6f3021f415005fd64be94c44cd3e7cf6b84947a3438e2855d23 [INFO] running `Command { std: "docker" "start" "-a" "97f53257cf6aa6f3021f415005fd64be94c44cd3e7cf6b84947a3438e2855d23", kill_on_drop: false }` [INFO] [stderr] Finished `test` profile [unoptimized + debuginfo] target(s) in 0.35s [INFO] [stderr] Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/oxigdal_cluster-54c4484086bbff03) [INFO] [stdout] [INFO] [stdout] running 113 tests [INFO] [stdout] test autoscale::tests::test_metrics_recording ... ok [INFO] [stdout] test autoscale::tests::test_cooldown_period ... ok [INFO] [stdout] test autoscale::tests::test_autoscaler_creation ... ok [INFO] [stdout] test autoscale::tests::test_scale_down_calculation ... ok [INFO] [stdout] test autoscale::tests::test_scale_up_calculation ... ok [INFO] [stdout] test cache_coherency::tests::test_cache_creation ... ok [INFO] [stdout] test cache_coherency::tests::test_cache_hit_rate ... ok [INFO] [stdout] test coordinator::tests::test_coordinator_creation ... ok [INFO] [stdout] test cache_coherency::tests::test_cache_compression ... ok [INFO] [stdout] test cache_coherency::tests::test_cache_put_get ... ok [INFO] [stdout] test coordinator::tests::test_config_storage ... ok [INFO] [stdout] test data_locality::tests::test_locality_optimizer_creation ... ok [INFO] [stdout] test coordinator::tests::test_coordinator_start_stop ... ok [INFO] [stdout] test error::tests::test_quorum_error ... ok [INFO] [stdout] test data_locality::tests::test_register_data ... ok [INFO] [stdout] test data_locality::tests::test_data_access_tracking ... ok [INFO] [stdout] test cache_coherency::tests::test_cache_invalidation ... ok [INFO] [stdout] test fault_tolerance::bulkhead::tests::test_bulkhead_registry ... ok [INFO] [stdout] test fault_tolerance::circuit_breaker::tests::test_circuit_breaker_force_operations ... ok [INFO] [stdout] test fault_tolerance::circuit_breaker::tests::test_circuit_breaker_registry ... ok [INFO] [stdout] test data_locality::tests::test_hot_data_detection ... ok [INFO] [stdout] test fault_tolerance::circuit_breaker::tests::test_circuit_breaker_closes_on_successes ... ok [INFO] [stdout] test fault_tolerance::circuit_breaker::tests::test_circuit_breaker_creation ... ok [INFO] [stdout] test fault_tolerance::circuit_breaker::tests::test_circuit_breaker_rejects_when_open ... ok [INFO] [stdout] test fault_tolerance::bulkhead::tests::test_bulkhead_creation ... ok [INFO] [stdout] test fault_tolerance::bulkhead::tests::test_bulkhead_stats ... ok [INFO] [stdout] test fault_tolerance::circuit_breaker::tests::test_circuit_breaker_stats ... ok [INFO] [stdout] test fault_tolerance::bulkhead::tests::test_bulkhead_acquire ... ok [INFO] [stdout] test fault_tolerance::bulkhead::tests::test_bulkhead_try_acquire ... ok [INFO] [stdout] test coordinator::tests::test_member_registration ... ok [INFO] [stdout] test fault_tolerance::degradation::tests::test_load_shedder ... ok [INFO] [stdout] test error::tests::test_error_retryable ... ok [INFO] [stdout] test fault_tolerance::degradation::tests::test_request_priority ... ok [INFO] [stdout] test fault_tolerance::degradation::tests::test_load_shedding ... ok [INFO] [stdout] test fault_tolerance::degradation::tests::test_degradation_level_ordering ... ok [INFO] [stdout] test fault_tolerance::health_check::tests::test_check_all ... ok [INFO] [stdout] test fault_tolerance::degradation::tests::test_degradation_manager_creation ... ok [INFO] [stdout] test fault_tolerance::degradation::tests::test_with_fallback ... ok [INFO] [stdout] test fault_tolerance::degradation::tests::test_set_level ... ok [INFO] [stdout] test fault_tolerance::degradation::tests::test_error_recording ... ok [INFO] [stdout] test fault_tolerance::degradation::tests::test_feature_availability ... ok [INFO] [stdout] test fault_tolerance::health_check::tests::test_composite_health_check ... ok [INFO] [stdout] test fault_tolerance::health_check::tests::test_health_check_manager_creation ... ok [INFO] [stdout] test fault_tolerance::tests::test_worker_quarantine ... ok [INFO] [stdout] test fault_tolerance::health_check::tests::test_health_status_combine ... ok [INFO] [stdout] test fault_tolerance::tests::test_task_retry ... ok [INFO] [stdout] test fault_tolerance::health_check::tests::test_liveness_readiness ... ok [INFO] [stdout] test fault_tolerance::timeout::tests::test_adaptive_timeout ... ok [INFO] [stdout] test fault_tolerance::bulkhead::tests::test_thread_pool_bulkhead ... ok [INFO] [stdout] test fault_tolerance::health_check::tests::test_register_health_check ... ok [INFO] [stdout] test fault_tolerance::tests::test_checkpoint ... ok [INFO] [stdout] test fault_tolerance::health_check::tests::test_unhealthy_check ... ok [INFO] [stdout] test fault_tolerance::tests::test_fault_tolerance_creation ... ok [INFO] [stdout] test fault_tolerance::tests::test_max_retries ... ok [INFO] [stdout] test fault_tolerance::timeout::tests::test_deadline ... ok [INFO] [stdout] test fault_tolerance::timeout::tests::test_timeout_budget ... ok [INFO] [stdout] test fault_tolerance::timeout::tests::test_deadline_expired ... ok [INFO] [stdout] test fault_tolerance::timeout::tests::test_timeout_budget_even_allocation ... ok [INFO] [stdout] test metrics::tests::test_metrics_creation ... ok [INFO] [stdout] test metrics::tests::test_queue_depth ... ok [INFO] [stdout] test fault_tolerance::timeout::tests::test_timeout_manager_creation ... ok [INFO] [stdout] test fault_tolerance::timeout::tests::test_timeout_registry ... ok [INFO] [stdout] test network::tests::test_bandwidth_tracker ... ok [INFO] [stdout] test metrics::tests::test_resource_utilization ... ok [INFO] [stdout] test fault_tolerance::timeout::tests::test_timeout_success ... ok [INFO] [stdout] test network::tests::test_topology_manager ... ok [INFO] [stdout] test error::tests::test_error_requires_failover ... ok [INFO] [stdout] test replication::tests::test_quorum_operations ... ok [INFO] [stdout] test network::tests::test_congestion_controller ... ok [INFO] [stdout] test replication::tests::test_replication_manager_creation ... ok [INFO] [stdout] test monitoring::tests::test_metric_registration ... ok [INFO] [stdout] test metrics::tests::test_cache_hit_rate ... ok [INFO] [stdout] test metrics::tests::test_task_metrics ... ok [INFO] [stdout] test monitoring::tests::test_alert_rule ... ok [INFO] [stdout] test fault_tolerance::timeout::tests::test_timeout_exceeded ... ok [INFO] [stdout] test monitoring::tests::test_anomaly_detection ... ok [INFO] [stdout] test monitoring::tests::test_metric_recording ... ok [INFO] [stdout] test replication::tests::test_rereplication ... ok [INFO] [stdout] test data_locality::tests::test_placement_recommendation ... ok [INFO] [stdout] test replication::tests::test_create_replicas ... ok [INFO] [stdout] test resources::quota::tests::test_quota_allocation ... ok [INFO] [stdout] test resources::quota::tests::test_quota_utilization ... ok [INFO] [stdout] test resources::reservation::tests::test_reservation_conflict ... ok [INFO] [stdout] test resources::reservation::tests::test_reservation_lifecycle ... ok [INFO] [stdout] test scheduler::advanced::tests::test_backfilling_scheduler ... ok [INFO] [stdout] test scheduler::advanced::tests::test_deadline_scheduler ... ok [INFO] [stdout] test scheduler::advanced::tests::test_fair_share_priority ... ok [INFO] [stdout] test scheduler::advanced::tests::test_gang_scheduler_creation ... ok [INFO] [stdout] test scheduler::advanced::tests::test_multi_queue_scheduler ... ok [INFO] [stdout] test scheduler::core::tests::test_submit_task ... ok [INFO] [stdout] test scheduler::core::tests::test_scheduler_creation ... ok [INFO] [stdout] test security::tests::test_authentication ... ok [INFO] [stdout] test security::tests::test_authorization ... ok [INFO] [stdout] test security::tests::test_user_creation ... ok [INFO] [stdout] test task_graph::tests::test_add_task ... ok [INFO] [stdout] test task_graph::tests::test_cycle_detection ... ok [INFO] [stdout] test security::tests::test_secret_management ... ok [INFO] [stdout] test task_graph::tests::test_execution_plan ... ok [INFO] [stdout] test task_graph::tests::test_task_dependencies ... ok [INFO] [stdout] test task_graph::tests::test_task_status_update ... ok [INFO] [stdout] test worker_pool::tests::test_heartbeat ... ok [INFO] [stdout] test worker_pool::tests::test_register_worker ... ok [INFO] [stdout] test worker_pool::tests::test_worker_pool_creation ... ok [INFO] [stdout] test worker_pool::tests::test_worker_selection ... ok [INFO] [stdout] test workflow::tests::test_workflow_execution ... ok [INFO] [stdout] test resources::reservation::tests::test_create_reservation ... ok [INFO] [stdout] test workflow::tests::test_workflow_pause_resume ... ok [INFO] [stdout] test workflow::tests::test_workflow_creation ... ok [INFO] [stdout] test resources::accounting::tests::test_invoice_generation ... ok [INFO] [stdout] test workflow::tests::test_template_creation ... ok [INFO] [stdout] test task_graph::tests::test_task_graph_creation ... ok [INFO] [stdout] test fault_tolerance::circuit_breaker::tests::test_circuit_breaker_opens_on_failures ... ok [INFO] [stdout] test resources::accounting::tests::test_task_accounting ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 113 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.14s [INFO] [stdout] [INFO] [stderr] Running tests/cluster_integration_test.rs (/opt/rustwide/target/debug/deps/cluster_integration_test-05d61abf30daaef3) [INFO] [stdout] [INFO] [stdout] running 10 tests [INFO] [stdout] test test_data_locality ... ok [INFO] [stdout] test test_cluster_builder ... ok [INFO] [stdout] test test_cluster_creation ... ok [INFO] [stdout] test test_coordinator ... ok [INFO] [stdout] test test_cluster_statistics ... ok [INFO] [stdout] test test_fault_tolerance ... ok [INFO] [stdout] test test_replication ... ok [INFO] [stdout] test test_task_dependencies ... ok [INFO] [stdout] test test_task_submission_and_execution ... ok [INFO] [stdout] test test_distributed_cache ... ok [INFO] [stderr] Running tests/workflow_test.rs (/opt/rustwide/target/debug/deps/workflow_test-ddbce6a962344d04) [INFO] [stdout] [INFO] [stdout] test result: ok. 10 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.11s [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] running 4 tests [INFO] [stdout] test test_workflow_template ... ok [INFO] [stdout] test test_workflow_execution ... ok [INFO] [stdout] test test_workflow_pause_resume ... ok [INFO] [stderr] Doc-tests oxigdal_cluster [INFO] [stdout] test test_workflow_creation ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 4 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] running 5 tests [INFO] [stdout] test src/fault_tolerance/mod.rs - fault_tolerance (line 14) ... ignored [INFO] [stdout] test src/lib.rs - (line 26) - compile ... ok [INFO] [stdout] test src/lib.rs - Cluster (line 351) - compile ... ok [INFO] [stdout] test src/lib.rs - (line 49) - compile ... ok [INFO] [stdout] test src/lib.rs - ClusterBuilder (line 180) ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 4 passed; 0 failed; 1 ignored; 0 measured; 0 filtered out; finished in 0.00s [INFO] [stdout] [INFO] [stdout] all doctests ran in 1.86s; merged doctests compilation took 1.82s [INFO] running `Command { std: "docker" "inspect" "97f53257cf6aa6f3021f415005fd64be94c44cd3e7cf6b84947a3438e2855d23", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "97f53257cf6aa6f3021f415005fd64be94c44cd3e7cf6b84947a3438e2855d23", kill_on_drop: false }` [INFO] [stdout] 97f53257cf6aa6f3021f415005fd64be94c44cd3e7cf6b84947a3438e2855d23