[INFO] fetching crate queue_workers 0.5.1...
[INFO] testing queue_workers-0.5.1 against beta-2025-10-28 for beta-1.92-2
[INFO] extracting crate queue_workers 0.5.1 into /workspace/builds/worker-0-tc2/source
[INFO] started tweaking crates.io crate queue_workers 0.5.1
[INFO] removed 0 missing tests
[INFO] finished tweaking crates.io crate queue_workers 0.5.1
[INFO] tweaked toml for crates.io crate queue_workers 0.5.1 written to /workspace/builds/worker-0-tc2/source/Cargo.toml
[INFO] validating manifest of crates.io crate queue_workers 0.5.1 on toolchain beta-2025-10-28
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+beta-2025-10-28" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] crate crates.io crate queue_workers 0.5.1 already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+beta-2025-10-28" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:4848fb76d95f26979359cc7e45710b1dbc8f3acb7aeedee7c460d7702230f228" "/opt/rustwide/cargo-home/bin/cargo" "+beta-2025-10-28" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] [stdout] c2fbe44dec73d4f33b9fd73dc425a5adae168a5b4a1b646dce571a05f576a7a7
[INFO] running `Command { std: "docker" "start" "-a" "c2fbe44dec73d4f33b9fd73dc425a5adae168a5b4a1b646dce571a05f576a7a7", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "c2fbe44dec73d4f33b9fd73dc425a5adae168a5b4a1b646dce571a05f576a7a7", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "c2fbe44dec73d4f33b9fd73dc425a5adae168a5b4a1b646dce571a05f576a7a7", kill_on_drop: false }`
[INFO] [stdout] c2fbe44dec73d4f33b9fd73dc425a5adae168a5b4a1b646dce571a05f576a7a7
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:4848fb76d95f26979359cc7e45710b1dbc8f3acb7aeedee7c460d7702230f228" "/opt/rustwide/cargo-home/bin/cargo" "+beta-2025-10-28" "build" "--frozen" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] 7e2cab8fa0617b537a623079602e4bd5265993cd2b9eaca1b9cfbd103ab70891
[INFO] running `Command { std: "docker" "start" "-a" "7e2cab8fa0617b537a623079602e4bd5265993cd2b9eaca1b9cfbd103ab70891", kill_on_drop: false }`
[INFO] [stderr]    Compiling smallvec v1.15.0
[INFO] [stderr]    Compiling num-traits v0.2.19
[INFO] [stderr]    Compiling futures-channel v0.3.31
[INFO] [stderr]    Compiling getrandom v0.3.2
[INFO] [stderr]    Compiling sha1_smol v1.0.1
[INFO] [stderr]    Compiling tokio-macros v2.5.0
[INFO] [stderr]    Compiling thiserror-impl v2.0.12
[INFO] [stderr]    Compiling arc-swap v1.7.1
[INFO] [stderr]    Compiling serde v1.0.219
[INFO] [stderr]    Compiling async-trait v0.1.88
[INFO] [stderr]    Compiling num_cpus v1.16.0
[INFO] [stderr]    Compiling icu_locid_transform v1.5.0
[INFO] [stderr]    Compiling parking_lot_core v0.9.10
[INFO] [stderr]    Compiling parking_lot v0.12.3
[INFO] [stderr]    Compiling futures-util v0.3.31
[INFO] [stderr]    Compiling tokio v1.44.2
[INFO] [stderr]    Compiling icu_properties v1.5.1
[INFO] [stderr]    Compiling num-integer v0.1.46
[INFO] [stderr]    Compiling thiserror v2.0.12
[INFO] [stderr]    Compiling num-bigint v0.4.6
[INFO] [stderr]    Compiling icu_normalizer v1.5.0
[INFO] [stderr]    Compiling uuid v1.16.0
[INFO] [stderr]    Compiling chrono v0.4.40
[INFO] [stderr]    Compiling serde_json v1.0.140
[INFO] [stderr]    Compiling futures-executor v0.3.31
[INFO] [stderr]    Compiling futures v0.3.31
[INFO] [stderr]    Compiling idna_adapter v1.2.0
[INFO] [stderr]    Compiling idna v1.0.3
[INFO] [stderr]    Compiling url v2.5.4
[INFO] [stderr]    Compiling tokio-util v0.7.14
[INFO] [stderr]    Compiling combine v4.6.7
[INFO] [stderr]    Compiling redis v0.29.5
[INFO] [stderr]    Compiling queue_workers v0.5.1 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `dev` profile [unoptimized + debuginfo] target(s) in 37.95s
[INFO] running `Command { std: "docker" "inspect" "7e2cab8fa0617b537a623079602e4bd5265993cd2b9eaca1b9cfbd103ab70891", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "7e2cab8fa0617b537a623079602e4bd5265993cd2b9eaca1b9cfbd103ab70891", kill_on_drop: false }`
[INFO] [stdout] 7e2cab8fa0617b537a623079602e4bd5265993cd2b9eaca1b9cfbd103ab70891
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:4848fb76d95f26979359cc7e45710b1dbc8f3acb7aeedee7c460d7702230f228" "/opt/rustwide/cargo-home/bin/cargo" "+beta-2025-10-28" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] 091829d6379ea9f03dee396bb053e73847dde544c51b2d7c3d94d00b2a78f501
[INFO] running `Command { std: "docker" "start" "-a" "091829d6379ea9f03dee396bb053e73847dde544c51b2d7c3d94d00b2a78f501", kill_on_drop: false }`
[INFO] [stderr]    Compiling tracing-core v0.1.33
[INFO] [stderr]    Compiling regex-syntax v0.8.5
[INFO] [stderr]    Compiling tracing-attributes v0.1.28
[INFO] [stderr]    Compiling regex-automata v0.1.10
[INFO] [stderr]    Compiling sharded-slab v0.1.7
[INFO] [stderr]    Compiling anstream v0.6.18
[INFO] [stderr]    Compiling env_filter v0.1.3
[INFO] [stderr]    Compiling thread_local v1.1.8
[INFO] [stderr]    Compiling tracing-test-macro v0.2.5
[INFO] [stderr]    Compiling test-log-macros v0.2.17
[INFO] [stderr]    Compiling queue_workers v0.5.1 (/opt/rustwide/workdir)
[INFO] [stderr]    Compiling env_logger v0.11.8
[INFO] [stderr]    Compiling tracing-log v0.2.0
[INFO] [stderr]    Compiling tracing-serde v0.2.0
[INFO] [stderr]    Compiling test-log v0.2.17
[INFO] [stderr]    Compiling matchers v0.1.0
[INFO] [stderr]    Compiling tracing v0.1.41
[INFO] [stderr]    Compiling regex-automata v0.4.9
[INFO] [stderr]    Compiling regex v1.11.1
[INFO] [stderr]    Compiling tracing-subscriber v0.3.19
[INFO] [stderr]    Compiling tracing-test v0.2.5
[INFO] [stdout] warning: struct `TestQueue` is never constructed
[INFO] [stdout]    --> tests/common/mod.rs:254:12
[INFO] [stdout]     |
[INFO] [stdout] 254 | pub struct TestQueue {
[INFO] [stdout]     |            ^^^^^^^^^
[INFO] [stdout]     |
[INFO] [stdout]     = note: `#[warn(dead_code)]` (part of `#[warn(unused)]`) on by default
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: struct `TestQueue` is never constructed
[INFO] [stdout]    --> tests/common/mod.rs:254:12
[INFO] [stdout]     |
[INFO] [stdout] 254 | pub struct TestQueue {
[INFO] [stdout]     |            ^^^^^^^^^
[INFO] [stdout]     |
[INFO] [stdout]     = note: `#[warn(dead_code)]` (part of `#[warn(unused)]`) on by default
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 16.45s
[INFO] running `Command { std: "docker" "inspect" "091829d6379ea9f03dee396bb053e73847dde544c51b2d7c3d94d00b2a78f501", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "091829d6379ea9f03dee396bb053e73847dde544c51b2d7c3d94d00b2a78f501", kill_on_drop: false }`
[INFO] [stdout] 091829d6379ea9f03dee396bb053e73847dde544c51b2d7c3d94d00b2a78f501
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:4848fb76d95f26979359cc7e45710b1dbc8f3acb7aeedee7c460d7702230f228" "/opt/rustwide/cargo-home/bin/cargo" "+beta-2025-10-28" "test" "--frozen", kill_on_drop: false }`
[INFO] [stdout] a08caad893239bf67a668d3eb59bd57a4ca98a8d7939f72dc088cf2b31acf499
[INFO] running `Command { std: "docker" "start" "-a" "a08caad893239bf67a668d3eb59bd57a4ca98a8d7939f72dc088cf2b31acf499", kill_on_drop: false }`
[INFO] [stderr] warning: struct `TestQueue` is never constructed
[INFO] [stderr]    --> tests/common/mod.rs:254:12
[INFO] [stderr]     |
[INFO] [stderr] 254 | pub struct TestQueue {
[INFO] [stderr]     |            ^^^^^^^^^
[INFO] [stderr]     |
[INFO] [stderr]     = note: `#[warn(dead_code)]` (part of `#[warn(unused)]`) on by default
[INFO] [stderr] 
[INFO] [stderr] warning: `queue_workers` (test "concurrent_worker_integration") generated 1 warning
[INFO] [stderr] warning: `queue_workers` (test "serial_worker_integration") generated 1 warning (1 duplicate)
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 0.16s
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/queue_workers-ff90760467e3528c)
[INFO] [stdout] 
[INFO] [stdout] running 4 tests
[INFO] [stdout] test job::tests::test_clone ... ok
[INFO] [stdout] test job::tests::test_new_job_metadata ... ok
[INFO] [stdout] test job::tests::test_serialization ... ok
[INFO] [stdout] test job::tests::test_update_status ... ok
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 4 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
[INFO] [stdout] 
[INFO] [stderr]      Running tests/concurrent_worker.rs (/opt/rustwide/target/debug/deps/concurrent_worker-858081366172a243)
[INFO] [stdout] 
[INFO] [stdout] running 20 tests
[INFO] [stdout] test common::tests::test_logging_levels ... ok
[INFO] [stdout] test common::tests::test_span_logging ... ok
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.420391Z","level":"INFO","fields":{"message":"All jobs completed, shutting down...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":122},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":122,"threadName":"test_concurrent_worker_job_retries_once","threadId":"ThreadId(9)"}
[INFO] [stdout] test test_concurrent_worker_job_retries_once ... ok
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.420921Z","level":"INFO","fields":{"message":"Starting concurrent worker...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":96},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":96,"threadName":"test_concurrent_worker_shutdown_with_empty_queue","threadId":"ThreadId(20)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.421058Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_shutdown_with_empty_queue","threadId":"ThreadId(20)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.421673Z","level":"INFO","fields":{"message":"All jobs completed, shutting down...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":122},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":122,"threadName":"test_concurrent_worker_job_respects_worker_config_retry_limit","threadId":"ThreadId(8)"}
[INFO] [stdout] test test_concurrent_worker_job_respects_worker_config_retry_limit ... ok
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.421911Z","level":"INFO","fields":{"message":"Shutdown signal received, waiting for 1s for running jobs to complete...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":105},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":105,"threadName":"test_concurrent_worker_job_retries_until_it_fails","threadId":"ThreadId(11)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.422093Z","level":"INFO","fields":{"message":"Starting concurrent worker...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":96},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":96,"threadName":"test_concurrent_worker_varying_job_durations","threadId":"ThreadId(21)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.422173Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_varying_job_durations","threadId":"ThreadId(21)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.422219Z","level":"DEBUG","fields":{"message":"Picked up new job from queue","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":59},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":59,"threadName":"test_concurrent_worker_varying_job_durations","threadId":"ThreadId(21)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.422277Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_varying_job_durations","threadId":"ThreadId(21)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.422318Z","level":"DEBUG","fields":{"message":"Picked up new job from queue","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":59},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":59,"threadName":"test_concurrent_worker_varying_job_durations","threadId":"ThreadId(21)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.424833Z","level":"INFO","fields":{"message":"Shutdown signal received, waiting for 50ms for running jobs to complete...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":105},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":105,"threadName":"test_concurrent_worker_graceful_shutdown_cancels_ongoing_job","threadId":"ThreadId(5)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.425249Z","level":"INFO","fields":{"message":"All jobs completed, shutting down...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":122},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":122,"threadName":"test_concurrent_worker_job_retries_until_it_fails","threadId":"ThreadId(11)"}
[INFO] [stdout] test test_concurrent_worker_job_retries_until_it_fails ... ok
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.425971Z","level":"INFO","fields":{"message":"Shutdown signal received, waiting for 1s for running jobs to complete...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":105},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":105,"threadName":"test_concurrent_worker_completes_job_during_shutdown","threadId":"ThreadId(4)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.433111Z","level":"INFO","fields":{"message":"Starting concurrent worker...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":96},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":96,"threadName":"test_concurrent_worker_shutdown_during_job_retry_delay","threadId":"ThreadId(18)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.433155Z","level":"INFO","fields":{"message":"Starting concurrent worker...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":96},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":96,"threadName":"test_concurrent_worker_shutdown_signal_channel_closed","threadId":"ThreadId(19)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.433234Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_shutdown_during_job_retry_delay","threadId":"ThreadId(18)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.433263Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_shutdown_signal_channel_closed","threadId":"ThreadId(19)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.433272Z","level":"DEBUG","fields":{"message":"Picked up new job from queue","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":59},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":59,"threadName":"test_concurrent_worker_shutdown_during_job_retry_delay","threadId":"ThreadId(18)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.433314Z","level":"DEBUG","fields":{"message":"Picked up new job from queue","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":59},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":59,"threadName":"test_concurrent_worker_shutdown_signal_channel_closed","threadId":"ThreadId(19)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.433413Z","level":"INFO","fields":{"message":"Shutdown signal received, waiting for 3s for running jobs to complete...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":105},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":105,"threadName":"test_concurrent_worker_shutdown_signal_channel_closed","threadId":"ThreadId(19)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.435055Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_graceful_shutdown_completes_job","threadId":"ThreadId(6)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.435164Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_graceful_shutdown_completes_job","threadId":"ThreadId(6)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.436270Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.436338Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.436395Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.436447Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.436491Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.436536Z","level":"DEBUG","fields":{"message":"Picked up new job from queue","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":59},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":59,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.436662Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.436763Z","level":"DEBUG","fields":{"message":"Picked up new job from queue","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":59},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":59,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.436832Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.436896Z","level":"DEBUG","fields":{"message":"Picked up new job from queue","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":59},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":59,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.437139Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.437183Z","level":"DEBUG","fields":{"message":"Picked up new job from queue","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":59},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":59,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.453517Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_varying_job_durations","threadId":"ThreadId(21)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.453740Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_varying_job_durations","threadId":"ThreadId(21)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.456000Z","level":"DEBUG","fields":{"message":"Picked up new job from queue","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":59},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":59,"threadName":"test_concurrent_worker_varying_job_durations","threadId":"ThreadId(21)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.457346Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.457405Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.457443Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.457479Z","level":"DEBUG","fields":{"message":"Picked up new job from queue","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":59},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":59,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.457524Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.457594Z","level":"DEBUG","fields":{"message":"Picked up new job from queue","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":59},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":59,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.458794Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.458849Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.458890Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.458925Z","level":"DEBUG","fields":{"message":"Picked up new job from queue","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":59},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":59,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.458967Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.459135Z","level":"DEBUG","fields":{"message":"Picked up new job from queue","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":59},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":59,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.465392Z","level":"INFO","fields":{"message":"Shutdown signal received, waiting for 600ms for running jobs to complete...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":105},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":105,"threadName":"test_concurrent_worker_graceful_shutdown_completes_job","threadId":"ThreadId(6)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.467296Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_parallel_execution","threadId":"ThreadId(15)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.467395Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_parallel_execution","threadId":"ThreadId(15)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.467450Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_parallel_execution","threadId":"ThreadId(15)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.467497Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_parallel_execution","threadId":"ThreadId(15)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.467535Z","level":"DEBUG","fields":{"message":"Picked up new job from queue","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":59},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":59,"threadName":"test_concurrent_worker_parallel_execution","threadId":"ThreadId(15)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.467584Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_parallel_execution","threadId":"ThreadId(15)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.467619Z","level":"DEBUG","fields":{"message":"Picked up new job from queue","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":59},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":59,"threadName":"test_concurrent_worker_parallel_execution","threadId":"ThreadId(15)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.467667Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_parallel_execution","threadId":"ThreadId(15)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.467701Z","level":"DEBUG","fields":{"message":"Picked up new job from queue","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":59},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":59,"threadName":"test_concurrent_worker_parallel_execution","threadId":"ThreadId(15)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.468384Z","level":"INFO","fields":{"message":"Shutdown signal received, waiting for 1s for running jobs to complete...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":105},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":105,"threadName":"test_concurrent_worker_job_retries_twice","threadId":"ThreadId(10)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.476028Z","level":"INFO","fields":{"message":"Shutdown timeout reached, forcing shutdown...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":117},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":117,"threadName":"test_concurrent_worker_graceful_shutdown_cancels_ongoing_job","threadId":"ThreadId(5)"}
[INFO] [stdout] test test_concurrent_worker_graceful_shutdown_cancels_ongoing_job ... ok
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.477187Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_varying_job_durations","threadId":"ThreadId(21)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.477277Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_varying_job_durations","threadId":"ThreadId(21)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.477476Z","level":"DEBUG","fields":{"message":"Picked up new job from queue","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":59},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":59,"threadName":"test_concurrent_worker_varying_job_durations","threadId":"ThreadId(21)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.478461Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.478519Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.478553Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.478755Z","level":"DEBUG","fields":{"message":"Picked up new job from queue","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":59},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":59,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.478836Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.478896Z","level":"DEBUG","fields":{"message":"Picked up new job from queue","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":59},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":59,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.480233Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.480503Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.480577Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.480637Z","level":"DEBUG","fields":{"message":"Picked up new job from queue","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":59},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":59,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.480827Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.480884Z","level":"DEBUG","fields":{"message":"Picked up new job from queue","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":59},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":59,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.484509Z","level":"INFO","fields":{"message":"Shutdown signal received, waiting for 100ms for running jobs to complete...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":105},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":105,"threadName":"test_concurrent_worker_shutdown_during_job_retry_delay","threadId":"ThreadId(18)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.499188Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.499241Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.499271Z","level":"DEBUG","fields":{"message":"Picked up new job from queue","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":59},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":59,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.500424Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.500477Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.500514Z","level":"DEBUG","fields":{"message":"Picked up new job from queue","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":59},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":59,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.501665Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.501717Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.501753Z","level":"DEBUG","fields":{"message":"Picked up new job from queue","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":59},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":59,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.503906Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.503955Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.504007Z","level":"DEBUG","fields":{"message":"Picked up new job from queue","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":59},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":59,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.516096Z","level":"INFO","fields":{"message":"Shutdown timeout reached, forcing shutdown...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":117},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":117,"threadName":"test_concurrent_worker_leaves_jobs_in_queue_on_shutdown","threadId":"ThreadId(13)"}
[INFO] [stdout] test test_concurrent_worker_leaves_jobs_in_queue_on_shutdown ... ok
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.518071Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_parallel_execution","threadId":"ThreadId(15)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.518175Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_parallel_execution","threadId":"ThreadId(15)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.518226Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_parallel_execution","threadId":"ThreadId(15)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.518271Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_parallel_execution","threadId":"ThreadId(15)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.518319Z","level":"DEBUG","fields":{"message":"Picked up new job from queue","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":59},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":59,"threadName":"test_concurrent_worker_parallel_execution","threadId":"ThreadId(15)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.518384Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_parallel_execution","threadId":"ThreadId(15)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.518431Z","level":"DEBUG","fields":{"message":"Picked up new job from queue","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":59},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":59,"threadName":"test_concurrent_worker_parallel_execution","threadId":"ThreadId(15)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.518482Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_parallel_execution","threadId":"ThreadId(15)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.518523Z","level":"DEBUG","fields":{"message":"Picked up new job from queue","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":59},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":59,"threadName":"test_concurrent_worker_parallel_execution","threadId":"ThreadId(15)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.519786Z","level":"INFO","fields":{"message":"All jobs completed, shutting down...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":122},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":122,"threadName":"test_concurrent_worker_job_retries_twice","threadId":"ThreadId(10)"}
[INFO] [stdout] test test_concurrent_worker_job_retries_twice ... ok
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.520238Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.520298Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.521438Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.521505Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.522438Z","level":"INFO","fields":{"message":"Shutdown signal received, waiting for 500ms for running jobs to complete...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":105},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":105,"threadName":"test_concurrent_worker_shutdown_with_empty_queue","threadId":"ThreadId(20)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.522727Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.522779Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.523756Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_varying_job_durations","threadId":"ThreadId(21)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.523813Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_varying_job_durations","threadId":"ThreadId(21)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.523850Z","level":"DEBUG","fields":{"message":"Picked up new job from queue","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":59},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":59,"threadName":"test_concurrent_worker_varying_job_durations","threadId":"ThreadId(21)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.525937Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.526013Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.529018Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_varying_job_durations","threadId":"ThreadId(21)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.529070Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_varying_job_durations","threadId":"ThreadId(21)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.534243Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_varying_job_durations","threadId":"ThreadId(21)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.534298Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_varying_job_durations","threadId":"ThreadId(21)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.534684Z","level":"INFO","fields":{"message":"All jobs completed, shutting down...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":122},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":122,"threadName":"test_concurrent_worker_shutdown_signal_channel_closed","threadId":"ThreadId(19)"}
[INFO] [stdout] test test_concurrent_worker_shutdown_signal_channel_closed ... ok
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.569914Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_parallel_execution","threadId":"ThreadId(15)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.570036Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_parallel_execution","threadId":"ThreadId(15)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.570083Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_parallel_execution","threadId":"ThreadId(15)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.570130Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_parallel_execution","threadId":"ThreadId(15)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.570175Z","level":"DEBUG","fields":{"message":"Picked up new job from queue","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":59},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":59,"threadName":"test_concurrent_worker_parallel_execution","threadId":"ThreadId(15)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.570232Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_parallel_execution","threadId":"ThreadId(15)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.570285Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_parallel_execution","threadId":"ThreadId(15)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.585845Z","level":"INFO","fields":{"message":"Shutdown timeout reached, forcing shutdown...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":117},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":117,"threadName":"test_concurrent_worker_shutdown_during_job_retry_delay","threadId":"ThreadId(18)"}
[INFO] [stdout] test test_concurrent_worker_shutdown_during_job_retry_delay ... ok
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.615169Z","level":"INFO","fields":{"message":"Shutdown signal received, waiting for 1s for running jobs to complete...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":105},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":105,"threadName":"test_concurrent_worker_job_execution_order","threadId":"ThreadId(7)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.616150Z","level":"INFO","fields":{"message":"Shutdown signal received, waiting for 1s for running jobs to complete...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":105},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":105,"threadName":"test_concurrent_worker_queue_errors","threadId":"ThreadId(16)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.621616Z","level":"INFO","fields":{"message":"Job executed successfully","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":132},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":132,"threadName":"test_concurrent_worker_parallel_execution","threadId":"ThreadId(15)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.621712Z","level":"DEBUG","fields":{"message":"Processing new job","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":56},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":56,"threadName":"test_concurrent_worker_parallel_execution","threadId":"ThreadId(15)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.716560Z","level":"INFO","fields":{"message":"Shutdown signal received, waiting for 1s for running jobs to complete...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":105},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":105,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.717200Z","level":"INFO","fields":{"message":"Shutdown signal received, waiting for 1s for running jobs to complete...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":105},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":105,"threadName":"test_concurrent_worker_parallel_execution","threadId":"ThreadId(15)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.723714Z","level":"INFO","fields":{"message":"Shutdown signal received, waiting for 1s for running jobs to complete...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":105},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":105,"threadName":"test_concurrent_worker_varying_job_durations","threadId":"ThreadId(21)"}
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.914864Z","level":"INFO","fields":{"message":"All jobs completed, shutting down...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":122},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":122,"threadName":"test_concurrent_worker_job_execution_order","threadId":"ThreadId(7)"}
[INFO] [stdout] test test_concurrent_worker_job_execution_order ... ok
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.917166Z","level":"INFO","fields":{"message":"All jobs completed, shutting down...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":122},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":122,"threadName":"test_concurrent_worker_job_succeeds_without_retries","threadId":"ThreadId(12)"}
[INFO] [stdout] test test_concurrent_worker_job_succeeds_without_retries ... ok
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.917317Z","level":"INFO","fields":{"message":"All jobs completed, shutting down...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":122},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":122,"threadName":"test_concurrent_worker_multiple_jobs","threadId":"ThreadId(14)"}
[INFO] [stdout] test test_concurrent_worker_multiple_jobs ... ok
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.917696Z","level":"INFO","fields":{"message":"All jobs completed, shutting down...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":122},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":122,"threadName":"test_concurrent_worker_completes_job_during_shutdown","threadId":"ThreadId(4)"}
[INFO] [stdout] test test_concurrent_worker_completes_job_during_shutdown ... ok
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.918680Z","level":"INFO","fields":{"message":"All jobs completed, shutting down...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":122},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":122,"threadName":"test_concurrent_worker_queue_errors","threadId":"ThreadId(16)"}
[INFO] [stdout] test test_concurrent_worker_queue_errors ... ok
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.922032Z","level":"INFO","fields":{"message":"All jobs completed, shutting down...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":122},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":122,"threadName":"test_concurrent_worker_shutdown_with_empty_queue","threadId":"ThreadId(20)"}
[INFO] [stdout] test test_concurrent_worker_shutdown_with_empty_queue ... ok
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:46.936045Z","level":"INFO","fields":{"message":"All jobs completed, shutting down...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":122},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":122,"threadName":"test_concurrent_worker_graceful_shutdown_completes_job","threadId":"ThreadId(6)"}
[INFO] [stdout] test test_concurrent_worker_graceful_shutdown_completes_job ... ok
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:47.027593Z","level":"INFO","fields":{"message":"All jobs completed, shutting down...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":122},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":122,"threadName":"test_concurrent_worker_respects_concurrency_limit","threadId":"ThreadId(17)"}
[INFO] [stdout] test test_concurrent_worker_respects_concurrency_limit ... ok
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:47.035267Z","level":"INFO","fields":{"message":"All jobs completed, shutting down...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":122},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":122,"threadName":"test_concurrent_worker_varying_job_durations","threadId":"ThreadId(21)"}
[INFO] [stdout] test test_concurrent_worker_varying_job_durations ... ok
[INFO] [stdout] {"timestamp":"2025-11-05T04:40:47.122216Z","level":"INFO","fields":{"message":"All jobs completed, shutting down...","log.target":"queue_workers::concurrent_worker","log.module_path":"queue_workers::concurrent_worker","log.file":"/opt/rustwide/workdir/src/concurrent_worker.rs","log.line":122},"target":"queue_workers::concurrent_worker","filename":"/opt/rustwide/workdir/src/concurrent_worker.rs","line_number":122,"threadName":"test_concurrent_worker_parallel_execution","threadId":"ThreadId(15)"}
[INFO] [stdout] test test_concurrent_worker_parallel_execution ... ok
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 20 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.71s
[INFO] [stdout] 
[INFO] [stderr]      Running tests/concurrent_worker_integration.rs (/opt/rustwide/target/debug/deps/concurrent_worker_integration-f7ea3bb88bba71c4)
[INFO] [stdout] 
[INFO] [stdout] running 5 tests
[INFO] [stdout] test common::tests::test_logging_levels ... ok
[INFO] [stdout] test common::tests::test_span_logging ... ok
[INFO] [stdout] test test_complete_workflow ... FAILED
[INFO] [stdout] test test_queue_persistence ... FAILED
[INFO] [stdout] test test_concurrent_workers ... FAILED
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout] 
[INFO] [stdout] ---- test_complete_workflow stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'test_complete_workflow' (52) panicked at tests/concurrent_worker_integration.rs:155:10:
[INFO] [stdout] Failed to push successful job: ConnectionError("Connection refused (os error 111)")
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x59a17bbad662 - std::backtrace_rs::backtrace::libunwind::trace::h16acf28769fcd909
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9
[INFO] [stdout]    1:     0x59a17bbad662 - std::backtrace_rs::backtrace::trace_unsynchronized::hb5541aa5d4f92513
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14
[INFO] [stdout]    2:     0x59a17bbad662 - std::sys::backtrace::_print_fmt::h8ac8268cb667a306
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/sys/backtrace.rs:66:9
[INFO] [stdout]    3:     0x59a17bbad662 - <std::sys::backtrace::BacktraceLock::print::DisplayBacktrace as core::fmt::Display>::fmt::h47627beda0767f4c
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/sys/backtrace.rs:39:26
[INFO] [stdout]    4:     0x59a17bbbf54f - core::fmt::rt::Argument::fmt::h686a01ad57c1c92a
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/fmt/rt.rs:173:76
[INFO] [stdout]    5:     0x59a17bbbf54f - core::fmt::write::h8a63064c67176fd8
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/fmt/mod.rs:1469:25
[INFO] [stdout]    6:     0x59a17bb79c83 - std::io::default_write_fmt::hd4797e693c0ec256
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/io/mod.rs:639:11
[INFO] [stdout]    7:     0x59a17bb79c83 - std::io::Write::write_fmt::h791e240ad2720c99
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/io/mod.rs:1954:13
[INFO] [stdout]    8:     0x59a17bb86812 - std::sys::backtrace::BacktraceLock::print::h4634d27c0afbaebb
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/sys/backtrace.rs:42:9
[INFO] [stdout]    9:     0x59a17bb8b59f - std::panicking::default_hook::{{closure}}::h23e0299d4738b766
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:301:27
[INFO] [stdout]   10:     0x59a17bb8b431 - std::panicking::default_hook::hfeec6294e8751b62
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:325:9
[INFO] [stdout]   11:     0x59a17b71e14e - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::h3f5a16438cee2b4e
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/alloc/src/boxed.rs:2019:9
[INFO] [stdout]   12:     0x59a17b71e14e - test::test_main_with_exit_callback::{{closure}}::h9214498cef9aafc5
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/test/src/lib.rs:145:21
[INFO] [stdout]   13:     0x59a17bb8bc5f - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::hdb18da3e68df7464
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/alloc/src/boxed.rs:2019:9
[INFO] [stdout]   14:     0x59a17bb8bc5f - std::panicking::panic_with_hook::hd57cd463d793ed79
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:842:13
[INFO] [stdout]   15:     0x59a17bb8ba0a - std::panicking::panic_handler::{{closure}}::hddd6216c3fddee3b
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:707:13
[INFO] [stdout]   16:     0x59a17bb86949 - std::sys::backtrace::__rust_end_short_backtrace::h5e7a56f283378525
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/sys/backtrace.rs:174:18
[INFO] [stdout]   17:     0x59a17bb6e35d - __rustc[256c90bb7e548b45]::rust_begin_unwind
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:698:5
[INFO] [stdout]   18:     0x59a17bbc9ef0 - core::panicking::panic_fmt::hf19c198748ef6a95
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/panicking.rs:80:14
[INFO] [stdout]   19:     0x59a17bbc91a6 - core::result::unwrap_failed::he81173b5792ad6b0
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/result.rs:1862:5
[INFO] [stdout]   20:     0x59a17b6fa075 - core::result::Result<T,E>::expect::h93db37cfcf080d8b
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/result.rs:1185:23
[INFO] [stdout]   21:     0x59a17b692e1a - concurrent_worker_integration::test_complete_workflow::{{closure}}::h68637ac1c92cf91e
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/concurrent_worker_integration.rs:155:10
[INFO] [stdout]   22:     0x59a17b6f5f72 - <core::pin::Pin<P> as core::future::future::Future>::poll::hf54ffef02a5a01f0
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/future/future.rs:133:9
[INFO] [stdout]   23:     0x59a17b6f5d4d - <core::pin::Pin<P> as core::future::future::Future>::poll::h78cc7fef8a1f4ca5
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/future/future.rs:133:9
[INFO] [stdout]   24:     0x59a17b6f4e1d - tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::{{closure}}::{{closure}}::hd0e28141f339b1fc
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/scheduler/current_thread/mod.rs:733:70
[INFO] [stdout]   25:     0x59a17b6f4bdb - tokio::task::coop::with_budget::hebb5badfc0e7d7fe
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/task/coop/mod.rs:167:5
[INFO] [stdout]   26:     0x59a17b6f4bdb - tokio::task::coop::budget::hd7e03a7f7b8eaee6
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/task/coop/mod.rs:133:5
[INFO] [stdout]   27:     0x59a17b6f4bdb - tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::{{closure}}::hbeb11dbbbce24cc4
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/scheduler/current_thread/mod.rs:733:25
[INFO] [stdout]   28:     0x59a17b6f21b0 - tokio::runtime::scheduler::current_thread::Context::enter::hcf80bcc281f4db10
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/scheduler/current_thread/mod.rs:432:19
[INFO] [stdout]   29:     0x59a17b6f4280 - tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::hb004e4d3e9778d84
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/scheduler/current_thread/mod.rs:732:44
[INFO] [stdout]   30:     0x59a17b6f34a4 - tokio::runtime::scheduler::current_thread::CoreGuard::enter::{{closure}}::hbaa9c0f1d4fe1bbd
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/scheduler/current_thread/mod.rs:820:68
[INFO] [stdout]   31:     0x59a17b6bbbeb - tokio::runtime::context::scoped::Scoped<T>::set::hfaf03abe62e843ca
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/context/scoped.rs:40:9
[INFO] [stdout]   32:     0x59a17b6ec3e9 - tokio::runtime::context::set_scheduler::{{closure}}::h94b8d2269795389e
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/context.rs:180:38
[INFO] [stdout]   33:     0x59a17b6f7f72 - std::thread::local::LocalKey<T>::try_with::h3a0b76a00ad0a585
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/thread/local.rs:508:12
[INFO] [stdout]   34:     0x59a17b6f70be - std::thread::local::LocalKey<T>::with::h4aab24a9e100ae2d
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/thread/local.rs:472:20
[INFO] [stdout]   35:     0x59a17b6ec31d - tokio::runtime::context::set_scheduler::h2dc2adaf94333090
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/context.rs:180:17
[INFO] [stdout]   36:     0x59a17b6f3230 - tokio::runtime::scheduler::current_thread::CoreGuard::enter::h4b0fce6ff6a33e3c
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/scheduler/current_thread/mod.rs:820:27
[INFO] [stdout]   37:     0x59a17b6f3523 - tokio::runtime::scheduler::current_thread::CoreGuard::block_on::h8018ae2361e7e298
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/scheduler/current_thread/mod.rs:720:24
[INFO] [stdout]   38:     0x59a17b6f02f3 - tokio::runtime::scheduler::current_thread::CurrentThread::block_on::{{closure}}::hf96b9d10e272d620
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/scheduler/current_thread/mod.rs:200:33
[INFO] [stdout]   39:     0x59a17b6ca2e0 - tokio::runtime::context::runtime::enter_runtime::h47e24e798b782ace
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/context/runtime.rs:65:16
[INFO] [stdout]   40:     0x59a17b6efc91 - tokio::runtime::scheduler::current_thread::CurrentThread::block_on::h4f362ed6cf52a96a
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/scheduler/current_thread/mod.rs:188:9
[INFO] [stdout]   41:     0x59a17b6bbe64 - tokio::runtime::runtime::Runtime::block_on_inner::h8f7e2eadf1f1c40f
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/runtime.rs:368:52
[INFO] [stdout]   42:     0x59a17b6bc027 - tokio::runtime::runtime::Runtime::block_on::h615345278c3b31e7
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/runtime.rs:342:18
[INFO] [stdout]   43:     0x59a17b691381 - concurrent_worker_integration::test_complete_workflow::h406d7345817144ae
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/concurrent_worker_integration.rs:205:45
[INFO] [stdout]   44:     0x59a17b693f77 - concurrent_worker_integration::test_complete_workflow::{{closure}}::had9553987a474c64
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/concurrent_worker_integration.rs:121:34
[INFO] [stdout]   45:     0x59a17b67a006 - core::ops::function::FnOnce::call_once::ha72dbac1597cad44
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   46:     0x59a17b71df9b - core::ops::function::FnOnce::call_once::h43f43c5185cf39c2
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   47:     0x59a17b71df9b - test::__rust_begin_short_backtrace::hc4fa634eb2764bdc
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/test/src/lib.rs:663:18
[INFO] [stdout]   48:     0x59a17b7325b8 - test::run_test_in_process::{{closure}}::h9f4b799a5211b72a
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/test/src/lib.rs:686:74
[INFO] [stdout]   49:     0x59a17b7325b8 - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::ha572bf7dc5230a8f
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/panic/unwind_safe.rs:274:9
[INFO] [stdout]   50:     0x59a17b7325b8 - std::panicking::catch_unwind::do_call::hfd6ff51f25dd177b
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:590:40
[INFO] [stdout]   51:     0x59a17b7325b8 - std::panicking::catch_unwind::h8609b446221def5f
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:553:19
[INFO] [stdout]   52:     0x59a17b7325b8 - std::panic::catch_unwind::h362f73cc48531e26
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panic.rs:359:14
[INFO] [stdout]   53:     0x59a17b7325b8 - test::run_test_in_process::hf52fd21d696aae67
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/test/src/lib.rs:686:27
[INFO] [stdout]   54:     0x59a17b7325b8 - test::run_test::{{closure}}::h7e780b8354e6d007
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/test/src/lib.rs:607:43
[INFO] [stdout]   55:     0x59a17b70b384 - test::run_test::{{closure}}::hdc2695f2276aad3e
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/test/src/lib.rs:637:41
[INFO] [stdout]   56:     0x59a17b70b384 - std::sys::backtrace::__rust_begin_short_backtrace::h2555b2113ed90fc9
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/sys/backtrace.rs:158:18
[INFO] [stdout]   57:     0x59a17b70ecba - std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}}::h99800d480987dfb6
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/thread/mod.rs:562:17
[INFO] [stdout]   58:     0x59a17b70ecba - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::hbbb69b5294b2221b
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/panic/unwind_safe.rs:274:9
[INFO] [stdout]   59:     0x59a17b70ecba - std::panicking::catch_unwind::do_call::h495689350c27df20
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:590:40
[INFO] [stdout]   60:     0x59a17b70ecba - std::panicking::catch_unwind::hf22437c51d1b3740
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:553:19
[INFO] [stdout]   61:     0x59a17b70ecba - std::panic::catch_unwind::habda1a57de8231f8
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panic.rs:359:14
[INFO] [stdout]   62:     0x59a17b70ecba - std::thread::Builder::spawn_unchecked_::{{closure}}::h5833d8dda8c7e80b
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/thread/mod.rs:560:30
[INFO] [stdout]   63:     0x59a17b70ecba - core::ops::function::FnOnce::call_once{{vtable.shim}}::ha2910283a5058402
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   64:     0x59a17bb81c3f - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::he4d85cb537521972
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/alloc/src/boxed.rs:2005:9
[INFO] [stdout]   65:     0x59a17bb81c3f - std::sys::thread::unix::Thread::new::thread_start::hbaf586a9e50a98cd
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/sys/thread/unix.rs:126:17
[INFO] [stdout]   66:     0x7ca8ae3f9aa4 - <unknown>
[INFO] [stdout]   67:     0x7ca8ae486a64 - clone
[INFO] [stdout]   68:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] ---- test_queue_persistence stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'test_queue_persistence' (54) panicked at tests/concurrent_worker_integration.rs:284:35:
[INFO] [stdout] Failed to push job: ConnectionError("Connection refused (os error 111)")
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x59a17bbad662 - std::backtrace_rs::backtrace::libunwind::trace::h16acf28769fcd909
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9
[INFO] [stdout]    1:     0x59a17bbad662 - std::backtrace_rs::backtrace::trace_unsynchronized::hb5541aa5d4f92513
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14
[INFO] [stdout]    2:     0x59a17bbad662 - std::sys::backtrace::_print_fmt::h8ac8268cb667a306
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/sys/backtrace.rs:66:9
[INFO] [stdout]    3:     0x59a17bbad662 - <std::sys::backtrace::BacktraceLock::print::DisplayBacktrace as core::fmt::Display>::fmt::h47627beda0767f4c
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/sys/backtrace.rs:39:26
[INFO] [stdout]    4:     0x59a17bbbf54f - core::fmt::rt::Argument::fmt::h686a01ad57c1c92a
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/fmt/rt.rs:173:76
[INFO] [stdout]    5:     0x59a17bbbf54f - core::fmt::write::h8a63064c67176fd8
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/fmt/mod.rs:1469:25
[INFO] [stdout]    6:     0x59a17bb79c83 - std::io::default_write_fmt::hd4797e693c0ec256
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/io/mod.rs:639:11
[INFO] [stdout]    7:     0x59a17bb79c83 - std::io::Write::write_fmt::h791e240ad2720c99
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/io/mod.rs:1954:13
[INFO] [stdout]    8:     0x59a17bb86812 - std::sys::backtrace::BacktraceLock::print::h4634d27c0afbaebb
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/sys/backtrace.rs:42:9
[INFO] [stdout]    9:     0x59a17bb8b59f - std::panicking::default_hook::{{closure}}::h23e0299d4738b766
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:301:27
[INFO] [stdout]   10:     0x59a17bb8b431 - std::panicking::default_hook::hfeec6294e8751b62
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:325:9
[INFO] [stdout]   11:     0x59a17b71e14e - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::h3f5a16438cee2b4e
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/alloc/src/boxed.rs:2019:9
[INFO] [stdout]   12:     0x59a17b71e14e - test::test_main_with_exit_callback::{{closure}}::h9214498cef9aafc5
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/test/src/lib.rs:145:21
[INFO] [stdout]   13:     0x59a17bb8bc5f - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::hdb18da3e68df7464
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/alloc/src/boxed.rs:2019:9
[INFO] [stdout]   14:     0x59a17bb8bc5f - std::panicking::panic_with_hook::hd57cd463d793ed79
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:842:13
[INFO] [stdout]   15:     0x59a17bb8ba0a - std::panicking::panic_handler::{{closure}}::hddd6216c3fddee3b
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:707:13
[INFO] [stdout]   16:     0x59a17bb86949 - std::sys::backtrace::__rust_end_short_backtrace::h5e7a56f283378525
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/sys/backtrace.rs:174:18
[INFO] [stdout]   17:     0x59a17bb6e35d - __rustc[256c90bb7e548b45]::rust_begin_unwind
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:698:5
[INFO] [stdout]   18:     0x59a17bbc9ef0 - core::panicking::panic_fmt::hf19c198748ef6a95
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/panicking.rs:80:14
[INFO] [stdout]   19:     0x59a17bbc91a6 - core::result::unwrap_failed::he81173b5792ad6b0
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/result.rs:1862:5
[INFO] [stdout]   20:     0x59a17b6fa075 - core::result::Result<T,E>::expect::h93db37cfcf080d8b
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/result.rs:1185:23
[INFO] [stdout]   21:     0x59a17b69581c - concurrent_worker_integration::test_queue_persistence::{{closure}}::h671e4489cf319f0d
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/concurrent_worker_integration.rs:284:35
[INFO] [stdout]   22:     0x59a17b6f5f72 - <core::pin::Pin<P> as core::future::future::Future>::poll::hf54ffef02a5a01f0
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/future/future.rs:133:9
[INFO] [stdout]   23:     0x59a17b6f5d4d - <core::pin::Pin<P> as core::future::future::Future>::poll::h78cc7fef8a1f4ca5
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/future/future.rs:133:9
[INFO] [stdout]   24:     0x59a17b6f4e1d - tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::{{closure}}::{{closure}}::hd0e28141f339b1fc
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/scheduler/current_thread/mod.rs:733:70
[INFO] [stdout]   25:     0x59a17b6f4bdb - tokio::task::coop::with_budget::hebb5badfc0e7d7fe
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/task/coop/mod.rs:167:5
[INFO] [stdout]   26:     0x59a17b6f4bdb - tokio::task::coop::budget::hd7e03a7f7b8eaee6
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/task/coop/mod.rs:133:5
[INFO] [stdout]   27:     0x59a17b6f4bdb - tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::{{closure}}::hbeb11dbbbce24cc4
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/scheduler/current_thread/mod.rs:733:25
[INFO] [stdout]   28:     0x59a17b6f21b0 - tokio::runtime::scheduler::current_thread::Context::enter::hcf80bcc281f4db10
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/scheduler/current_thread/mod.rs:432:19
[INFO] [stdout]   29:     0x59a17b6f4280 - tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::hb004e4d3e9778d84
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/scheduler/current_thread/mod.rs:732:44
[INFO] [stdout]   30:     0x59a17b6f34a4 - tokio::runtime::scheduler::current_thread::CoreGuard::enter::{{closure}}::hbaa9c0f1d4fe1bbd
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/scheduler/current_thread/mod.rs:820:68
[INFO] [stdout]   31:     0x59a17b6bbbeb - tokio::runtime::context::scoped::Scoped<T>::set::hfaf03abe62e843ca
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/context/scoped.rs:40:9
[INFO] [stdout]   32:     0x59a17b6ec3e9 - tokio::runtime::context::set_scheduler::{{closure}}::h94b8d2269795389e
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/context.rs:180:38
[INFO] [stdout]   33:     0x59a17b6f7f72 - std::thread::local::LocalKey<T>::try_with::h3a0b76a00ad0a585
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/thread/local.rs:508:12
[INFO] [stdout]   34:     0x59a17b6f70be - std::thread::local::LocalKey<T>::with::h4aab24a9e100ae2d
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/thread/local.rs:472:20
[INFO] [stdout]   35:     0x59a17b6ec31d - tokio::runtime::context::set_scheduler::h2dc2adaf94333090
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/context.rs:180:17
[INFO] [stdout]   36:     0x59a17b6f3230 - tokio::runtime::scheduler::current_thread::CoreGuard::enter::h4b0fce6ff6a33e3c
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/scheduler/current_thread/mod.rs:820:27
[INFO] [stdout]   37:     0x59a17b6f3523 - tokio::runtime::scheduler::current_thread::CoreGuard::block_on::h8018ae2361e7e298
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/scheduler/current_thread/mod.rs:720:24
[INFO] [stdout]   38:     0x59a17b6f02f3 - tokio::runtime::scheduler::current_thread::CurrentThread::block_on::{{closure}}::hf96b9d10e272d620
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/scheduler/current_thread/mod.rs:200:33
[INFO] [stdout]   39:     0x59a17b6ca2e0 - tokio::runtime::context::runtime::enter_runtime::h47e24e798b782ace
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/context/runtime.rs:65:16
[INFO] [stdout]   40:     0x59a17b6efc91 - tokio::runtime::scheduler::current_thread::CurrentThread::block_on::h4f362ed6cf52a96a
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/scheduler/current_thread/mod.rs:188:9
[INFO] [stdout]   41:     0x59a17b6bbe64 - tokio::runtime::runtime::Runtime::block_on_inner::h8f7e2eadf1f1c40f
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/runtime.rs:368:52
[INFO] [stdout]   42:     0x59a17b6bc027 - tokio::runtime::runtime::Runtime::block_on::h615345278c3b31e7
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/runtime.rs:342:18
[INFO] [stdout]   43:     0x59a17b694c01 - concurrent_worker_integration::test_queue_persistence::h4a9ce327bb46042b
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/concurrent_worker_integration.rs:293:45
[INFO] [stdout]   44:     0x59a17b694c97 - concurrent_worker_integration::test_queue_persistence::{{closure}}::h632f85d6f6be26cf
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/concurrent_worker_integration.rs:271:34
[INFO] [stdout]   45:     0x59a17b67a2c6 - core::ops::function::FnOnce::call_once::hc1ba1935e663be3c
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   46:     0x59a17b71df9b - core::ops::function::FnOnce::call_once::h43f43c5185cf39c2
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   47:     0x59a17b71df9b - test::__rust_begin_short_backtrace::hc4fa634eb2764bdc
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/test/src/lib.rs:663:18
[INFO] [stdout]   48:     0x59a17b7325b8 - test::run_test_in_process::{{closure}}::h9f4b799a5211b72a
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/test/src/lib.rs:686:74
[INFO] [stdout]   49:     0x59a17b7325b8 - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::ha572bf7dc5230a8f
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/panic/unwind_safe.rs:274:9
[INFO] [stdout]   50:     0x59a17b7325b8 - std::panicking::catch_unwind::do_call::hfd6ff51f25dd177b
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:590:40
[INFO] [stdout]   51:     0x59a17b7325b8 - std::panicking::catch_unwind::h8609b446221def5f
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:553:19
[INFO] [stdout]   52:     0x59a17b7325b8 - std::panic::catch_unwind::h362f73cc48531e26
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panic.rs:359:14
[INFO] [stdout]   53:     0x59a17b7325b8 - test::run_test_in_process::hf52fd21d696aae67
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/test/src/lib.rs:686:27
[INFO] [stdout]   54:     0x59a17b7325b8 - test::run_test::{{closure}}::h7e780b8354e6d007
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/test/src/lib.rs:607:43
[INFO] [stdout]   55:     0x59a17b70b384 - test::run_test::{{closure}}::hdc2695f2276aad3e
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/test/src/lib.rs:637:41
[INFO] [stdout]   56:     0x59a17b70b384 - std::sys::backtrace::__rust_begin_short_backtrace::h2555b2113ed90fc9
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/sys/backtrace.rs:158:18
[INFO] [stdout]   57:     0x59a17b70ecba - std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}}::h99800d480987dfb6
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/thread/mod.rs:562:17
[INFO] [stdout]   58:     0x59a17b70ecba - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::hbbb69b5294b2221b
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/panic/unwind_safe.rs:274:9
[INFO] [stdout]   59:     0x59a17b70ecba - std::panicking::catch_unwind::do_call::h495689350c27df20
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:590:40
[INFO] [stdout]   60:     0x59a17b70ecba - std::panicking::catch_unwind::hf22437c51d1b3740
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:553:19
[INFO] [stdout]   61:     0x59a17b70ecba - std::panic::catch_unwind::habda1a57de8231f8
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panic.rs:359:14
[INFO] [stdout]   62:     0x59a17b70ecba - std::thread::Builder::spawn_unchecked_::{{closure}}::h5833d8dda8c7e80b
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/thread/mod.rs:560:30
[INFO] [stdout]   63:     0x59a17b70ecba - core::ops::function::FnOnce::call_once{{vtable.shim}}::ha2910283a5058402
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   64:     0x59a17bb81c3f - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::he4d85cb537521972
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/alloc/src/boxed.rs:2005:9
[INFO] [stdout]   65:     0x59a17bb81c3f - std::sys::thread::unix::Thread::new::thread_start::hbaf586a9e50a98cd
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/sys/thread/unix.rs:126:17
[INFO] [stdout]   66:     0x7ca8ae3f9aa4 - <unknown>
[INFO] [stdout]   67:     0x7ca8ae486a64 - clone
[INFO] [stdout]   68:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] ---- test_concurrent_workers stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'test_concurrent_workers' (53) panicked at tests/concurrent_worker_integration.rs:226:31:
[INFO] [stdout] Failed to push job: ConnectionError("Connection refused (os error 111)")
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x59a17bbad662 - std::backtrace_rs::backtrace::libunwind::trace::h16acf28769fcd909
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9
[INFO] [stdout]    1:     0x59a17bbad662 - std::backtrace_rs::backtrace::trace_unsynchronized::hb5541aa5d4f92513
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14
[INFO] [stdout]    2:     0x59a17bbad662 - std::sys::backtrace::_print_fmt::h8ac8268cb667a306
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/sys/backtrace.rs:66:9
[INFO] [stdout]    3:     0x59a17bbad662 - <std::sys::backtrace::BacktraceLock::print::DisplayBacktrace as core::fmt::Display>::fmt::h47627beda0767f4c
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/sys/backtrace.rs:39:26
[INFO] [stdout]    4:     0x59a17bbbf54f - core::fmt::rt::Argument::fmt::h686a01ad57c1c92a
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/fmt/rt.rs:173:76
[INFO] [stdout]    5:     0x59a17bbbf54f - core::fmt::write::h8a63064c67176fd8
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/fmt/mod.rs:1469:25
[INFO] [stdout]    6:     0x59a17bb79c83 - std::io::default_write_fmt::hd4797e693c0ec256
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/io/mod.rs:639:11
[INFO] [stdout]    7:     0x59a17bb79c83 - std::io::Write::write_fmt::h791e240ad2720c99
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/io/mod.rs:1954:13
[INFO] [stdout]    8:     0x59a17bb86812 - std::sys::backtrace::BacktraceLock::print::h4634d27c0afbaebb
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/sys/backtrace.rs:42:9
[INFO] [stdout]    9:     0x59a17bb8b59f - std::panicking::default_hook::{{closure}}::h23e0299d4738b766
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:301:27
[INFO] [stdout]   10:     0x59a17bb8b431 - std::panicking::default_hook::hfeec6294e8751b62
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:325:9
[INFO] [stdout]   11:     0x59a17b71e14e - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::h3f5a16438cee2b4e
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/alloc/src/boxed.rs:2019:9
[INFO] [stdout]   12:     0x59a17b71e14e - test::test_main_with_exit_callback::{{closure}}::h9214498cef9aafc5
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/test/src/lib.rs:145:21
[INFO] [stdout]   13:     0x59a17bb8bc5f - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::hdb18da3e68df7464
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/alloc/src/boxed.rs:2019:9
[INFO] [stdout]   14:     0x59a17bb8bc5f - std::panicking::panic_with_hook::hd57cd463d793ed79
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:842:13
[INFO] [stdout]   15:     0x59a17bb8ba0a - std::panicking::panic_handler::{{closure}}::hddd6216c3fddee3b
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:707:13
[INFO] [stdout]   16:     0x59a17bb86949 - std::sys::backtrace::__rust_end_short_backtrace::h5e7a56f283378525
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/sys/backtrace.rs:174:18
[INFO] [stdout]   17:     0x59a17bb6e35d - __rustc[256c90bb7e548b45]::rust_begin_unwind
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:698:5
[INFO] [stdout]   18:     0x59a17bbc9ef0 - core::panicking::panic_fmt::hf19c198748ef6a95
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/panicking.rs:80:14
[INFO] [stdout]   19:     0x59a17bbc91a6 - core::result::unwrap_failed::he81173b5792ad6b0
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/result.rs:1862:5
[INFO] [stdout]   20:     0x59a17b6fa075 - core::result::Result<T,E>::expect::h93db37cfcf080d8b
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/result.rs:1185:23
[INFO] [stdout]   21:     0x59a17b69747e - concurrent_worker_integration::test_concurrent_workers::{{closure}}::h2b3d9d2a18a48e90
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/concurrent_worker_integration.rs:226:31
[INFO] [stdout]   22:     0x59a17b6f5f72 - <core::pin::Pin<P> as core::future::future::Future>::poll::hf54ffef02a5a01f0
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/future/future.rs:133:9
[INFO] [stdout]   23:     0x59a17b6f5d4d - <core::pin::Pin<P> as core::future::future::Future>::poll::h78cc7fef8a1f4ca5
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/future/future.rs:133:9
[INFO] [stdout]   24:     0x59a17b6f4e1d - tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::{{closure}}::{{closure}}::hd0e28141f339b1fc
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/scheduler/current_thread/mod.rs:733:70
[INFO] [stdout]   25:     0x59a17b6f4bdb - tokio::task::coop::with_budget::hebb5badfc0e7d7fe
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/task/coop/mod.rs:167:5
[INFO] [stdout]   26:     0x59a17b6f4bdb - tokio::task::coop::budget::hd7e03a7f7b8eaee6
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/task/coop/mod.rs:133:5
[INFO] [stdout]   27:     0x59a17b6f4bdb - tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::{{closure}}::hbeb11dbbbce24cc4
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/scheduler/current_thread/mod.rs:733:25
[INFO] [stdout]   28:     0x59a17b6f21b0 - tokio::runtime::scheduler::current_thread::Context::enter::hcf80bcc281f4db10
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/scheduler/current_thread/mod.rs:432:19
[INFO] [stdout]   29:     0x59a17b6f4280 - tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::hb004e4d3e9778d84
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/scheduler/current_thread/mod.rs:732:44
[INFO] [stdout]   30:     0x59a17b6f34a4 - tokio::runtime::scheduler::current_thread::CoreGuard::enter::{{closure}}::hbaa9c0f1d4fe1bbd
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/scheduler/current_thread/mod.rs:820:68
[INFO] [stdout]   31:     0x59a17b6bbbeb - tokio::runtime::context::scoped::Scoped<T>::set::hfaf03abe62e843ca
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/context/scoped.rs:40:9
[INFO] [stdout]   32:     0x59a17b6ec3e9 - tokio::runtime::context::set_scheduler::{{closure}}::h94b8d2269795389e
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/context.rs:180:38
[INFO] [stdout]   33:     0x59a17b6f7f72 - std::thread::local::LocalKey<T>::try_with::h3a0b76a00ad0a585
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/thread/local.rs:508:12
[INFO] [stdout]   34:     0x59a17b6f70be - std::thread::local::LocalKey<T>::with::h4aab24a9e100ae2d
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/thread/local.rs:472:20
[INFO] [stdout]   35:     0x59a17b6ec31d - tokio::runtime::context::set_scheduler::h2dc2adaf94333090
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/context.rs:180:17
[INFO] [stdout]   36:     0x59a17b6f3230 - tokio::runtime::scheduler::current_thread::CoreGuard::enter::h4b0fce6ff6a33e3c
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/scheduler/current_thread/mod.rs:820:27
[INFO] [stdout]   37:     0x59a17b6f3523 - tokio::runtime::scheduler::current_thread::CoreGuard::block_on::h8018ae2361e7e298
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/scheduler/current_thread/mod.rs:720:24
[INFO] [stdout]   38:     0x59a17b6f02f3 - tokio::runtime::scheduler::current_thread::CurrentThread::block_on::{{closure}}::hf96b9d10e272d620
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/scheduler/current_thread/mod.rs:200:33
[INFO] [stdout]   39:     0x59a17b6ca2e0 - tokio::runtime::context::runtime::enter_runtime::h47e24e798b782ace
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/context/runtime.rs:65:16
[INFO] [stdout]   40:     0x59a17b6efc91 - tokio::runtime::scheduler::current_thread::CurrentThread::block_on::h4f362ed6cf52a96a
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/scheduler/current_thread/mod.rs:188:9
[INFO] [stdout]   41:     0x59a17b6bbe64 - tokio::runtime::runtime::Runtime::block_on_inner::h8f7e2eadf1f1c40f
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/runtime.rs:368:52
[INFO] [stdout]   42:     0x59a17b6bc027 - tokio::runtime::runtime::Runtime::block_on::h615345278c3b31e7
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.44.2/src/runtime/runtime.rs:342:18
[INFO] [stdout]   43:     0x59a17b6963e1 - concurrent_worker_integration::test_concurrent_workers::hb0ffbe3ec06707b8
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/concurrent_worker_integration.rs:264:35
[INFO] [stdout]   44:     0x59a17b696477 - concurrent_worker_integration::test_concurrent_workers::{{closure}}::h27eb1b594cf5406b
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/concurrent_worker_integration.rs:209:35
[INFO] [stdout]   45:     0x59a17b67a496 - core::ops::function::FnOnce::call_once::hf79207cd90c9bed2
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   46:     0x59a17b71df9b - core::ops::function::FnOnce::call_once::h43f43c5185cf39c2
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   47:     0x59a17b71df9b - test::__rust_begin_short_backtrace::hc4fa634eb2764bdc
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/test/src/lib.rs:663:18
[INFO] [stdout]   48:     0x59a17b7325b8 - test::run_test_in_process::{{closure}}::h9f4b799a5211b72a
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/test/src/lib.rs:686:74
[INFO] [stdout]   49:     0x59a17b7325b8 - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::ha572bf7dc5230a8f
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/panic/unwind_safe.rs:274:9
[INFO] [stdout]   50:     0x59a17b7325b8 - std::panicking::catch_unwind::do_call::hfd6ff51f25dd177b
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:590:40
[INFO] [stdout]   51:     0x59a17b7325b8 - std::panicking::catch_unwind::h8609b446221def5f
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:553:19
[INFO] [stdout]   52:     0x59a17b7325b8 - std::panic::catch_unwind::h362f73cc48531e26
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panic.rs:359:14
[INFO] [stdout]   53:     0x59a17b7325b8 - test::run_test_in_process::hf52fd21d696aae67
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/test/src/lib.rs:686:27
[INFO] [stdout]   54:     0x59a17b7325b8 - test::run_test::{{closure}}::h7e780b8354e6d007
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/test/src/lib.rs:607:43
[INFO] [stdout]   55:     0x59a17b70b384 - test::run_test::{{closure}}::hdc2695f2276aad3e
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/test/src/lib.rs:637:41
[INFO] [stdout]   56:     0x59a17b70b384 - std::sys::backtrace::__rust_begin_short_backtrace::h2555b2113ed90fc9
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/sys/backtrace.rs:158:18
[INFO] [stdout]   57:     0x59a17b70ecba - std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}}::h99800d480987dfb6
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/thread/mod.rs:562:17
[INFO] [stdout]   58:     0x59a17b70ecba - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::hbbb69b5294b2221b
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/panic/unwind_safe.rs:274:9
[INFO] [stdout]   59:     0x59a17b70ecba - std::panicking::catch_unwind::do_call::h495689350c27df20
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:590:40
[INFO] [stdout]   60:     0x59a17b70ecba - std::panicking::catch_unwind::hf22437c51d1b3740
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:553:19
[INFO] [stdout]   61:     0x59a17b70ecba - std::panic::catch_unwind::habda1a57de8231f8
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panic.rs:359:14
[INFO] [stdout]   62:     0x59a17b70ecba - std::thread::Builder::spawn_unchecked_::{{closure}}::h5833d8dda8c7e80b
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/thread/mod.rs:560:30
[INFO] [stdout]   63:     0x59a17b70ecba - core::ops::function::FnOnce::call_once{{vtable.shim}}::ha2910283a5058402
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   64:     0x59a17bb81c3f - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::he4d85cb537521972
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/alloc/src/boxed.rs:2005:9
[INFO] [stdout]   65:     0x59a17bb81c3f - std::sys::thread::unix::Thread::new::thread_start::hbaf586a9e50a98cd
[INFO] [stdout]                                at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/sys/thread/unix.rs:126:17
[INFO] [stdout]   66:     0x7ca8ae3f9aa4 - <unknown>
[INFO] [stdout]   67:     0x7ca8ae486a64 - clone
[INFO] [stdout]   68:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout]     test_complete_workflow
[INFO] [stdout]     test_concurrent_workers
[INFO] [stdout]     test_queue_persistence
[INFO] [stdout] 
[INFO] [stdout] test result: FAILED. 2 passed; 3 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.06s
[INFO] [stdout] 
[INFO] [stderr] error: test failed, to rerun pass `--test concurrent_worker_integration`
[INFO] running `Command { std: "docker" "inspect" "a08caad893239bf67a668d3eb59bd57a4ca98a8d7939f72dc088cf2b31acf499", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "a08caad893239bf67a668d3eb59bd57a4ca98a8d7939f72dc088cf2b31acf499", kill_on_drop: false }`
[INFO] [stdout] a08caad893239bf67a668d3eb59bd57a4ca98a8d7939f72dc088cf2b31acf499
