[INFO] fetching crate tracing-s3 0.1.5...
[INFO] testing tracing-s3-0.1.5 against master#350d0ef0ec0493e6d21cfb265cb8211a0e74d766 for pr-145330-1
[INFO] extracting crate tracing-s3 0.1.5 into /workspace/builds/worker-4-tc1/source
[INFO] started tweaking crates.io crate tracing-s3 0.1.5
[INFO] finished tweaking crates.io crate tracing-s3 0.1.5
[INFO] tweaked toml for crates.io crate tracing-s3 0.1.5 written to /workspace/builds/worker-4-tc1/source/Cargo.toml
[INFO] validating manifest of crates.io crate tracing-s3 0.1.5 on toolchain 350d0ef0ec0493e6d21cfb265cb8211a0e74d766
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+350d0ef0ec0493e6d21cfb265cb8211a0e74d766" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] crate crates.io crate tracing-s3 0.1.5 already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+350d0ef0ec0493e6d21cfb265cb8211a0e74d766" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] [stderr]     Updating crates.io index
[INFO] [stderr]  Downloading crates ...
[INFO] [stderr]   Downloaded aws-types v1.3.8
[INFO] [stderr]   Downloaded base64-simd v0.8.0
[INFO] [stderr]   Downloaded bytes-utils v0.1.4
[INFO] [stderr]   Downloaded outref v0.5.2
[INFO] [stderr]   Downloaded aws-smithy-async v1.2.5
[INFO] [stderr]   Downloaded aws-credential-types v1.2.4
[INFO] [stderr]   Downloaded vsimd v0.8.0
[INFO] [stderr]   Downloaded ff v0.12.1
[INFO] [stderr]   Downloaded rfc6979 v0.3.1
[INFO] [stderr]   Downloaded group v0.12.1
[INFO] [stderr]   Downloaded aws-smithy-checksums v0.63.5
[INFO] [stderr]   Downloaded ecdsa v0.14.8
[INFO] [stderr]   Downloaded crypto-bigint v0.4.9
[INFO] [stderr]   Downloaded aws-runtime v1.5.9
[INFO] [stderr]   Downloaded der v0.6.1
[INFO] [stderr]   Downloaded security-framework v3.2.0
[INFO] [stderr]   Downloaded aws-smithy-runtime v1.8.5
[INFO] [stderr]   Downloaded aws-smithy-http-client v1.0.6
[INFO] [stderr]   Downloaded h2 v0.4.11
[INFO] [stderr]   Downloaded elliptic-curve v0.12.3
[INFO] [stderr]   Downloaded p256 v0.11.1
[INFO] [stderr]   Downloaded aws-lc-rs v1.13.3
[INFO] [stderr]   Downloaded aws-sigv4 v1.3.3
[INFO] [stderr]   Downloaded crc-fast v1.3.0
[INFO] [stderr]   Downloaded aws-smithy-types v1.3.2
[INFO] [stderr]   Downloaded aws-smithy-eventstream v0.60.10
[INFO] [stderr]   Downloaded xmlparser v0.13.6
[INFO] [stderr]   Downloaded base64ct v1.8.0
[INFO] [stderr]   Downloaded pkcs8 v0.9.0
[INFO] [stderr]   Downloaded aws-smithy-json v0.61.4
[INFO] [stderr]   Downloaded aws-smithy-http v0.62.2
[INFO] [stderr]   Downloaded rustls-native-certs v0.6.3
[INFO] [stderr]   Downloaded aws-smithy-xml v0.60.10
[INFO] [stderr]   Downloaded aws-smithy-runtime-api v1.8.5
[INFO] [stderr]   Downloaded base16ct v0.1.1
[INFO] [stderr]   Downloaded spki v0.6.0
[INFO] [stderr]   Downloaded sec1 v0.3.0
[INFO] [stderr]   Downloaded aws-smithy-observability v0.1.3
[INFO] [stderr]   Downloaded crc v3.3.0
[INFO] [stderr]   Downloaded aws-sdk-s3 v1.100.0
[INFO] [stderr]   Downloaded aws-lc-sys v0.30.0
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-4-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-4-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:e90291280db7d1fac5b66fc6dad9f9662629e7365a55743daf9bdf73ebc4ea79" "/opt/rustwide/cargo-home/bin/cargo" "+350d0ef0ec0493e6d21cfb265cb8211a0e74d766" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] [stdout] 78746dc46142d0bd8d513f6b834770f395fa71e19e692926d6d01595847e60fa
[INFO] running `Command { std: "docker" "start" "-a" "78746dc46142d0bd8d513f6b834770f395fa71e19e692926d6d01595847e60fa", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "78746dc46142d0bd8d513f6b834770f395fa71e19e692926d6d01595847e60fa", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "78746dc46142d0bd8d513f6b834770f395fa71e19e692926d6d01595847e60fa", kill_on_drop: false }`
[INFO] [stdout] 78746dc46142d0bd8d513f6b834770f395fa71e19e692926d6d01595847e60fa
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-4-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-4-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:e90291280db7d1fac5b66fc6dad9f9662629e7365a55743daf9bdf73ebc4ea79" "/opt/rustwide/cargo-home/bin/cargo" "+350d0ef0ec0493e6d21cfb265cb8211a0e74d766" "build" "--frozen" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] 8d8d7c732147e52b31e82b772b8dc3f034b15930a46c6d7b1ee3d4dc75e68046
[INFO] running `Command { std: "docker" "start" "-a" "8d8d7c732147e52b31e82b772b8dc3f034b15930a46c6d7b1ee3d4dc75e68046", kill_on_drop: false }`
[INFO] [stderr]    Compiling libc v0.2.174
[INFO] [stderr]    Compiling smallvec v1.15.1
[INFO] [stderr]    Compiling subtle v2.6.1
[INFO] [stderr]    Compiling tracing-core v0.1.34
[INFO] [stderr]    Compiling typenum v1.18.0
[INFO] [stderr]    Compiling futures-task v0.3.31
[INFO] [stderr]    Compiling num-traits v0.2.19
[INFO] [stderr]    Compiling generic-array v0.14.7
[INFO] [stderr]    Compiling either v1.15.0
[INFO] [stderr]    Compiling vsimd v0.8.0
[INFO] [stderr]    Compiling outref v0.5.2
[INFO] [stderr]    Compiling fs_extra v1.3.0
[INFO] [stderr]    Compiling dunce v1.0.5
[INFO] [stderr]    Compiling tracing-attributes v0.1.30
[INFO] [stderr]    Compiling aws-lc-rs v1.13.3
[INFO] [stderr]    Compiling getrandom v0.3.3
[INFO] [stderr]    Compiling futures-util v0.3.31
[INFO] [stderr]    Compiling der v0.6.1
[INFO] [stderr]    Compiling rustls-pki-types v1.12.0
[INFO] [stderr]    Compiling base64ct v1.8.0
[INFO] [stderr]    Compiling bytes-utils v0.1.4
[INFO] [stderr]    Compiling crc32fast v1.5.0
[INFO] [stderr]    Compiling rustls v0.23.31
[INFO] [stderr]    Compiling atomic-waker v1.1.2
[INFO] [stderr]    Compiling zerocopy v0.8.26
[INFO] [stderr]    Compiling rustls v0.21.12
[INFO] [stderr]    Compiling semver v1.0.26
[INFO] [stderr]    Compiling cpufeatures v0.2.17
[INFO] [stderr]    Compiling base16ct v0.1.1
[INFO] [stderr]    Compiling aho-corasick v1.1.3
[INFO] [stderr]    Compiling rustls-native-certs v0.8.1
[INFO] [stderr]    Compiling rustls-native-certs v0.6.3
[INFO] [stderr]    Compiling base64-simd v0.8.0
[INFO] [stderr]    Compiling tower v0.5.2
[INFO] [stderr]    Compiling icu_normalizer v2.0.0
[INFO] [stderr]    Compiling crc-catalog v2.4.0
[INFO] [stderr]    Compiling fastrand v2.3.0
[INFO] [stderr]    Compiling serde_json v1.0.141
[INFO] [stderr]    Compiling crc v3.3.0
[INFO] [stderr]    Compiling xmlparser v0.13.6
[INFO] [stderr]    Compiling overload v0.1.1
[INFO] [stderr]    Compiling nu-ansi-term v0.46.0
[INFO] [stderr]    Compiling spki v0.6.0
[INFO] [stderr]    Compiling rustc_version v0.4.1
[INFO] [stderr]    Compiling num-integer v0.1.46
[INFO] [stderr]    Compiling pkcs8 v0.9.0
[INFO] [stderr]    Compiling parking_lot_core v0.9.11
[INFO] [stderr]    Compiling signal-hook-registry v1.4.5
[INFO] [stderr]    Compiling mio v1.0.4
[INFO] [stderr]    Compiling socket2 v0.6.0
[INFO] [stderr]    Compiling jobserver v0.1.33
[INFO] [stderr]    Compiling getrandom v0.2.16
[INFO] [stderr]    Compiling parking_lot v0.12.4
[INFO] [stderr]    Compiling crypto-common v0.1.6
[INFO] [stderr]    Compiling cc v1.2.30
[INFO] [stderr]    Compiling block-buffer v0.10.4
[INFO] [stderr]    Compiling rand_core v0.6.4
[INFO] [stderr]    Compiling sec1 v0.3.0
[INFO] [stderr]    Compiling digest v0.10.7
[INFO] [stderr]    Compiling socket2 v0.5.10
[INFO] [stderr]    Compiling tracing v0.1.41
[INFO] [stderr]    Compiling rand_core v0.9.3
[INFO] [stderr]    Compiling tokio v1.47.1
[INFO] [stderr]    Compiling aws-types v1.3.8
[INFO] [stderr]    Compiling idna_adapter v1.2.1
[INFO] [stderr]    Compiling regex-automata v0.4.9
[INFO] [stderr]    Compiling ff v0.12.1
[INFO] [stderr]    Compiling crypto-bigint v0.4.9
[INFO] [stderr]    Compiling hmac v0.12.1
[INFO] [stderr]    Compiling sha2 v0.10.9
[INFO] [stderr]    Compiling signature v1.6.4
[INFO] [stderr]    Compiling group v0.12.1
[INFO] [stderr]    Compiling crypto-bigint v0.5.5
[INFO] [stderr]    Compiling sha1 v0.10.6
[INFO] [stderr]    Compiling md-5 v0.10.6
[INFO] [stderr]    Compiling idna v1.0.3
[INFO] [stderr]    Compiling uuid v1.17.0
[INFO] [stderr]    Compiling aws-smithy-xml v0.60.10
[INFO] [stderr]    Compiling sharded-slab v0.1.7
[INFO] [stderr]    Compiling tracing-serde v0.2.0
[INFO] [stderr]    Compiling tracing-log v0.2.0
[INFO] [stderr]    Compiling thread_local v1.1.9
[INFO] [stderr]    Compiling ppv-lite86 v0.2.21
[INFO] [stderr]    Compiling url v2.5.4
[INFO] [stderr]    Compiling iana-time-zone v0.1.63
[INFO] [stderr]    Compiling regex-lite v0.1.6
[INFO] [stderr]    Compiling dotenv v0.15.0
[INFO] [stderr]    Compiling chrono v0.4.41
[INFO] [stderr]    Compiling cmake v0.1.54
[INFO] [stderr]    Compiling rfc6979 v0.3.1
[INFO] [stderr]    Compiling elliptic-curve v0.12.3
[INFO] [stderr]    Compiling rand_chacha v0.9.0
[INFO] [stderr]    Compiling ecdsa v0.14.8
[INFO] [stderr]    Compiling rand v0.9.2
[INFO] [stderr]    Compiling aws-lc-sys v0.30.0
[INFO] [stderr]    Compiling ring v0.17.14
[INFO] [stderr]    Compiling p256 v0.11.1
[INFO] [stderr]    Compiling regex v1.11.1
[INFO] [stderr]    Compiling tracing-subscriber v0.3.19
[INFO] [stderr]    Compiling crc-fast v1.3.0
[INFO] [stderr]    Compiling sct v0.7.1
[INFO] [stderr]    Compiling rustls-webpki v0.101.7
[INFO] [stderr]    Compiling tokio-util v0.7.15
[INFO] [stderr]    Compiling aws-smithy-async v1.2.5
[INFO] [stderr]    Compiling aws-smithy-types v1.3.2
[INFO] [stderr]    Compiling h2 v0.4.11
[INFO] [stderr]    Compiling h2 v0.3.27
[INFO] [stderr]    Compiling aws-smithy-runtime-api v1.8.5
[INFO] [stderr]    Compiling aws-smithy-eventstream v0.60.10
[INFO] [stderr]    Compiling aws-smithy-json v0.61.4
[INFO] [stderr]    Compiling tokio-rustls v0.24.1
[INFO] [stderr]    Compiling aws-smithy-http v0.62.2
[INFO] [stderr]    Compiling aws-credential-types v1.2.4
[INFO] [stderr]    Compiling aws-smithy-observability v0.1.3
[INFO] [stderr]    Compiling aws-smithy-checksums v0.63.5
[INFO] [stderr]    Compiling aws-sigv4 v1.3.3
[INFO] [stderr]    Compiling hyper v1.6.0
[INFO] [stderr]    Compiling hyper v0.14.32
[INFO] [stderr]    Compiling hyper-util v0.1.16
[INFO] [stderr]    Compiling hyper-rustls v0.24.2
[INFO] [stderr]    Compiling rustls-webpki v0.103.4
[INFO] [stderr]    Compiling tokio-rustls v0.26.2
[INFO] [stderr]    Compiling hyper-rustls v0.27.7
[INFO] [stderr]    Compiling aws-smithy-http-client v1.0.6
[INFO] [stderr]    Compiling aws-smithy-runtime v1.8.5
[INFO] [stderr]    Compiling aws-runtime v1.5.9
[INFO] [stderr]    Compiling aws-sdk-s3 v1.100.0
[INFO] [stderr]    Compiling tracing-s3 v0.1.5 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `dev` profile [unoptimized + debuginfo] target(s) in 1m 30s
[INFO] running `Command { std: "docker" "inspect" "8d8d7c732147e52b31e82b772b8dc3f034b15930a46c6d7b1ee3d4dc75e68046", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "8d8d7c732147e52b31e82b772b8dc3f034b15930a46c6d7b1ee3d4dc75e68046", kill_on_drop: false }`
[INFO] [stdout] 8d8d7c732147e52b31e82b772b8dc3f034b15930a46c6d7b1ee3d4dc75e68046
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-4-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-4-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:e90291280db7d1fac5b66fc6dad9f9662629e7365a55743daf9bdf73ebc4ea79" "/opt/rustwide/cargo-home/bin/cargo" "+350d0ef0ec0493e6d21cfb265cb8211a0e74d766" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] 9171274f998a4054662cc46ff42a660cff8bc75481bd257c0e3450d034c5495f
[INFO] running `Command { std: "docker" "start" "-a" "9171274f998a4054662cc46ff42a660cff8bc75481bd257c0e3450d034c5495f", kill_on_drop: false }`
[INFO] [stderr]    Compiling tracing-s3 v0.1.5 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 4.97s
[INFO] running `Command { std: "docker" "inspect" "9171274f998a4054662cc46ff42a660cff8bc75481bd257c0e3450d034c5495f", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "9171274f998a4054662cc46ff42a660cff8bc75481bd257c0e3450d034c5495f", kill_on_drop: false }`
[INFO] [stdout] 9171274f998a4054662cc46ff42a660cff8bc75481bd257c0e3450d034c5495f
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-4-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-4-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:e90291280db7d1fac5b66fc6dad9f9662629e7365a55743daf9bdf73ebc4ea79" "/opt/rustwide/cargo-home/bin/cargo" "+350d0ef0ec0493e6d21cfb265cb8211a0e74d766" "test" "--frozen", kill_on_drop: false }`
[INFO] [stdout] 5ab86e0eb229213d35145eaa10973ad6ebff58316fb11f0c16f92ff9567ade14
[INFO] running `Command { std: "docker" "start" "-a" "5ab86e0eb229213d35145eaa10973ad6ebff58316fb11f0c16f92ff9567ade14", kill_on_drop: false }`
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 0.26s
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/tracing_s3-2a74c1461e52a098)
[INFO] [stdout] 
[INFO] [stdout] running 3 tests
[INFO] [stdout] {"timestamp":"2025-10-02T06:46:31.775298Z","level":"INFO","fields":{"message":"close","time.busy":"10.2µs","time.idle":"21.1µs"},"target":"tracing_s3::testing::tests","span":{"name":"add"},"spans":[]}
[INFO] [stdout] test s3_helpers::tests::append_to_file_test ... FAILED
[INFO] [stdout] test testing::tests::http_tracing ... FAILED
[INFO] [stdout] test testing::tests::json_tracing ... ok
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout] 
[INFO] [stdout] ---- s3_helpers::tests::append_to_file_test stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 's3_helpers::tests::append_to_file_test' (25) panicked at src/s3_helpers.rs:83:10:
[INFO] [stdout] called `Result::unwrap()` on an `Err` value: environment variable not found
[INFO] [stdout] 
[INFO] [stdout] Stack backtrace:
[INFO] [stdout]    0: anyhow::error::<impl core::convert::From<E> for anyhow::Error>::from
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.98/src/backtrace.rs:27:14
[INFO] [stdout]    1: <core::result::Result<T,F> as core::ops::try_trait::FromResidual<core::result::Result<core::convert::Infallible,E>>>::from_residual
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/result.rs:2174:27
[INFO] [stdout]    2: tracing_s3::config::tracing_s3_config::TracingS3Config::new::{{closure}}
[INFO] [stdout]              at ./src/config/tracing_s3_config.rs:68:21
[INFO] [stdout]    3: tracing_s3::s3_helpers::tests::append_to_file_test::{{closure}}
[INFO] [stdout]              at ./src/s3_helpers.rs:82:10
[INFO] [stdout]    4: <core::pin::Pin<P> as core::future::future::Future>::poll
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/future/future.rs:133:9
[INFO] [stdout]    5: <core::pin::Pin<P> as core::future::future::Future>::poll
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/future/future.rs:133:9
[INFO] [stdout]    6: tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::{{closure}}::{{closure}}
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:742:70
[INFO] [stdout]    7: tokio::task::coop::with_budget
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/task/coop/mod.rs:167:5
[INFO] [stdout]    8: tokio::task::coop::budget
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/task/coop/mod.rs:133:5
[INFO] [stdout]    9: tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::{{closure}}
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:742:25
[INFO] [stdout]   10: tokio::runtime::scheduler::current_thread::Context::enter
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:432:19
[INFO] [stdout]   11: tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:741:44
[INFO] [stdout]   12: tokio::runtime::scheduler::current_thread::CoreGuard::enter::{{closure}}
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:829:68
[INFO] [stdout]   13: tokio::runtime::context::scoped::Scoped<T>::set
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/context/scoped.rs:40:9
[INFO] [stdout]   14: tokio::runtime::context::set_scheduler::{{closure}}
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/context.rs:176:38
[INFO] [stdout]   15: std::thread::local::LocalKey<T>::try_with
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/thread/local.rs:315:12
[INFO] [stdout]   16: std::thread::local::LocalKey<T>::with
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/thread/local.rs:279:20
[INFO] [stdout]   17: tokio::runtime::context::set_scheduler
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/context.rs:176:17
[INFO] [stdout]   18: tokio::runtime::scheduler::current_thread::CoreGuard::enter
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:829:27
[INFO] [stdout]   19: tokio::runtime::scheduler::current_thread::CoreGuard::block_on
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:729:24
[INFO] [stdout]   20: tokio::runtime::scheduler::current_thread::CurrentThread::block_on::{{closure}}
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:200:33
[INFO] [stdout]   21: tokio::runtime::context::runtime::enter_runtime
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/context/runtime.rs:65:16
[INFO] [stdout]   22: tokio::runtime::scheduler::current_thread::CurrentThread::block_on
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:188:9
[INFO] [stdout]   23: tokio::runtime::runtime::Runtime::block_on_inner
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/runtime.rs:356:52
[INFO] [stdout]   24: tokio::runtime::runtime::Runtime::block_on
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/runtime.rs:330:18
[INFO] [stdout]   25: tracing_s3::s3_helpers::tests::append_to_file_test
[INFO] [stdout]              at ./src/s3_helpers.rs:84:23
[INFO] [stdout]   26: tracing_s3::s3_helpers::tests::append_to_file_test::{{closure}}
[INFO] [stdout]              at ./src/s3_helpers.rs:69:39
[INFO] [stdout]   27: core::ops::function::FnOnce::call_once
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/ops/function.rs:253:5
[INFO] [stdout]   28: core::ops::function::FnOnce::call_once
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/ops/function.rs:253:5
[INFO] [stdout]   29: test::__rust_begin_short_backtrace
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/test/src/lib.rs:663:18
[INFO] [stdout]   30: test::run_test_in_process::{{closure}}
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/test/src/lib.rs:686:74
[INFO] [stdout]   31: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/panic/unwind_safe.rs:272:9
[INFO] [stdout]   32: std::panicking::catch_unwind::do_call
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panicking.rs:590:40
[INFO] [stdout]   33: std::panicking::catch_unwind
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panicking.rs:553:19
[INFO] [stdout]   34: std::panic::catch_unwind
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panic.rs:359:14
[INFO] [stdout]   35: test::run_test_in_process
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/test/src/lib.rs:686:27
[INFO] [stdout]   36: test::run_test::{{closure}}
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/test/src/lib.rs:607:43
[INFO] [stdout]   37: test::run_test::{{closure}}
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/test/src/lib.rs:637:41
[INFO] [stdout]   38: std::sys::backtrace::__rust_begin_short_backtrace
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/sys/backtrace.rs:158:18
[INFO] [stdout]   39: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}}
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/thread/mod.rs:559:17
[INFO] [stdout]   40: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/panic/unwind_safe.rs:272:9
[INFO] [stdout]   41: std::panicking::catch_unwind::do_call
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panicking.rs:590:40
[INFO] [stdout]   42: std::panicking::catch_unwind
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panicking.rs:553:19
[INFO] [stdout]   43: std::panic::catch_unwind
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panic.rs:359:14
[INFO] [stdout]   44: std::thread::Builder::spawn_unchecked_::{{closure}}
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/thread/mod.rs:557:30
[INFO] [stdout]   45: core::ops::function::FnOnce::call_once{{vtable.shim}}
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/ops/function.rs:253:5
[INFO] [stdout]   46: <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/alloc/src/boxed.rs:1971:9
[INFO] [stdout]   47: std::sys::pal::unix::thread::Thread::new::thread_start
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/sys/pal/unix/thread.rs:107:17
[INFO] [stdout]   48: <unknown>
[INFO] [stdout]   49: clone
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x5e1de3559cf2 - std::backtrace_rs::backtrace::libunwind::trace::h0fb8082ca5562a61
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9
[INFO] [stdout]    1:     0x5e1de3559cf2 - std::backtrace_rs::backtrace::trace_unsynchronized::hfaa258994374a3cd
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14
[INFO] [stdout]    2:     0x5e1de3559cf2 - std::sys::backtrace::_print_fmt::h11496fe34963a885
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/sys/backtrace.rs:66:9
[INFO] [stdout]    3:     0x5e1de3559cf2 - <std::sys::backtrace::BacktraceLock::print::DisplayBacktrace as core::fmt::Display>::fmt::hff1a9408d012ee89
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/sys/backtrace.rs:39:26
[INFO] [stdout]    4:     0x5e1de3580f0f - core::fmt::rt::Argument::fmt::hf11195b61445f5d1
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/fmt/rt.rs:173:76
[INFO] [stdout]    5:     0x5e1de3580f0f - core::fmt::write::h2f1fc679f228cc52
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/fmt/mod.rs:1468:25
[INFO] [stdout]    6:     0x5e1de35454f3 - std::io::default_write_fmt::h12bd533187bc883d
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/io/mod.rs:639:11
[INFO] [stdout]    7:     0x5e1de35454f3 - std::io::Write::write_fmt::h926a1fdfdcb90065
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/io/mod.rs:1954:13
[INFO] [stdout]    8:     0x5e1de3559b42 - std::sys::backtrace::BacktraceLock::print::h28bfdbcac6d3828b
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/sys/backtrace.rs:42:9
[INFO] [stdout]    9:     0x5e1de354381c - std::panicking::default_hook::{{closure}}::h1f968e3a24b0e3b4
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panicking.rs:301:27
[INFO] [stdout]   10:     0x5e1de3543699 - std::panicking::default_hook::h43da101644971931
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panicking.rs:325:9
[INFO] [stdout]   11:     0x5e1de22186ce - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::h4b2012949041da5d
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/alloc/src/boxed.rs:1985:9
[INFO] [stdout]   12:     0x5e1de22186ce - test::test_main_with_exit_callback::{{closure}}::h53c9154cdc260357
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/test/src/lib.rs:145:21
[INFO] [stdout]   13:     0x5e1de3543e23 - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::h911f2e3e7e84b764
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/alloc/src/boxed.rs:1985:9
[INFO] [stdout]   14:     0x5e1de3543e23 - std::panicking::panic_with_hook::hb4e916c3e65eccec
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panicking.rs:842:13
[INFO] [stdout]   15:     0x5e1de35596ca - std::panicking::panic_handler::{{closure}}::hbff715d0475cf1bd
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panicking.rs:707:13
[INFO] [stdout]   16:     0x5e1de3559629 - std::sys::backtrace::__rust_end_short_backtrace::hd6f43484e45a4955
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/sys/backtrace.rs:174:18
[INFO] [stdout]   17:     0x5e1de35445ad - __rustc[b29d3319de9a3146]::rust_begin_unwind
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panicking.rs:698:5
[INFO] [stdout]   18:     0x5e1de358b680 - core::panicking::panic_fmt::h5f8d281875be5ff1
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/panicking.rs:75:14
[INFO] [stdout]   19:     0x5e1de358ce76 - core::result::unwrap_failed::hbb243a6a8b53218d
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/result.rs:1852:5
[INFO] [stdout]   20:     0x5e1de21c1099 - core::result::Result<T,E>::unwrap::hf3a03b10d8902d3a
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/result.rs:1223:23
[INFO] [stdout]   21:     0x5e1de21c1099 - tracing_s3::s3_helpers::tests::append_to_file_test::{{closure}}::hf88c31efc8138aeb
[INFO] [stdout]                                at /opt/rustwide/workdir/src/s3_helpers.rs:83:10
[INFO] [stdout]   22:     0x5e1de21f0da2 - <core::pin::Pin<P> as core::future::future::Future>::poll::haf9ba1ca38248d51
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/future/future.rs:133:9
[INFO] [stdout]   23:     0x5e1de21f0e2d - <core::pin::Pin<P> as core::future::future::Future>::poll::hc97d77a775208c57
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/future/future.rs:133:9
[INFO] [stdout]   24:     0x5e1de21e023d - tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::{{closure}}::{{closure}}::h01eee766a298f079
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:742:70
[INFO] [stdout]   25:     0x5e1de21e0a0b - tokio::task::coop::with_budget::hc4e5444a81518f75
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/task/coop/mod.rs:167:5
[INFO] [stdout]   26:     0x5e1de21e0a0b - tokio::task::coop::budget::hcac78ccb60a8d666
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/task/coop/mod.rs:133:5
[INFO] [stdout]   27:     0x5e1de21e0a0b - tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::{{closure}}::he56ab39145f70812
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:742:25
[INFO] [stdout]   28:     0x5e1de21e0430 - tokio::runtime::scheduler::current_thread::Context::enter::h668224b6a04d3298
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:432:19
[INFO] [stdout]   29:     0x5e1de21e22ad - tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::h544e0376f6b06cb5
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:741:44
[INFO] [stdout]   30:     0x5e1de21e3c24 - tokio::runtime::scheduler::current_thread::CoreGuard::enter::{{closure}}::h375634c02983f8e3
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:829:68
[INFO] [stdout]   31:     0x5e1de21f106b - tokio::runtime::context::scoped::Scoped<T>::set::h8dcb25a8a2b4f838
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/context/scoped.rs:40:9
[INFO] [stdout]   32:     0x5e1de21d0959 - tokio::runtime::context::set_scheduler::{{closure}}::h6cb8b0710deb3773
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/context.rs:176:38
[INFO] [stdout]   33:     0x5e1de21dc652 - std::thread::local::LocalKey<T>::try_with::h2d8bb38db4f53369
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/thread/local.rs:315:12
[INFO] [stdout]   34:     0x5e1de21db89e - std::thread::local::LocalKey<T>::with::h04e2094a71bd4022
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/thread/local.rs:279:20
[INFO] [stdout]   35:     0x5e1de21d0a0d - tokio::runtime::context::set_scheduler::hc70f7780e0fc3a2d
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/context.rs:176:17
[INFO] [stdout]   36:     0x5e1de21e19e0 - tokio::runtime::scheduler::current_thread::CoreGuard::enter::hcd6b2d77cf6889ae
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:829:27
[INFO] [stdout]   37:     0x5e1de21e3f43 - tokio::runtime::scheduler::current_thread::CoreGuard::block_on::h52a0b41aed79dcca
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:729:24
[INFO] [stdout]   38:     0x5e1de21e07e0 - tokio::runtime::scheduler::current_thread::CurrentThread::block_on::{{closure}}::hdf1734ea4838263f
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:200:33
[INFO] [stdout]   39:     0x5e1de21f4bb0 - tokio::runtime::context::runtime::enter_runtime::he771724394b4fd1b
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/context/runtime.rs:65:16
[INFO] [stdout]   40:     0x5e1de21e3bd1 - tokio::runtime::scheduler::current_thread::CurrentThread::block_on::h3f40c21ec6506398
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:188:9
[INFO] [stdout]   41:     0x5e1de21e6884 - tokio::runtime::runtime::Runtime::block_on_inner::hc09b80519c0ff9a5
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/runtime.rs:356:52
[INFO] [stdout]   42:     0x5e1de21e6a51 - tokio::runtime::runtime::Runtime::block_on::h4e8f787ab6d437e3
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/runtime.rs:330:18
[INFO] [stdout]   43:     0x5e1de21c092c - tracing_s3::s3_helpers::tests::append_to_file_test::h123edcce5ac7abb4
[INFO] [stdout]                                at /opt/rustwide/workdir/src/s3_helpers.rs:84:23
[INFO] [stdout]   44:     0x5e1de21c1527 - tracing_s3::s3_helpers::tests::append_to_file_test::{{closure}}::h542efb673d42b5d0
[INFO] [stdout]                                at /opt/rustwide/workdir/src/s3_helpers.rs:69:39
[INFO] [stdout]   45:     0x5e1de21ea936 - core::ops::function::FnOnce::call_once::h7002a87fb44d5da2
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/ops/function.rs:253:5
[INFO] [stdout]   46:     0x5e1de221dc0b - core::ops::function::FnOnce::call_once::haf4e03bb51ef1351
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/ops/function.rs:253:5
[INFO] [stdout]   47:     0x5e1de221dc0b - test::__rust_begin_short_backtrace::h50f5566ee84f2f21
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/test/src/lib.rs:663:18
[INFO] [stdout]   48:     0x5e1de2220e05 - test::run_test_in_process::{{closure}}::heb3733b71d876eca
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/test/src/lib.rs:686:74
[INFO] [stdout]   49:     0x5e1de2220e05 - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::he2fe41e1b161faa9
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/panic/unwind_safe.rs:272:9
[INFO] [stdout]   50:     0x5e1de2220e05 - std::panicking::catch_unwind::do_call::h00aa383d8fd97a09
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panicking.rs:590:40
[INFO] [stdout]   51:     0x5e1de2220e05 - std::panicking::catch_unwind::he482e1914bc21641
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panicking.rs:553:19
[INFO] [stdout]   52:     0x5e1de2220e05 - std::panic::catch_unwind::h86ac9705098f4f22
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panic.rs:359:14
[INFO] [stdout]   53:     0x5e1de2220e05 - test::run_test_in_process::h636a992821e3c6aa
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/test/src/lib.rs:686:27
[INFO] [stdout]   54:     0x5e1de2220e05 - test::run_test::{{closure}}::he454cc9a192df79f
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/test/src/lib.rs:607:43
[INFO] [stdout]   55:     0x5e1de22467b4 - test::run_test::{{closure}}::haec47455908dff86
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/test/src/lib.rs:637:41
[INFO] [stdout]   56:     0x5e1de22467b4 - std::sys::backtrace::__rust_begin_short_backtrace::h230785972524cdc1
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/sys/backtrace.rs:158:18
[INFO] [stdout]   57:     0x5e1de222d3ca - std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}}::haa5a562db4cde838
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/thread/mod.rs:559:17
[INFO] [stdout]   58:     0x5e1de222d3ca - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::h89254f37a55d0a87
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/panic/unwind_safe.rs:272:9
[INFO] [stdout]   59:     0x5e1de222d3ca - std::panicking::catch_unwind::do_call::h499f5a462f019d9d
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panicking.rs:590:40
[INFO] [stdout]   60:     0x5e1de222d3ca - std::panicking::catch_unwind::h6736fbbb1a264383
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panicking.rs:553:19
[INFO] [stdout]   61:     0x5e1de222d3ca - std::panic::catch_unwind::h49ea7bdd1cbee572
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panic.rs:359:14
[INFO] [stdout]   62:     0x5e1de222d3ca - std::thread::Builder::spawn_unchecked_::{{closure}}::h653dfa62acf32f5a
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/thread/mod.rs:557:30
[INFO] [stdout]   63:     0x5e1de222d3ca - core::ops::function::FnOnce::call_once{{vtable.shim}}::h82582a626a045a45
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/ops/function.rs:253:5
[INFO] [stdout]   64:     0x5e1de352d3af - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h4ab26c07513156cc
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/alloc/src/boxed.rs:1971:9
[INFO] [stdout]   65:     0x5e1de352d3af - std::sys::pal::unix::thread::Thread::new::thread_start::h66ff1bba185a50cf
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/sys/pal/unix/thread.rs:107:17
[INFO] [stdout]   66:     0x7cc241648aa4 - <unknown>
[INFO] [stdout]   67:     0x7cc2416d5a34 - clone
[INFO] [stdout]   68:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] ---- testing::tests::http_tracing stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'testing::tests::http_tracing' (26) panicked at src/testing.rs:49:10:
[INFO] [stdout] called `Result::unwrap()` on an `Err` value: environment variable not found
[INFO] [stdout] 
[INFO] [stdout] Stack backtrace:
[INFO] [stdout]    0: anyhow::error::<impl core::convert::From<E> for anyhow::Error>::from
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.98/src/backtrace.rs:27:14
[INFO] [stdout]    1: <core::result::Result<T,F> as core::ops::try_trait::FromResidual<core::result::Result<core::convert::Infallible,E>>>::from_residual
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/result.rs:2174:27
[INFO] [stdout]    2: tracing_s3::config::tracing_s3_config::TracingS3Config::new::{{closure}}
[INFO] [stdout]              at ./src/config/tracing_s3_config.rs:68:21
[INFO] [stdout]    3: tracing_s3::testing::tests::http_tracing::{{closure}}
[INFO] [stdout]              at ./src/testing.rs:48:10
[INFO] [stdout]    4: <core::pin::Pin<P> as core::future::future::Future>::poll
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/future/future.rs:133:9
[INFO] [stdout]    5: <core::pin::Pin<P> as core::future::future::Future>::poll
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/future/future.rs:133:9
[INFO] [stdout]    6: tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::{{closure}}::{{closure}}
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:742:70
[INFO] [stdout]    7: tokio::task::coop::with_budget
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/task/coop/mod.rs:167:5
[INFO] [stdout]    8: tokio::task::coop::budget
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/task/coop/mod.rs:133:5
[INFO] [stdout]    9: tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::{{closure}}
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:742:25
[INFO] [stdout]   10: tokio::runtime::scheduler::current_thread::Context::enter
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:432:19
[INFO] [stdout]   11: tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:741:44
[INFO] [stdout]   12: tokio::runtime::scheduler::current_thread::CoreGuard::enter::{{closure}}
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:829:68
[INFO] [stdout]   13: tokio::runtime::context::scoped::Scoped<T>::set
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/context/scoped.rs:40:9
[INFO] [stdout]   14: tokio::runtime::context::set_scheduler::{{closure}}
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/context.rs:176:38
[INFO] [stdout]   15: std::thread::local::LocalKey<T>::try_with
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/thread/local.rs:315:12
[INFO] [stdout]   16: std::thread::local::LocalKey<T>::with
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/thread/local.rs:279:20
[INFO] [stdout]   17: tokio::runtime::context::set_scheduler
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/context.rs:176:17
[INFO] [stdout]   18: tokio::runtime::scheduler::current_thread::CoreGuard::enter
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:829:27
[INFO] [stdout]   19: tokio::runtime::scheduler::current_thread::CoreGuard::block_on
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:729:24
[INFO] [stdout]   20: tokio::runtime::scheduler::current_thread::CurrentThread::block_on::{{closure}}
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:200:33
[INFO] [stdout]   21: tokio::runtime::context::runtime::enter_runtime
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/context/runtime.rs:65:16
[INFO] [stdout]   22: tokio::runtime::scheduler::current_thread::CurrentThread::block_on
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:188:9
[INFO] [stdout]   23: tokio::runtime::runtime::Runtime::block_on_inner
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/runtime.rs:356:52
[INFO] [stdout]   24: tokio::runtime::runtime::Runtime::block_on
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/runtime.rs:330:18
[INFO] [stdout]   25: tracing_s3::testing::tests::http_tracing
[INFO] [stdout]              at ./src/testing.rs:68:64
[INFO] [stdout]   26: tracing_s3::testing::tests::http_tracing::{{closure}}
[INFO] [stdout]              at ./src/testing.rs:35:28
[INFO] [stdout]   27: core::ops::function::FnOnce::call_once
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/ops/function.rs:253:5
[INFO] [stdout]   28: core::ops::function::FnOnce::call_once
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/ops/function.rs:253:5
[INFO] [stdout]   29: test::__rust_begin_short_backtrace
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/test/src/lib.rs:663:18
[INFO] [stdout]   30: test::run_test_in_process::{{closure}}
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/test/src/lib.rs:686:74
[INFO] [stdout]   31: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/panic/unwind_safe.rs:272:9
[INFO] [stdout]   32: std::panicking::catch_unwind::do_call
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panicking.rs:590:40
[INFO] [stdout]   33: std::panicking::catch_unwind
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panicking.rs:553:19
[INFO] [stdout]   34: std::panic::catch_unwind
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panic.rs:359:14
[INFO] [stdout]   35: test::run_test_in_process
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/test/src/lib.rs:686:27
[INFO] [stdout]   36: test::run_test::{{closure}}
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/test/src/lib.rs:607:43
[INFO] [stdout]   37: test::run_test::{{closure}}
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/test/src/lib.rs:637:41
[INFO] [stdout]   38: std::sys::backtrace::__rust_begin_short_backtrace
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/sys/backtrace.rs:158:18
[INFO] [stdout]   39: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}}
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/thread/mod.rs:559:17
[INFO] [stdout]   40: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/panic/unwind_safe.rs:272:9
[INFO] [stdout]   41: std::panicking::catch_unwind::do_call
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panicking.rs:590:40
[INFO] [stdout]   42: std::panicking::catch_unwind
[INFO] [stderr] error: test failed, to rerun pass `--lib`
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panicking.rs:553:19
[INFO] [stdout]   43: std::panic::catch_unwind
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panic.rs:359:14
[INFO] [stdout]   44: std::thread::Builder::spawn_unchecked_::{{closure}}
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/thread/mod.rs:557:30
[INFO] [stdout]   45: core::ops::function::FnOnce::call_once{{vtable.shim}}
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/ops/function.rs:253:5
[INFO] [stdout]   46: <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/alloc/src/boxed.rs:1971:9
[INFO] [stdout]   47: std::sys::pal::unix::thread::Thread::new::thread_start
[INFO] [stdout]              at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/sys/pal/unix/thread.rs:107:17
[INFO] [stdout]   48: <unknown>
[INFO] [stdout]   49: clone
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x5e1de3559cf2 - std::backtrace_rs::backtrace::libunwind::trace::h0fb8082ca5562a61
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9
[INFO] [stdout]    1:     0x5e1de3559cf2 - std::backtrace_rs::backtrace::trace_unsynchronized::hfaa258994374a3cd
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14
[INFO] [stdout]    2:     0x5e1de3559cf2 - std::sys::backtrace::_print_fmt::h11496fe34963a885
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/sys/backtrace.rs:66:9
[INFO] [stdout]    3:     0x5e1de3559cf2 - <std::sys::backtrace::BacktraceLock::print::DisplayBacktrace as core::fmt::Display>::fmt::hff1a9408d012ee89
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/sys/backtrace.rs:39:26
[INFO] [stdout]    4:     0x5e1de3580f0f - core::fmt::rt::Argument::fmt::hf11195b61445f5d1
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/fmt/rt.rs:173:76
[INFO] [stdout]    5:     0x5e1de3580f0f - core::fmt::write::h2f1fc679f228cc52
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/fmt/mod.rs:1468:25
[INFO] [stdout]    6:     0x5e1de35454f3 - std::io::default_write_fmt::h12bd533187bc883d
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/io/mod.rs:639:11
[INFO] [stdout]    7:     0x5e1de35454f3 - std::io::Write::write_fmt::h926a1fdfdcb90065
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/io/mod.rs:1954:13
[INFO] [stdout]    8:     0x5e1de3559b42 - std::sys::backtrace::BacktraceLock::print::h28bfdbcac6d3828b
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/sys/backtrace.rs:42:9
[INFO] [stdout]    9:     0x5e1de354381c - std::panicking::default_hook::{{closure}}::h1f968e3a24b0e3b4
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panicking.rs:301:27
[INFO] [stdout]   10:     0x5e1de3543699 - std::panicking::default_hook::h43da101644971931
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panicking.rs:325:9
[INFO] [stdout]   11:     0x5e1de22186ce - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::h4b2012949041da5d
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/alloc/src/boxed.rs:1985:9
[INFO] [stdout]   12:     0x5e1de22186ce - test::test_main_with_exit_callback::{{closure}}::h53c9154cdc260357
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/test/src/lib.rs:145:21
[INFO] [stdout]   13:     0x5e1de3543e23 - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::h911f2e3e7e84b764
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/alloc/src/boxed.rs:1985:9
[INFO] [stdout]   14:     0x5e1de3543e23 - std::panicking::panic_with_hook::hb4e916c3e65eccec
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panicking.rs:842:13
[INFO] [stdout]   15:     0x5e1de35596ca - std::panicking::panic_handler::{{closure}}::hbff715d0475cf1bd
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panicking.rs:707:13
[INFO] [stdout]   16:     0x5e1de3559629 - std::sys::backtrace::__rust_end_short_backtrace::hd6f43484e45a4955
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/sys/backtrace.rs:174:18
[INFO] [stdout]   17:     0x5e1de35445ad - __rustc[b29d3319de9a3146]::rust_begin_unwind
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panicking.rs:698:5
[INFO] [stdout]   18:     0x5e1de358b680 - core::panicking::panic_fmt::h5f8d281875be5ff1
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/panicking.rs:75:14
[INFO] [stdout]   19:     0x5e1de358ce76 - core::result::unwrap_failed::hbb243a6a8b53218d
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/result.rs:1852:5
[INFO] [stdout]   20:     0x5e1de2205703 - core::result::Result<T,E>::unwrap::hf3a03b10d8902d3a
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/result.rs:1223:23
[INFO] [stdout]   21:     0x5e1de2205703 - tracing_s3::testing::tests::http_tracing::{{closure}}::hfa43791fd95bc711
[INFO] [stdout]                                at /opt/rustwide/workdir/src/testing.rs:49:10
[INFO] [stdout]   22:     0x5e1de21f0da2 - <core::pin::Pin<P> as core::future::future::Future>::poll::haf9ba1ca38248d51
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/future/future.rs:133:9
[INFO] [stdout]   23:     0x5e1de21f0e2d - <core::pin::Pin<P> as core::future::future::Future>::poll::hc97d77a775208c57
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/future/future.rs:133:9
[INFO] [stdout]   24:     0x5e1de21e023d - tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::{{closure}}::{{closure}}::h01eee766a298f079
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:742:70
[INFO] [stdout]   25:     0x5e1de21e0a0b - tokio::task::coop::with_budget::hc4e5444a81518f75
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/task/coop/mod.rs:167:5
[INFO] [stdout]   26:     0x5e1de21e0a0b - tokio::task::coop::budget::hcac78ccb60a8d666
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/task/coop/mod.rs:133:5
[INFO] [stdout]   27:     0x5e1de21e0a0b - tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::{{closure}}::he56ab39145f70812
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:742:25
[INFO] [stdout]   28:     0x5e1de21e0430 - tokio::runtime::scheduler::current_thread::Context::enter::h668224b6a04d3298
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:432:19
[INFO] [stdout]   29:     0x5e1de21e22ad - tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::h544e0376f6b06cb5
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:741:44
[INFO] [stdout]   30:     0x5e1de21e3c24 - tokio::runtime::scheduler::current_thread::CoreGuard::enter::{{closure}}::h375634c02983f8e3
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:829:68
[INFO] [stdout]   31:     0x5e1de21f106b - tokio::runtime::context::scoped::Scoped<T>::set::h8dcb25a8a2b4f838
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/context/scoped.rs:40:9
[INFO] [stdout]   32:     0x5e1de21d0959 - tokio::runtime::context::set_scheduler::{{closure}}::h6cb8b0710deb3773
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/context.rs:176:38
[INFO] [stdout]   33:     0x5e1de21dc652 - std::thread::local::LocalKey<T>::try_with::h2d8bb38db4f53369
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/thread/local.rs:315:12
[INFO] [stdout]   34:     0x5e1de21db89e - std::thread::local::LocalKey<T>::with::h04e2094a71bd4022
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/thread/local.rs:279:20
[INFO] [stdout]   35:     0x5e1de21d0a0d - tokio::runtime::context::set_scheduler::hc70f7780e0fc3a2d
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/context.rs:176:17
[INFO] [stdout]   36:     0x5e1de21e19e0 - tokio::runtime::scheduler::current_thread::CoreGuard::enter::hcd6b2d77cf6889ae
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:829:27
[INFO] [stdout]   37:     0x5e1de21e3f43 - tokio::runtime::scheduler::current_thread::CoreGuard::block_on::h52a0b41aed79dcca
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:729:24
[INFO] [stdout]   38:     0x5e1de21e07e0 - tokio::runtime::scheduler::current_thread::CurrentThread::block_on::{{closure}}::hdf1734ea4838263f
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:200:33
[INFO] [stdout]   39:     0x5e1de21f4bb0 - tokio::runtime::context::runtime::enter_runtime::he771724394b4fd1b
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/context/runtime.rs:65:16
[INFO] [stdout]   40:     0x5e1de21e3bd1 - tokio::runtime::scheduler::current_thread::CurrentThread::block_on::h3f40c21ec6506398
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/scheduler/current_thread/mod.rs:188:9
[INFO] [stdout]   41:     0x5e1de21e6884 - tokio::runtime::runtime::Runtime::block_on_inner::hc09b80519c0ff9a5
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/runtime.rs:356:52
[INFO] [stdout]   42:     0x5e1de21e6a51 - tokio::runtime::runtime::Runtime::block_on::h4e8f787ab6d437e3
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.47.1/src/runtime/runtime.rs:330:18
[INFO] [stdout]   43:     0x5e1de2205fe0 - tracing_s3::testing::tests::http_tracing::h60834bdc53e7ef76
[INFO] [stdout]                                at /opt/rustwide/workdir/src/testing.rs:68:64
[INFO] [stdout]   44:     0x5e1de2205e87 - tracing_s3::testing::tests::http_tracing::{{closure}}::h11eab8a1ba88b292
[INFO] [stdout]                                at /opt/rustwide/workdir/src/testing.rs:35:28
[INFO] [stdout]   45:     0x5e1de21ea416 - core::ops::function::FnOnce::call_once::h3ac5c0ac2e822e39
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/ops/function.rs:253:5
[INFO] [stdout]   46:     0x5e1de221dc0b - core::ops::function::FnOnce::call_once::haf4e03bb51ef1351
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/ops/function.rs:253:5
[INFO] [stdout]   47:     0x5e1de221dc0b - test::__rust_begin_short_backtrace::h50f5566ee84f2f21
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/test/src/lib.rs:663:18
[INFO] [stdout]   48:     0x5e1de2220e05 - test::run_test_in_process::{{closure}}::heb3733b71d876eca
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/test/src/lib.rs:686:74
[INFO] [stdout]   49:     0x5e1de2220e05 - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::he2fe41e1b161faa9
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/panic/unwind_safe.rs:272:9
[INFO] [stdout]   50:     0x5e1de2220e05 - std::panicking::catch_unwind::do_call::h00aa383d8fd97a09
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panicking.rs:590:40
[INFO] [stdout]   51:     0x5e1de2220e05 - std::panicking::catch_unwind::he482e1914bc21641
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panicking.rs:553:19
[INFO] [stdout]   52:     0x5e1de2220e05 - std::panic::catch_unwind::h86ac9705098f4f22
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panic.rs:359:14
[INFO] [stdout]   53:     0x5e1de2220e05 - test::run_test_in_process::h636a992821e3c6aa
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/test/src/lib.rs:686:27
[INFO] [stdout]   54:     0x5e1de2220e05 - test::run_test::{{closure}}::he454cc9a192df79f
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/test/src/lib.rs:607:43
[INFO] [stdout]   55:     0x5e1de22467b4 - test::run_test::{{closure}}::haec47455908dff86
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/test/src/lib.rs:637:41
[INFO] [stdout]   56:     0x5e1de22467b4 - std::sys::backtrace::__rust_begin_short_backtrace::h230785972524cdc1
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/sys/backtrace.rs:158:18
[INFO] [stdout]   57:     0x5e1de222d3ca - std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}}::haa5a562db4cde838
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/thread/mod.rs:559:17
[INFO] [stdout]   58:     0x5e1de222d3ca - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::h89254f37a55d0a87
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/panic/unwind_safe.rs:272:9
[INFO] [stdout]   59:     0x5e1de222d3ca - std::panicking::catch_unwind::do_call::h499f5a462f019d9d
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panicking.rs:590:40
[INFO] [stdout]   60:     0x5e1de222d3ca - std::panicking::catch_unwind::h6736fbbb1a264383
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panicking.rs:553:19
[INFO] [stdout]   61:     0x5e1de222d3ca - std::panic::catch_unwind::h49ea7bdd1cbee572
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/panic.rs:359:14
[INFO] [stdout]   62:     0x5e1de222d3ca - std::thread::Builder::spawn_unchecked_::{{closure}}::h653dfa62acf32f5a
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/thread/mod.rs:557:30
[INFO] [stdout]   63:     0x5e1de222d3ca - core::ops::function::FnOnce::call_once{{vtable.shim}}::h82582a626a045a45
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/core/src/ops/function.rs:253:5
[INFO] [stdout]   64:     0x5e1de352d3af - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h4ab26c07513156cc
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/alloc/src/boxed.rs:1971:9
[INFO] [stdout]   65:     0x5e1de352d3af - std::sys::pal::unix::thread::Thread::new::thread_start::h66ff1bba185a50cf
[INFO] [stdout]                                at /rustc/350d0ef0ec0493e6d21cfb265cb8211a0e74d766/library/std/src/sys/pal/unix/thread.rs:107:17
[INFO] [stdout]   66:     0x7cc241648aa4 - <unknown>
[INFO] [stdout]   67:     0x7cc2416d5a34 - clone
[INFO] [stdout]   68:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout]     s3_helpers::tests::append_to_file_test
[INFO] [stdout]     testing::tests::http_tracing
[INFO] [stdout] 
[INFO] [stdout] test result: FAILED. 1 passed; 2 failed; 0 ignored; 0 measured; 0 filtered out; finished in 1.00s
[INFO] [stdout] 
[INFO] running `Command { std: "docker" "inspect" "5ab86e0eb229213d35145eaa10973ad6ebff58316fb11f0c16f92ff9567ade14", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "5ab86e0eb229213d35145eaa10973ad6ebff58316fb11f0c16f92ff9567ade14", kill_on_drop: false }`
[INFO] [stdout] 5ab86e0eb229213d35145eaa10973ad6ebff58316fb11f0c16f92ff9567ade14
