[INFO] cloning repository https://github.com/famedly/hedwig
[INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/famedly/hedwig" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffamedly%2Fhedwig", kill_on_drop: false }`
[INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffamedly%2Fhedwig'...
[INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }`
[INFO] [stdout] 8dea76d3c8d4753ebdbf9da0c77c48cdc4d45846
[INFO] testing famedly/hedwig against nightly-2025-01-18+rustflags=-Zrandomize-layout for randomize-layout-2
[INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffamedly%2Fhedwig" "/workspace/builds/worker-1-tc2/source", kill_on_drop: false }`
[INFO] [stderr] Cloning into '/workspace/builds/worker-1-tc2/source'...
[INFO] [stderr] done.
[INFO] validating manifest of git repo https://github.com/famedly/hedwig on toolchain nightly-2025-01-18
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+nightly-2025-01-18" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] started tweaking git repo https://github.com/famedly/hedwig
[INFO] finished tweaking git repo https://github.com/famedly/hedwig
[INFO] tweaked toml for git repo https://github.com/famedly/hedwig written to /workspace/builds/worker-1-tc2/source/Cargo.toml
[INFO] crate git repo https://github.com/famedly/hedwig already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+nightly-2025-01-18" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:819108c5571ea2e421544af4d832f968d213c87fbe3707a016657f43d2f853bc" "/opt/rustwide/cargo-home/bin/cargo" "+nightly-2025-01-18" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] [stdout] 124d02b966089b5f6e0bfae818cdcf6e6157275624fade8f2cc617494925187d
[INFO] running `Command { std: "docker" "start" "-a" "124d02b966089b5f6e0bfae818cdcf6e6157275624fade8f2cc617494925187d", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "124d02b966089b5f6e0bfae818cdcf6e6157275624fade8f2cc617494925187d", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "124d02b966089b5f6e0bfae818cdcf6e6157275624fade8f2cc617494925187d", kill_on_drop: false }`
[INFO] [stdout] 124d02b966089b5f6e0bfae818cdcf6e6157275624fade8f2cc617494925187d
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid -Zrandomize-layout" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:819108c5571ea2e421544af4d832f968d213c87fbe3707a016657f43d2f853bc" "/opt/rustwide/cargo-home/bin/cargo" "+nightly-2025-01-18" "build" "--frozen" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] 81321692230ffb037774e2d293c75a3a5b75f7d37240d93c2ce2fe50c22188c9
[INFO] running `Command { std: "docker" "start" "-a" "81321692230ffb037774e2d293c75a3a5b75f7d37240d93c2ce2fe50c22188c9", kill_on_drop: false }`
[INFO] [stderr]    Compiling proc-macro2 v1.0.78
[INFO] [stderr]    Compiling unicode-ident v1.0.12
[INFO] [stderr]    Compiling libc v0.2.155
[INFO] [stderr]    Compiling cfg-if v1.0.0
[INFO] [stderr]    Compiling once_cell v1.19.0
[INFO] [stderr]    Compiling memchr v2.7.1
[INFO] [stderr]    Compiling autocfg v1.1.0
[INFO] [stderr]    Compiling version_check v0.9.4
[INFO] [stderr]    Compiling pin-project-lite v0.2.13
[INFO] [stderr]    Compiling fnv v1.0.7
[INFO] [stderr]    Compiling itoa v1.0.10
[INFO] [stderr]    Compiling smallvec v1.13.1
[INFO] [stderr]    Compiling log v0.4.20
[INFO] [stderr]    Compiling bytes v1.5.0
[INFO] [stderr]    Compiling rustversion v1.0.17
[INFO] [stderr]    Compiling thiserror v1.0.56
[INFO] [stderr]    Compiling futures-core v0.3.30
[INFO] [stderr]    Compiling parking_lot_core v0.9.9
[INFO] [stderr]    Compiling scopeguard v1.2.0
[INFO] [stderr]    Compiling futures-sink v0.3.30
[INFO] [stderr]    Compiling serde v1.0.195
[INFO] [stderr]    Compiling pin-utils v0.1.0
[INFO] [stderr]    Compiling futures-io v0.3.30
[INFO] [stderr]    Compiling tracing-core v0.1.32
[INFO] [stderr]    Compiling futures-channel v0.3.30
[INFO] [stderr]    Compiling futures-task v0.3.30
[INFO] [stderr]    Compiling ryu v1.0.16
[INFO] [stderr]    Compiling hashbrown v0.14.3
[INFO] [stderr]    Compiling equivalent v1.0.1
[INFO] [stderr]    Compiling typenum v1.17.0
[INFO] [stderr]    Compiling percent-encoding v2.3.1
[INFO] [stderr]    Compiling ident_case v1.0.1
[INFO] [stderr]    Compiling powerfmt v0.2.0
[INFO] [stderr]    Compiling lock_api v0.4.11
[INFO] [stderr]    Compiling slab v0.4.9
[INFO] [stderr]    Compiling strsim v0.11.1
[INFO] [stderr]    Compiling generic-array v0.14.7
[INFO] [stderr]    Compiling async-trait v0.1.77
[INFO] [stderr]    Compiling httparse v1.8.0
[INFO] [stderr]    Compiling base64 v0.21.7
[INFO] [stderr]    Compiling tower-service v0.3.2
[INFO] [stderr]    Compiling lazy_static v1.4.0
[INFO] [stderr]    Compiling http v0.2.11
[INFO] [stderr]    Compiling proc-macro-error-attr v1.0.4
[INFO] [stderr]    Compiling try-lock v0.2.5
[INFO] [stderr]    Compiling httpdate v1.0.3
[INFO] [stderr]    Compiling serde_json v1.0.111
[INFO] [stderr]    Compiling syn v1.0.109
[INFO] [stderr]    Compiling time-core v0.1.2
[INFO] [stderr]    Compiling num-conv v0.1.0
[INFO] [stderr]    Compiling want v0.3.1
[INFO] [stderr]    Compiling form_urlencoded v1.2.1
[INFO] [stderr]    Compiling num-traits v0.2.17
[INFO] [stderr]    Compiling proc-macro-error v1.0.4
[INFO] [stderr]    Compiling semver v1.0.21
[INFO] [stderr]    Compiling spin v0.9.8
[INFO] [stderr]    Compiling untrusted v0.9.0
[INFO] [stderr]    Compiling tinyvec_macros v0.1.1
[INFO] [stderr]    Compiling crossbeam-utils v0.8.19
[INFO] [stderr]    Compiling anyhow v1.0.86
[INFO] [stderr]    Compiling mime v0.3.17
[INFO] [stderr]    Compiling camino v1.1.7
[INFO] [stderr]    Compiling tinyvec v1.6.0
[INFO] [stderr]    Compiling vergen-lib v0.1.3
[INFO] [stderr]    Compiling aho-corasick v1.1.2
[INFO] [stderr]    Compiling indexmap v2.1.0
[INFO] [stderr]    Compiling quote v1.0.35
[INFO] [stderr]    Compiling ahash v0.7.8
[INFO] [stderr]    Compiling regex-syntax v0.8.2
[INFO] [stderr]    Compiling getrandom v0.2.12
[INFO] [stderr]    Compiling cc v1.0.83
[INFO] [stderr]    Compiling socket2 v0.5.5
[INFO] [stderr]    Compiling mio v0.8.10
[INFO] [stderr]    Compiling signal-hook-registry v1.4.1
[INFO] [stderr]    Compiling num_cpus v1.16.0
[INFO] [stderr]    Compiling syn v2.0.48
[INFO] [stderr]    Compiling parking_lot v0.12.1
[INFO] [stderr]    Compiling http-body v0.4.6
[INFO] [stderr]    Compiling overload v0.1.1
[INFO] [stderr]    Compiling ucd-trie v0.1.6
[INFO] [stderr]    Compiling nu-ansi-term v0.46.0
[INFO] [stderr]    Compiling rand_core v0.6.4
[INFO] [stderr]    Compiling axum-core v0.3.4
[INFO] [stderr]    Compiling vergen v9.0.0
[INFO] [stderr]    Compiling tracing-log v0.2.0
[INFO] [stderr]    Compiling sharded-slab v0.1.7
[INFO] [stderr]    Compiling deranged v0.3.11
[INFO] [stderr]    Compiling thread_local v1.1.7
[INFO] [stderr]    Compiling ppv-lite86 v0.2.17
[INFO] [stderr]    Compiling block-buffer v0.10.4
[INFO] [stderr]    Compiling crypto-common v0.1.6
[INFO] [stderr]    Compiling unicode-bidi v0.3.15
[INFO] [stderr]    Compiling digest v0.10.7
[INFO] [stderr]    Compiling cpufeatures v0.2.12
[INFO] [stderr]    Compiling tower-layer v0.3.2
[INFO] [stderr]    Compiling protobuf v2.28.0
[INFO] [stderr]    Compiling sync_wrapper v0.1.2
[INFO] [stderr]    Compiling num_threads v0.1.7
[INFO] [stderr]    Compiling unicode-normalization v0.1.22
[INFO] [stderr]    Compiling spin v0.5.2
[INFO] [stderr]    Compiling bitflags v1.3.2
[INFO] [stderr]    Compiling rustls v0.20.9
[INFO] [stderr]    Compiling untrusted v0.7.1
[INFO] [stderr]    Compiling rand_chacha v0.3.1
[INFO] [stderr]    Compiling crossbeam-channel v0.5.11
[INFO] [stderr]    Compiling sha1 v0.10.6
[INFO] [stderr]    Compiling headers-core v0.2.0
[INFO] [stderr]    Compiling sysinfo v0.30.13
[INFO] [stderr]    Compiling vergen-gitcl v1.0.0
[INFO] [stderr]    Compiling axum v0.6.20
[INFO] [stderr]    Compiling heck v0.4.1
[INFO] [stderr]    Compiling urlencoding v2.1.3
[INFO] [stderr]    Compiling prometheus v0.13.3
[INFO] [stderr]    Compiling rustix v0.38.30
[INFO] [stderr]    Compiling rand v0.8.5
[INFO] [stderr]    Compiling hashbrown v0.12.3
[INFO] [stderr]    Compiling ring v0.17.7
[INFO] [stderr]    Compiling ring v0.16.20
[INFO] [stderr]    Compiling backtrace v0.3.69
[INFO] [stderr]    Compiling idna v0.5.0
[INFO] [stderr]    Compiling headers v0.3.9
[INFO] [stderr]    Compiling ordered-float v4.2.0
[INFO] [stderr]    Compiling regex-automata v0.4.5
[INFO] [stderr]    Compiling time v0.3.36
[INFO] [stderr]    Compiling tracing-subscriber v0.3.18
[INFO] [stderr]    Compiling rustls-pemfile v1.0.4
[INFO] [stderr]    Compiling adler v1.0.2
[INFO] [stderr]    Compiling bitflags v2.4.2
[INFO] [stderr]    Compiling gimli v0.28.1
[INFO] [stderr]    Compiling eyre v0.6.11
[INFO] [stderr]    Compiling url v2.5.0
[INFO] [stderr]    Compiling glob v0.3.1
[INFO] [stderr]    Compiling matchit v0.7.3
[INFO] [stderr]    Compiling dlv-list v0.3.0
[INFO] [stderr]    Compiling linux-raw-sys v0.4.13
[INFO] [stderr]    Compiling openssl-probe v0.1.5
[INFO] [stderr]    Compiling ordered-multimap v0.4.3
[INFO] [stderr]    Compiling miniz_oxide v0.7.1
[INFO] [stderr]    Compiling rustls-native-certs v0.6.3
[INFO] [stderr]    Compiling dirs-sys-next v0.1.2
[INFO] [stderr]    Compiling getset v0.1.2
[INFO] [stderr]    Compiling object v0.32.2
[INFO] [stderr]    Compiling encoding_rs v0.8.33
[INFO] [stderr]    Compiling indenter v0.3.3
[INFO] [stderr]    Compiling base64 v0.13.1
[INFO] [stderr]    Compiling darling_core v0.20.10
[INFO] [stderr]    Compiling either v1.9.0
[INFO] [stderr]    Compiling ipnet v2.9.0
[INFO] [stderr]    Compiling owo-colors v3.5.0
[INFO] [stderr]    Compiling linked-hash-map v0.5.6
[INFO] [stderr]    Compiling rustc-demangle v0.1.23
[INFO] [stderr]    Compiling iana-time-zone v0.1.59
[INFO] [stderr]    Compiling minimal-lexical v0.2.1
[INFO] [stderr]    Compiling home v0.5.9
[INFO] [stderr]    Compiling chrono v0.4.33
[INFO] [stderr]    Compiling yaml-rust v0.4.5
[INFO] [stderr]    Compiling nom v7.1.3
[INFO] [stderr]    Compiling dirs-next v2.0.0
[INFO] [stderr]    Compiling rust-ini v0.18.0
[INFO] [stderr]    Compiling pathdiff v0.2.1
[INFO] [stderr]    Compiling regex v1.10.6
[INFO] [stderr]    Compiling addr2line v0.21.0
[INFO] [stderr]    Compiling serde_derive v1.0.195
[INFO] [stderr]    Compiling thiserror-impl v1.0.56
[INFO] [stderr]    Compiling tokio-macros v2.2.0
[INFO] [stderr]    Compiling futures-macro v0.3.30
[INFO] [stderr]    Compiling tracing-attributes v0.1.27
[INFO] [stderr]    Compiling pin-project-internal v1.1.4
[INFO] [stderr]    Compiling sct v0.7.1
[INFO] [stderr]    Compiling darling_macro v0.20.10
[INFO] [stderr]    Compiling webpki v0.22.4
[INFO] [stderr]    Compiling tokio v1.35.1
[INFO] [stderr]    Compiling axum-macros v0.3.8
[INFO] [stderr]    Compiling futures-util v0.3.30
[INFO] [stderr]    Compiling darling v0.20.10
[INFO] [stderr]    Compiling which v4.4.2
[INFO] [stderr]    Compiling derive_builder_core v0.20.0
[INFO] [stderr]    Compiling pest v2.7.11
[INFO] [stderr]    Compiling opentelemetry v0.21.0
[INFO] [stderr]    Compiling pin-project v1.1.4
[INFO] [stderr]    Compiling tracing v0.1.40
[INFO] [stderr]    Compiling derive_builder_macro v0.20.0
[INFO] [stderr]    Compiling tracing-error v0.2.0
[INFO] [stderr]    Compiling tracing-futures v0.2.5
[INFO] [stderr]    Compiling color-spantrace v0.2.1
[INFO] [stderr]    Compiling derive_builder v0.20.0
[INFO] [stderr]    Compiling color-eyre v0.6.2
[INFO] [stderr]    Compiling pest_meta v2.7.11
[INFO] [stderr]    Compiling pest_generator v2.7.11
[INFO] [stderr]    Compiling futures-executor v0.3.30
[INFO] [stderr]    Compiling futures v0.3.30
[INFO] [stderr]    Compiling pest_derive v2.7.11
[INFO] [stderr]    Compiling cargo-platform v0.1.8
[INFO] [stderr]    Compiling rustc_version v0.4.0
[INFO] [stderr]    Compiling cargo_metadata v0.18.1
[INFO] [stderr]    Compiling serde_urlencoded v0.7.1
[INFO] [stderr]    Compiling serde_path_to_error v0.1.15
[INFO] [stderr]    Compiling ron v0.7.1
[INFO] [stderr]    Compiling toml v0.5.11
[INFO] [stderr]    Compiling json5 v0.4.1
[INFO] [stderr]    Compiling tokio-util v0.7.10
[INFO] [stderr]    Compiling tokio-stream v0.1.14
[INFO] [stderr]    Compiling tower v0.4.13
[INFO] [stderr]    Compiling tokio-rustls v0.23.4
[INFO] [stderr]    Compiling matrix-hedwig v2.0.0 (/opt/rustwide/workdir)
[INFO] [stderr]    Compiling config v0.13.4
[INFO] [stderr]    Compiling opentelemetry_sdk v0.21.2
[INFO] [stderr]    Compiling h2 v0.3.24
[INFO] [stderr]    Compiling opentelemetry-prometheus v0.14.1
[INFO] [stderr]    Compiling tracing-appender v0.2.3
[INFO] [stderr]    Compiling hyper v0.14.28
[INFO] [stderr]    Compiling reqwest v0.11.27
[INFO] [stderr]    Compiling hyper-rustls v0.23.2
[INFO] [stderr]    Compiling gcp_auth v0.7.6
[INFO] [stderr]    Compiling firebae-cm v0.1.0
[INFO] [stderr]    Compiling axum-extra v0.8.0
[INFO] [stderr]    Compiling axum-opentelemetry-middleware v0.2.1 (https://github.com/famedly/axum-opentelemetry-middleware.git?rev=f8da4a9642fcc2a5671e4f2eaa5831b94c62464f#f8da4a96)
[INFO] [stderr]     Finished `dev` profile [unoptimized + debuginfo] target(s) in 2m 01s
[INFO] running `Command { std: "docker" "inspect" "81321692230ffb037774e2d293c75a3a5b75f7d37240d93c2ce2fe50c22188c9", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "81321692230ffb037774e2d293c75a3a5b75f7d37240d93c2ce2fe50c22188c9", kill_on_drop: false }`
[INFO] [stdout] 81321692230ffb037774e2d293c75a3a5b75f7d37240d93c2ce2fe50c22188c9
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid -Zrandomize-layout" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:819108c5571ea2e421544af4d832f968d213c87fbe3707a016657f43d2f853bc" "/opt/rustwide/cargo-home/bin/cargo" "+nightly-2025-01-18" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] 663b1460baf4a2a71e38a13220462320a64498f4f4c851c4fbb7ca9fccbbc53e
[INFO] running `Command { std: "docker" "start" "-a" "663b1460baf4a2a71e38a13220462320a64498f4f4c851c4fbb7ca9fccbbc53e", kill_on_drop: false }`
[INFO] [stderr]    Compiling aho-corasick v1.1.2
[INFO] [stderr]    Compiling regex-syntax v0.8.2
[INFO] [stderr]    Compiling regex-automata v0.4.5
[INFO] [stderr]    Compiling regex v1.10.6
[INFO] [stderr]    Compiling vergen v9.0.0
[INFO] [stderr]    Compiling vergen-gitcl v1.0.0
[INFO] [stderr]    Compiling matrix-hedwig v2.0.0 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 22.94s
[INFO] running `Command { std: "docker" "inspect" "663b1460baf4a2a71e38a13220462320a64498f4f4c851c4fbb7ca9fccbbc53e", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "663b1460baf4a2a71e38a13220462320a64498f4f4c851c4fbb7ca9fccbbc53e", kill_on_drop: false }`
[INFO] [stdout] 663b1460baf4a2a71e38a13220462320a64498f4f4c851c4fbb7ca9fccbbc53e
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid -Zrandomize-layout" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:819108c5571ea2e421544af4d832f968d213c87fbe3707a016657f43d2f853bc" "/opt/rustwide/cargo-home/bin/cargo" "+nightly-2025-01-18" "test" "--frozen", kill_on_drop: false }`
[INFO] [stdout] 0faef54861417cf1e6b937cdafccc1b7d85d4ee574dd57192c7b2af655cd00b1
[INFO] running `Command { std: "docker" "start" "-a" "0faef54861417cf1e6b937cdafccc1b7d85d4ee574dd57192c7b2af655cd00b1", kill_on_drop: false }`
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 0.28s
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/matrix_hedwig-a9fcc5ed854c0443)
[INFO] [stdout] 
[INFO] [stdout] running 0 tests
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
[INFO] [stdout] 
[INFO] [stderr]      Running unittests src/main.rs (/opt/rustwide/target/debug/deps/matrix_hedwig-5f97b93e9fb22446)
[INFO] [stdout] 
[INFO] [stdout] running 0 tests
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
[INFO] [stdout] 
[INFO] [stderr]      Running tests/pusher.rs (/opt/rustwide/target/debug/deps/pusher-8fa6dc9fd84ddf65)
[INFO] [stdout] 
[INFO] [stdout] running 6 tests
[INFO] [stdout] test bad_json ... ok
[INFO] [stdout] test push_body_limit ... ok
[INFO] [stdout] test many_requests ... ok
[INFO] [stdout] test normal_operation ... FAILED
[INFO] [stdout] test fcm_failure ... ok
[INFO] [stdout] test many_devices ... FAILED
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout] 
[INFO] [stdout] ---- normal_operation stdout ----
[INFO] [stdout] OpenTelemetry metrics error occurred. Metrics error: reader is shut down or not registered
[INFO] [stdout] 
[INFO] [stdout] thread 'normal_operation' panicked at tests/pusher.rs:211:5:
[INFO] [stdout] assertion `left == right` failed
[INFO] [stdout]   left: ""
[INFO] [stdout]  right: "# TYPE devices_total counter\ndevices_total{otel_scope_name=\"axum-opentelemetry\"} 8\n# TYPE http_requests_duration_seconds histogram\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\",le=\"0\"} 0\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\",le=\"5\"} 8\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\",le=\"10\"} 8\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\",le=\"25\"} 8\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\",le=\"50\"} 8\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\",le=\"75\"} 8\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\",le=\"100\"} 8\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\",le=\"250\"} 8\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\",le=\"500\"} 8\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\",le=\"750\"} 8\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\",le=\"1000\"} 8\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\",le=\"2500\"} 8\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\",le=\"5000\"} 8\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\",le=\"7500\"} 8\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\",le=\"10000\"} 8\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\",le=\"+Inf\"} 8\nhttp_requests_duration_seconds_sum{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\"} FLOAT\nhttp_requests_duration_seconds_count{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\"} 8\n# TYPE http_requests_total counter\nhttp_requests_total{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\"} 8\n# TYPE notifications_total counter\nnotifications_total{otel_scope_name=\"axum-opentelemetry\"} 8\n# HELP otel_scope_info Instrumentation Scope metadata\n# TYPE otel_scope_info gauge\notel_scope_info{otel_scope_name=\"axum-opentelemetry\"} 1\n# HELP pushes_successful_total Successful pushes\n# TYPE pushes_successful_total counter\npushes_successful_total{device_type=\"Android\",otel_scope_name=\"axum-opentelemetry\"} 2\npushes_successful_total{device_type=\"AndroidLegacy\",otel_scope_name=\"axum-opentelemetry\"} 2\npushes_successful_total{device_type=\"Ios\",otel_scope_name=\"axum-opentelemetry\"} 2\npushes_successful_total{device_type=\"None\",otel_scope_name=\"axum-opentelemetry\"} 2\n# HELP target_info Target metadata\n# TYPE target_info gauge\ntarget_info{service_name=\"Hedwig\"} 1\n"
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x58ec9d4bd79a - std::backtrace_rs::backtrace::libunwind::trace::hb059275cfc8d6126
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/../../backtrace/src/backtrace/libunwind.rs:116:5
[INFO] [stdout]    1:     0x58ec9d4bd79a - std::backtrace_rs::backtrace::trace_unsynchronized::h2da071e4327ce3ee
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
[INFO] [stdout]    2:     0x58ec9d4bd79a - std::sys::backtrace::_print_fmt::h842a1474e6f8d23f
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/sys/backtrace.rs:66:9
[INFO] [stdout]    3:     0x58ec9d4bd79a - <std::sys::backtrace::BacktraceLock::print::DisplayBacktrace as core::fmt::Display>::fmt::h71a62eb3b9696b12
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/sys/backtrace.rs:39:26
[INFO] [stdout]    4:     0x58ec9d4e8003 - core::fmt::rt::Argument::fmt::hdb6b616786b41dc1
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/core/src/fmt/rt.rs:177:76
[INFO] [stdout]    5:     0x58ec9d4e8003 - core::fmt::write::h2cc1698af7e2d686
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/core/src/fmt/mod.rs:1440:21
[INFO] [stdout]    6:     0x58ec9d4b9ee3 - std::io::Write::write_fmt::hab1b4cd059a79022
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/io/mod.rs:1887:15
[INFO] [stdout]    7:     0x58ec9d4bd5e2 - std::sys::backtrace::BacktraceLock::print::h147fe35b4ea13b08
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/sys/backtrace.rs:42:9
[INFO] [stdout]    8:     0x58ec9d4bebbf - std::panicking::default_hook::{{closure}}::hbd44223dbdc0d208
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/panicking.rs:298:22
[INFO] [stdout]    9:     0x58ec9d4be9d8 - std::panicking::default_hook::h20f81eb0576efcec
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/panicking.rs:322:9
[INFO] [stdout]   10:     0x58ec9cd3b6a3 - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::hdb53814c496a4d34
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/alloc/src/boxed.rs:2027:9
[INFO] [stdout]   11:     0x58ec9cd3b6a3 - test::test_main::{{closure}}::hc0a4963c59427c24
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/test/src/lib.rs:134:21
[INFO] [stdout]   12:     0x58ec9d4bf6b3 - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::h591b2225413a77e9
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/alloc/src/boxed.rs:2027:9
[INFO] [stdout]   13:     0x58ec9d4bf6b3 - std::panicking::rust_panic_with_hook::h625eea43051b2edc
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/panicking.rs:839:13
[INFO] [stdout]   14:     0x58ec9d4bf36a - std::panicking::begin_panic_handler::{{closure}}::h4f9159cfbc3f6bd3
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/panicking.rs:704:13
[INFO] [stdout]   15:     0x58ec9d4bdc99 - std::sys::backtrace::__rust_end_short_backtrace::h0390abce48353151
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/sys/backtrace.rs:168:18
[INFO] [stdout]   16:     0x58ec9d4beffd - rust_begin_unwind
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/panicking.rs:695:5
[INFO] [stdout]   17:     0x58ec9d4e5290 - core::panicking::panic_fmt::h9e7c637e9e5f29c9
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/core/src/panicking.rs:75:14
[INFO] [stdout]   18:     0x58ec9d4e56e3 - core::panicking::assert_failed_inner::h538bec7c1374cd9c
[INFO] [stdout]   19:     0x58ec9ccf2695 - core::panicking::assert_failed::h5a68695e926e1e5c
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/core/src/panicking.rs:364:5
[INFO] [stdout]   20:     0x58ec9ccd3e55 - pusher::check_prom::{{closure}}::hfc866bc40126f5a4
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/pusher.rs:211:2
[INFO] [stdout]   21:     0x58ec9ccd9f22 - pusher::normal_operation::{{closure}}::hb7f66ae259a36e81
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/pusher.rs:315:68
[INFO] [stdout]   22:     0x58ec9ccf8fff - <core::pin::Pin<P> as core::future::future::Future>::poll::h5124004a86ed160e
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/core/src/future/future.rs:124:9
[INFO] [stdout]   23:     0x58ec9ccf8f9b - <core::pin::Pin<P> as core::future::future::Future>::poll::h02c977e88b32c811
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/core/src/future/future.rs:124:9
[INFO] [stdout]   24:     0x58ec9ccefa4e - tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::{{closure}}::{{closure}}::h9ce0cb7fdebe90a7
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.35.1/src/runtime/scheduler/current_thread/mod.rs:665:57
[INFO] [stdout]   25:     0x58ec9ccef975 - tokio::runtime::coop::with_budget::h97eaaea827be4e99
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.35.1/src/runtime/coop.rs:107:5
[INFO] [stdout]   26:     0x58ec9ccef975 - tokio::runtime::coop::budget::h2a0a53332db82692
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.35.1/src/runtime/coop.rs:73:5
[INFO] [stdout]   27:     0x58ec9ccef975 - tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::{{closure}}::h7df2199eeda2ef8f
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.35.1/src/runtime/scheduler/current_thread/mod.rs:665:25
[INFO] [stdout]   28:     0x58ec9ccee29d - tokio::runtime::scheduler::current_thread::Context::enter::h4b61c7fde4666bdc
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.35.1/src/runtime/scheduler/current_thread/mod.rs:410:19
[INFO] [stdout]   29:     0x58ec9ccef11b - tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::h633b13f56f0eb993
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.35.1/src/runtime/scheduler/current_thread/mod.rs:664:36
[INFO] [stdout]   30:     0x58ec9cceee5b - tokio::runtime::scheduler::current_thread::CoreGuard::enter::{{closure}}::h7735bd2ad715442b
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.35.1/src/runtime/scheduler/current_thread/mod.rs:743:68
[INFO] [stdout]   31:     0x58ec9ccf319a - tokio::runtime::context::scoped::Scoped<T>::set::h6cc826cc5c049476
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.35.1/src/runtime/context/scoped.rs:40:9
[INFO] [stdout]   32:     0x58ec9ccdfffa - tokio::runtime::context::set_scheduler::{{closure}}::haa1a2a15ba08f7ae
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.35.1/src/runtime/context.rs:176:26
[INFO] [stdout]   33:     0x58ec9cce5d25 - std::thread::local::LocalKey<T>::try_with::h201bf81746ea57b1
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/thread/local.rs:308:12
[INFO] [stdout]   34:     0x58ec9cce5bac - std::thread::local::LocalKey<T>::with::h65a201b32d3e68d5
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/thread/local.rs:272:9
[INFO] [stdout]   35:     0x58ec9ccdffa1 - tokio::runtime::context::set_scheduler::h00df6dd1172fc972
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.35.1/src/runtime/context.rs:176:9
[INFO] [stdout]   36:     0x58ec9cceebbe - tokio::runtime::scheduler::current_thread::CoreGuard::enter::ha752b023d2e76425
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.35.1/src/runtime/scheduler/current_thread/mod.rs:743:27
[INFO] [stdout]   37:     0x58ec9cceee91 - tokio::runtime::scheduler::current_thread::CoreGuard::block_on::hcae4a4a45fd33420
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.35.1/src/runtime/scheduler/current_thread/mod.rs:652:19
[INFO] [stdout]   38:     0x58ec9ccedce0 - tokio::runtime::scheduler::current_thread::CurrentThread::block_on::{{closure}}::h555b2eabbf61a00c
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.35.1/src/runtime/scheduler/current_thread/mod.rs:175:28
[INFO] [stdout]   39:     0x58ec9ccfe182 - tokio::runtime::context::runtime::enter_runtime::h34ab9bab1459617b
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.35.1/src/runtime/context/runtime.rs:65:16
[INFO] [stdout]   40:     0x58ec9ccedbd7 - tokio::runtime::scheduler::current_thread::CurrentThread::block_on::h4e71d6a573c38b44
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.35.1/src/runtime/scheduler/current_thread/mod.rs:167:9
[INFO] [stdout]   41:     0x58ec9ccfe8e0 - tokio::runtime::runtime::Runtime::block_on::h3ea33de04ad26876
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.35.1/src/runtime/runtime.rs:348:47
[INFO] [stdout]   42:     0x58ec9ccd8bc3 - pusher::normal_operation::he2fcc9e53a618d4b
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/pusher.rs:317:2
[INFO] [stdout]   43:     0x58ec9ccd8a67 - pusher::normal_operation::{{closure}}::h8c157f23ca015a97
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/pusher.rs:291:32
[INFO] [stdout]   44:     0x58ec9ccff2f6 - core::ops::function::FnOnce::call_once::h7f8dc60be6d4e72d
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   45:     0x58ec9cd40dfb - core::ops::function::FnOnce::call_once::he27718dfdd183f43
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   46:     0x58ec9cd40dfb - test::__rust_begin_short_backtrace::h4e84902998457a5d
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/test/src/lib.rs:632:18
[INFO] [stdout]   47:     0x58ec9cd3fd33 - test::run_test_in_process::{{closure}}::h7176fd18fc1feca0
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/test/src/lib.rs:655:60
[INFO] [stdout]   48:     0x58ec9cd3fd33 - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::hf79cff2a624d8cf7
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/core/src/panic/unwind_safe.rs:272:9
[INFO] [stdout]   49:     0x58ec9cd3fd33 - std::panicking::try::do_call::h3da0561d9ab99c25
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/panicking.rs:587:40
[INFO] [stdout]   50:     0x58ec9cd3fd33 - std::panicking::try::h41c9fa508bc61df6
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/panicking.rs:550:19
[INFO] [stdout]   51:     0x58ec9cd3fd33 - std::panic::catch_unwind::h6b3ff07bb5afad93
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/panic.rs:358:14
[INFO] [stdout]   52:     0x58ec9cd3fd33 - test::run_test_in_process::hc7253dd11b39b9f4
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/test/src/lib.rs:655:27
[INFO] [stdout]   53:     0x58ec9cd3fd33 - test::run_test::{{closure}}::hfb2007f8649c30bb
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/test/src/lib.rs:576:43
[INFO] [stdout]   54:     0x58ec9cd02e15 - test::run_test::{{closure}}::h56a17aa7a282a9f4
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/test/src/lib.rs:606:41
[INFO] [stdout]   55:     0x58ec9cd02e15 - std::sys::backtrace::__rust_begin_short_backtrace::hd2d2d2fb8e8c6aac
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/sys/backtrace.rs:152:18
[INFO] [stdout]   56:     0x58ec9cd066fa - std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}}::h4faa3f9db6133423
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/thread/mod.rs:559:17
[INFO] [stdout]   57:     0x58ec9cd066fa - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::hf2e855a36a4ea846
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/core/src/panic/unwind_safe.rs:272:9
[INFO] [stdout]   58:     0x58ec9cd066fa - std::panicking::try::do_call::h2f73af3616c35465
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/panicking.rs:587:40
[INFO] [stdout]   59:     0x58ec9cd066fa - std::panicking::try::hd1660ce9efadef5a
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/panicking.rs:550:19
[INFO] [stdout]   60:     0x58ec9cd066fa - std::panic::catch_unwind::h5ee8d7823b8ca744
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/panic.rs:358:14
[INFO] [stdout]   61:     0x58ec9cd066fa - std::thread::Builder::spawn_unchecked_::{{closure}}::h53c3a1894dce8407
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/thread/mod.rs:557:30
[INFO] [stdout]   62:     0x58ec9cd066fa - core::ops::function::FnOnce::call_once{{vtable.shim}}::h048ce291ad4f62bf
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   63:     0x58ec9d4c387b - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::ha52bedf99a3b4981
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/alloc/src/boxed.rs:2013:9
[INFO] [stdout]   64:     0x58ec9d4c387b - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h567748934d80ccf8
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/alloc/src/boxed.rs:2013:9
[INFO] [stdout]   65:     0x58ec9d4c387b - std::sys::pal::unix::thread::Thread::new::thread_start::h2d970728ae887adc
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/sys/pal/unix/thread.rs:106:17
[INFO] [stdout]   66:     0x7bdc6b051ac3 - <unknown>
[INFO] [stdout]   67:     0x7bdc6b0e2a04 - clone
[INFO] [stdout]   68:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] ---- many_devices stdout ----
[INFO] [stdout] OpenTelemetry metrics error occurred. Metrics error: reader is shut down or not registered
[INFO] [stdout] 
[INFO] [stdout] thread 'many_devices' panicked at tests/pusher.rs:211:5:
[INFO] [stdout] assertion `left == right` failed
[INFO] [stdout]   left: ""
[INFO] [stdout]  right: "# TYPE devices_total counter\ndevices_total{otel_scope_name=\"axum-opentelemetry\"} 12\n# TYPE http_requests_duration_seconds histogram\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\",le=\"0\"} 0\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\",le=\"5\"} 2\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\",le=\"10\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\",le=\"25\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\",le=\"50\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\",le=\"75\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\",le=\"100\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\",le=\"250\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\",le=\"500\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\",le=\"750\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\",le=\"1000\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\",le=\"2500\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\",le=\"5000\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\",le=\"7500\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\",le=\"10000\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\",le=\"+Inf\"} 3\nhttp_requests_duration_seconds_sum{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\"} FLOAT\nhttp_requests_duration_seconds_count{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\"} 3\n# TYPE http_requests_total counter\nhttp_requests_total{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"axum-opentelemetry\"} 3\n# TYPE notifications_total counter\nnotifications_total{otel_scope_name=\"axum-opentelemetry\"} 3\n# HELP otel_scope_info Instrumentation Scope metadata\n# TYPE otel_scope_info gauge\notel_scope_info{otel_scope_name=\"axum-opentelemetry\"} 1\n# HELP pushes_failed_total Failed pushes\n# TYPE pushes_failed_total counter\npushes_failed_total{device_type=\"AndroidLegacy\",otel_scope_name=\"axum-opentelemetry\"} 1\npushes_failed_total{device_type=\"None\",otel_scope_name=\"axum-opentelemetry\"} 1\n# HELP pushes_successful_total Successful pushes\n# TYPE pushes_successful_total counter\npushes_successful_total{device_type=\"Android\",otel_scope_name=\"axum-opentelemetry\"} 3\npushes_successful_total{device_type=\"AndroidLegacy\",otel_scope_name=\"axum-opentelemetry\"} 2\npushes_successful_total{device_type=\"Ios\",otel_scope_name=\"axum-opentelemetry\"} 3\npushes_successful_total{device_type=\"None\",otel_scope_name=\"axum-opentelemetry\"} 2\n# HELP target_info Target metadata\n# TYPE target_info gauge\ntarget_info{service_name=\"Hedwig\"} 1\n"
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x58ec9d4bd79a - std::backtrace_rs::backtrace::libunwind::trace::hb059275cfc8d6126
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/../../backtrace/src/backtrace/libunwind.rs:116:5
[INFO] [stdout]    1:     0x58ec9d4bd79a - std::backtrace_rs::backtrace::trace_unsynchronized::h2da071e4327ce3ee
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
[INFO] [stdout]    2:     0x58ec9d4bd79a - std::sys::backtrace::_print_fmt::h842a1474e6f8d23f
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/sys/backtrace.rs:66:9
[INFO] [stdout]    3:     0x58ec9d4bd79a - <std::sys::backtrace::BacktraceLock::print::DisplayBacktrace as core::fmt::Display>::fmt::h71a62eb3b9696b12
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/sys/backtrace.rs:39:26
[INFO] [stdout]    4:     0x58ec9d4e8003 - core::fmt::rt::Argument::fmt::hdb6b616786b41dc1
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/core/src/fmt/rt.rs:177:76
[INFO] [stdout]    5:     0x58ec9d4e8003 - core::fmt::write::h2cc1698af7e2d686
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/core/src/fmt/mod.rs:1440:21
[INFO] [stdout]    6:     0x58ec9d4b9ee3 - std::io::Write::write_fmt::hab1b4cd059a79022
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/io/mod.rs:1887:15
[INFO] [stdout]    7:     0x58ec9d4bd5e2 - std::sys::backtrace::BacktraceLock::print::h147fe35b4ea13b08
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/sys/backtrace.rs:42:9
[INFO] [stdout]    8:     0x58ec9d4bebbf - std::panicking::default_hook::{{closure}}::hbd44223dbdc0d208
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/panicking.rs:298:22
[INFO] [stdout]    9:     0x58ec9d4be9d8 - std::panicking::default_hook::h20f81eb0576efcec
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/panicking.rs:322:9
[INFO] [stdout]   10:     0x58ec9cd3b6a3 - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::hdb53814c496a4d34
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/alloc/src/boxed.rs:2027:9
[INFO] [stdout]   11:     0x58ec9cd3b6a3 - test::test_main::{{closure}}::hc0a4963c59427c24
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/test/src/lib.rs:134:21
[INFO] [stdout]   12:     0x58ec9d4bf6b3 - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::h591b2225413a77e9
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/alloc/src/boxed.rs:2027:9
[INFO] [stdout]   13:     0x58ec9d4bf6b3 - std::panicking::rust_panic_with_hook::h625eea43051b2edc
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/panicking.rs:839:13
[INFO] [stdout]   14:     0x58ec9d4bf36a - std::panicking::begin_panic_handler::{{closure}}::h4f9159cfbc3f6bd3
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/panicking.rs:704:13
[INFO] [stdout]   15:     0x58ec9d4bdc99 - std::sys::backtrace::__rust_end_short_backtrace::h0390abce48353151
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/sys/backtrace.rs:168:18
[INFO] [stdout]   16:     0x58ec9d4beffd - rust_begin_unwind
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/panicking.rs:695:5
[INFO] [stdout]   17:     0x58ec9d4e5290 - core::panicking::panic_fmt::h9e7c637e9e5f29c9
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/core/src/panicking.rs:75:14
[INFO] [stdout]   18:     0x58ec9d4e56e3 - core::panicking::assert_failed_inner::h538bec7c1374cd9c
[INFO] [stdout]   19:     0x58ec9ccf2695 - core::panicking::assert_failed::h5a68695e926e1e5c
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/core/src/panicking.rs:364:5
[INFO] [stdout]   20:     0x58ec9ccd3e55 - pusher::check_prom::{{closure}}::hfc866bc40126f5a4
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/pusher.rs:211:2
[INFO] [stdout]   21:     0x58ec9ccdca7e - pusher::many_devices::{{closure}}::h3bc0fc878f236103
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/pusher.rs:372:64
[INFO] [stdout]   22:     0x58ec9ccf8fff - <core::pin::Pin<P> as core::future::future::Future>::poll::h5124004a86ed160e
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/core/src/future/future.rs:124:9
[INFO] [stdout]   23:     0x58ec9ccf8f9b - <core::pin::Pin<P> as core::future::future::Future>::poll::h02c977e88b32c811
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/core/src/future/future.rs:124:9
[INFO] [stdout]   24:     0x58ec9ccefa4e - tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::{{closure}}::{{closure}}::h9ce0cb7fdebe90a7
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.35.1/src/runtime/scheduler/current_thread/mod.rs:665:57
[INFO] [stdout]   25:     0x58ec9ccef975 - tokio::runtime::coop::with_budget::h97eaaea827be4e99
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.35.1/src/runtime/coop.rs:107:5
[INFO] [stdout]   26:     0x58ec9ccef975 - tokio::runtime::coop::budget::h2a0a53332db82692
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.35.1/src/runtime/coop.rs:73:5
[INFO] [stdout]   27:     0x58ec9ccef975 - tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::{{closure}}::h7df2199eeda2ef8f
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.35.1/src/runtime/scheduler/current_thread/mod.rs:665:25
[INFO] [stdout]   28:     0x58ec9ccee29d - tokio::runtime::scheduler::current_thread::Context::enter::h4b61c7fde4666bdc
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.35.1/src/runtime/scheduler/current_thread/mod.rs:410:19
[INFO] [stdout]   29:     0x58ec9ccef11b - tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::h633b13f56f0eb993
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.35.1/src/runtime/scheduler/current_thread/mod.rs:664:36
[INFO] [stdout]   30:     0x58ec9cceee5b - tokio::runtime::scheduler::current_thread::CoreGuard::enter::{{closure}}::h7735bd2ad715442b
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.35.1/src/runtime/scheduler/current_thread/mod.rs:743:68
[INFO] [stdout]   31:     0x58ec9ccf319a - tokio::runtime::context::scoped::Scoped<T>::set::h6cc826cc5c049476
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.35.1/src/runtime/context/scoped.rs:40:9
[INFO] [stdout]   32:     0x58ec9ccdfffa - tokio::runtime::context::set_scheduler::{{closure}}::haa1a2a15ba08f7ae
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.35.1/src/runtime/context.rs:176:26
[INFO] [stdout]   33:     0x58ec9cce5d25 - std::thread::local::LocalKey<T>::try_with::h201bf81746ea57b1
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/thread/local.rs:308:12
[INFO] [stdout]   34:     0x58ec9cce5bac - std::thread::local::LocalKey<T>::with::h65a201b32d3e68d5
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/thread/local.rs:272:9
[INFO] [stdout]   35:     0x58ec9ccdffa1 - tokio::runtime::context::set_scheduler::h00df6dd1172fc972
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.35.1/src/runtime/context.rs:176:9
[INFO] [stdout]   36:     0x58ec9cceebbe - tokio::runtime::scheduler::current_thread::CoreGuard::enter::ha752b023d2e76425
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.35.1/src/runtime/scheduler/current_thread/mod.rs:743:27
[INFO] [stdout]   37:     0x58ec9cceee91 - tokio::runtime::scheduler::current_thread::CoreGuard::block_on::hcae4a4a45fd33420
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.35.1/src/runtime/scheduler/current_thread/mod.rs:652:19
[INFO] [stdout]   38:     0x58ec9ccedce0 - tokio::runtime::scheduler::current_thread::CurrentThread::block_on::{{closure}}::h555b2eabbf61a00c
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.35.1/src/runtime/scheduler/current_thread/mod.rs:175:28
[INFO] [stdout]   39:     0x58ec9ccfe182 - tokio::runtime::context::runtime::enter_runtime::h34ab9bab1459617b
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.35.1/src/runtime/context/runtime.rs:65:16
[INFO] [stdout]   40:     0x58ec9ccedbd7 - tokio::runtime::scheduler::current_thread::CurrentThread::block_on::h4e71d6a573c38b44
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.35.1/src/runtime/scheduler/current_thread/mod.rs:167:9
[INFO] [stdout]   41:     0x58ec9ccfe8e0 - tokio::runtime::runtime::Runtime::block_on::h3ea33de04ad26876
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.35.1/src/runtime/runtime.rs:348:47
[INFO] [stdout]   42:     0x58ec9ccdb083 - pusher::many_devices::h60d4ea3e8ceb62f0
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/pusher.rs:374:2
[INFO] [stdout]   43:     0x58ec9ccdaf27 - pusher::many_devices::{{closure}}::he24686c93d29bbc0
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/pusher.rs:336:28
[INFO] [stdout]   44:     0x58ec9ccff3e6 - core::ops::function::FnOnce::call_once::hf2a1588e1c40c08f
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   45:     0x58ec9cd40dfb - core::ops::function::FnOnce::call_once::he27718dfdd183f43
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   46:     0x58ec9cd40dfb - test::__rust_begin_short_backtrace::h4e84902998457a5d
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/test/src/lib.rs:632:18
[INFO] [stdout]   47:     0x58ec9cd3fd33 - test::run_test_in_process::{{closure}}::h7176fd18fc1feca0
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/test/src/lib.rs:655:60
[INFO] [stdout]   48:     0x58ec9cd3fd33 - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::hf79cff2a624d8cf7
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/core/src/panic/unwind_safe.rs:272:9
[INFO] [stdout]   49:     0x58ec9cd3fd33 - std::panicking::try::do_call::h3da0561d9ab99c25
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/panicking.rs:587:40
[INFO] [stdout]   50:     0x58ec9cd3fd33 - std::panicking::try::h41c9fa508bc61df6
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/panicking.rs:550:19
[INFO] [stdout]   51:     0x58ec9cd3fd33 - std::panic::catch_unwind::h6b3ff07bb5afad93
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/panic.rs:358:14
[INFO] [stdout]   52:     0x58ec9cd3fd33 - test::run_test_in_process::hc7253dd11b39b9f4
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/test/src/lib.rs:655:27
[INFO] [stdout]   53:     0x58ec9cd3fd33 - test::run_test::{{closure}}::hfb2007f8649c30bb
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/test/src/lib.rs:576:43
[INFO] [stdout]   54:     0x58ec9cd02e15 - test::run_test::{{closure}}::h56a17aa7a282a9f4
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/test/src/lib.rs:606:41
[INFO] [stdout]   55:     0x58ec9cd02e15 - std::sys::backtrace::__rust_begin_short_backtrace::hd2d2d2fb8e8c6aac
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/sys/backtrace.rs:152:18
[INFO] [stdout]   56:     0x58ec9cd066fa - std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}}::h4faa3f9db6133423
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/thread/mod.rs:559:17
[INFO] [stdout]   57:     0x58ec9cd066fa - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::hf2e855a36a4ea846
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/core/src/panic/unwind_safe.rs:272:9
[INFO] [stdout]   58:     0x58ec9cd066fa - std::panicking::try::do_call::h2f73af3616c35465
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/panicking.rs:587:40
[INFO] [stdout]   59:     0x58ec9cd066fa - std::panicking::try::hd1660ce9efadef5a
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/panicking.rs:550:19
[INFO] [stdout]   60:     0x58ec9cd066fa - std::panic::catch_unwind::h5ee8d7823b8ca744
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/panic.rs:358:14
[INFO] [stdout]   61:     0x58ec9cd066fa - std::thread::Builder::spawn_unchecked_::{{closure}}::h53c3a1894dce8407
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/thread/mod.rs:557:30
[INFO] [stdout]   62:     0x58ec9cd066fa - core::ops::function::FnOnce::call_once{{vtable.shim}}::h048ce291ad4f62bf
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   63:     0x58ec9d4c387b - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::ha52bedf99a3b4981
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/alloc/src/boxed.rs:2013:9
[INFO] [stdout]   64:     0x58ec9d4c387b - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h567748934d80ccf8
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/alloc/src/boxed.rs:2013:9
[INFO] [stdout]   65:     0x58ec9d4c387b - std::sys::pal::unix::thread::Thread::new::thread_start::h2d970728ae887adc
[INFO] [stdout]                                at /rustc/6067b36314ab5eb2eb47cecc464545ba58e1ad24/library/std/src/sys/pal/unix/thread.rs:106:17
[INFO] [stdout]   66:     0x7bdc6b051ac3 - <unknown>
[INFO] [stdout]   67:     0x7bdc6b0e2a04 - clone
[INFO] [stdout]   68:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout]     many_devices
[INFO] [stdout]     normal_operation
[INFO] [stdout] 
[INFO] [stdout] test result: FAILED. 4 passed; 2 failed; 0 ignored; 0 measured; 0 filtered out; finished in 7.52s
[INFO] [stdout] 
[INFO] [stderr] error: test failed, to rerun pass `--test pusher`
[INFO] running `Command { std: "docker" "inspect" "0faef54861417cf1e6b937cdafccc1b7d85d4ee574dd57192c7b2af655cd00b1", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "0faef54861417cf1e6b937cdafccc1b7d85d4ee574dd57192c7b2af655cd00b1", kill_on_drop: false }`
[INFO] [stdout] 0faef54861417cf1e6b937cdafccc1b7d85d4ee574dd57192c7b2af655cd00b1
