[INFO] cloning repository https://github.com/famedly/hedwig [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/famedly/hedwig" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffamedly%2Fhedwig", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffamedly%2Fhedwig'... [INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }` [INFO] [stdout] 23fc774cf509c0c244222e11a5e85c28dd257b1c [INFO] testing famedly/hedwig against try#bd7d74411512a3dd3b35d2f699c51dd2557c7e7e+cargoflags=-Zbuild-dir-new-layout for pr-149852-1 [INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffamedly%2Fhedwig" "/workspace/builds/worker-0-tc2/source", kill_on_drop: false }` [INFO] [stderr] Cloning into '/workspace/builds/worker-0-tc2/source'... [INFO] [stderr] done. [INFO] started tweaking git repo https://github.com/famedly/hedwig [INFO] finished tweaking git repo https://github.com/famedly/hedwig [INFO] tweaked toml for git repo https://github.com/famedly/hedwig written to /workspace/builds/worker-0-tc2/source/Cargo.toml [INFO] validating manifest of git repo https://github.com/famedly/hedwig on toolchain bd7d74411512a3dd3b35d2f699c51dd2557c7e7e [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+bd7d74411512a3dd3b35d2f699c51dd2557c7e7e" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }` [INFO] crate git repo https://github.com/famedly/hedwig already has a lockfile, it will not be regenerated [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+bd7d74411512a3dd3b35d2f699c51dd2557c7e7e" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:aa71247004a7fa38d13ec170f48f06cdedf5bc50b2a8645e56ed7e992e6fa513" "/opt/rustwide/cargo-home/bin/cargo" "+bd7d74411512a3dd3b35d2f699c51dd2557c7e7e" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }` [INFO] [stdout] 78ac73aebdb90eadbc07c353dbe7b893bf5ec21013b73213008115a633e15fb4 [INFO] running `Command { std: "docker" "start" "-a" "78ac73aebdb90eadbc07c353dbe7b893bf5ec21013b73213008115a633e15fb4", kill_on_drop: false }` [INFO] running `Command { std: "docker" "inspect" "78ac73aebdb90eadbc07c353dbe7b893bf5ec21013b73213008115a633e15fb4", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "78ac73aebdb90eadbc07c353dbe7b893bf5ec21013b73213008115a633e15fb4", kill_on_drop: false }` [INFO] [stdout] 78ac73aebdb90eadbc07c353dbe7b893bf5ec21013b73213008115a633e15fb4 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:aa71247004a7fa38d13ec170f48f06cdedf5bc50b2a8645e56ed7e992e6fa513" "/opt/rustwide/cargo-home/bin/cargo" "+bd7d74411512a3dd3b35d2f699c51dd2557c7e7e" "build" "--frozen" "--message-format=json" "-Zbuild-dir-new-layout", kill_on_drop: false }` [INFO] [stdout] 6ace0e9c6aec899e7347a378c91408d35b625cac82e5f5023b8fc8e9abbd50e9 [INFO] running `Command { std: "docker" "start" "-a" "6ace0e9c6aec899e7347a378c91408d35b625cac82e5f5023b8fc8e9abbd50e9", kill_on_drop: false }` [INFO] [stderr] Compiling proc-macro2 v1.0.103 [INFO] [stderr] Compiling unicode-ident v1.0.20 [INFO] [stderr] Compiling serde_core v1.0.228 [INFO] [stderr] Compiling tracing-core v0.1.36 [INFO] [stderr] Compiling mio v1.1.0 [INFO] [stderr] Compiling parking_lot_core v0.9.12 [INFO] [stderr] Compiling zmij v1.0.12 [INFO] [stderr] Compiling cc v1.2.43 [INFO] [stderr] Compiling serde_json v1.0.149 [INFO] [stderr] Compiling indexmap v2.12.0 [INFO] [stderr] Compiling parking_lot v0.12.5 [INFO] [stderr] Compiling getrandom v0.2.16 [INFO] [stderr] Compiling stable_deref_trait v1.2.1 [INFO] [stderr] Compiling quote v1.0.41 [INFO] [stderr] Compiling writeable v0.6.2 [INFO] [stderr] Compiling getrandom v0.3.4 [INFO] [stderr] Compiling litemap v0.8.1 [INFO] [stderr] Compiling icu_normalizer_data v2.1.1 [INFO] [stderr] Compiling syn v2.0.108 [INFO] [stderr] Compiling icu_properties_data v2.1.1 [INFO] [stderr] Compiling rustls-pki-types v1.13.0 [INFO] [stderr] Compiling anyhow v1.0.100 [INFO] [stderr] Compiling rand_core v0.9.3 [INFO] [stderr] Compiling regex-syntax v0.8.8 [INFO] [stderr] Compiling ring v0.17.14 [INFO] [stderr] Compiling rand_chacha v0.9.0 [INFO] [stderr] Compiling rand v0.9.2 [INFO] [stderr] Compiling sharded-slab v0.1.7 [INFO] [stderr] Compiling tracing-log v0.2.0 [INFO] [stderr] Compiling thread_local v1.1.9 [INFO] [stderr] Compiling nu-ansi-term v0.50.3 [INFO] [stderr] Compiling regex-automata v0.4.13 [INFO] [stderr] Compiling powerfmt v0.2.0 [INFO] [stderr] Compiling tiny-keccak v2.0.2 [INFO] [stderr] Compiling camino v1.2.1 [INFO] [stderr] Compiling num-conv v0.1.0 [INFO] [stderr] Compiling bitflags v2.10.0 [INFO] [stderr] Compiling time-core v0.1.6 [INFO] [stderr] Compiling itertools v0.14.0 [INFO] [stderr] Compiling vergen-lib v0.1.6 [INFO] [stderr] Compiling http v0.2.12 [INFO] [stderr] Compiling aho-corasick v1.1.4 [INFO] [stderr] Compiling semver v1.0.27 [INFO] [stderr] Compiling matchers v0.2.0 [INFO] [stderr] Compiling typeid v1.0.3 [INFO] [stderr] Compiling ucd-trie v0.1.7 [INFO] [stderr] Compiling once_cell v1.21.3 [INFO] [stderr] Compiling rustls v0.21.12 [INFO] [stderr] Compiling const-random-macro v0.1.16 [INFO] [stderr] Compiling pest v2.8.3 [INFO] [stderr] Compiling openssl-sys v0.9.110 [INFO] [stderr] Compiling deranged v0.5.5 [INFO] [stderr] Compiling synstructure v0.13.2 [INFO] [stderr] Compiling darling_core v0.20.11 [INFO] [stderr] Compiling rustls-webpki v0.101.7 [INFO] [stderr] Compiling sct v0.7.1 [INFO] [stderr] Compiling vergen v9.0.6 [INFO] [stderr] Compiling rustls v0.22.4 [INFO] [stderr] Compiling rustls v0.23.34 [INFO] [stderr] Compiling ref-cast v1.0.25 [INFO] [stderr] Compiling num_threads v0.1.7 [INFO] [stderr] Compiling time v0.3.44 [INFO] [stderr] Compiling pest_meta v2.8.3 [INFO] [stderr] Compiling serde_derive_internals v0.29.1 [INFO] [stderr] Compiling rustls-webpki v0.102.8 [INFO] [stderr] Compiling tracing-attributes v0.1.31 [INFO] [stderr] Compiling serde_derive v1.0.228 [INFO] [stderr] Compiling tokio-macros v2.6.0 [INFO] [stderr] Compiling futures-macro v0.3.31 [INFO] [stderr] Compiling tracing v0.1.44 [INFO] [stderr] Compiling thiserror-impl v2.0.17 [INFO] [stderr] Compiling tokio v1.49.0 [INFO] [stderr] Compiling zerofrom-derive v0.1.6 [INFO] [stderr] Compiling yoke-derive v0.8.1 [INFO] [stderr] Compiling futures-util v0.3.31 [INFO] [stderr] Compiling zerovec-derive v0.11.2 [INFO] [stderr] Compiling displaydoc v0.2.5 [INFO] [stderr] Compiling thiserror v2.0.17 [INFO] [stderr] Compiling zerofrom v0.1.6 [INFO] [stderr] Compiling opentelemetry v0.30.0 [INFO] [stderr] Compiling yoke v0.8.1 [INFO] [stderr] Compiling darling_macro v0.20.11 [INFO] [stderr] Compiling zerotrie v0.2.3 [INFO] [stderr] Compiling darling v0.20.11 [INFO] [stderr] Compiling thiserror-impl v1.0.69 [INFO] [stderr] Compiling zerovec v0.11.5 [INFO] [stderr] Compiling derive_builder_core v0.20.2 [INFO] [stderr] Compiling serde v1.0.228 [INFO] [stderr] Compiling tinystr v0.8.2 [INFO] [stderr] Compiling icu_locale_core v2.1.1 [INFO] [stderr] Compiling potential_utf v0.1.4 [INFO] [stderr] Compiling tracing-serde v0.2.0 [INFO] [stderr] Compiling serde_urlencoded v0.7.1 [INFO] [stderr] Compiling thiserror v1.0.69 [INFO] [stderr] Compiling pin-project-internal v1.1.10 [INFO] [stderr] Compiling icu_collections v2.1.1 [INFO] [stderr] Compiling tracing-subscriber v0.3.22 [INFO] [stderr] Compiling async-trait v0.1.89 [INFO] [stderr] Compiling derive_builder_macro v0.20.2 [INFO] [stderr] Compiling icu_provider v2.1.1 [INFO] [stderr] Compiling icu_normalizer v2.1.1 [INFO] [stderr] Compiling icu_properties v2.1.1 [INFO] [stderr] Compiling futures-executor v0.3.31 [INFO] [stderr] Compiling cargo-platform v0.1.9 [INFO] [stderr] Compiling derive_builder v0.20.2 [INFO] [stderr] Compiling pin-project v1.1.10 [INFO] [stderr] Compiling opentelemetry v0.31.0 [INFO] [stderr] Compiling prost-derive v0.13.5 [INFO] [stderr] Compiling cargo_metadata v0.19.2 [INFO] [stderr] Compiling axum-core v0.5.5 [INFO] [stderr] Compiling regex v1.12.2 [INFO] [stderr] Compiling tokio-util v0.7.16 [INFO] [stderr] Compiling tokio-stream v0.1.17 [INFO] [stderr] Compiling idna_adapter v1.2.1 [INFO] [stderr] Compiling h2 v0.4.12 [INFO] [stderr] Compiling idna v1.1.0 [INFO] [stderr] Compiling tower v0.5.2 [INFO] [stderr] Compiling opentelemetry_sdk v0.30.0 [INFO] [stderr] Compiling prost v0.13.5 [INFO] [stderr] Compiling url v2.5.7 [INFO] [stderr] Compiling h2 v0.3.27 [INFO] [stderr] Compiling opentelemetry_sdk v0.31.0 [INFO] [stderr] Compiling axum-macros v0.5.0 [INFO] [stderr] Compiling tower-http v0.6.8 [INFO] [stderr] Compiling ref-cast-impl v1.0.25 [INFO] [stderr] Compiling rustls-webpki v0.103.8 [INFO] [stderr] Compiling const-random v0.1.18 [INFO] [stderr] Compiling rustc_version v0.4.1 [INFO] [stderr] Compiling http-body v0.4.6 [INFO] [stderr] Compiling serde_path_to_error v0.1.20 [INFO] [stderr] Compiling vergen-gitcl v1.0.8 [INFO] [stderr] Compiling sysinfo v0.34.2 [INFO] [stderr] Compiling encoding_rs v0.8.35 [INFO] [stderr] Compiling erased-serde v0.4.8 [INFO] [stderr] Compiling protobuf v3.7.2 [INFO] [stderr] Compiling foldhash v0.1.5 [INFO] [stderr] Compiling object v0.37.3 [INFO] [stderr] Compiling owo-colors v4.2.3 [INFO] [stderr] Compiling matchit v0.8.4 [INFO] [stderr] Compiling hashbrown v0.15.5 [INFO] [stderr] Compiling hyper v1.7.0 [INFO] [stderr] Compiling dlv-list v0.5.2 [INFO] [stderr] Compiling tokio-rustls v0.24.1 [INFO] [stderr] Compiling hyper v0.14.32 [INFO] [stderr] Compiling protobuf-support v3.7.2 [INFO] [stderr] Compiling hyper-util v0.1.17 [INFO] [stderr] Compiling schemars_derive v1.0.4 [INFO] [stderr] Compiling pest_generator v2.8.3 [INFO] [stderr] Compiling webpki-roots v1.0.4 [INFO] [stderr] Compiling color-spantrace v0.3.0 [INFO] [stderr] Compiling hyper-timeout v0.5.2 [INFO] [stderr] Compiling axum v0.8.8 [INFO] [stderr] Compiling tonic v0.13.1 [INFO] [stderr] Compiling reqwest v0.12.24 [INFO] [stderr] Compiling hashbrown v0.14.5 [INFO] [stderr] Compiling eyre v0.6.12 [INFO] [stderr] Compiling gimli v0.32.3 [INFO] [stderr] Compiling openssl v0.10.74 [INFO] [stderr] Compiling prometheus v0.14.0 [INFO] [stderr] Compiling opentelemetry-resource-detectors v0.9.0 [INFO] [stderr] Compiling dyn-clone v1.0.20 [INFO] [stderr] Compiling toml_parser v1.0.4 [INFO] [stderr] Compiling tokio-rustls v0.25.0 [INFO] [stderr] Compiling opentelemetry-http v0.30.0 [INFO] [stderr] Compiling opentelemetry-proto v0.30.0 [INFO] [stderr] Compiling schemars v1.0.4 [INFO] [stderr] Compiling addr2line v0.25.1 [INFO] [stderr] Compiling miniz_oxide v0.8.9 [INFO] [stderr] Compiling ordered-multimap v0.7.3 [INFO] [stderr] Compiling hyper-rustls v0.24.2 [INFO] [stderr] Compiling rustls-native-certs v0.8.2 [INFO] [stderr] Compiling tokio-rustls v0.26.4 [INFO] [stderr] Compiling webpki-roots v0.26.11 [INFO] [stderr] Compiling pest_derive v2.8.3 [INFO] [stderr] Compiling hashlink v0.10.0 [INFO] [stderr] Compiling tracing-opentelemetry v0.32.0 [INFO] [stderr] Compiling rustls-pemfile v1.0.4 [INFO] [stderr] Compiling tracing-error v0.2.1 [INFO] [stderr] Compiling openssl-macros v0.1.1 [INFO] [stderr] Compiling toml_datetime v0.7.3 [INFO] [stderr] Compiling serde_spanned v1.0.3 [INFO] [stderr] Compiling arraydeque v0.5.1 [INFO] [stderr] Compiling opentelemetry-semantic-conventions v0.31.0 [INFO] [stderr] Compiling webpki-roots v0.25.4 [INFO] [stderr] Compiling indenter v0.3.4 [INFO] [stderr] Compiling opentelemetry-semantic-conventions v0.30.0 [INFO] [stderr] Compiling rustc-demangle v0.1.26 [INFO] [stderr] Compiling convert_case v0.6.0 [INFO] [stderr] Compiling tracing-opentelemetry-instrumentation-sdk v0.32.1 [INFO] [stderr] Compiling yaml-rust2 v0.10.4 [INFO] [stderr] Compiling reqwest v0.11.27 [INFO] [stderr] Compiling chrono v0.4.42 [INFO] [stderr] Compiling toml v0.9.8 [INFO] [stderr] Compiling serde-untagged v0.1.9 [INFO] [stderr] Compiling matrix-hedwig v2.2.0 (/opt/rustwide/workdir) [INFO] [stderr] Compiling hyper-rustls v0.27.7 [INFO] [stderr] Compiling json5 v0.4.1 [INFO] [stderr] Compiling hyper-rustls v0.26.0 [INFO] [stderr] Compiling rust-ini v0.21.3 [INFO] [stderr] Compiling backtrace v0.3.76 [INFO] [stderr] Compiling tower-otel-http-metrics v0.16.0 [INFO] [stderr] Compiling opentelemetry-otlp v0.30.0 [INFO] [stderr] Compiling famedly_rust_utils v1.0.2 [INFO] [stderr] Compiling tracing-opentelemetry v0.31.0 [INFO] [stderr] Compiling ron v0.12.0 [INFO] [stderr] Compiling opentelemetry-appender-tracing v0.30.1 [INFO] [stderr] Compiling tracing-futures v0.2.5 [INFO] [stderr] Compiling erased-serde v0.3.31 [INFO] [stderr] Compiling firebae-derive v0.1.0 [INFO] [stderr] Compiling rustls-pemfile v2.2.0 [INFO] [stderr] Compiling pathdiff v0.2.3 [INFO] [stderr] Compiling firebae-cm v0.4.2 (https://github.com/famedly/firebae-cm.git?branch=thomast%2Fdeserializable-enums#25287f69) [INFO] [stderr] Compiling gcp_auth v0.12.6 [INFO] [stderr] Compiling a2 v0.10.0 (https://github.com/famedly/a2.git?branch=thomast%2Fowned-struct-params#44625845) [INFO] [stderr] Compiling rust-telemetry v1.2.0 [INFO] [stderr] Compiling config v0.15.19 [INFO] [stderr] Compiling color-eyre v0.6.5 [INFO] [stderr] Compiling opentelemetry-prometheus v0.31.0 [INFO] [stderr] Compiling axum-tracing-opentelemetry v0.32.2 [INFO] [stderr] Compiling futures v0.3.31 [INFO] [stderr] Finished `dev` profile [unoptimized + debuginfo] target(s) in 5m 09s [INFO] running `Command { std: "docker" "inspect" "6ace0e9c6aec899e7347a378c91408d35b625cac82e5f5023b8fc8e9abbd50e9", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "6ace0e9c6aec899e7347a378c91408d35b625cac82e5f5023b8fc8e9abbd50e9", kill_on_drop: false }` [INFO] [stdout] 6ace0e9c6aec899e7347a378c91408d35b625cac82e5f5023b8fc8e9abbd50e9 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:aa71247004a7fa38d13ec170f48f06cdedf5bc50b2a8645e56ed7e992e6fa513" "/opt/rustwide/cargo-home/bin/cargo" "+bd7d74411512a3dd3b35d2f699c51dd2557c7e7e" "test" "--frozen" "--no-run" "--message-format=json" "-Zbuild-dir-new-layout", kill_on_drop: false }` [INFO] [stdout] 402e2c4906f391167ff67d835f3e57da2ddbc3bda21f527bb634fa1446610802 [INFO] running `Command { std: "docker" "start" "-a" "402e2c4906f391167ff67d835f3e57da2ddbc3bda21f527bb634fa1446610802", kill_on_drop: false }` [INFO] [stderr] Compiling aho-corasick v1.1.4 [INFO] [stderr] Compiling regex-syntax v0.8.8 [INFO] [stderr] Compiling hyper v0.14.32 [INFO] [stderr] Compiling regex-automata v0.4.13 [INFO] [stderr] Compiling hyper-rustls v0.24.2 [INFO] [stderr] Compiling reqwest v0.11.27 [INFO] [stderr] Compiling regex v1.12.2 [INFO] [stderr] Compiling firebae-cm v0.4.2 (https://github.com/famedly/firebae-cm.git?branch=thomast%2Fdeserializable-enums#25287f69) [INFO] [stderr] Compiling vergen v9.0.6 [INFO] [stderr] Compiling vergen-gitcl v1.0.8 [INFO] [stderr] Compiling matrix-hedwig v2.2.0 (/opt/rustwide/workdir) [INFO] [stderr] Compiling matchers v0.2.0 [INFO] [stderr] Compiling tracing-subscriber v0.3.22 [INFO] [stderr] Compiling tracing-opentelemetry v0.32.0 [INFO] [stderr] Compiling tracing-error v0.2.1 [INFO] [stderr] Compiling opentelemetry-appender-tracing v0.30.1 [INFO] [stderr] Compiling tracing-opentelemetry v0.31.0 [INFO] [stderr] Compiling color-spantrace v0.3.0 [INFO] [stderr] Compiling color-eyre v0.6.5 [INFO] [stderr] Compiling rust-telemetry v1.2.0 [INFO] [stderr] Compiling tracing-opentelemetry-instrumentation-sdk v0.32.1 [INFO] [stderr] Compiling axum-tracing-opentelemetry v0.32.2 [INFO] [stderr] Finished `test` profile [unoptimized + debuginfo] target(s) in 1m 23s [INFO] running `Command { std: "docker" "inspect" "402e2c4906f391167ff67d835f3e57da2ddbc3bda21f527bb634fa1446610802", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "402e2c4906f391167ff67d835f3e57da2ddbc3bda21f527bb634fa1446610802", kill_on_drop: false }` [INFO] [stdout] 402e2c4906f391167ff67d835f3e57da2ddbc3bda21f527bb634fa1446610802 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:aa71247004a7fa38d13ec170f48f06cdedf5bc50b2a8645e56ed7e992e6fa513" "/opt/rustwide/cargo-home/bin/cargo" "+bd7d74411512a3dd3b35d2f699c51dd2557c7e7e" "test" "--frozen" "-Zbuild-dir-new-layout", kill_on_drop: false }` [INFO] [stdout] 95314eff7c9b954877cce1f3dabcb8c57b36e7b38ae7b9fc960b0dbdeaac42de [INFO] running `Command { std: "docker" "start" "-a" "95314eff7c9b954877cce1f3dabcb8c57b36e7b38ae7b9fc960b0dbdeaac42de", kill_on_drop: false }` [INFO] [stderr] Finished `test` profile [unoptimized + debuginfo] target(s) in 0.65s [INFO] [stderr] Running unittests src/lib.rs (/opt/rustwide/target/debug/build/matrix-hedwig/1a3f399094c8df03/deps/matrix_hedwig-1a3f399094c8df03) [INFO] [stdout] [INFO] [stdout] running 0 tests [INFO] [stdout] [INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s [INFO] [stdout] [INFO] [stderr] Running unittests src/main.rs (/opt/rustwide/target/debug/build/matrix-hedwig/d299a8404531d216/deps/matrix_hedwig-d299a8404531d216) [INFO] [stdout] [INFO] [stdout] running 0 tests [INFO] [stderr] Running tests/api.rs (/opt/rustwide/target/debug/build/matrix-hedwig/1757cc8f227c3138/deps/api-1757cc8f227c3138) [INFO] [stdout] [INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] running 1 test [INFO] [stdout] test server_starts_successfully ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 1.01s [INFO] [stdout] [INFO] [stderr] Running tests/apns.rs (/opt/rustwide/target/debug/build/matrix-hedwig/5b39a5a706c19b0c/deps/apns-5b39a5a706c19b0c) [INFO] [stdout] [INFO] [stdout] running 3 tests [INFO] [stdout] test apns_sender_missing_key ... ok [INFO] [stdout] test apns_sender_create_production ... ok [INFO] [stdout] test apns_sender_create_sandbox ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 3 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.02s [INFO] [stdout] [INFO] [stderr] Running tests/fcm.rs (/opt/rustwide/target/debug/build/matrix-hedwig/39d6fb7893862fef/deps/fcm-39d6fb7893862fef) [INFO] [stdout] [INFO] [stdout] running 2 tests [INFO] [stdout] test fcm_error ... ok [INFO] [stdout] test fcm_sender_create ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.19s [INFO] [stdout] [INFO] [stderr] Running tests/pusher.rs (/opt/rustwide/target/debug/build/matrix-hedwig/4c142412b5ebde36/deps/pusher-4c142412b5ebde36) [INFO] [stdout] [INFO] [stdout] running 9 tests [INFO] [stdout] test bad_json ... ok [INFO] [stdout] test push_body_limit ... ok [INFO] [stdout] test many_requests ... ok [INFO] [stdout] test panic_handler ... ok [INFO] [stdout] test normal_operation ... FAILED [INFO] [stdout] test direct_apns_failure ... ok [INFO] [stdout] test apns_through_fcm_failure ... ok [INFO] [stdout] test fcm_failure ... ok [INFO] [stdout] test many_devices ... FAILED [INFO] [stdout] [INFO] [stdout] failures: [INFO] [stdout] [INFO] [stdout] ---- normal_operation stdout ---- [INFO] [stdout] [INFO] [stdout] thread 'normal_operation' (34) panicked at tests/pusher.rs:301:5: [INFO] [stdout] assertion `left == right` failed [INFO] [stdout] left: "" [INFO] [stdout] right: "# TYPE devices_total counter\ndevices_total{otel_scope_name=\"Hedwig\"} 10\n# HELP http_requests_duration_seconds HTTP request duration in seconds\n# TYPE http_requests_duration_seconds histogram\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"0\"} 0\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"5\"} 10\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"10\"} 10\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"25\"} 10\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"50\"} 10\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"75\"} 10\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"100\"} 10\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"250\"} 10\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"500\"} 10\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"750\"} 10\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"1000\"} 10\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"2500\"} 10\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"5000\"} 10\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"7500\"} 10\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"10000\"} 10\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"+Inf\"} 10\nhttp_requests_duration_seconds_sum{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\"} FLOAT\nhttp_requests_duration_seconds_count{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\"} 10\n# HELP http_requests_total Total number of HTTP requests\n# TYPE http_requests_total counter\nhttp_requests_total{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\"} 10\n# TYPE notifications_total counter\nnotifications_total{otel_scope_name=\"Hedwig\"} 10\n# HELP pushes_successful_total Successful pushes\n# TYPE pushes_successful_total counter\npushes_successful_total{device_type=\"Android\",otel_scope_name=\"Hedwig\"} 2\npushes_successful_total{device_type=\"AndroidLegacy\",otel_scope_name=\"Hedwig\"} 2\npushes_successful_total{device_type=\"Ios\",otel_scope_name=\"Hedwig\"} 4\npushes_successful_total{device_type=\"None\",otel_scope_name=\"Hedwig\"} 2\n# HELP target_info Target metadata\n# TYPE target_info gauge\ntarget_info{service_name=\"Hedwig\",telemetry_sdk_language=\"rust\",telemetry_sdk_name=\"opentelemetry\",telemetry_sdk_version=\"any\"} 1" [INFO] [stdout] stack backtrace: [INFO] [stdout] 0: 0x5da7a73535c2 - std[840933623431fd06]::backtrace_rs::backtrace::libunwind::trace [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9 [INFO] [stdout] 1: 0x5da7a73535c2 - std[840933623431fd06]::backtrace_rs::backtrace::trace_unsynchronized:: [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14 [INFO] [stdout] 2: 0x5da7a73535c2 - std[840933623431fd06]::sys::backtrace::_print_fmt [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/sys/backtrace.rs:74:9 [INFO] [stdout] 3: 0x5da7a73535c2 - <::print::DisplayBacktrace as core[8f93d80df273fe75]::fmt::Display>::fmt [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/sys/backtrace.rs:44:26 [INFO] [stdout] 4: 0x5da7a736b8ba - ::fmt [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/core/src/fmt/rt.rs:152:76 [INFO] [stdout] 5: 0x5da7a736b8ba - core[8f93d80df273fe75]::fmt::write [INFO] [stdout] 6: 0x5da7a7358626 - std[840933623431fd06]::io::default_write_fmt::> [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/io/mod.rs:639:11 [INFO] [stdout] 7: 0x5da7a7358626 - as std[840933623431fd06]::io::Write>::write_fmt [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/io/mod.rs:1994:13 [INFO] [stdout] 8: 0x5da7a73311af - ::print [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/sys/backtrace.rs:47:9 [INFO] [stdout] 9: 0x5da7a73311af - std[840933623431fd06]::panicking::default_hook::{closure#0} [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/panicking.rs:292:27 [INFO] [stdout] 10: 0x5da7a734b239 - std[840933623431fd06]::panicking::default_hook [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/panicking.rs:316:9 [INFO] [stdout] 11: 0x5da7a6bd64ee - core[8f93d80df273fe75]::ops::function::Fn<(&'a std[840933623431fd06]::panic::PanicHookInfo<'b>,), Output = ()> + core[8f93d80df273fe75]::marker::Sync + core[8f93d80df273fe75]::marker::Send> as core[8f93d80df273fe75]::ops::function::Fn<(&std[840933623431fd06]::panic::PanicHookInfo,)>>::call [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/alloc/src/boxed.rs:2220:9 [INFO] [stdout] 12: 0x5da7a6bd64ee - test[2f1252070343a163]::test_main_with_exit_callback::::{closure#0} [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/test/src/lib.rs:145:21 [INFO] [stdout] 13: 0x5da7a734b4a2 - core[8f93d80df273fe75]::ops::function::Fn<(&'a std[840933623431fd06]::panic::PanicHookInfo<'b>,), Output = ()> + core[8f93d80df273fe75]::marker::Sync + core[8f93d80df273fe75]::marker::Send> as core[8f93d80df273fe75]::ops::function::Fn<(&std[840933623431fd06]::panic::PanicHookInfo,)>>::call [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/alloc/src/boxed.rs:2220:9 [INFO] [stdout] 14: 0x5da7a734b4a2 - std[840933623431fd06]::panicking::panic_with_hook [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/panicking.rs:833:13 [INFO] [stdout] 15: 0x5da7a7331268 - std[840933623431fd06]::panicking::panic_handler::{closure#0} [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/panicking.rs:698:13 [INFO] [stdout] 16: 0x5da7a7328b09 - std[840933623431fd06]::sys::backtrace::__rust_end_short_backtrace:: [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/sys/backtrace.rs:182:18 [INFO] [stdout] 17: 0x5da7a73320bd - __rustc[5b4a0c6d8cc4a177]::rust_begin_unwind [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/panicking.rs:689:5 [INFO] [stdout] 18: 0x5da7a736c0ac - core[8f93d80df273fe75]::panicking::panic_fmt [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/core/src/panicking.rs:80:14 [INFO] [stdout] 19: 0x5da7a736bf33 - core[8f93d80df273fe75]::panicking::assert_failed_inner [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/core/src/panicking.rs:439:17 [INFO] [stdout] 20: 0x5da7a6d0a3e2 - core[8f93d80df273fe75]::panicking::assert_failed::<&str, &str> [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/core/src/panicking.rs:394:5 [INFO] [stdout] 21: 0x5da7a6b89b6e - pusher[a9952f5db69afd14]::check_prom::{closure#0} [INFO] [stdout] at /opt/rustwide/workdir/tests/pusher.rs:301:2 [INFO] [stdout] 22: 0x5da7a6b93841 - pusher[a9952f5db69afd14]::normal_operation::{closure#0} [INFO] [stdout] at /opt/rustwide/workdir/tests/pusher.rs:496:68 [INFO] [stdout] 23: 0x5da7a6bc9cff - >>> as core[8f93d80df273fe75]::future::future::Future>::poll [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/core/src/future/future.rs:133:9 [INFO] [stdout] 24: 0x5da7a6bc9dbb - >>>> as core[8f93d80df273fe75]::future::future::Future>::poll [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/core/src/future/future.rs:133:9 [INFO] [stdout] 25: 0x5da7a6ba7e9b - ::block_on::>>>>>::{closure#0}::{closure#0}::{closure#0} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:753:70 [INFO] [stdout] 26: 0x5da7a6ba7d5b - tokio[22607737001b8a38]::task::coop::with_budget::>>, ::block_on>>>>>::{closure#0}::{closure#0}::{closure#0}> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/task/coop/mod.rs:167:5 [INFO] [stdout] 27: 0x5da7a6ba7d5b - tokio[22607737001b8a38]::task::coop::budget::>>, ::block_on>>>>>::{closure#0}::{closure#0}::{closure#0}> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/task/coop/mod.rs:133:5 [INFO] [stdout] 28: 0x5da7a6ba7d5b - ::block_on::>>>>>::{closure#0}::{closure#0} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:753:25 [INFO] [stdout] 29: 0x5da7a6ba2a1d - ::enter::>>, ::block_on>>>>>::{closure#0}::{closure#0}> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:442:19 [INFO] [stdout] 30: 0x5da7a6ba6f1d - ::block_on::>>>>>::{closure#0} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:752:44 [INFO] [stdout] 31: 0x5da7a6ba615b - ::enter::<::block_on>>>>>::{closure#0}, core[8f93d80df273fe75]::option::Option>>>::{closure#0} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:840:68 [INFO] [stdout] 32: 0x5da7a6ba216a - >::set::<::enter<::block_on>>>>>::{closure#0}, core[8f93d80df273fe75]::option::Option>>>::{closure#0}, (alloc[40b2bae28975ac47]::boxed::Box, core[8f93d80df273fe75]::option::Option>>)> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/context/scoped.rs:40:9 [INFO] [stdout] 33: 0x5da7a6bb1aaa - tokio[22607737001b8a38]::runtime::context::set_scheduler::<(alloc[40b2bae28975ac47]::boxed::Box, core[8f93d80df273fe75]::option::Option>>), ::enter<::block_on>>>>>::{closure#0}, core[8f93d80df273fe75]::option::Option>>>::{closure#0}>::{closure#0} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/context.rs:176:38 [INFO] [stdout] 34: 0x5da7a6bafa65 - >::try_with::, core[8f93d80df273fe75]::option::Option>>), ::enter<::block_on>>>>>::{closure#0}, core[8f93d80df273fe75]::option::Option>>>::{closure#0}>::{closure#0}, (alloc[40b2bae28975ac47]::boxed::Box, core[8f93d80df273fe75]::option::Option>>)> [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/thread/local.rs:513:12 [INFO] [stdout] 35: 0x5da7a6baf59d - >::with::, core[8f93d80df273fe75]::option::Option>>), ::enter<::block_on>>>>>::{closure#0}, core[8f93d80df273fe75]::option::Option>>>::{closure#0}>::{closure#0}, (alloc[40b2bae28975ac47]::boxed::Box, core[8f93d80df273fe75]::option::Option>>)> [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/thread/local.rs:477:20 [INFO] [stdout] 36: 0x5da7a6bb1341 - tokio[22607737001b8a38]::runtime::context::set_scheduler::<(alloc[40b2bae28975ac47]::boxed::Box, core[8f93d80df273fe75]::option::Option>>), ::enter<::block_on>>>>>::{closure#0}, core[8f93d80df273fe75]::option::Option>>>::{closure#0}> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/context.rs:176:17 [INFO] [stdout] 37: 0x5da7a6ba4bfe - ::enter::<::block_on>>>>>::{closure#0}, core[8f93d80df273fe75]::option::Option>>> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:840:27 [INFO] [stdout] 38: 0x5da7a6ba4f4e - ::block_on::>>>>> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:740:24 [INFO] [stdout] 39: 0x5da7a6ba5596 - ::block_on::>>>>::{closure#0} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:200:33 [INFO] [stdout] 40: 0x5da7a6bbfd1f - tokio[22607737001b8a38]::runtime::context::runtime::enter_runtime::<::block_on>>>>::{closure#0}, core[8f93d80df273fe75]::result::Result<(), alloc[40b2bae28975ac47]::boxed::Box>> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/context/runtime.rs:65:16 [INFO] [stdout] 41: 0x5da7a6ba2337 - ::block_on::>>>> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:188:9 [INFO] [stdout] 42: 0x5da7a6bb8e10 - ::block_on_inner::>>>> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/runtime.rs:368:52 [INFO] [stdout] 43: 0x5da7a6bb9034 - ::block_on::>>>> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/runtime.rs:342:18 [INFO] [stdout] 44: 0x5da7a6b9e497 - pusher[a9952f5db69afd14]::normal_operation [INFO] [stdout] at /opt/rustwide/workdir/tests/pusher.rs:498:4 [INFO] [stdout] 45: 0x5da7a6b8a857 - pusher[a9952f5db69afd14]::normal_operation::{closure#0} [INFO] [stdout] at /opt/rustwide/workdir/tests/pusher.rs:443:32 [INFO] [stdout] 46: 0x5da7a6ba1e76 - >::call_once [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/core/src/ops/function.rs:250:5 [INFO] [stdout] 47: 0x5da7a6bca89b - core[8f93d80df273fe75]::result::Result<(), alloc[40b2bae28975ac47]::string::String> as core[8f93d80df273fe75]::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/core/src/ops/function.rs:250:5 [INFO] [stdout] 48: 0x5da7a6bca89b - test[2f1252070343a163]::__rust_begin_short_backtrace::, fn() -> core[8f93d80df273fe75]::result::Result<(), alloc[40b2bae28975ac47]::string::String>> [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/test/src/lib.rs:663:18 [INFO] [stdout] 49: 0x5da7a6bd70fa - test[2f1252070343a163]::run_test_in_process::{closure#0} [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/test/src/lib.rs:686:74 [INFO] [stdout] 50: 0x5da7a6bd70fa - as core[8f93d80df273fe75]::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 51: 0x5da7a6bd70fa - std[840933623431fd06]::panicking::catch_unwind::do_call::, core[8f93d80df273fe75]::result::Result<(), alloc[40b2bae28975ac47]::string::String>> [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/panicking.rs:581:40 [INFO] [stdout] 52: 0x5da7a6bd70fa - std[840933623431fd06]::panicking::catch_unwind::, core[8f93d80df273fe75]::panic::unwind_safe::AssertUnwindSafe> [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/panicking.rs:544:19 [INFO] [stdout] 53: 0x5da7a6bd70fa - std[840933623431fd06]::panic::catch_unwind::, core[8f93d80df273fe75]::result::Result<(), alloc[40b2bae28975ac47]::string::String>> [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/panic.rs:359:14 [INFO] [stdout] 54: 0x5da7a6bd70fa - test[2f1252070343a163]::run_test_in_process [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/test/src/lib.rs:686:27 [INFO] [stdout] 55: 0x5da7a6bd70fa - test[2f1252070343a163]::run_test::{closure#0} [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/test/src/lib.rs:607:43 [INFO] [stdout] 56: 0x5da7a6bd15c4 - test[2f1252070343a163]::run_test::{closure#1} [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/test/src/lib.rs:637:41 [INFO] [stdout] 57: 0x5da7a6bd15c4 - std[840933623431fd06]::sys::backtrace::__rust_begin_short_backtrace:: [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/sys/backtrace.rs:166:18 [INFO] [stdout] 58: 0x5da7a6bd9bf2 - std[840933623431fd06]::thread::lifecycle::spawn_unchecked::::{closure#1}::{closure#0} [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/thread/lifecycle.rs:91:13 [INFO] [stdout] 59: 0x5da7a6bd9bf2 - ::{closure#1}::{closure#0}> as core[8f93d80df273fe75]::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 60: 0x5da7a6bd9bf2 - std[840933623431fd06]::panicking::catch_unwind::do_call::::{closure#1}::{closure#0}>, ()> [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/panicking.rs:581:40 [INFO] [stdout] 61: 0x5da7a6bd9bf2 - std[840933623431fd06]::panicking::catch_unwind::<(), core[8f93d80df273fe75]::panic::unwind_safe::AssertUnwindSafe::{closure#1}::{closure#0}>> [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/panicking.rs:544:19 [INFO] [stdout] 62: 0x5da7a6bd9bf2 - std[840933623431fd06]::panic::catch_unwind::::{closure#1}::{closure#0}>, ()> [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/panic.rs:359:14 [INFO] [stdout] 63: 0x5da7a6bd9bf2 - std[840933623431fd06]::thread::lifecycle::spawn_unchecked::::{closure#1} [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/thread/lifecycle.rs:89:26 [INFO] [stdout] 64: 0x5da7a6bd9bf2 - ::{closure#1} as core[8f93d80df273fe75]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0} [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/core/src/ops/function.rs:250:5 [INFO] [stdout] 65: 0x5da7a7352a8f - + core[8f93d80df273fe75]::marker::Send> as core[8f93d80df273fe75]::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/alloc/src/boxed.rs:2206:9 [INFO] [stdout] 66: 0x5da7a7352a8f - ::new::thread_start [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/sys/thread/unix.rs:119:17 [INFO] [stdout] 67: 0x7cab0aacaaa4 - [INFO] [stdout] 68: 0x7cab0ab57a64 - clone [INFO] [stdout] 69: 0x0 - [INFO] [stdout] [INFO] [stdout] ---- many_devices stdout ---- [INFO] [stdout] [INFO] [stdout] thread 'many_devices' (32) panicked at tests/pusher.rs:301:5: [INFO] [stdout] assertion `left == right` failed [INFO] [stdout] left: "" [INFO] [stdout] right: "# TYPE devices_total counter\ndevices_total{otel_scope_name=\"Hedwig\"} 12\n# HELP http_requests_duration_seconds HTTP request duration in seconds\n# TYPE http_requests_duration_seconds histogram\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"0\"} 0\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"5\"} 2\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"10\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"25\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"50\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"75\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"100\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"250\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"500\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"750\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"1000\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"2500\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"5000\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"7500\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"10000\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"+Inf\"} 3\nhttp_requests_duration_seconds_sum{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\"} FLOAT\nhttp_requests_duration_seconds_count{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\"} 3\n# HELP http_requests_total Total number of HTTP requests\n# TYPE http_requests_total counter\nhttp_requests_total{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\"} 3\n# TYPE notifications_total counter\nnotifications_total{otel_scope_name=\"Hedwig\"} 3\n# HELP pushes_failed_total Failed pushes\n# TYPE pushes_failed_total counter\npushes_failed_total{device_type=\"AndroidLegacy\",otel_scope_name=\"Hedwig\"} 1\npushes_failed_total{device_type=\"None\",otel_scope_name=\"Hedwig\"} 1\n# HELP pushes_successful_total Successful pushes\n# TYPE pushes_successful_total counter\npushes_successful_total{device_type=\"Android\",otel_scope_name=\"Hedwig\"} 3\npushes_successful_total{device_type=\"AndroidLegacy\",otel_scope_name=\"Hedwig\"} 2\npushes_successful_total{device_type=\"Ios\",otel_scope_name=\"Hedwig\"} 3\npushes_successful_total{device_type=\"None\",otel_scope_name=\"Hedwig\"} 2\n# HELP target_info Target metadata\n# TYPE target_info gauge\ntarget_info{service_name=\"Hedwig\",telemetry_sdk_language=\"rust\",telemetry_sdk_name=\"opentelemetry\",telemetry_sdk_version=\"any\"} 1" [INFO] [stdout] stack backtrace: [INFO] [stdout] 0: 0x5da7a73535c2 - std[840933623431fd06]::backtrace_rs::backtrace::libunwind::trace [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9 [INFO] [stdout] 1: 0x5da7a73535c2 - std[840933623431fd06]::backtrace_rs::backtrace::trace_unsynchronized:: [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14 [INFO] [stdout] 2: 0x5da7a73535c2 - std[840933623431fd06]::sys::backtrace::_print_fmt [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/sys/backtrace.rs:74:9 [INFO] [stdout] 3: 0x5da7a73535c2 - <::print::DisplayBacktrace as core[8f93d80df273fe75]::fmt::Display>::fmt [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/sys/backtrace.rs:44:26 [INFO] [stdout] 4: 0x5da7a736b8ba - ::fmt [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/core/src/fmt/rt.rs:152:76 [INFO] [stdout] 5: 0x5da7a736b8ba - core[8f93d80df273fe75]::fmt::write [INFO] [stdout] 6: 0x5da7a7358626 - std[840933623431fd06]::io::default_write_fmt::> [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/io/mod.rs:639:11 [INFO] [stdout] 7: 0x5da7a7358626 - as std[840933623431fd06]::io::Write>::write_fmt [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/io/mod.rs:1994:13 [INFO] [stdout] 8: 0x5da7a73311af - ::print [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/sys/backtrace.rs:47:9 [INFO] [stdout] 9: 0x5da7a73311af - std[840933623431fd06]::panicking::default_hook::{closure#0} [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/panicking.rs:292:27 [INFO] [stdout] 10: 0x5da7a734b239 - std[840933623431fd06]::panicking::default_hook [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/panicking.rs:316:9 [INFO] [stdout] 11: 0x5da7a6bd64ee - core[8f93d80df273fe75]::ops::function::Fn<(&'a std[840933623431fd06]::panic::PanicHookInfo<'b>,), Output = ()> + core[8f93d80df273fe75]::marker::Sync + core[8f93d80df273fe75]::marker::Send> as core[8f93d80df273fe75]::ops::function::Fn<(&std[840933623431fd06]::panic::PanicHookInfo,)>>::call [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/alloc/src/boxed.rs:2220:9 [INFO] [stdout] 12: 0x5da7a6bd64ee - test[2f1252070343a163]::test_main_with_exit_callback::::{closure#0} [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/test/src/lib.rs:145:21 [INFO] [stdout] 13: 0x5da7a734b4a2 - core[8f93d80df273fe75]::ops::function::Fn<(&'a std[840933623431fd06]::panic::PanicHookInfo<'b>,), Output = ()> + core[8f93d80df273fe75]::marker::Sync + core[8f93d80df273fe75]::marker::Send> as core[8f93d80df273fe75]::ops::function::Fn<(&std[840933623431fd06]::panic::PanicHookInfo,)>>::call [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/alloc/src/boxed.rs:2220:9 [INFO] [stdout] 14: 0x5da7a734b4a2 - std[840933623431fd06]::panicking::panic_with_hook [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/panicking.rs:833:13 [INFO] [stdout] 15: 0x5da7a7331268 - std[840933623431fd06]::panicking::panic_handler::{closure#0} [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/panicking.rs:698:13 [INFO] [stdout] 16: 0x5da7a7328b09 - std[840933623431fd06]::sys::backtrace::__rust_end_short_backtrace:: [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/sys/backtrace.rs:182:18 [INFO] [stdout] 17: 0x5da7a73320bd - __rustc[5b4a0c6d8cc4a177]::rust_begin_unwind [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/panicking.rs:689:5 [INFO] [stdout] 18: 0x5da7a736c0ac - core[8f93d80df273fe75]::panicking::panic_fmt [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/core/src/panicking.rs:80:14 [INFO] [stdout] 19: 0x5da7a736bf33 - core[8f93d80df273fe75]::panicking::assert_failed_inner [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/core/src/panicking.rs:439:17 [INFO] [stdout] 20: 0x5da7a6d0a3e2 - core[8f93d80df273fe75]::panicking::assert_failed::<&str, &str> [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/core/src/panicking.rs:394:5 [INFO] [stdout] 21: 0x5da7a6b89b6e - pusher[a9952f5db69afd14]::check_prom::{closure#0} [INFO] [stdout] at /opt/rustwide/workdir/tests/pusher.rs:301:2 [INFO] [stdout] 22: 0x5da7a6b8e099 - pusher[a9952f5db69afd14]::many_devices::{closure#0} [INFO] [stdout] at /opt/rustwide/workdir/tests/pusher.rs:571:64 [INFO] [stdout] 23: 0x5da7a6bc9cff - >>> as core[8f93d80df273fe75]::future::future::Future>::poll [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/core/src/future/future.rs:133:9 [INFO] [stdout] 24: 0x5da7a6bc9dbb - >>>> as core[8f93d80df273fe75]::future::future::Future>::poll [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/core/src/future/future.rs:133:9 [INFO] [stdout] 25: 0x5da7a6ba7e9b - ::block_on::>>>>>::{closure#0}::{closure#0}::{closure#0} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:753:70 [INFO] [stdout] 26: 0x5da7a6ba7d5b - tokio[22607737001b8a38]::task::coop::with_budget::>>, ::block_on>>>>>::{closure#0}::{closure#0}::{closure#0}> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/task/coop/mod.rs:167:5 [INFO] [stdout] 27: 0x5da7a6ba7d5b - tokio[22607737001b8a38]::task::coop::budget::>>, ::block_on>>>>>::{closure#0}::{closure#0}::{closure#0}> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/task/coop/mod.rs:133:5 [INFO] [stdout] 28: 0x5da7a6ba7d5b - ::block_on::>>>>>::{closure#0}::{closure#0} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:753:25 [INFO] [stdout] 29: 0x5da7a6ba2a1d - ::enter::>>, ::block_on>>>>>::{closure#0}::{closure#0}> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:442:19 [INFO] [stdout] 30: 0x5da7a6ba6f1d - ::block_on::>>>>>::{closure#0} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:752:44 [INFO] [stdout] 31: 0x5da7a6ba615b - ::enter::<::block_on>>>>>::{closure#0}, core[8f93d80df273fe75]::option::Option>>>::{closure#0} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:840:68 [INFO] [stdout] 32: 0x5da7a6ba216a - >::set::<::enter<::block_on>>>>>::{closure#0}, core[8f93d80df273fe75]::option::Option>>>::{closure#0}, (alloc[40b2bae28975ac47]::boxed::Box, core[8f93d80df273fe75]::option::Option>>)> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/context/scoped.rs:40:9 [INFO] [stdout] 33: 0x5da7a6bb1aaa - tokio[22607737001b8a38]::runtime::context::set_scheduler::<(alloc[40b2bae28975ac47]::boxed::Box, core[8f93d80df273fe75]::option::Option>>), ::enter<::block_on>>>>>::{closure#0}, core[8f93d80df273fe75]::option::Option>>>::{closure#0}>::{closure#0} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/context.rs:176:38 [INFO] [stdout] 34: 0x5da7a6bafa65 - >::try_with::, core[8f93d80df273fe75]::option::Option>>), ::enter<::block_on>>>>>::{closure#0}, core[8f93d80df273fe75]::option::Option>>>::{closure#0}>::{closure#0}, (alloc[40b2bae28975ac47]::boxed::Box, core[8f93d80df273fe75]::option::Option>>)> [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/thread/local.rs:513:12 [INFO] [stdout] 35: 0x5da7a6baf59d - >::with::, core[8f93d80df273fe75]::option::Option>>), ::enter<::block_on>>>>>::{closure#0}, core[8f93d80df273fe75]::option::Option>>>::{closure#0}>::{closure#0}, (alloc[40b2bae28975ac47]::boxed::Box, core[8f93d80df273fe75]::option::Option>>)> [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/thread/local.rs:477:20 [INFO] [stdout] 36: 0x5da7a6bb1341 - tokio[22607737001b8a38]::runtime::context::set_scheduler::<(alloc[40b2bae28975ac47]::boxed::Box, core[8f93d80df273fe75]::option::Option>>), ::enter<::block_on>>>>>::{closure#0}, core[8f93d80df273fe75]::option::Option>>>::{closure#0}> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/context.rs:176:17 [INFO] [stdout] 37: 0x5da7a6ba4bfe - ::enter::<::block_on>>>>>::{closure#0}, core[8f93d80df273fe75]::option::Option>>> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:840:27 [INFO] [stdout] 38: 0x5da7a6ba4f4e - ::block_on::>>>>> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:740:24 [INFO] [stdout] 39: 0x5da7a6ba5596 - ::block_on::>>>>::{closure#0} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:200:33 [INFO] [stdout] 40: 0x5da7a6bbfd1f - tokio[22607737001b8a38]::runtime::context::runtime::enter_runtime::<::block_on>>>>::{closure#0}, core[8f93d80df273fe75]::result::Result<(), alloc[40b2bae28975ac47]::boxed::Box>> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/context/runtime.rs:65:16 [INFO] [stdout] 41: 0x5da7a6ba2337 - ::block_on::>>>> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:188:9 [INFO] [stdout] 42: 0x5da7a6bb8e10 - ::block_on_inner::>>>> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/runtime.rs:368:52 [INFO] [stdout] 43: 0x5da7a6bb9034 - ::block_on::>>>> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/runtime.rs:342:18 [INFO] [stdout] 44: 0x5da7a6b9dcd4 - pusher[a9952f5db69afd14]::many_devices [INFO] [stdout] at /opt/rustwide/workdir/tests/pusher.rs:573:4 [INFO] [stdout] 45: 0x5da7a6b8a797 - pusher[a9952f5db69afd14]::many_devices::{closure#0} [INFO] [stdout] at /opt/rustwide/workdir/tests/pusher.rs:530:28 [INFO] [stdout] 46: 0x5da7a6ba1d76 - >::call_once [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/core/src/ops/function.rs:250:5 [INFO] [stdout] 47: 0x5da7a6bca89b - core[8f93d80df273fe75]::result::Result<(), alloc[40b2bae28975ac47]::string::String> as core[8f93d80df273fe75]::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/core/src/ops/function.rs:250:5 [INFO] [stdout] 48: 0x5da7a6bca89b - test[2f1252070343a163]::__rust_begin_short_backtrace::, fn() -> core[8f93d80df273fe75]::result::Result<(), alloc[40b2bae28975ac47]::string::String>> [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/test/src/lib.rs:663:18 [INFO] [stdout] 49: 0x5da7a6bd70fa - test[2f1252070343a163]::run_test_in_process::{closure#0} [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/test/src/lib.rs:686:74 [INFO] [stdout] 50: 0x5da7a6bd70fa - as core[8f93d80df273fe75]::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 51: 0x5da7a6bd70fa - std[840933623431fd06]::panicking::catch_unwind::do_call::, core[8f93d80df273fe75]::result::Result<(), alloc[40b2bae28975ac47]::string::String>> [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/panicking.rs:581:40 [INFO] [stdout] 52: 0x5da7a6bd70fa - std[840933623431fd06]::panicking::catch_unwind::, core[8f93d80df273fe75]::panic::unwind_safe::AssertUnwindSafe> [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/panicking.rs:544:19 [INFO] [stdout] 53: 0x5da7a6bd70fa - std[840933623431fd06]::panic::catch_unwind::, core[8f93d80df273fe75]::result::Result<(), alloc[40b2bae28975ac47]::string::String>> [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/panic.rs:359:14 [INFO] [stdout] 54: 0x5da7a6bd70fa - test[2f1252070343a163]::run_test_in_process [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/test/src/lib.rs:686:27 [INFO] [stdout] 55: 0x5da7a6bd70fa - test[2f1252070343a163]::run_test::{closure#0} [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/test/src/lib.rs:607:43 [INFO] [stdout] 56: 0x5da7a6bd15c4 - test[2f1252070343a163]::run_test::{closure#1} [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/test/src/lib.rs:637:41 [INFO] [stdout] 57: 0x5da7a6bd15c4 - std[840933623431fd06]::sys::backtrace::__rust_begin_short_backtrace:: [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/sys/backtrace.rs:166:18 [INFO] [stdout] 58: 0x5da7a6bd9bf2 - std[840933623431fd06]::thread::lifecycle::spawn_unchecked::::{closure#1}::{closure#0} [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/thread/lifecycle.rs:91:13 [INFO] [stdout] 59: 0x5da7a6bd9bf2 - ::{closure#1}::{closure#0}> as core[8f93d80df273fe75]::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 60: 0x5da7a6bd9bf2 - std[840933623431fd06]::panicking::catch_unwind::do_call::::{closure#1}::{closure#0}>, ()> [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/panicking.rs:581:40 [INFO] [stdout] 61: 0x5da7a6bd9bf2 - std[840933623431fd06]::panicking::catch_unwind::<(), core[8f93d80df273fe75]::panic::unwind_safe::AssertUnwindSafe::{closure#1}::{closure#0}>> [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/panicking.rs:544:19 [INFO] [stdout] 62: 0x5da7a6bd9bf2 - std[840933623431fd06]::panic::catch_unwind::::{closure#1}::{closure#0}>, ()> [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/panic.rs:359:14 [INFO] [stdout] 63: 0x5da7a6bd9bf2 - std[840933623431fd06]::thread::lifecycle::spawn_unchecked::::{closure#1} [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/thread/lifecycle.rs:89:26 [INFO] [stdout] 64: 0x5da7a6bd9bf2 - ::{closure#1} as core[8f93d80df273fe75]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0} [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/core/src/ops/function.rs:250:5 [INFO] [stdout] 65: 0x5da7a7352a8f - + core[8f93d80df273fe75]::marker::Send> as core[8f93d80df273fe75]::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/alloc/src/boxed.rs:2206:9 [INFO] [stdout] 66: 0x5da7a7352a8f - ::new::thread_start [INFO] [stdout] at /rustc/bd7d74411512a3dd3b35d2f699c51dd2557c7e7e/library/std/src/sys/thread/unix.rs:119:17 [INFO] [stdout] 67: 0x7cab0aacaaa4 - [INFO] [stdout] 68: 0x7cab0ab57a64 - clone [INFO] [stdout] 69: 0x0 - [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] failures: [INFO] [stdout] many_devices [INFO] [stdout] normal_operation [INFO] [stdout] [INFO] [stdout] test result: FAILED. 7 passed; 2 failed; 0 ignored; 0 measured; 0 filtered out; finished in 7.57s [INFO] [stdout] [INFO] [stderr] error: test failed, to rerun pass `--test pusher` [INFO] running `Command { std: "docker" "inspect" "95314eff7c9b954877cce1f3dabcb8c57b36e7b38ae7b9fc960b0dbdeaac42de", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "95314eff7c9b954877cce1f3dabcb8c57b36e7b38ae7b9fc960b0dbdeaac42de", kill_on_drop: false }` [INFO] [stdout] 95314eff7c9b954877cce1f3dabcb8c57b36e7b38ae7b9fc960b0dbdeaac42de