[INFO] cloning repository https://github.com/famedly/hedwig [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/famedly/hedwig" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffamedly%2Fhedwig", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffamedly%2Fhedwig'... [INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }` [INFO] [stdout] 010583158efef8b2d3475ad224768d8ea1246ed2 [INFO] testing famedly/hedwig against master#d933cf483edf1605142ac6899ff32536c0ad8b22 for pr-150933 [INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffamedly%2Fhedwig" "/workspace/builds/worker-1-tc1/source", kill_on_drop: false }` [INFO] [stderr] Cloning into '/workspace/builds/worker-1-tc1/source'... [INFO] [stderr] done. [INFO] started tweaking git repo https://github.com/famedly/hedwig [INFO] finished tweaking git repo https://github.com/famedly/hedwig [INFO] tweaked toml for git repo https://github.com/famedly/hedwig written to /workspace/builds/worker-1-tc1/source/Cargo.toml [INFO] validating manifest of git repo https://github.com/famedly/hedwig on toolchain d933cf483edf1605142ac6899ff32536c0ad8b22 [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+d933cf483edf1605142ac6899ff32536c0ad8b22" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }` [INFO] crate git repo https://github.com/famedly/hedwig already has a lockfile, it will not be regenerated [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+d933cf483edf1605142ac6899ff32536c0ad8b22" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] [stderr] Updating git repository `https://github.com/famedly/a2.git` [INFO] [stderr] Updating crates.io index [INFO] [stderr] Updating git repository `https://github.com/famedly/firebae-cm.git` [INFO] [stderr] Blocking waiting for file lock on package cache [INFO] [stderr] Downloading crates ... [INFO] [stderr] Downloaded vergen-lib v0.1.6 [INFO] [stderr] Downloaded derive_builder_core v0.20.2 [INFO] [stderr] Downloaded vergen-gitcl v1.0.8 [INFO] [stderr] Downloaded derive_builder_macro v0.20.2 [INFO] [stderr] Downloaded time-macros v0.2.24 [INFO] [stderr] Downloaded unicode-ident v1.0.20 [INFO] [stderr] Downloaded typeid v1.0.3 [INFO] [stderr] Downloaded protobuf-support v3.7.2 [INFO] [stderr] Downloaded untrusted v0.9.0 [INFO] [stderr] Downloaded opentelemetry-resource-detectors v0.9.0 [INFO] [stderr] Downloaded firebae-derive v0.1.0 [INFO] [stderr] Downloaded tracing-futures v0.2.5 [INFO] [stderr] Downloaded tracing-serde v0.2.0 [INFO] [stderr] Downloaded axum-core v0.5.5 [INFO] [stderr] Downloaded color-spantrace v0.3.0 [INFO] [stderr] Downloaded rand_core v0.9.3 [INFO] [stderr] Downloaded rustls-pemfile v2.2.0 [INFO] [stderr] Downloaded webpki-roots v0.26.11 [INFO] [stderr] Downloaded pest_meta v2.8.3 [INFO] [stderr] Downloaded tokio-rustls v0.25.0 [INFO] [stderr] Downloaded opentelemetry-semantic-conventions v0.31.0 [INFO] [stderr] Downloaded tonic v0.13.1 [INFO] [stderr] Downloaded openssl-sys v0.9.110 [INFO] [stderr] Downloaded hashbrown v0.16.0 [INFO] [stderr] Downloaded rustls-webpki v0.101.7 [INFO] [stderr] Downloaded reqwest v0.12.24 [INFO] [stderr] Downloaded tracing-opentelemetry v0.32.0 [INFO] [stderr] Downloaded chrono v0.4.42 [INFO] [stderr] Downloaded opentelemetry_sdk v0.31.0 [INFO] [stderr] Downloaded rustls-webpki v0.102.8 [INFO] [stderr] Downloaded webpki-roots v1.0.4 [INFO] [stderr] Downloaded rustls v0.21.12 [INFO] [stderr] Downloaded webpki-roots v0.25.4 [INFO] [stderr] Downloaded openssl v0.10.74 [INFO] [stderr] Downloaded rustls v0.23.34 [INFO] [stderr] Downloaded opentelemetry_sdk v0.30.0 [INFO] [stderr] Downloaded rustls v0.22.4 [INFO] [stderr] Downloaded syn v2.0.108 [INFO] [stderr] Downloaded protobuf v3.7.2 [INFO] [stderr] Downloaded opentelemetry-proto v0.30.0 [INFO] [stderr] Downloaded h2 v0.4.12 [INFO] [stderr] Downloaded sysinfo v0.34.2 [INFO] [stderr] Downloaded axum v0.8.8 [INFO] [stderr] Downloaded icu_properties_data v2.1.1 [INFO] [stderr] Downloaded tower-http v0.6.8 [INFO] [stderr] Downloaded pest v2.8.3 [INFO] [stderr] Downloaded ron v0.12.0 [INFO] [stderr] Downloaded tracing-opentelemetry v0.31.0 [INFO] [stderr] Downloaded indexmap v2.12.0 [INFO] [stderr] Downloaded mio v1.1.0 [INFO] [stderr] Downloaded cc v1.2.43 [INFO] [stderr] Downloaded web-sys v0.3.82 [INFO] [stderr] Downloaded prometheus v0.14.0 [INFO] [stderr] Downloaded hyper-util v0.1.17 [INFO] [stderr] Downloaded color-eyre v0.6.5 [INFO] [stderr] Downloaded opentelemetry v0.30.0 [INFO] [stderr] Downloaded hyper-rustls v0.26.0 [INFO] [stderr] Downloaded security-framework v3.5.1 [INFO] [stderr] Downloaded rustls-webpki v0.103.8 [INFO] [stderr] Downloaded opentelemetry v0.31.0 [INFO] [stderr] Downloaded schemars v1.0.4 [INFO] [stderr] Downloaded opentelemetry-otlp v0.30.0 [INFO] [stderr] Downloaded opentelemetry-semantic-conventions v0.30.0 [INFO] [stderr] Downloaded yaml-rust2 v0.10.4 [INFO] [stderr] Downloaded config v0.15.19 [INFO] [stderr] Downloaded tokio-stream v0.1.17 [INFO] [stderr] Downloaded icu_properties v2.1.1 [INFO] [stderr] Downloaded windows-core v0.57.0 [INFO] [stderr] Downloaded axum-tracing-opentelemetry v0.32.2 [INFO] [stderr] Downloaded eyre v0.6.12 [INFO] [stderr] Downloaded owo-colors v4.2.3 [INFO] [stderr] Downloaded pest_generator v2.8.3 [INFO] [stderr] Downloaded toml v0.9.8 [INFO] [stderr] Downloaded tokio-rustls v0.26.4 [INFO] [stderr] Downloaded hyper-rustls v0.27.7 [INFO] [stderr] Downloaded find-msvc-tools v0.1.4 [INFO] [stderr] Downloaded rustls-pki-types v1.13.0 [INFO] [stderr] Downloaded schemars_derive v1.0.4 [INFO] [stderr] Downloaded famedly_rust_utils v1.0.2 [INFO] [stderr] Downloaded opentelemetry-appender-tracing v0.30.1 [INFO] [stderr] Downloaded wasm-bindgen-futures v0.4.55 [INFO] [stderr] Downloaded axum-macros v0.5.0 [INFO] [stderr] Downloaded matchit v0.8.4 [INFO] [stderr] Downloaded rust-telemetry v1.2.0 [INFO] [stderr] Downloaded camino v1.2.1 [INFO] [stderr] Downloaded cargo_metadata v0.19.2 [INFO] [stderr] Downloaded tracing-opentelemetry-instrumentation-sdk v0.32.1 [INFO] [stderr] Downloaded pest_derive v2.8.3 [INFO] [stderr] Downloaded rust-ini v0.21.3 [INFO] [stderr] Downloaded erased-serde v0.4.8 [INFO] [stderr] Downloaded serde_spanned v1.0.3 [INFO] [stderr] Downloaded toml_datetime v0.7.3 [INFO] [stderr] Downloaded toml_parser v1.0.4 [INFO] [stderr] Downloaded hashlink v0.10.0 [INFO] [stderr] Downloaded hyper-rustls v0.24.2 [INFO] [stderr] Downloaded sct v0.7.1 [INFO] [stderr] Downloaded tokio-rustls v0.24.1 [INFO] [stderr] Downloaded iana-time-zone v0.1.64 [INFO] [stderr] Downloaded ring v0.17.14 [INFO] [stderr] Downloaded core-foundation v0.10.1 [INFO] [stderr] Downloaded gcp_auth v0.12.6 [INFO] [stderr] Downloaded opentelemetry-http v0.30.0 [INFO] [stderr] Downloaded prost v0.13.5 [INFO] [stderr] Downloaded zmij v1.0.12 [INFO] [stderr] Downloaded indenter v0.3.4 [INFO] [stderr] Downloaded tracing-error v0.2.1 [INFO] [stderr] Downloaded generic-array v0.14.9 [INFO] [stderr] Downloaded serde-untagged v0.1.9 [INFO] [stderr] Downloaded rustls-native-certs v0.8.2 [INFO] [stderr] Downloaded opentelemetry-prometheus v0.31.0 [INFO] [stderr] Downloaded hyper-timeout v0.5.2 [INFO] [stderr] Downloaded prost-derive v0.13.5 [INFO] [stderr] Downloaded serde_path_to_error v0.1.20 [INFO] [stderr] Downloaded tower-otel-http-metrics v0.16.0 [INFO] [stderr] Downloaded windows-implement v0.57.0 [INFO] [stderr] Downloaded windows-interface v0.57.0 [INFO] [stderr] Downloaded derive_builder v0.20.2 [INFO] [stderr] Downloaded vergen v9.0.6 [INFO] [stderr] Downloaded windows v0.57.0 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:cfa559dde23f44738f9990739aaa3487d8df3af37eb5df0572f7cf76004a604a" "/opt/rustwide/cargo-home/bin/cargo" "+d933cf483edf1605142ac6899ff32536c0ad8b22" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }` [INFO] [stdout] a4441b650c2d23540818ec3f1228702dc01bb324ce8d9a5a40e9d573c7a223aa [INFO] running `Command { std: "docker" "start" "-a" "a4441b650c2d23540818ec3f1228702dc01bb324ce8d9a5a40e9d573c7a223aa", kill_on_drop: false }` [INFO] running `Command { std: "docker" "inspect" "a4441b650c2d23540818ec3f1228702dc01bb324ce8d9a5a40e9d573c7a223aa", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "a4441b650c2d23540818ec3f1228702dc01bb324ce8d9a5a40e9d573c7a223aa", kill_on_drop: false }` [INFO] [stdout] a4441b650c2d23540818ec3f1228702dc01bb324ce8d9a5a40e9d573c7a223aa [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:cfa559dde23f44738f9990739aaa3487d8df3af37eb5df0572f7cf76004a604a" "/opt/rustwide/cargo-home/bin/cargo" "+d933cf483edf1605142ac6899ff32536c0ad8b22" "build" "--frozen" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] 2871baef279d433f15fb96d8958cb12157533f45a8f95fb174c18fc1b3dfad35 [INFO] running `Command { std: "docker" "start" "-a" "2871baef279d433f15fb96d8958cb12157533f45a8f95fb174c18fc1b3dfad35", kill_on_drop: false }` [INFO] [stderr] Compiling proc-macro2 v1.0.103 [INFO] [stderr] Compiling quote v1.0.41 [INFO] [stderr] Compiling unicode-ident v1.0.20 [INFO] [stderr] Compiling libc v0.2.177 [INFO] [stderr] Compiling cfg-if v1.0.4 [INFO] [stderr] Compiling memchr v2.7.6 [INFO] [stderr] Compiling pin-project-lite v0.2.16 [INFO] [stderr] Compiling once_cell v1.21.3 [INFO] [stderr] Compiling smallvec v1.15.1 [INFO] [stderr] Compiling log v0.4.28 [INFO] [stderr] Compiling serde_core v1.0.228 [INFO] [stderr] Compiling bytes v1.10.1 [INFO] [stderr] Compiling futures-core v0.3.31 [INFO] [stderr] Compiling tracing-core v0.1.36 [INFO] [stderr] Compiling fnv v1.0.7 [INFO] [stderr] Compiling parking_lot_core v0.9.12 [INFO] [stderr] Compiling lock_api v0.4.14 [INFO] [stderr] Compiling futures-sink v0.3.31 [INFO] [stderr] Compiling slab v0.4.11 [INFO] [stderr] Compiling futures-channel v0.3.31 [INFO] [stderr] Compiling futures-io v0.3.31 [INFO] [stderr] Compiling zmij v1.0.12 [INFO] [stderr] Compiling syn v2.0.108 [INFO] [stderr] Compiling serde v1.0.228 [INFO] [stderr] Compiling futures-task v0.3.31 [INFO] [stderr] Compiling signal-hook-registry v1.4.6 [INFO] [stderr] Compiling socket2 v0.6.1 [INFO] [stderr] Compiling mio v1.1.0 [INFO] [stderr] Compiling parking_lot v0.12.5 [INFO] [stderr] Compiling shlex v1.3.0 [INFO] [stderr] Compiling percent-encoding v2.3.2 [INFO] [stderr] Compiling find-msvc-tools v0.1.4 [INFO] [stderr] Compiling hashbrown v0.16.0 [INFO] [stderr] Compiling thiserror v2.0.17 [INFO] [stderr] Compiling cc v1.2.43 [INFO] [stderr] Compiling serde_json v1.0.149 [INFO] [stderr] Compiling getrandom v0.2.16 [INFO] [stderr] Compiling http v1.3.1 [INFO] [stderr] Compiling httparse v1.10.1 [INFO] [stderr] Compiling tower-service v0.3.3 [INFO] [stderr] Compiling stable_deref_trait v1.2.1 [INFO] [stderr] Compiling try-lock v0.2.5 [INFO] [stderr] Compiling httpdate v1.0.3 [INFO] [stderr] Compiling want v0.3.1 [INFO] [stderr] Compiling socket2 v0.5.10 [INFO] [stderr] Compiling indexmap v2.12.0 [INFO] [stderr] Compiling untrusted v0.9.0 [INFO] [stderr] Compiling ipnet v2.11.0 [INFO] [stderr] Compiling zerocopy v0.8.27 [INFO] [stderr] Compiling getrandom v0.3.4 [INFO] [stderr] Compiling http-body v1.0.1 [INFO] [stderr] Compiling rustversion v1.0.22 [INFO] [stderr] Compiling writeable v0.6.2 [INFO] [stderr] Compiling litemap v0.8.1 [INFO] [stderr] Compiling ring v0.17.14 [INFO] [stderr] Compiling icu_normalizer_data v2.1.1 [INFO] [stderr] Compiling icu_properties_data v2.1.1 [INFO] [stderr] Compiling base64 v0.22.1 [INFO] [stderr] Compiling zeroize v1.8.2 [INFO] [stderr] Compiling rustls-pki-types v1.13.0 [INFO] [stderr] Compiling form_urlencoded v1.2.2 [INFO] [stderr] Compiling rand_core v0.9.3 [INFO] [stderr] Compiling http-body-util v0.1.3 [INFO] [stderr] Compiling anyhow v1.0.100 [INFO] [stderr] Compiling sync_wrapper v1.0.2 [INFO] [stderr] Compiling tower-layer v0.3.3 [INFO] [stderr] Compiling regex-syntax v0.8.8 [INFO] [stderr] Compiling strsim v0.11.1 [INFO] [stderr] Compiling utf8_iter v1.0.4 [INFO] [stderr] Compiling tracing-log v0.2.0 [INFO] [stderr] Compiling thread_local v1.1.9 [INFO] [stderr] Compiling nu-ansi-term v0.50.3 [INFO] [stderr] Compiling bitflags v2.10.0 [INFO] [stderr] Compiling powerfmt v0.2.0 [INFO] [stderr] Compiling thiserror v1.0.69 [INFO] [stderr] Compiling crunchy v0.2.4 [INFO] [stderr] Compiling ppv-lite86 v0.2.21 [INFO] [stderr] Compiling subtle v2.6.1 [INFO] [stderr] Compiling tiny-keccak v2.0.2 [INFO] [stderr] Compiling either v1.15.0 [INFO] [stderr] Compiling mime v0.3.17 [INFO] [stderr] Compiling camino v1.2.1 [INFO] [stderr] Compiling regex-automata v0.4.13 [INFO] [stderr] Compiling rand_chacha v0.9.0 [INFO] [stderr] Compiling num-conv v0.1.0 [INFO] [stderr] Compiling time-core v0.1.6 [INFO] [stderr] Compiling itertools v0.14.0 [INFO] [stderr] Compiling rand v0.9.2 [INFO] [stderr] Compiling synstructure v0.13.2 [INFO] [stderr] Compiling darling_core v0.20.11 [INFO] [stderr] Compiling vergen-lib v0.1.6 [INFO] [stderr] Compiling semver v1.0.27 [INFO] [stderr] Compiling http v0.2.12 [INFO] [stderr] Compiling aho-corasick v1.1.4 [INFO] [stderr] Compiling matchers v0.2.0 [INFO] [stderr] Compiling typeid v1.0.3 [INFO] [stderr] Compiling tracing-attributes v0.1.31 [INFO] [stderr] Compiling serde_derive v1.0.228 [INFO] [stderr] Compiling tokio-macros v2.6.0 [INFO] [stderr] Compiling futures-macro v0.3.31 [INFO] [stderr] Compiling tokio v1.49.0 [INFO] [stderr] Compiling thiserror-impl v2.0.17 [INFO] [stderr] Compiling futures-util v0.3.31 [INFO] [stderr] Compiling tracing v0.1.44 [INFO] [stderr] Compiling zerofrom-derive v0.1.6 [INFO] [stderr] Compiling yoke-derive v0.8.1 [INFO] [stderr] Compiling zerovec-derive v0.11.2 [INFO] [stderr] Compiling displaydoc v0.2.5 [INFO] [stderr] Compiling opentelemetry v0.30.0 [INFO] [stderr] Compiling darling_macro v0.20.11 [INFO] [stderr] Compiling darling v0.20.11 [INFO] [stderr] Compiling thiserror-impl v1.0.69 [INFO] [stderr] Compiling derive_builder_core v0.20.2 [INFO] [stderr] Compiling zerofrom v0.1.6 [INFO] [stderr] Compiling yoke v0.8.1 [INFO] [stderr] Compiling zerotrie v0.2.3 [INFO] [stderr] Compiling zerovec v0.11.5 [INFO] [stderr] Compiling pin-project-internal v1.1.10 [INFO] [stderr] Compiling async-trait v0.1.89 [INFO] [stderr] Compiling tinystr v0.8.2 [INFO] [stderr] Compiling potential_utf v0.1.4 [INFO] [stderr] Compiling icu_locale_core v2.1.1 [INFO] [stderr] Compiling icu_collections v2.1.1 [INFO] [stderr] Compiling tracing-serde v0.2.0 [INFO] [stderr] Compiling serde_urlencoded v0.7.1 [INFO] [stderr] Compiling tracing-subscriber v0.3.22 [INFO] [stderr] Compiling futures-executor v0.3.31 [INFO] [stderr] Compiling pin-project v1.1.10 [INFO] [stderr] Compiling derive_builder_macro v0.20.2 [INFO] [stderr] Compiling ucd-trie v0.1.7 [INFO] [stderr] Compiling rustls v0.21.12 [INFO] [stderr] Compiling pkg-config v0.3.32 [INFO] [stderr] Compiling vcpkg v0.2.15 [INFO] [stderr] Compiling derive_builder v0.20.2 [INFO] [stderr] Compiling pest v2.8.3 [INFO] [stderr] Compiling icu_provider v2.1.1 [INFO] [stderr] Compiling opentelemetry v0.31.0 [INFO] [stderr] Compiling icu_properties v2.1.1 [INFO] [stderr] Compiling icu_normalizer v2.1.1 [INFO] [stderr] Compiling cargo-platform v0.1.9 [INFO] [stderr] Compiling openssl-sys v0.9.110 [INFO] [stderr] Compiling const-random-macro v0.1.16 [INFO] [stderr] Compiling prost-derive v0.13.5 [INFO] [stderr] Compiling sct v0.7.1 [INFO] [stderr] Compiling rustls-webpki v0.101.7 [INFO] [stderr] Compiling tokio-util v0.7.16 [INFO] [stderr] Compiling tokio-stream v0.1.17 [INFO] [stderr] Compiling h2 v0.4.12 [INFO] [stderr] Compiling idna_adapter v1.2.1 [INFO] [stderr] Compiling tower v0.5.2 [INFO] [stderr] Compiling idna v1.1.0 [INFO] [stderr] Compiling opentelemetry_sdk v0.30.0 [INFO] [stderr] Compiling url v2.5.7 [INFO] [stderr] Compiling deranged v0.5.5 [INFO] [stderr] Compiling vergen v9.0.6 [INFO] [stderr] Compiling autocfg v1.5.0 [INFO] [stderr] Compiling rustls v0.22.4 [INFO] [stderr] Compiling iri-string v0.7.8 [INFO] [stderr] Compiling ref-cast v1.0.25 [INFO] [stderr] Compiling num_threads v0.1.7 [INFO] [stderr] Compiling rustls v0.23.34 [INFO] [stderr] Compiling num-traits v0.2.19 [INFO] [stderr] Compiling cargo_metadata v0.19.2 [INFO] [stderr] Compiling regex v1.12.2 [INFO] [stderr] Compiling time v0.3.44 [INFO] [stderr] Compiling opentelemetry_sdk v0.31.0 [INFO] [stderr] Compiling prost v0.13.5 [INFO] [stderr] Compiling h2 v0.3.27 [INFO] [stderr] Compiling tower-http v0.6.8 [INFO] [stderr] Compiling pest_meta v2.8.3 [INFO] [stderr] Compiling const-random v0.1.18 [INFO] [stderr] Compiling axum-core v0.5.5 [INFO] [stderr] Compiling axum-macros v0.5.0 [INFO] [stderr] Compiling hyper v1.7.0 [INFO] [stderr] Compiling ref-cast-impl v1.0.25 [INFO] [stderr] Compiling http-body v0.4.6 [INFO] [stderr] Compiling rustls-webpki v0.102.8 [INFO] [stderr] Compiling rustls-webpki v0.103.8 [INFO] [stderr] Compiling rustc_version v0.4.1 [INFO] [stderr] Compiling serde_derive_internals v0.29.1 [INFO] [stderr] Compiling hyper-util v0.1.17 [INFO] [stderr] Compiling serde_path_to_error v0.1.20 [INFO] [stderr] Compiling vergen-gitcl v1.0.8 [INFO] [stderr] Compiling sysinfo v0.34.2 [INFO] [stderr] Compiling encoding_rs v0.8.35 [INFO] [stderr] Compiling object v0.37.3 [INFO] [stderr] Compiling matchit v0.8.4 [INFO] [stderr] Compiling erased-serde v0.4.8 [INFO] [stderr] Compiling foldhash v0.1.5 [INFO] [stderr] Compiling protobuf v3.7.2 [INFO] [stderr] Compiling base64 v0.21.7 [INFO] [stderr] Compiling owo-colors v4.2.3 [INFO] [stderr] Compiling hashbrown v0.15.5 [INFO] [stderr] Compiling schemars_derive v1.0.4 [INFO] [stderr] Compiling hyper v0.14.32 [INFO] [stderr] Compiling hyper-timeout v0.5.2 [INFO] [stderr] Compiling tonic v0.13.1 [INFO] [stderr] Compiling reqwest v0.12.24 [INFO] [stderr] Compiling axum v0.8.8 [INFO] [stderr] Compiling tokio-rustls v0.24.1 [INFO] [stderr] Compiling pest_generator v2.8.3 [INFO] [stderr] Compiling dlv-list v0.5.2 [INFO] [stderr] Compiling protobuf-support v3.7.2 [INFO] [stderr] Compiling webpki-roots v1.0.4 [INFO] [stderr] Compiling eyre v0.6.12 [INFO] [stderr] Compiling openssl v0.10.74 [INFO] [stderr] Compiling prometheus v0.14.0 [INFO] [stderr] Compiling adler2 v2.0.1 [INFO] [stderr] Compiling foreign-types-shared v0.1.1 [INFO] [stderr] Compiling hashbrown v0.14.5 [INFO] [stderr] Compiling opentelemetry-resource-detectors v0.9.0 [INFO] [stderr] Compiling winnow v0.7.13 [INFO] [stderr] Compiling openssl-probe v0.1.6 [INFO] [stderr] Compiling color-spantrace v0.3.0 [INFO] [stderr] Compiling gimli v0.32.3 [INFO] [stderr] Compiling dyn-clone v1.0.20 [INFO] [stderr] Compiling schemars v1.0.4 [INFO] [stderr] Compiling tokio-rustls v0.26.4 [INFO] [stderr] Compiling toml_parser v1.0.4 [INFO] [stderr] Compiling tokio-rustls v0.25.0 [INFO] [stderr] Compiling rustls-native-certs v0.8.2 [INFO] [stderr] Compiling hyper-rustls v0.24.2 [INFO] [stderr] Compiling ordered-multimap v0.7.3 [INFO] [stderr] Compiling opentelemetry-http v0.30.0 [INFO] [stderr] Compiling foreign-types v0.3.2 [INFO] [stderr] Compiling miniz_oxide v0.8.9 [INFO] [stderr] Compiling addr2line v0.25.1 [INFO] [stderr] Compiling webpki-roots v0.26.11 [INFO] [stderr] Compiling pest_derive v2.8.3 [INFO] [stderr] Compiling opentelemetry-proto v0.30.0 [INFO] [stderr] Compiling hashlink v0.10.0 [INFO] [stderr] Compiling rustls-pemfile v1.0.4 [INFO] [stderr] Compiling tracing-opentelemetry v0.32.0 [INFO] [stderr] Compiling tracing-error v0.2.1 [INFO] [stderr] Compiling openssl-macros v0.1.1 [INFO] [stderr] Compiling serde_spanned v1.0.3 [INFO] [stderr] Compiling toml_datetime v0.7.3 [INFO] [stderr] Compiling sync_wrapper v0.1.2 [INFO] [stderr] Compiling rustc-demangle v0.1.26 [INFO] [stderr] Compiling indenter v0.3.4 [INFO] [stderr] Compiling webpki-roots v0.25.4 [INFO] [stderr] Compiling opentelemetry-semantic-conventions v0.31.0 [INFO] [stderr] Compiling iana-time-zone v0.1.64 [INFO] [stderr] Compiling opentelemetry-semantic-conventions v0.30.0 [INFO] [stderr] Compiling arraydeque v0.5.1 [INFO] [stderr] Compiling convert_case v0.6.0 [INFO] [stderr] Compiling yaml-rust2 v0.10.4 [INFO] [stderr] Compiling chrono v0.4.42 [INFO] [stderr] Compiling tracing-opentelemetry-instrumentation-sdk v0.32.1 [INFO] [stderr] Compiling reqwest v0.11.27 [INFO] [stderr] Compiling toml v0.9.8 [INFO] [stderr] Compiling opentelemetry-otlp v0.30.0 [INFO] [stderr] Compiling serde-untagged v0.1.9 [INFO] [stderr] Compiling backtrace v0.3.76 [INFO] [stderr] Compiling matrix-hedwig v2.2.0 (/opt/rustwide/workdir) [INFO] [stderr] Compiling json5 v0.4.1 [INFO] [stderr] Compiling hyper-rustls v0.26.0 [INFO] [stderr] Compiling rust-ini v0.21.3 [INFO] [stderr] Compiling tower-otel-http-metrics v0.16.0 [INFO] [stderr] Compiling famedly_rust_utils v1.0.2 [INFO] [stderr] Compiling hyper-rustls v0.27.7 [INFO] [stderr] Compiling ron v0.12.0 [INFO] [stderr] Compiling tracing-opentelemetry v0.31.0 [INFO] [stderr] Compiling opentelemetry-appender-tracing v0.30.1 [INFO] [stderr] Compiling tracing-futures v0.2.5 [INFO] [stderr] Compiling erased-serde v0.3.31 [INFO] [stderr] Compiling firebae-derive v0.1.0 [INFO] [stderr] Compiling rustls-pemfile v2.2.0 [INFO] [stderr] Compiling pathdiff v0.2.3 [INFO] [stderr] Compiling firebae-cm v0.4.2 (https://github.com/famedly/firebae-cm.git?branch=thomast%2Fdeserializable-enums#25287f69) [INFO] [stderr] Compiling gcp_auth v0.12.6 [INFO] [stderr] Compiling rust-telemetry v1.2.0 [INFO] [stderr] Compiling a2 v0.10.0 (https://github.com/famedly/a2.git?branch=thomast%2Fowned-struct-params#44625845) [INFO] [stderr] Compiling config v0.15.19 [INFO] [stderr] Compiling color-eyre v0.6.5 [INFO] [stderr] Compiling opentelemetry-prometheus v0.31.0 [INFO] [stderr] Compiling axum-tracing-opentelemetry v0.32.2 [INFO] [stderr] Compiling futures v0.3.31 [INFO] [stderr] Finished `dev` profile [unoptimized + debuginfo] target(s) in 6m 14s [INFO] running `Command { std: "docker" "inspect" "2871baef279d433f15fb96d8958cb12157533f45a8f95fb174c18fc1b3dfad35", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "2871baef279d433f15fb96d8958cb12157533f45a8f95fb174c18fc1b3dfad35", kill_on_drop: false }` [INFO] [stdout] 2871baef279d433f15fb96d8958cb12157533f45a8f95fb174c18fc1b3dfad35 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:cfa559dde23f44738f9990739aaa3487d8df3af37eb5df0572f7cf76004a604a" "/opt/rustwide/cargo-home/bin/cargo" "+d933cf483edf1605142ac6899ff32536c0ad8b22" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] c6e46a6da3bf3af5ca9a61728711571982fd1e16d46a36efd20a97ae6cc9f0b3 [INFO] running `Command { std: "docker" "start" "-a" "c6e46a6da3bf3af5ca9a61728711571982fd1e16d46a36efd20a97ae6cc9f0b3", kill_on_drop: false }` [INFO] [stderr] Compiling aho-corasick v1.1.4 [INFO] [stderr] Compiling regex-syntax v0.8.8 [INFO] [stderr] Compiling hyper v0.14.32 [INFO] [stderr] Compiling regex-automata v0.4.13 [INFO] [stderr] Compiling hyper-rustls v0.24.2 [INFO] [stderr] Compiling reqwest v0.11.27 [INFO] [stderr] Compiling regex v1.12.2 [INFO] [stderr] Compiling vergen v9.0.6 [INFO] [stderr] Compiling vergen-gitcl v1.0.8 [INFO] [stderr] Compiling firebae-cm v0.4.2 (https://github.com/famedly/firebae-cm.git?branch=thomast%2Fdeserializable-enums#25287f69) [INFO] [stderr] Compiling matrix-hedwig v2.2.0 (/opt/rustwide/workdir) [INFO] [stderr] Compiling matchers v0.2.0 [INFO] [stderr] Compiling tracing-subscriber v0.3.22 [INFO] [stderr] Compiling tracing-error v0.2.1 [INFO] [stderr] Compiling tracing-opentelemetry v0.32.0 [INFO] [stderr] Compiling opentelemetry-appender-tracing v0.30.1 [INFO] [stderr] Compiling tracing-opentelemetry v0.31.0 [INFO] [stderr] Compiling color-spantrace v0.3.0 [INFO] [stderr] Compiling color-eyre v0.6.5 [INFO] [stderr] Compiling rust-telemetry v1.2.0 [INFO] [stderr] Compiling tracing-opentelemetry-instrumentation-sdk v0.32.1 [INFO] [stderr] Compiling axum-tracing-opentelemetry v0.32.2 [INFO] [stderr] Finished `test` profile [unoptimized + debuginfo] target(s) in 1m 32s [INFO] running `Command { std: "docker" "inspect" "c6e46a6da3bf3af5ca9a61728711571982fd1e16d46a36efd20a97ae6cc9f0b3", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "c6e46a6da3bf3af5ca9a61728711571982fd1e16d46a36efd20a97ae6cc9f0b3", kill_on_drop: false }` [INFO] [stdout] c6e46a6da3bf3af5ca9a61728711571982fd1e16d46a36efd20a97ae6cc9f0b3 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:cfa559dde23f44738f9990739aaa3487d8df3af37eb5df0572f7cf76004a604a" "/opt/rustwide/cargo-home/bin/cargo" "+d933cf483edf1605142ac6899ff32536c0ad8b22" "test" "--frozen", kill_on_drop: false }` [INFO] [stdout] 56a1ead05f5f47cb138c5ab2cb0133566d8500da0af3c47d761f88bd7709cb3d [INFO] running `Command { std: "docker" "start" "-a" "56a1ead05f5f47cb138c5ab2cb0133566d8500da0af3c47d761f88bd7709cb3d", kill_on_drop: false }` [INFO] [stderr] Finished `test` profile [unoptimized + debuginfo] target(s) in 0.63s [INFO] [stderr] Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/matrix_hedwig-1a3f399094c8df03) [INFO] [stdout] [INFO] [stdout] running 0 tests [INFO] [stdout] [INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s [INFO] [stdout] [INFO] [stderr] Running unittests src/main.rs (/opt/rustwide/target/debug/deps/matrix_hedwig-d299a8404531d216) [INFO] [stdout] [INFO] [stdout] running 0 tests [INFO] [stdout] [INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s [INFO] [stdout] [INFO] [stderr] Running tests/api.rs (/opt/rustwide/target/debug/deps/api-1757cc8f227c3138) [INFO] [stdout] [INFO] [stdout] running 1 test [INFO] [stdout] test server_starts_successfully ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 1.01s [INFO] [stdout] [INFO] [stderr] Running tests/apns.rs (/opt/rustwide/target/debug/deps/apns-5b39a5a706c19b0c) [INFO] [stdout] [INFO] [stdout] running 3 tests [INFO] [stdout] test apns_sender_missing_key ... ok [INFO] [stdout] test apns_sender_create_sandbox ... ok [INFO] [stdout] test apns_sender_create_production ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 3 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.09s [INFO] [stdout] [INFO] [stderr] Running tests/fcm.rs (/opt/rustwide/target/debug/deps/fcm-39d6fb7893862fef) [INFO] [stdout] [INFO] [stdout] running 2 tests [INFO] [stdout] test fcm_error ... ok [INFO] [stdout] test fcm_sender_create ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.21s [INFO] [stdout] [INFO] [stderr] Running tests/pusher.rs (/opt/rustwide/target/debug/deps/pusher-4c142412b5ebde36) [INFO] [stdout] [INFO] [stdout] running 9 tests [INFO] [stdout] test bad_json ... ok [INFO] [stdout] test push_body_limit ... ok [INFO] [stdout] test many_requests ... ok [INFO] [stdout] test panic_handler ... ok [INFO] [stdout] test normal_operation ... FAILED [INFO] [stdout] test fcm_failure ... ok [INFO] [stdout] test apns_through_fcm_failure ... ok [INFO] [stdout] test direct_apns_failure ... ok [INFO] [stdout] test many_devices ... FAILED [INFO] [stdout] [INFO] [stdout] failures: [INFO] [stdout] [INFO] [stdout] ---- normal_operation stdout ---- [INFO] [stdout] [INFO] [stdout] thread 'normal_operation' (34) panicked at tests/pusher.rs:305:5: [INFO] [stdout] assertion `left == right` failed [INFO] [stdout] left: "" [INFO] [stdout] right: "# TYPE devices_total counter\ndevices_total{otel_scope_name=\"Hedwig\"} 10\n# HELP http_requests_duration_seconds HTTP request duration in seconds\n# TYPE http_requests_duration_seconds histogram\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"0\"} 0\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"5\"} 10\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"10\"} 10\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"25\"} 10\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"50\"} 10\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"75\"} 10\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"100\"} 10\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"250\"} 10\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"500\"} 10\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"750\"} 10\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"1000\"} 10\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"2500\"} 10\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"5000\"} 10\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"7500\"} 10\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"10000\"} 10\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"+Inf\"} 10\nhttp_requests_duration_seconds_sum{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\"} FLOAT\nhttp_requests_duration_seconds_count{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\"} 10\n# HELP http_requests_total Total number of HTTP requests\n# TYPE http_requests_total counter\nhttp_requests_total{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\"} 10\n# TYPE notifications_total counter\nnotifications_total{otel_scope_name=\"Hedwig\"} 10\n# HELP pushes_successful_total Successful pushes\n# TYPE pushes_successful_total counter\npushes_successful_total{device_type=\"Android\",otel_scope_name=\"Hedwig\"} 2\npushes_successful_total{device_type=\"AndroidLegacy\",otel_scope_name=\"Hedwig\"} 2\npushes_successful_total{device_type=\"Ios\",otel_scope_name=\"Hedwig\"} 4\npushes_successful_total{device_type=\"None\",otel_scope_name=\"Hedwig\"} 2\n# HELP target_info Target metadata\n# TYPE target_info gauge\ntarget_info{service_name=\"Hedwig\",telemetry_sdk_language=\"rust\",telemetry_sdk_name=\"opentelemetry\",telemetry_sdk_version=\"any\"} 1" [INFO] [stdout] stack backtrace: [INFO] [stdout] 0: 0x6119b4d9f84a - std[69d51b4813ba037]::backtrace_rs::backtrace::libunwind::trace [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9 [INFO] [stdout] 1: 0x6119b4d9f84a - std[69d51b4813ba037]::backtrace_rs::backtrace::trace_unsynchronized:: [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14 [INFO] [stdout] 2: 0x6119b4d9f84a - std[69d51b4813ba037]::sys::backtrace::_print_fmt [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/sys/backtrace.rs:74:9 [INFO] [stdout] 3: 0x6119b4d9f84a - <::print::DisplayBacktrace as core[51d4adbef590f61]::fmt::Display>::fmt [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/sys/backtrace.rs:44:26 [INFO] [stdout] 4: 0x6119b4db6f2a - ::fmt [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/core/src/fmt/rt.rs:152:76 [INFO] [stdout] 5: 0x6119b4db6f2a - core[51d4adbef590f61]::fmt::write [INFO] [stdout] 6: 0x6119b4da4302 - std[69d51b4813ba037]::io::default_write_fmt::> [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/io/mod.rs:639:11 [INFO] [stdout] 7: 0x6119b4da4302 - as std[69d51b4813ba037]::io::Write>::write_fmt [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/io/mod.rs:1994:13 [INFO] [stdout] 8: 0x6119b4d7e22f - ::print [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/sys/backtrace.rs:47:9 [INFO] [stdout] 9: 0x6119b4d7e22f - std[69d51b4813ba037]::panicking::default_hook::{closure#0} [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/panicking.rs:292:27 [INFO] [stdout] 10: 0x6119b4d977f9 - std[69d51b4813ba037]::panicking::default_hook [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/panicking.rs:316:9 [INFO] [stdout] 11: 0x6119b46112ac - core[51d4adbef590f61]::ops::function::Fn<(&'a std[69d51b4813ba037]::panic::PanicHookInfo<'b>,), Output = ()> + core[51d4adbef590f61]::marker::Sync + core[51d4adbef590f61]::marker::Send> as core[51d4adbef590f61]::ops::function::Fn<(&std[69d51b4813ba037]::panic::PanicHookInfo,)>>::call [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/alloc/src/boxed.rs:2254:9 [INFO] [stdout] 12: 0x6119b46112ac - test[8fe65b9e05bf4c74]::test_main_with_exit_callback::::{closure#0} [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/test/src/lib.rs:145:21 [INFO] [stdout] 13: 0x6119b4d97a72 - core[51d4adbef590f61]::ops::function::Fn<(&'a std[69d51b4813ba037]::panic::PanicHookInfo<'b>,), Output = ()> + core[51d4adbef590f61]::marker::Sync + core[51d4adbef590f61]::marker::Send> as core[51d4adbef590f61]::ops::function::Fn<(&std[69d51b4813ba037]::panic::PanicHookInfo,)>>::call [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/alloc/src/boxed.rs:2254:9 [INFO] [stdout] 14: 0x6119b4d97a72 - std[69d51b4813ba037]::panicking::panic_with_hook [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/panicking.rs:833:13 [INFO] [stdout] 15: 0x6119b4d7e2e8 - std[69d51b4813ba037]::panicking::panic_handler::{closure#0} [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/panicking.rs:698:13 [INFO] [stdout] 16: 0x6119b4d75b09 - std[69d51b4813ba037]::sys::backtrace::__rust_end_short_backtrace:: [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/sys/backtrace.rs:182:18 [INFO] [stdout] 17: 0x6119b4d7effd - __rustc[cb16bc19fc993bd7]::rust_begin_unwind [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/panicking.rs:689:5 [INFO] [stdout] 18: 0x6119b4db78bc - core[51d4adbef590f61]::panicking::panic_fmt [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/core/src/panicking.rs:80:14 [INFO] [stdout] 19: 0x6119b4db7743 - core[51d4adbef590f61]::panicking::assert_failed_inner [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/core/src/panicking.rs:439:17 [INFO] [stdout] 20: 0x6119b474db2e - core[51d4adbef590f61]::panicking::assert_failed::<&str, &str> [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/core/src/panicking.rs:394:5 [INFO] [stdout] 21: 0x6119b45c3c5e - pusher[1c3bbb2d7e981c8]::check_prom::{closure#0} [INFO] [stdout] at /opt/rustwide/workdir/tests/pusher.rs:305:2 [INFO] [stdout] 22: 0x6119b45cdf5e - pusher[1c3bbb2d7e981c8]::normal_operation::{closure#0} [INFO] [stdout] at /opt/rustwide/workdir/tests/pusher.rs:500:68 [INFO] [stdout] 23: 0x6119b45e08ef - >>> as core[51d4adbef590f61]::future::future::Future>::poll [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/core/src/future/future.rs:133:9 [INFO] [stdout] 24: 0x6119b45e09ab - >>>> as core[51d4adbef590f61]::future::future::Future>::poll [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/core/src/future/future.rs:133:9 [INFO] [stdout] 25: 0x6119b460401b - ::block_on::>>>>>::{closure#0}::{closure#0}::{closure#0} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:753:70 [INFO] [stdout] 26: 0x6119b4603e4b - tokio[f3ed3df2856e16bd]::task::coop::with_budget::>>, ::block_on>>>>>::{closure#0}::{closure#0}::{closure#0}> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/task/coop/mod.rs:167:5 [INFO] [stdout] 27: 0x6119b4603e4b - tokio[f3ed3df2856e16bd]::task::coop::budget::>>, ::block_on>>>>>::{closure#0}::{closure#0}::{closure#0}> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/task/coop/mod.rs:133:5 [INFO] [stdout] 28: 0x6119b4603e4b - ::block_on::>>>>>::{closure#0}::{closure#0} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:753:25 [INFO] [stdout] 29: 0x6119b45fe56d - ::enter::>>, ::block_on>>>>>::{closure#0}::{closure#0}> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:442:19 [INFO] [stdout] 30: 0x6119b4602f0d - ::block_on::>>>>>::{closure#0} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:752:44 [INFO] [stdout] 31: 0x6119b460214b - ::enter::<::block_on>>>>>::{closure#0}, core[51d4adbef590f61]::option::Option>>>::{closure#0} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:840:68 [INFO] [stdout] 32: 0x6119b45f90da - >::set::<::enter<::block_on>>>>>::{closure#0}, core[51d4adbef590f61]::option::Option>>>::{closure#0}, (alloc[18203fec9a0cd4ec]::boxed::Box, core[51d4adbef590f61]::option::Option>>)> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/context/scoped.rs:40:9 [INFO] [stdout] 33: 0x6119b45f9d3a - tokio[f3ed3df2856e16bd]::runtime::context::set_scheduler::<(alloc[18203fec9a0cd4ec]::boxed::Box, core[51d4adbef590f61]::option::Option>>), ::enter<::block_on>>>>>::{closure#0}, core[51d4adbef590f61]::option::Option>>>::{closure#0}>::{closure#0} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/context.rs:176:38 [INFO] [stdout] 34: 0x6119b45e1de5 - >::try_with::, core[51d4adbef590f61]::option::Option>>), ::enter<::block_on>>>>>::{closure#0}, core[51d4adbef590f61]::option::Option>>>::{closure#0}>::{closure#0}, (alloc[18203fec9a0cd4ec]::boxed::Box, core[51d4adbef590f61]::option::Option>>)> [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/thread/local.rs:513:12 [INFO] [stdout] 35: 0x6119b45e191d - >::with::, core[51d4adbef590f61]::option::Option>>), ::enter<::block_on>>>>>::{closure#0}, core[51d4adbef590f61]::option::Option>>>::{closure#0}>::{closure#0}, (alloc[18203fec9a0cd4ec]::boxed::Box, core[51d4adbef590f61]::option::Option>>)> [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/thread/local.rs:477:20 [INFO] [stdout] 36: 0x6119b45f95b1 - tokio[f3ed3df2856e16bd]::runtime::context::set_scheduler::<(alloc[18203fec9a0cd4ec]::boxed::Box, core[51d4adbef590f61]::option::Option>>), ::enter<::block_on>>>>>::{closure#0}, core[51d4adbef590f61]::option::Option>>>::{closure#0}> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/context.rs:176:17 [INFO] [stdout] 37: 0x6119b460083e - ::enter::<::block_on>>>>>::{closure#0}, core[51d4adbef590f61]::option::Option>>> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:840:27 [INFO] [stdout] 38: 0x6119b4600b8e - ::block_on::>>>>> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:740:24 [INFO] [stdout] 39: 0x6119b4601b76 - ::block_on::>>>>::{closure#0} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:200:33 [INFO] [stdout] 40: 0x6119b45edc5f - tokio[f3ed3df2856e16bd]::runtime::context::runtime::enter_runtime::<::block_on>>>>::{closure#0}, core[51d4adbef590f61]::result::Result<(), alloc[18203fec9a0cd4ec]::boxed::Box>> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/context/runtime.rs:65:16 [INFO] [stdout] 41: 0x6119b45fded7 - ::block_on::>>>> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:188:9 [INFO] [stdout] 42: 0x6119b45dd910 - ::block_on_inner::>>>> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/runtime.rs:368:52 [INFO] [stdout] 43: 0x6119b45ddb39 - ::block_on::>>>> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/runtime.rs:342:18 [INFO] [stdout] 44: 0x6119b45d8da7 - pusher[1c3bbb2d7e981c8]::normal_operation [INFO] [stdout] at /opt/rustwide/workdir/tests/pusher.rs:502:4 [INFO] [stdout] 45: 0x6119b45c4947 - pusher[1c3bbb2d7e981c8]::normal_operation::{closure#0} [INFO] [stdout] at /opt/rustwide/workdir/tests/pusher.rs:447:32 [INFO] [stdout] 46: 0x6119b45dc7e6 - >::call_once [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/core/src/ops/function.rs:250:5 [INFO] [stdout] 47: 0x6119b460538b - core[51d4adbef590f61]::result::Result<(), alloc[18203fec9a0cd4ec]::string::String> as core[51d4adbef590f61]::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/core/src/ops/function.rs:250:5 [INFO] [stdout] 48: 0x6119b460538b - test[8fe65b9e05bf4c74]::__rust_begin_short_backtrace::, fn() -> core[51d4adbef590f61]::result::Result<(), alloc[18203fec9a0cd4ec]::string::String>> [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/test/src/lib.rs:663:18 [INFO] [stdout] 49: 0x6119b4611d7b - test[8fe65b9e05bf4c74]::run_test_in_process::{closure#0} [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/test/src/lib.rs:686:74 [INFO] [stdout] 50: 0x6119b4611d7b - as core[51d4adbef590f61]::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 51: 0x6119b4611d7b - std[69d51b4813ba037]::panicking::catch_unwind::do_call::, core[51d4adbef590f61]::result::Result<(), alloc[18203fec9a0cd4ec]::string::String>> [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/panicking.rs:581:40 [INFO] [stdout] 52: 0x6119b4611d7b - std[69d51b4813ba037]::panicking::catch_unwind::, core[51d4adbef590f61]::panic::unwind_safe::AssertUnwindSafe> [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/panicking.rs:544:19 [INFO] [stdout] 53: 0x6119b4611d7b - std[69d51b4813ba037]::panic::catch_unwind::, core[51d4adbef590f61]::result::Result<(), alloc[18203fec9a0cd4ec]::string::String>> [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/panic.rs:359:14 [INFO] [stdout] 54: 0x6119b4611d7b - test[8fe65b9e05bf4c74]::run_test_in_process [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/test/src/lib.rs:686:27 [INFO] [stdout] 55: 0x6119b4611d7b - test[8fe65b9e05bf4c74]::run_test::{closure#0} [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/test/src/lib.rs:607:43 [INFO] [stdout] 56: 0x6119b460d494 - test[8fe65b9e05bf4c74]::run_test::{closure#1} [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/test/src/lib.rs:637:41 [INFO] [stdout] 57: 0x6119b460d494 - std[69d51b4813ba037]::sys::backtrace::__rust_begin_short_backtrace:: [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/sys/backtrace.rs:166:18 [INFO] [stdout] 58: 0x6119b4614982 - std[69d51b4813ba037]::thread::lifecycle::spawn_unchecked::::{closure#1}::{closure#0} [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/thread/lifecycle.rs:91:13 [INFO] [stdout] 59: 0x6119b4614982 - ::{closure#1}::{closure#0}> as core[51d4adbef590f61]::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 60: 0x6119b4614982 - std[69d51b4813ba037]::panicking::catch_unwind::do_call::::{closure#1}::{closure#0}>, ()> [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/panicking.rs:581:40 [INFO] [stdout] 61: 0x6119b4614982 - std[69d51b4813ba037]::panicking::catch_unwind::<(), core[51d4adbef590f61]::panic::unwind_safe::AssertUnwindSafe::{closure#1}::{closure#0}>> [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/panicking.rs:544:19 [INFO] [stdout] 62: 0x6119b4614982 - std[69d51b4813ba037]::panic::catch_unwind::::{closure#1}::{closure#0}>, ()> [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/panic.rs:359:14 [INFO] [stdout] 63: 0x6119b4614982 - std[69d51b4813ba037]::thread::lifecycle::spawn_unchecked::::{closure#1} [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/thread/lifecycle.rs:89:26 [INFO] [stdout] 64: 0x6119b4614982 - ::{closure#1} as core[51d4adbef590f61]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0} [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/core/src/ops/function.rs:250:5 [INFO] [stdout] 65: 0x6119b4d9edbf - + core[51d4adbef590f61]::marker::Send> as core[51d4adbef590f61]::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/alloc/src/boxed.rs:2240:9 [INFO] [stdout] 66: 0x6119b4d9edbf - ::new::thread_start [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/sys/thread/unix.rs:118:17 [INFO] [stdout] 67: 0x760260651aa4 - [INFO] [stdout] 68: 0x7602606dea64 - clone [INFO] [stdout] 69: 0x0 - [INFO] [stdout] [INFO] [stdout] ---- many_devices stdout ---- [INFO] [stdout] [INFO] [stdout] thread 'many_devices' (32) panicked at tests/pusher.rs:305:5: [INFO] [stdout] assertion `left == right` failed [INFO] [stdout] left: "" [INFO] [stdout] right: "# TYPE devices_total counter\ndevices_total{otel_scope_name=\"Hedwig\"} 12\n# HELP http_requests_duration_seconds HTTP request duration in seconds\n# TYPE http_requests_duration_seconds histogram\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"0\"} 0\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"5\"} 2\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"10\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"25\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"50\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"75\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"100\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"250\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"500\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"750\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"1000\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"2500\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"5000\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"7500\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"10000\"} 3\nhttp_requests_duration_seconds_bucket{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\",le=\"+Inf\"} 3\nhttp_requests_duration_seconds_sum{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\"} FLOAT\nhttp_requests_duration_seconds_count{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\"} 3\n# HELP http_requests_total Total number of HTTP requests\n# TYPE http_requests_total counter\nhttp_requests_total{endpoint=\"/_matrix/push/v1/notify\",method=\"POST\",status=\"200\",otel_scope_name=\"Hedwig\"} 3\n# TYPE notifications_total counter\nnotifications_total{otel_scope_name=\"Hedwig\"} 3\n# HELP pushes_failed_total Failed pushes\n# TYPE pushes_failed_total counter\npushes_failed_total{device_type=\"AndroidLegacy\",otel_scope_name=\"Hedwig\"} 1\npushes_failed_total{device_type=\"None\",otel_scope_name=\"Hedwig\"} 1\n# HELP pushes_successful_total Successful pushes\n# TYPE pushes_successful_total counter\npushes_successful_total{device_type=\"Android\",otel_scope_name=\"Hedwig\"} 3\npushes_successful_total{device_type=\"AndroidLegacy\",otel_scope_name=\"Hedwig\"} 2\npushes_successful_total{device_type=\"Ios\",otel_scope_name=\"Hedwig\"} 3\npushes_successful_total{device_type=\"None\",otel_scope_name=\"Hedwig\"} 2\n# HELP target_info Target metadata\n# TYPE target_info gauge\ntarget_info{service_name=\"Hedwig\",telemetry_sdk_language=\"rust\",telemetry_sdk_name=\"opentelemetry\",telemetry_sdk_version=\"any\"} 1" [INFO] [stdout] stack backtrace: [INFO] [stdout] 0: 0x6119b4d9f84a - std[69d51b4813ba037]::backtrace_rs::backtrace::libunwind::trace [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9 [INFO] [stdout] 1: 0x6119b4d9f84a - std[69d51b4813ba037]::backtrace_rs::backtrace::trace_unsynchronized:: [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14 [INFO] [stdout] 2: 0x6119b4d9f84a - std[69d51b4813ba037]::sys::backtrace::_print_fmt [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/sys/backtrace.rs:74:9 [INFO] [stdout] 3: 0x6119b4d9f84a - <::print::DisplayBacktrace as core[51d4adbef590f61]::fmt::Display>::fmt [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/sys/backtrace.rs:44:26 [INFO] [stdout] 4: 0x6119b4db6f2a - ::fmt [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/core/src/fmt/rt.rs:152:76 [INFO] [stdout] 5: 0x6119b4db6f2a - core[51d4adbef590f61]::fmt::write [INFO] [stdout] 6: 0x6119b4da4302 - std[69d51b4813ba037]::io::default_write_fmt::> [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/io/mod.rs:639:11 [INFO] [stdout] 7: 0x6119b4da4302 - as std[69d51b4813ba037]::io::Write>::write_fmt [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/io/mod.rs:1994:13 [INFO] [stdout] 8: 0x6119b4d7e22f - ::print [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/sys/backtrace.rs:47:9 [INFO] [stdout] 9: 0x6119b4d7e22f - std[69d51b4813ba037]::panicking::default_hook::{closure#0} [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/panicking.rs:292:27 [INFO] [stdout] 10: 0x6119b4d977f9 - std[69d51b4813ba037]::panicking::default_hook [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/panicking.rs:316:9 [INFO] [stdout] 11: 0x6119b46112ac - core[51d4adbef590f61]::ops::function::Fn<(&'a std[69d51b4813ba037]::panic::PanicHookInfo<'b>,), Output = ()> + core[51d4adbef590f61]::marker::Sync + core[51d4adbef590f61]::marker::Send> as core[51d4adbef590f61]::ops::function::Fn<(&std[69d51b4813ba037]::panic::PanicHookInfo,)>>::call [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/alloc/src/boxed.rs:2254:9 [INFO] [stdout] 12: 0x6119b46112ac - test[8fe65b9e05bf4c74]::test_main_with_exit_callback::::{closure#0} [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/test/src/lib.rs:145:21 [INFO] [stdout] 13: 0x6119b4d97a72 - core[51d4adbef590f61]::ops::function::Fn<(&'a std[69d51b4813ba037]::panic::PanicHookInfo<'b>,), Output = ()> + core[51d4adbef590f61]::marker::Sync + core[51d4adbef590f61]::marker::Send> as core[51d4adbef590f61]::ops::function::Fn<(&std[69d51b4813ba037]::panic::PanicHookInfo,)>>::call [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/alloc/src/boxed.rs:2254:9 [INFO] [stdout] 14: 0x6119b4d97a72 - std[69d51b4813ba037]::panicking::panic_with_hook [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/panicking.rs:833:13 [INFO] [stdout] 15: 0x6119b4d7e2e8 - std[69d51b4813ba037]::panicking::panic_handler::{closure#0} [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/panicking.rs:698:13 [INFO] [stdout] 16: 0x6119b4d75b09 - std[69d51b4813ba037]::sys::backtrace::__rust_end_short_backtrace:: [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/sys/backtrace.rs:182:18 [INFO] [stdout] 17: 0x6119b4d7effd - __rustc[cb16bc19fc993bd7]::rust_begin_unwind [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/panicking.rs:689:5 [INFO] [stdout] 18: 0x6119b4db78bc - core[51d4adbef590f61]::panicking::panic_fmt [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/core/src/panicking.rs:80:14 [INFO] [stdout] 19: 0x6119b4db7743 - core[51d4adbef590f61]::panicking::assert_failed_inner [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/core/src/panicking.rs:439:17 [INFO] [stdout] 20: 0x6119b474db2e - core[51d4adbef590f61]::panicking::assert_failed::<&str, &str> [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/core/src/panicking.rs:394:5 [INFO] [stdout] 21: 0x6119b45c3c5e - pusher[1c3bbb2d7e981c8]::check_prom::{closure#0} [INFO] [stdout] at /opt/rustwide/workdir/tests/pusher.rs:305:2 [INFO] [stdout] 22: 0x6119b45c8398 - pusher[1c3bbb2d7e981c8]::many_devices::{closure#0} [INFO] [stdout] at /opt/rustwide/workdir/tests/pusher.rs:575:64 [INFO] [stdout] 23: 0x6119b45e08ef - >>> as core[51d4adbef590f61]::future::future::Future>::poll [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/core/src/future/future.rs:133:9 [INFO] [stdout] 24: 0x6119b45e09ab - >>>> as core[51d4adbef590f61]::future::future::Future>::poll [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/core/src/future/future.rs:133:9 [INFO] [stdout] 25: 0x6119b460401b - ::block_on::>>>>>::{closure#0}::{closure#0}::{closure#0} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:753:70 [INFO] [stdout] 26: 0x6119b4603e4b - tokio[f3ed3df2856e16bd]::task::coop::with_budget::>>, ::block_on>>>>>::{closure#0}::{closure#0}::{closure#0}> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/task/coop/mod.rs:167:5 [INFO] [stdout] 27: 0x6119b4603e4b - tokio[f3ed3df2856e16bd]::task::coop::budget::>>, ::block_on>>>>>::{closure#0}::{closure#0}::{closure#0}> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/task/coop/mod.rs:133:5 [INFO] [stdout] 28: 0x6119b4603e4b - ::block_on::>>>>>::{closure#0}::{closure#0} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:753:25 [INFO] [stdout] 29: 0x6119b45fe56d - ::enter::>>, ::block_on>>>>>::{closure#0}::{closure#0}> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:442:19 [INFO] [stdout] 30: 0x6119b4602f0d - ::block_on::>>>>>::{closure#0} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:752:44 [INFO] [stdout] 31: 0x6119b460214b - ::enter::<::block_on>>>>>::{closure#0}, core[51d4adbef590f61]::option::Option>>>::{closure#0} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:840:68 [INFO] [stdout] 32: 0x6119b45f90da - >::set::<::enter<::block_on>>>>>::{closure#0}, core[51d4adbef590f61]::option::Option>>>::{closure#0}, (alloc[18203fec9a0cd4ec]::boxed::Box, core[51d4adbef590f61]::option::Option>>)> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/context/scoped.rs:40:9 [INFO] [stdout] 33: 0x6119b45f9d3a - tokio[f3ed3df2856e16bd]::runtime::context::set_scheduler::<(alloc[18203fec9a0cd4ec]::boxed::Box, core[51d4adbef590f61]::option::Option>>), ::enter<::block_on>>>>>::{closure#0}, core[51d4adbef590f61]::option::Option>>>::{closure#0}>::{closure#0} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/context.rs:176:38 [INFO] [stdout] 34: 0x6119b45e1de5 - >::try_with::, core[51d4adbef590f61]::option::Option>>), ::enter<::block_on>>>>>::{closure#0}, core[51d4adbef590f61]::option::Option>>>::{closure#0}>::{closure#0}, (alloc[18203fec9a0cd4ec]::boxed::Box, core[51d4adbef590f61]::option::Option>>)> [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/thread/local.rs:513:12 [INFO] [stdout] 35: 0x6119b45e191d - >::with::, core[51d4adbef590f61]::option::Option>>), ::enter<::block_on>>>>>::{closure#0}, core[51d4adbef590f61]::option::Option>>>::{closure#0}>::{closure#0}, (alloc[18203fec9a0cd4ec]::boxed::Box, core[51d4adbef590f61]::option::Option>>)> [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/thread/local.rs:477:20 [INFO] [stdout] 36: 0x6119b45f95b1 - tokio[f3ed3df2856e16bd]::runtime::context::set_scheduler::<(alloc[18203fec9a0cd4ec]::boxed::Box, core[51d4adbef590f61]::option::Option>>), ::enter<::block_on>>>>>::{closure#0}, core[51d4adbef590f61]::option::Option>>>::{closure#0}> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/context.rs:176:17 [INFO] [stdout] 37: 0x6119b460083e - ::enter::<::block_on>>>>>::{closure#0}, core[51d4adbef590f61]::option::Option>>> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:840:27 [INFO] [stdout] 38: 0x6119b4600b8e - ::block_on::>>>>> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:740:24 [INFO] [stdout] 39: 0x6119b4601b76 - ::block_on::>>>>::{closure#0} [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:200:33 [INFO] [stdout] 40: 0x6119b45edc5f - tokio[f3ed3df2856e16bd]::runtime::context::runtime::enter_runtime::<::block_on>>>>::{closure#0}, core[51d4adbef590f61]::result::Result<(), alloc[18203fec9a0cd4ec]::boxed::Box>> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/context/runtime.rs:65:16 [INFO] [stdout] 41: 0x6119b45fded7 - ::block_on::>>>> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/scheduler/current_thread/mod.rs:188:9 [INFO] [stdout] 42: 0x6119b45dd910 - ::block_on_inner::>>>> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/runtime.rs:368:52 [INFO] [stdout] 43: 0x6119b45ddb39 - ::block_on::>>>> [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.49.0/src/runtime/runtime.rs:342:18 [INFO] [stdout] 44: 0x6119b45d85e4 - pusher[1c3bbb2d7e981c8]::many_devices [INFO] [stdout] at /opt/rustwide/workdir/tests/pusher.rs:577:4 [INFO] [stdout] 45: 0x6119b45c4887 - pusher[1c3bbb2d7e981c8]::many_devices::{closure#0} [INFO] [stdout] at /opt/rustwide/workdir/tests/pusher.rs:534:28 [INFO] [stdout] 46: 0x6119b45dc6e6 - >::call_once [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/core/src/ops/function.rs:250:5 [INFO] [stdout] 47: 0x6119b460538b - core[51d4adbef590f61]::result::Result<(), alloc[18203fec9a0cd4ec]::string::String> as core[51d4adbef590f61]::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/core/src/ops/function.rs:250:5 [INFO] [stdout] 48: 0x6119b460538b - test[8fe65b9e05bf4c74]::__rust_begin_short_backtrace::, fn() -> core[51d4adbef590f61]::result::Result<(), alloc[18203fec9a0cd4ec]::string::String>> [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/test/src/lib.rs:663:18 [INFO] [stdout] 49: 0x6119b4611d7b - test[8fe65b9e05bf4c74]::run_test_in_process::{closure#0} [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/test/src/lib.rs:686:74 [INFO] [stdout] 50: 0x6119b4611d7b - as core[51d4adbef590f61]::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 51: 0x6119b4611d7b - std[69d51b4813ba037]::panicking::catch_unwind::do_call::, core[51d4adbef590f61]::result::Result<(), alloc[18203fec9a0cd4ec]::string::String>> [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/panicking.rs:581:40 [INFO] [stdout] 52: 0x6119b4611d7b - std[69d51b4813ba037]::panicking::catch_unwind::, core[51d4adbef590f61]::panic::unwind_safe::AssertUnwindSafe> [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/panicking.rs:544:19 [INFO] [stdout] 53: 0x6119b4611d7b - std[69d51b4813ba037]::panic::catch_unwind::, core[51d4adbef590f61]::result::Result<(), alloc[18203fec9a0cd4ec]::string::String>> [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/panic.rs:359:14 [INFO] [stdout] 54: 0x6119b4611d7b - test[8fe65b9e05bf4c74]::run_test_in_process [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/test/src/lib.rs:686:27 [INFO] [stdout] 55: 0x6119b4611d7b - test[8fe65b9e05bf4c74]::run_test::{closure#0} [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/test/src/lib.rs:607:43 [INFO] [stdout] 56: 0x6119b460d494 - test[8fe65b9e05bf4c74]::run_test::{closure#1} [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/test/src/lib.rs:637:41 [INFO] [stdout] 57: 0x6119b460d494 - std[69d51b4813ba037]::sys::backtrace::__rust_begin_short_backtrace:: [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/sys/backtrace.rs:166:18 [INFO] [stdout] 58: 0x6119b4614982 - std[69d51b4813ba037]::thread::lifecycle::spawn_unchecked::::{closure#1}::{closure#0} [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/thread/lifecycle.rs:91:13 [INFO] [stdout] 59: 0x6119b4614982 - ::{closure#1}::{closure#0}> as core[51d4adbef590f61]::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 60: 0x6119b4614982 - std[69d51b4813ba037]::panicking::catch_unwind::do_call::::{closure#1}::{closure#0}>, ()> [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/panicking.rs:581:40 [INFO] [stdout] 61: 0x6119b4614982 - std[69d51b4813ba037]::panicking::catch_unwind::<(), core[51d4adbef590f61]::panic::unwind_safe::AssertUnwindSafe::{closure#1}::{closure#0}>> [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/panicking.rs:544:19 [INFO] [stdout] 62: 0x6119b4614982 - std[69d51b4813ba037]::panic::catch_unwind::::{closure#1}::{closure#0}>, ()> [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/panic.rs:359:14 [INFO] [stdout] 63: 0x6119b4614982 - std[69d51b4813ba037]::thread::lifecycle::spawn_unchecked::::{closure#1} [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/thread/lifecycle.rs:89:26 [INFO] [stdout] 64: 0x6119b4614982 - ::{closure#1} as core[51d4adbef590f61]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0} [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/core/src/ops/function.rs:250:5 [INFO] [stdout] 65: 0x6119b4d9edbf - + core[51d4adbef590f61]::marker::Send> as core[51d4adbef590f61]::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/alloc/src/boxed.rs:2240:9 [INFO] [stdout] 66: 0x6119b4d9edbf - ::new::thread_start [INFO] [stdout] at /rustc/d933cf483edf1605142ac6899ff32536c0ad8b22/library/std/src/sys/thread/unix.rs:118:17 [INFO] [stdout] 67: 0x760260651aa4 - [INFO] [stdout] 68: 0x7602606dea64 - clone [INFO] [stdout] 69: 0x0 - [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] failures: [INFO] [stdout] many_devices [INFO] [stdout] normal_operation [INFO] [stdout] [INFO] [stdout] test result: FAILED. 7 passed; 2 failed; 0 ignored; 0 measured; 0 filtered out; finished in 7.56s [INFO] [stdout] [INFO] [stderr] error: test failed, to rerun pass `--test pusher` [INFO] running `Command { std: "docker" "inspect" "56a1ead05f5f47cb138c5ab2cb0133566d8500da0af3c47d761f88bd7709cb3d", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "56a1ead05f5f47cb138c5ab2cb0133566d8500da0af3c47d761f88bd7709cb3d", kill_on_drop: false }` [INFO] [stdout] 56a1ead05f5f47cb138c5ab2cb0133566d8500da0af3c47d761f88bd7709cb3d