[INFO] fetching crate prodex 0.2.64...
[INFO] testing prodex-0.2.64 against try#0abe69e6c16114311cc2700e972492e64d69c28f for pr-154065-1
[INFO] extracting crate prodex 0.2.64 into /workspace/builds/worker-5-tc2/source
[INFO] started tweaking crates.io crate prodex 0.2.64
[INFO] removed 0 missing tests
[INFO] finished tweaking crates.io crate prodex 0.2.64
[INFO] tweaked toml for crates.io crate prodex 0.2.64 written to /workspace/builds/worker-5-tc2/source/Cargo.toml
[INFO] validating manifest of crates.io crate prodex 0.2.64 on toolchain 0abe69e6c16114311cc2700e972492e64d69c28f
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+0abe69e6c16114311cc2700e972492e64d69c28f" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] crate crates.io crate prodex 0.2.64 already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+0abe69e6c16114311cc2700e972492e64d69c28f" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+0abe69e6c16114311cc2700e972492e64d69c28f" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] [stdout] 3b4e55e9cfc02219ba87e1827d211750ac908da48b8e0c768e7467da25173374
[INFO] running `Command { std: "docker" "start" "-a" "3b4e55e9cfc02219ba87e1827d211750ac908da48b8e0c768e7467da25173374", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "3b4e55e9cfc02219ba87e1827d211750ac908da48b8e0c768e7467da25173374", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "3b4e55e9cfc02219ba87e1827d211750ac908da48b8e0c768e7467da25173374", kill_on_drop: false }`
[INFO] [stdout] 3b4e55e9cfc02219ba87e1827d211750ac908da48b8e0c768e7467da25173374
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+0abe69e6c16114311cc2700e972492e64d69c28f" "build" "--frozen" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] c9404f999de3fd351ab4914c5bc504796547bf4a5c50cc8a14376a58c4d99deb
[INFO] running `Command { std: "docker" "start" "-a" "c9404f999de3fd351ab4914c5bc504796547bf4a5c50cc8a14376a58c4d99deb", kill_on_drop: false }`
[INFO] [stderr]    Compiling find-msvc-tools v0.1.9
[INFO] [stderr]    Compiling fs_extra v1.3.0
[INFO] [stderr]    Compiling dunce v1.0.5
[INFO] [stderr]    Compiling bytes v1.11.1
[INFO] [stderr]    Compiling pin-project-lite v0.2.17
[INFO] [stderr]    Compiling itoa v1.0.18
[INFO] [stderr]    Compiling futures-core v0.3.32
[INFO] [stderr]    Compiling aws-lc-rs v1.16.2
[INFO] [stderr]    Compiling once_cell v1.21.4
[INFO] [stderr]    Compiling rustls-pki-types v1.14.0
[INFO] [stderr]    Compiling futures-sink v0.3.32
[INFO] [stderr]    Compiling jobserver v0.1.34
[INFO] [stderr]    Compiling socket2 v0.6.3
[INFO] [stderr]    Compiling mio v1.1.1
[INFO] [stderr]    Compiling syn v2.0.117
[INFO] [stderr]    Compiling memchr v2.8.0
[INFO] [stderr]    Compiling rustls v0.23.37
[INFO] [stderr]    Compiling untrusted v0.9.0
[INFO] [stderr]    Compiling futures-io v0.3.32
[INFO] [stderr]    Compiling slab v0.4.12
[INFO] [stderr]    Compiling futures-task v0.3.32
[INFO] [stderr]    Compiling zerocopy v0.8.47
[INFO] [stderr]    Compiling getrandom v0.3.4
[INFO] [stderr]    Compiling futures-channel v0.3.32
[INFO] [stderr]    Compiling openssl-probe v0.2.1
[INFO] [stderr]    Compiling zmij v1.0.21
[INFO] [stderr]    Compiling cc v1.2.57
[INFO] [stderr]    Compiling tracing-core v0.1.36
[INFO] [stderr]    Compiling rand_core v0.9.5
[INFO] [stderr]    Compiling rustls-native-certs v0.8.3
[INFO] [stderr]    Compiling num-traits v0.2.19
[INFO] [stderr]    Compiling anstyle-parse v1.0.0
[INFO] [stderr]    Compiling form_urlencoded v1.2.2
[INFO] [stderr]    Compiling sync_wrapper v1.0.2
[INFO] [stderr]    Compiling anstyle v1.0.14
[INFO] [stderr]    Compiling serde_json v1.0.149
[INFO] [stderr]    Compiling colorchoice v1.0.5
[INFO] [stderr]    Compiling ipnet v2.12.0
[INFO] [stderr]    Compiling thiserror v2.0.18
[INFO] [stderr]    Compiling digest v0.10.7
[INFO] [stderr]    Compiling clap_lex v1.1.0
[INFO] [stderr]    Compiling bitflags v2.11.0
[INFO] [stderr]    Compiling anyhow v1.0.102
[INFO] [stderr]    Compiling futures-util v0.3.32
[INFO] [stderr]    Compiling iri-string v0.7.11
[INFO] [stderr]    Compiling sha1 v0.10.6
[INFO] [stderr]    Compiling anstream v1.0.0
[INFO] [stderr]    Compiling http v1.4.0
[INFO] [stderr]    Compiling tokio v1.50.0
[INFO] [stderr]    Compiling tracing v0.1.44
[INFO] [stderr]    Compiling dirs-sys v0.5.0
[INFO] [stderr]    Compiling chunked_transfer v1.5.0
[INFO] [stderr]    Compiling httpdate v1.0.3
[INFO] [stderr]    Compiling clap_builder v4.6.0
[INFO] [stderr]    Compiling ascii v1.1.0
[INFO] [stderr]    Compiling iana-time-zone v0.1.65
[INFO] [stderr]    Compiling data-encoding v2.10.0
[INFO] [stderr]    Compiling dirs v6.0.0
[INFO] [stderr]    Compiling fs2 v0.4.3
[INFO] [stderr]    Compiling tiny_http v0.12.0
[INFO] [stderr]    Compiling http-body v1.0.1
[INFO] [stderr]    Compiling http-body-util v0.1.3
[INFO] [stderr]    Compiling chrono v0.4.44
[INFO] [stderr]    Compiling cmake v0.1.57
[INFO] [stderr]    Compiling aws-lc-sys v0.39.0
[INFO] [stderr]    Compiling synstructure v0.13.2
[INFO] [stderr]    Compiling zerofrom-derive v0.1.6
[INFO] [stderr]    Compiling yoke-derive v0.8.1
[INFO] [stderr]    Compiling zerovec-derive v0.11.2
[INFO] [stderr]    Compiling displaydoc v0.2.5
[INFO] [stderr]    Compiling thiserror-impl v2.0.18
[INFO] [stderr]    Compiling serde_derive v1.0.228
[INFO] [stderr]    Compiling clap_derive v4.6.0
[INFO] [stderr]    Compiling zerofrom v0.1.6
[INFO] [stderr]    Compiling hyper v1.8.1
[INFO] [stderr]    Compiling tower v0.5.3
[INFO] [stderr]    Compiling yoke v0.8.1
[INFO] [stderr]    Compiling zerovec v0.11.5
[INFO] [stderr]    Compiling zerotrie v0.2.3
[INFO] [stderr]    Compiling tinystr v0.8.2
[INFO] [stderr]    Compiling potential_utf v0.1.4
[INFO] [stderr]    Compiling hyper-util v0.1.20
[INFO] [stderr]    Compiling tower-http v0.6.8
[INFO] [stderr]    Compiling icu_locale_core v2.1.1
[INFO] [stderr]    Compiling icu_collections v2.1.1
[INFO] [stderr]    Compiling ppv-lite86 v0.2.21
[INFO] [stderr]    Compiling rand_chacha v0.9.0
[INFO] [stderr]    Compiling serde v1.0.228
[INFO] [stderr]    Compiling clap v4.6.0
[INFO] [stderr]    Compiling rand v0.9.2
[INFO] [stderr]    Compiling icu_provider v2.1.1
[INFO] [stderr]    Compiling icu_normalizer v2.1.1
[INFO] [stderr]    Compiling icu_properties v2.1.2
[INFO] [stderr]    Compiling idna_adapter v1.2.1
[INFO] [stderr]    Compiling idna v1.1.0
[INFO] [stderr]    Compiling url v2.5.8
[INFO] [stderr]    Compiling rustls-webpki v0.103.10
[INFO] [stderr]    Compiling tokio-rustls v0.26.4
[INFO] [stderr]    Compiling rustls-platform-verifier v0.6.2
[INFO] [stderr]    Compiling tungstenite v0.29.0
[INFO] [stderr]    Compiling hyper-rustls v0.27.7
[INFO] [stderr]    Compiling reqwest v0.13.2
[INFO] [stderr]    Compiling prodex v0.2.64 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `dev` profile [unoptimized + debuginfo] target(s) in 1m 05s
[INFO] running `Command { std: "docker" "inspect" "c9404f999de3fd351ab4914c5bc504796547bf4a5c50cc8a14376a58c4d99deb", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "c9404f999de3fd351ab4914c5bc504796547bf4a5c50cc8a14376a58c4d99deb", kill_on_drop: false }`
[INFO] [stdout] c9404f999de3fd351ab4914c5bc504796547bf4a5c50cc8a14376a58c4d99deb
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+0abe69e6c16114311cc2700e972492e64d69c28f" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] 339507d694e68d71f0093aa55bbf8825084b6734edae3941f22ab2cafe25efe7
[INFO] running `Command { std: "docker" "start" "-a" "339507d694e68d71f0093aa55bbf8825084b6734edae3941f22ab2cafe25efe7", kill_on_drop: false }`
[INFO] [stderr]    Compiling prodex v0.2.64 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 10.54s
[INFO] running `Command { std: "docker" "inspect" "339507d694e68d71f0093aa55bbf8825084b6734edae3941f22ab2cafe25efe7", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "339507d694e68d71f0093aa55bbf8825084b6734edae3941f22ab2cafe25efe7", kill_on_drop: false }`
[INFO] [stdout] 339507d694e68d71f0093aa55bbf8825084b6734edae3941f22ab2cafe25efe7
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+0abe69e6c16114311cc2700e972492e64d69c28f" "test" "--frozen", kill_on_drop: false }`
[INFO] [stdout] eece6d4cb283998c8025f377e0ac51aaf58def10af4401168c3edb96730e9925
[INFO] running `Command { std: "docker" "start" "-a" "eece6d4cb283998c8025f377e0ac51aaf58def10af4401168c3edb96730e9925", kill_on_drop: false }`
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 0.20s
[INFO] [stderr]      Running unittests src/main.rs (/opt/rustwide/target/debug/deps/prodex-3d831c889dc8b709)
[INFO] [stdout] 
[INFO] [stdout] running 5 tests
[INFO] [stdout] test update_notice_tests::normalize_run_codex_args_keeps_regular_prompt_intact ... ok
[INFO] [stdout] test update_notice_tests::normalize_run_codex_args_rewrites_session_id_to_resume ... ok
[INFO] [stdout] test update_notice_tests::update_check_cache_ttl_is_short_when_cached_version_matches_current ... ok
[INFO] [stdout] test update_notice_tests::update_notice_is_suppressed_for_machine_output_modes ... ok
[INFO] [stdout] test update_notice_tests::version_is_newer_compares_semver_like_versions ... ok
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 5 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
[INFO] [stdout] 
[INFO] [stderr]      Running tests/auto_rotate.rs (/opt/rustwide/target/debug/deps/auto_rotate-f1416bf1bd80d179)
[INFO] [stdout] 
[INFO] [stdout] running 15 tests
[INFO] [stdout] test quota_raw_uses_builtin_usage_client ... ok
[INFO] [stdout] test login_without_profile_uses_auth_email_before_quota_lookup ... ok
[INFO] [stdout] test login_without_profile_creates_profile_from_email ... ok
[INFO] [stdout] test login_without_profile_adds_suffix_when_email_name_is_taken ... ok
[INFO] [stdout] test doctor_quota_checks_profiles_in_parallel ... ok
[INFO] [stdout] test quota_all_detail_shows_main_reset_times ... ok
[INFO] [stdout] test quota_all_detail_sorts_by_status_then_nearest_main_reset ... ok
[INFO] [stdout] test run_auto_rotates_active_profile_when_current_is_blocked ... ok
[INFO] [stdout] test login_without_profile_reuses_existing_profile_for_same_email ... ok
[INFO] [stdout] test run_preflight_checks_fallback_profiles_in_parallel ... ok
[INFO] [stdout] test run_without_profile_selects_the_best_ready_account ... ok
[INFO] [stdout] test explicit_profile_can_disable_auto_rotate ... ok
[INFO] [stdout] test run_shares_resume_history_across_managed_profiles ... ok
[INFO] [stdout] test explicit_profile_auto_rotates_by_default ... ok
[INFO] [stdout] test login_without_profile_looks_up_existing_profiles_in_parallel ... ok
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 15 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.91s
[INFO] [stdout] 
[INFO] [stderr]      Running tests/main_internal.rs (/opt/rustwide/target/debug/deps/main_internal-055e8a3f34ea2fa3)
[INFO] [stdout] 
[INFO] [stdout] running 153 tests
[INFO] [stdout] test prodex_impl::tests::all_quota_watch_output_preserves_updated_on_load_error ... ok
[INFO] [stdout] test prodex_impl::tests::backend_api_base_url_maps_to_wham_usage ... ok
[INFO] [stdout] test prodex_impl::tests::app_state_load_compacts_stale_entries_in_memory ... ok
[INFO] [stdout] test prodex_impl::tests::app_state_housekeeping_prunes_stale_entries_on_save ... ok
[INFO] [stdout] test prodex_impl::tests::blocks_when_weekly_window_is_missing ... ok
[INFO] [stdout] test prodex_impl::tests::blocks_when_main_window_is_exhausted ... ok
[INFO] [stdout] test prodex_impl::tests::compact_window_format_uses_scale_of_100 ... ok
[INFO] [stdout] test prodex_impl::tests::custom_base_url_maps_to_codex_usage ... ok
[INFO] [stdout] test prodex_impl::tests::app_state_load_uses_last_good_backup_when_primary_is_invalid ... ok
[INFO] [stdout] test prodex_impl::tests::app_state_save_merges_existing_runtime_bindings ... ok
[INFO] [stdout] test prodex_impl::tests::field_lines_do_not_exceed_cli_width ... ok
[INFO] [stdout] test prodex_impl::tests::field_lines_respect_requested_width ... ok
[INFO] [stdout] test prodex_impl::tests::collect_orphan_managed_profile_dirs_ignores_tracked_and_fresh_dirs ... ok
[INFO] [stdout] test prodex_impl::tests::main_reset_summary_lists_required_windows ... ok
[INFO] [stdout] test prodex_impl::tests::main_reset_summary_marks_missing_required_window ... ok
[INFO] [stdout] test prodex_impl::tests::map_parallel_runs_jobs_concurrently_and_preserves_order ... ok
[INFO] [stdout] test prodex_impl::tests::merge_runtime_usage_snapshots_keeps_newer_entries ... ok
[INFO] [stdout] test prodex_impl::tests::commit_runtime_proxy_profile_selection_recovers_only_matching_route_profile_health ... ok
[INFO] [stdout] test prodex_impl::tests::attempt_runtime_standard_request_skips_exhausted_profile_before_send ... ok
[INFO] [stdout] test prodex_impl::tests::affinity_candidate_skips_persisted_exhausted_session_owner ... ok
[INFO] [stdout] test prodex_impl::tests::commit_runtime_proxy_profile_selection_clears_matching_route_bad_pairing ... ok
[INFO] [stdout] test prodex_impl::tests::direct_current_fallback_profile_is_route_aware_for_heavy_routes ... ok
[INFO] [stdout] test prodex_impl::tests::commit_runtime_proxy_profile_selection_skips_persist_when_nothing_changed ... ok
[INFO] [stdout] test prodex_impl::tests::acquire_runtime_profile_inflight_guard_uses_weighted_units ... ok
[INFO] [stdout] test prodex_impl::tests::attempt_runtime_responses_request_skips_exhausted_profile_before_send ... ok
[INFO] [stdout] test prodex_impl::tests::compact_health_penalty_does_not_degrade_responses_selection ... ok
[INFO] [stdout] test prodex_impl::tests::compact_bad_pairing_does_not_degrade_responses_selection ... ok
[INFO] [stdout] test prodex_impl::tests::commit_runtime_proxy_profile_selection_accelerates_recovery_after_success_streak ... ok
[INFO] [stdout] test prodex_impl::tests::direct_current_fallback_profile_bypasses_local_selection_penalties ... ok
[INFO] [stdout] test prodex_impl::tests::next_runtime_response_candidate_falls_back_to_soonest_transport_recovery ... ok
[INFO] [stdout] test prodex_impl::tests::exhausted_usage_snapshot_releases_persisted_affinity_bindings ... ok
[INFO] [stdout] test prodex_impl::tests::parses_email_from_chatgpt_id_token ... ok
[INFO] [stdout] test prodex_impl::tests::precommit_budget_exhausts_by_attempt_limit_or_elapsed_time ... ok
[INFO] [stdout] test prodex_impl::tests::local_proxy_overload_backoff_activates_and_expires ... ok
[INFO] [stdout] test prodex_impl::tests::commit_runtime_proxy_profile_selection_clears_profile_health ... ok
[INFO] [stdout] test prodex_impl::tests::next_runtime_response_candidate_prefers_lower_latency_penalty ... ok
[INFO] [stdout] test prodex_impl::tests::profile_name_is_derived_from_email ... ok
[INFO] [stdout] test prodex_impl::tests::profile_quota_watch_output_contains_header_and_snapshot_body ... ok
[INFO] [stdout] test prodex_impl::tests::quota_command_accepts_once_flag ... ok
[INFO] [stdout] test prodex_impl::tests::quota_overview_sort_prioritizes_status_then_nearest_reset ... ok
[INFO] [stdout] test prodex_impl::tests::quota_reports_fit_requested_width_in_narrow_layout ... ok
[INFO] [stdout] test prodex_impl::tests::quota_reports_respect_line_budget_while_preserving_sort_order ... ok
[INFO] [stdout] test prodex_impl::tests::optimistic_current_candidate_skips_busy_profile ... ok
[INFO] [stdout] test prodex_impl::tests::quota_watch_defaults_to_live_refresh_for_regular_views ... ok
[INFO] [stdout] test prodex_impl::tests::quota_watch_respects_once_and_raw_modes ... ok
[INFO] [stdout] test prodex_impl::tests::ready_profile_ranking_prefers_larger_reserve_when_resets_match ... ok
[INFO] [stdout] test prodex_impl::tests::ready_profile_ranking_prefers_soon_recovering_weekly_capacity ... ok
[INFO] [stdout] test prodex_impl::tests::ready_profile_candidates_use_persisted_snapshot_when_probe_is_unavailable ... ok
[INFO] [stdout] test prodex_impl::tests::next_runtime_response_candidate_prefers_healthier_profile ... ok
[INFO] [stdout] test prodex_impl::tests::remove_profile_deletes_managed_home_by_default ... ok
[INFO] [stdout] test prodex_impl::tests::next_runtime_response_candidate_prefers_less_loaded_profile ... ok
[INFO] [stdout] test prodex_impl::tests::rotates_profiles_after_current_profile ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_doctor_collect_summary_reports_route_circuit_diagnosis ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_doctor_detects_upstream_without_local_chunk_in_sampled_tail ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_doctor_json_value_includes_selection_markers ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_doctor_state_collects_persisted_degradation_and_orphans ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_doctor_summary_counts_recent_runtime_markers ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_fault_injection_consumes_budget ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_log_housekeeping_prunes_old_logs_and_stale_pointer ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_probe_cache_freshness_distinguishes_fresh_stale_and_expired ... ok
[INFO] [stdout] test prodex_impl::tests::next_runtime_response_candidate_prefers_healthier_quota_window_mix ... ok
[INFO] [stdout] test prodex_impl::tests::optimistic_current_candidate_skips_cached_usage_exhausted_profile ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_profile_inflight_weight_prioritizes_long_lived_routes ... ok
[INFO] [stdout] test prodex_impl::tests::recognizes_known_windows ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_profile_transport_health_penalty_weights_connect_failures_higher ... ok
[INFO] [stdout] test prodex_impl::tests::optimistic_current_candidate_skips_persisted_exhausted_snapshot ... ok
[INFO] [stdout] test prodex_impl::tests::previous_response_owner_discovery_ignores_retry_backoff ... ok
[INFO] [stdout] test prodex_impl::tests::next_runtime_response_candidate_skips_transport_backoff_when_alternative_is_ready ... ok
[INFO] [stdout] test prodex_impl::tests::optimistic_current_candidate_skips_open_route_circuit ... ok
[INFO] [stdout] test prodex_impl::tests::optimistic_current_candidate_skips_transport_backoff ... ok
[INFO] [stdout] test prodex_impl::tests::previous_response_affinity_release_requires_repeated_not_found ... ok
[INFO] [stdout] test prodex_impl::tests::previous_response_discovery_skips_exhausted_current_profile ... ok
[INFO] [stdout] test prodex_impl::tests::optimistic_current_candidate_skips_thin_long_lived_quota ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_profile_selection_jitter_is_deterministic_for_same_sequence ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_profile_inflight_hard_limit_uses_weighted_admission_cost ... ok
[INFO] [stdout] test prodex_impl::tests::response_affinity_skips_recent_negative_cache_for_same_route ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_active_request_wait_recovers_after_short_burst ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_injects_codex_backend_overrides ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_active_request_limit_is_enforced_and_released ... ok
[INFO] [stdout] test prodex_impl::tests::optimistic_current_candidate_skips_recently_unhealthy_profile ... ok
[INFO] [stdout] test prodex_impl::tests::reserve_runtime_profile_route_circuit_half_open_probe_is_single_flight ... ok
[INFO] [stdout] test prodex_impl::tests::response_affinity_touch_persists_recent_use_for_housekeeping ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_absorbs_brief_long_lived_queue_burst ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_maps_openai_prefix_to_upstream_backend_api ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_profile_inflight_hard_limit_detects_saturation ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_logs_local_writer_disconnect_after_first_chunk ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_discovers_previous_response_owner_without_saved_binding_websocket ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_lane_limit_is_enforced_without_blocking_other_lanes ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_discovers_previous_response_owner_without_saved_binding_http ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_falls_back_to_fresh_request_when_previous_response_missing_everywhere_websocket ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_passes_through_upstream_http_error_response ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxies_bind_distinct_local_ports ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_falls_back_to_fresh_request_when_previous_response_missing_everywhere_http ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_pressure_mode_shrinks_precommit_budget ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_does_not_fresh_fallback_function_call_output_requests ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_preserves_codex_headers_on_websocket_responses_request ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_passes_through_upstream_websocket_error_payload ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_passes_through_plain_429_without_rotating_profiles ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_keeps_previous_response_affinity_for_websocket_requests ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_preserves_codex_headers_on_http_responses_request ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_keeps_previous_response_affinity_for_http_requests ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_keeps_healthy_long_http_stream_alive ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_preserves_websocket_headers_and_payload_metadata ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_preserves_websocket_request_client_metadata_payload ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_releases_stale_previous_response_binding_after_not_found_http ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_persists_session_affinity_across_restart_for_compact ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_retries_previous_response_with_upstream_turn_state_websocket ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_reloads_auth_json_between_http_requests ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_persists_previous_response_affinity_across_restart ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_quota_summary_distinguishes_window_health ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_request_detects_function_call_output_payloads ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_sidecar_housekeeping_prunes_stale_entries ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_retries_previous_response_with_upstream_turn_state_http ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_state_save_debounce_only_applies_to_binding_updates ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_releases_quota_blocked_session_affinity_and_rotates ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_state_snapshot_save_preserves_concurrent_profiles ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_state_snapshot_save_returns_error_on_injected_failure ... ok
[INFO] [stdout] test prodex_impl::tests::scheduler_allows_switch_when_preferred_profile_is_in_cooldown ... ok
[INFO] [stdout] test prodex_impl::tests::scheduler_keeps_preferred_profile_when_gain_is_small ... ok
[INFO] [stdout] test prodex_impl::tests::scheduler_prefers_rested_profile_within_near_optimal_band ... ok
[INFO] [stdout] test prodex_impl::tests::section_headers_expand_to_requested_width ... ok
[INFO] [stdout] test prodex_impl::tests::section_headers_use_cli_width ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_retries_usage_limited_response_on_another_profile ... ok
[INFO] [stdout] test prodex_impl::tests::session_affinity_prefers_bound_profile_for_compact_requests ... ok
[INFO] [stdout] test prodex_impl::tests::stale_login_dir_housekeeping_removes_old_temp_login_homes ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_state_save_scheduler_persists_latest_snapshot ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_sheds_long_lived_queue_overload_fast ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_uses_current_profile_without_runtime_quota_probe ... ok
[INFO] [stdout] test prodex_impl::tests::unique_profile_name_adds_numeric_suffix ... ok
[INFO] [stdout] test prodex_impl::tests::unique_profile_name_reclaims_untracked_managed_directory ... ok
[INFO] [stdout] test prodex_impl::tests::usage_response_accepts_null_additional_rate_limits ... ok
[INFO] [stdout] test prodex_impl::tests::validates_profile_names ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_sse_tap_reader_keeps_response_affinity_when_prelude_splits_event ... ok
[INFO] [stdout] test prodex_impl::update_notice_tests::normalize_run_codex_args_keeps_regular_prompt_intact ... ok
[INFO] [stdout] test prodex_impl::update_notice_tests::normalize_run_codex_args_rewrites_session_id_to_resume ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_returns_503_for_local_candidate_exhaustion_without_upstream_429 ... ok
[INFO] [stdout] test prodex_impl::update_notice_tests::update_notice_is_suppressed_for_machine_output_modes ... ok
[INFO] [stdout] test prodex_impl::update_notice_tests::version_is_newer_compares_semver_like_versions ... ok
[INFO] [stdout] test prodex_impl::tests::turn_state_affinity_prefers_bound_profile ... ok
[INFO] [stdout] test prodex_impl::tests::transport_backoff_escalates_for_repeated_failures ... ok
[INFO] [stdout] test prodex_impl::tests::startup_audit_prunes_stale_sidecars_for_missing_managed_profile ... ok
[INFO] [stdout] test prodex_impl::update_notice_tests::update_check_cache_ttl_is_short_when_cached_version_matches_current ... ok
[INFO] [stdout] test prodex_impl::tests::turn_state_affinity_ignores_inflight_and_health_penalties ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_retries_overloaded_compact_on_another_profile ... ok
[INFO] [stdout] test prodex_impl::tests::websocket_bad_pairing_lightly_degrades_responses_selection ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_retries_quota_blocked_response_on_another_profile ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_websocket_rotates_on_upstream_websocket_quota_error ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_reuses_rotated_profile_without_reprobing_quota ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_websocket_surfaces_mid_turn_close_without_post_commit_rotate ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_aborts_stalled_http_fallback_before_long_hang ... ok
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_retries_after_websocket_reuse_silent_hang ... FAILED
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_does_not_rotate_after_first_sse_chunk_reset ... FAILED
[INFO] [stdout] test prodex_impl::tests::runtime_proxy_does_not_rotate_after_multi_chunk_sse_stall ... FAILED
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout] 
[INFO] [stdout] ---- prodex_impl::tests::runtime_proxy_retries_after_websocket_reuse_silent_hang stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'prodex_impl::tests::runtime_proxy_retries_after_websocket_reuse_silent_hang' (1650) panicked at tests/support/main_internal_body.rs:9710:5:
[INFO] [stdout] runtime log should capture websocket reuse watchdog
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x5e3bd3883c7a - std[ec4e911328de40a6]::backtrace_rs::backtrace::libunwind::trace
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9
[INFO] [stdout]    1:     0x5e3bd3883c7a - std[ec4e911328de40a6]::backtrace_rs::backtrace::trace_unsynchronized::<std[ec4e911328de40a6]::sys::backtrace::_print_fmt::{closure#1}>
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14
[INFO] [stdout]    2:     0x5e3bd3883c7a - std[ec4e911328de40a6]::sys::backtrace::_print_fmt
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/sys/backtrace.rs:74:9
[INFO] [stdout]    3:     0x5e3bd3883c7a - <<std[ec4e911328de40a6]::sys::backtrace::BacktraceLock>::print::DisplayBacktrace as core[a96a4c5c53f902a3]::fmt::Display>::fmt
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/sys/backtrace.rs:44:26
[INFO] [stdout]    4:     0x5e3bd389b98a - <core[a96a4c5c53f902a3]::fmt::rt::Argument>::fmt
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/fmt/rt.rs:152:76
[INFO] [stdout]    5:     0x5e3bd389b98a - core[a96a4c5c53f902a3]::fmt::write
[INFO] [stdout]    6:     0x5e3bd38897c2 - std[ec4e911328de40a6]::io::default_write_fmt::<alloc[c960326de6de28e6]::vec::Vec<u8>>
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/io/mod.rs:639:11
[INFO] [stdout]    7:     0x5e3bd38897c2 - <alloc[c960326de6de28e6]::vec::Vec<u8> as std[ec4e911328de40a6]::io::Write>::write_fmt
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/io/mod.rs:1994:13
[INFO] [stdout]    8:     0x5e3bd385d2cf - <std[ec4e911328de40a6]::sys::backtrace::BacktraceLock>::print
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/sys/backtrace.rs:47:9
[INFO] [stdout]    9:     0x5e3bd385d2cf - std[ec4e911328de40a6]::panicking::default_hook::{closure#0}
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:292:27
[INFO] [stdout]   10:     0x5e3bd387a0d9 - std[ec4e911328de40a6]::panicking::default_hook
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:316:9
[INFO] [stdout]   11:     0x5e3bd32c7cbc - <alloc[c960326de6de28e6]::boxed::Box<dyn for<'a, 'b> core[a96a4c5c53f902a3]::ops::function::Fn<(&'a std[ec4e911328de40a6]::panic::PanicHookInfo<'b>,), Output = ()> + core[a96a4c5c53f902a3]::marker::Sync + core[a96a4c5c53f902a3]::marker::Send> as core[a96a4c5c53f902a3]::ops::function::Fn<(&std[ec4e911328de40a6]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/alloc/src/boxed.rs:2254:9
[INFO] [stdout]   12:     0x5e3bd32c7cbc - test[30c43f9fd66fea90]::test_main_with_exit_callback::<test[30c43f9fd66fea90]::test_main::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/test/src/lib.rs:145:21
[INFO] [stdout]   13:     0x5e3bd387a352 - <alloc[c960326de6de28e6]::boxed::Box<dyn for<'a, 'b> core[a96a4c5c53f902a3]::ops::function::Fn<(&'a std[ec4e911328de40a6]::panic::PanicHookInfo<'b>,), Output = ()> + core[a96a4c5c53f902a3]::marker::Sync + core[a96a4c5c53f902a3]::marker::Send> as core[a96a4c5c53f902a3]::ops::function::Fn<(&std[ec4e911328de40a6]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/alloc/src/boxed.rs:2254:9
[INFO] [stdout]   14:     0x5e3bd387a352 - std[ec4e911328de40a6]::panicking::panic_with_hook
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:833:13
[INFO] [stdout]   15:     0x5e3bd385d3ba - std[ec4e911328de40a6]::panicking::panic_handler::{closure#0}
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:691:13
[INFO] [stdout]   16:     0x5e3bd38542c9 - std[ec4e911328de40a6]::sys::backtrace::__rust_end_short_backtrace::<std[ec4e911328de40a6]::panicking::panic_handler::{closure#0}, !>
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/sys/backtrace.rs:182:18
[INFO] [stdout]   17:     0x5e3bd385e5cd - __rustc[aa69f48705c57ca8]::rust_begin_unwind
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:689:5
[INFO] [stdout]   18:     0x5e3bd389c14c - core[a96a4c5c53f902a3]::panicking::panic_fmt
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/panicking.rs:80:14
[INFO] [stdout]   19:     0x5e3bd2c57e7a - main_internal[7525cd43ed7300a8]::prodex_impl::tests::runtime_proxy_retries_after_websocket_reuse_silent_hang
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/support/main_internal_body.rs:9710:5
[INFO] [stdout]   20:     0x5e3bd2c1c487 - main_internal[7525cd43ed7300a8]::prodex_impl::tests::runtime_proxy_retries_after_websocket_reuse_silent_hang::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/support/main_internal_body.rs:9557:61
[INFO] [stdout]   21:     0x5e3bd2eaff56 - <main_internal[7525cd43ed7300a8]::prodex_impl::tests::runtime_proxy_retries_after_websocket_reuse_silent_hang::{closure#0} as core[a96a4c5c53f902a3]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   22:     0x5e3bd32bbd9b - <fn() -> core[a96a4c5c53f902a3]::result::Result<(), alloc[c960326de6de28e6]::string::String> as core[a96a4c5c53f902a3]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   23:     0x5e3bd32bbd9b - test[30c43f9fd66fea90]::__rust_begin_short_backtrace::<core[a96a4c5c53f902a3]::result::Result<(), alloc[c960326de6de28e6]::string::String>, fn() -> core[a96a4c5c53f902a3]::result::Result<(), alloc[c960326de6de28e6]::string::String>>
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/test/src/lib.rs:663:18
[INFO] [stdout]   24:     0x5e3bd32c878b - test[30c43f9fd66fea90]::run_test_in_process::{closure#0}
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/test/src/lib.rs:686:74
[INFO] [stdout]   25:     0x5e3bd32c878b - <core[a96a4c5c53f902a3]::panic::unwind_safe::AssertUnwindSafe<test[30c43f9fd66fea90]::run_test_in_process::{closure#0}> as core[a96a4c5c53f902a3]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   26:     0x5e3bd32c878b - std[ec4e911328de40a6]::panicking::catch_unwind::do_call::<core[a96a4c5c53f902a3]::panic::unwind_safe::AssertUnwindSafe<test[30c43f9fd66fea90]::run_test_in_process::{closure#0}>, core[a96a4c5c53f902a3]::result::Result<(), alloc[c960326de6de28e6]::string::String>>
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:581:40
[INFO] [stdout]   27:     0x5e3bd32c878b - std[ec4e911328de40a6]::panicking::catch_unwind::<core[a96a4c5c53f902a3]::result::Result<(), alloc[c960326de6de28e6]::string::String>, core[a96a4c5c53f902a3]::panic::unwind_safe::AssertUnwindSafe<test[30c43f9fd66fea90]::run_test_in_process::{closure#0}>>
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:544:19
[INFO] [stdout]   28:     0x5e3bd32c878b - std[ec4e911328de40a6]::panic::catch_unwind::<core[a96a4c5c53f902a3]::panic::unwind_safe::AssertUnwindSafe<test[30c43f9fd66fea90]::run_test_in_process::{closure#0}>, core[a96a4c5c53f902a3]::result::Result<(), alloc[c960326de6de28e6]::string::String>>
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panic.rs:359:14
[INFO] [stdout]   29:     0x5e3bd32c878b - test[30c43f9fd66fea90]::run_test_in_process
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/test/src/lib.rs:686:27
[INFO] [stdout]   30:     0x5e3bd32c878b - test[30c43f9fd66fea90]::run_test::{closure#0}
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/test/src/lib.rs:607:43
[INFO] [stdout]   31:     0x5e3bd32c3ea4 - test[30c43f9fd66fea90]::run_test::{closure#1}
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/test/src/lib.rs:637:41
[INFO] [stdout]   32:     0x5e3bd32c3ea4 - std[ec4e911328de40a6]::sys::backtrace::__rust_begin_short_backtrace::<test[30c43f9fd66fea90]::run_test::{closure#1}, ()>
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/sys/backtrace.rs:166:18
[INFO] [stdout]   33:     0x5e3bd32cb392 - std[ec4e911328de40a6]::thread::lifecycle::spawn_unchecked::<test[30c43f9fd66fea90]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/thread/lifecycle.rs:91:13
[INFO] [stdout]   34:     0x5e3bd32cb392 - <core[a96a4c5c53f902a3]::panic::unwind_safe::AssertUnwindSafe<std[ec4e911328de40a6]::thread::lifecycle::spawn_unchecked<test[30c43f9fd66fea90]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}> as core[a96a4c5c53f902a3]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   35:     0x5e3bd32cb392 - std[ec4e911328de40a6]::panicking::catch_unwind::do_call::<core[a96a4c5c53f902a3]::panic::unwind_safe::AssertUnwindSafe<std[ec4e911328de40a6]::thread::lifecycle::spawn_unchecked<test[30c43f9fd66fea90]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:581:40
[INFO] [stdout]   36:     0x5e3bd32cb392 - std[ec4e911328de40a6]::panicking::catch_unwind::<(), core[a96a4c5c53f902a3]::panic::unwind_safe::AssertUnwindSafe<std[ec4e911328de40a6]::thread::lifecycle::spawn_unchecked<test[30c43f9fd66fea90]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>>
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:544:19
[INFO] [stdout]   37:     0x5e3bd32cb392 - std[ec4e911328de40a6]::panic::catch_unwind::<core[a96a4c5c53f902a3]::panic::unwind_safe::AssertUnwindSafe<std[ec4e911328de40a6]::thread::lifecycle::spawn_unchecked<test[30c43f9fd66fea90]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panic.rs:359:14
[INFO] [stdout]   38:     0x5e3bd32cb392 - std[ec4e911328de40a6]::thread::lifecycle::spawn_unchecked::<test[30c43f9fd66fea90]::run_test::{closure#1}, ()>::{closure#1}
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/thread/lifecycle.rs:89:26
[INFO] [stdout]   39:     0x5e3bd32cb392 - <std[ec4e911328de40a6]::thread::lifecycle::spawn_unchecked<test[30c43f9fd66fea90]::run_test::{closure#1}, ()>::{closure#1} as core[a96a4c5c53f902a3]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0}
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   40:     0x5e3bd3882a5f - <alloc[c960326de6de28e6]::boxed::Box<dyn core[a96a4c5c53f902a3]::ops::function::FnOnce<(), Output = ()> + core[a96a4c5c53f902a3]::marker::Send> as core[a96a4c5c53f902a3]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/alloc/src/boxed.rs:2240:9
[INFO] [stdout]   41:     0x5e3bd3882a5f - <std[ec4e911328de40a6]::sys::thread::unix::Thread>::new::thread_start
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/sys/thread/unix.rs:118:17
[INFO] [stdout]   42:     0x77a201e27aa4 - <unknown>
[INFO] [stdout]   43:     0x77a201eb4a64 - clone
[INFO] [stdout]   44:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] ---- prodex_impl::tests::runtime_proxy_does_not_rotate_after_first_sse_chunk_reset stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'prodex_impl::tests::runtime_proxy_does_not_rotate_after_first_sse_chunk_reset' (587) panicked at tests/support/main_internal_body.rs:9209:14:
[INFO] [stdout] runtime log tail should be readable: failed to open /tmp/prodex-runtime-test-429-1774849886579090795/runtime-logs/prodex-runtime-429-1774849886599.log
[INFO] [stdout] 
[INFO] [stdout] Caused by:
[INFO] [stdout]     No such file or directory (os error 2)
[INFO] [stdout] 
[INFO] [stdout] Stack backtrace:
[INFO] [stdout]    0: <std::io::error::Error as anyhow::context::ext::StdError>::ext_context::<alloc::string::String>
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.102/src/backtrace.rs:10:14
[INFO] [stdout]    1: <core::result::Result<std::fs::File, std::io::error::Error> as anyhow::Context<std::fs::File, std::io::error::Error>>::with_context::<alloc::string::String, main_internal::prodex_impl::read_runtime_log_tail::{closure#0}>
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.102/src/context.rs:65:37
[INFO] [stdout]    2: main_internal::prodex_impl::read_runtime_log_tail
[INFO] [stdout]              at ./tests/../src/main.rs:3764:30
[INFO] [stdout]    3: main_internal::prodex_impl::tests::runtime_proxy_does_not_rotate_after_first_sse_chunk_reset
[INFO] [stdout]              at ./tests/support/main_internal_body.rs:9208:16
[INFO] [stdout]    4: main_internal::prodex_impl::tests::runtime_proxy_does_not_rotate_after_first_sse_chunk_reset::{closure#0}
[INFO] [stdout]              at ./tests/support/main_internal_body.rs:9152:63
[INFO] [stdout]    5: <main_internal::prodex_impl::tests::runtime_proxy_does_not_rotate_after_first_sse_chunk_reset::{closure#0} as core::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/ops/function.rs:250:5
[INFO] [stdout]    6: <fn() -> core::result::Result<(), alloc::string::String> as core::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/ops/function.rs:250:5
[INFO] [stdout]    7: test::__rust_begin_short_backtrace::<core::result::Result<(), alloc::string::String>, fn() -> core::result::Result<(), alloc::string::String>>
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/test/src/lib.rs:663:18
[INFO] [stdout]    8: test::run_test_in_process::{closure#0}
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/test/src/lib.rs:686:74
[INFO] [stdout]    9: <core::panic::unwind_safe::AssertUnwindSafe<test::run_test_in_process::{closure#0}> as core::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   10: std::panicking::catch_unwind::do_call::<core::panic::unwind_safe::AssertUnwindSafe<test::run_test_in_process::{closure#0}>, core::result::Result<(), alloc::string::String>>
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:581:40
[INFO] [stdout]   11: std::panicking::catch_unwind::<core::result::Result<(), alloc::string::String>, core::panic::unwind_safe::AssertUnwindSafe<test::run_test_in_process::{closure#0}>>
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:544:19
[INFO] [stdout]   12: std::panic::catch_unwind::<core::panic::unwind_safe::AssertUnwindSafe<test::run_test_in_process::{closure#0}>, core::result::Result<(), alloc::string::String>>
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panic.rs:359:14
[INFO] [stdout]   13: test::run_test_in_process
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/test/src/lib.rs:686:27
[INFO] [stdout]   14: test::run_test::{closure#0}
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/test/src/lib.rs:607:43
[INFO] [stdout]   15: test::run_test::{closure#1}
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/test/src/lib.rs:637:41
[INFO] [stdout]   16: std::sys::backtrace::__rust_begin_short_backtrace::<test::run_test::{closure#1}, ()>
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/sys/backtrace.rs:166:18
[INFO] [stdout]   17: std::thread::lifecycle::spawn_unchecked::<test::run_test::{closure#1}, ()>::{closure#1}::{closure#0}
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/thread/lifecycle.rs:91:13
[INFO] [stdout]   18: <core::panic::unwind_safe::AssertUnwindSafe<std::thread::lifecycle::spawn_unchecked<test::run_test::{closure#1}, ()>::{closure#1}::{closure#0}> as core::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   19: std::panicking::catch_unwind::do_call::<core::panic::unwind_safe::AssertUnwindSafe<std::thread::lifecycle::spawn_unchecked<test::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:581:40
[INFO] [stdout]   20: std::panicking::catch_unwind::<(), core::panic::unwind_safe::AssertUnwindSafe<std::thread::lifecycle::spawn_unchecked<test::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>>
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:544:19
[INFO] [stdout]   21: std::panic::catch_unwind::<core::panic::unwind_safe::AssertUnwindSafe<std::thread::lifecycle::spawn_unchecked<test::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panic.rs:359:14
[INFO] [stdout]   22: std::thread::lifecycle::spawn_unchecked::<test::run_test::{closure#1}, ()>::{closure#1}
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/thread/lifecycle.rs:89:26
[INFO] [stdout]   23: <std::thread::lifecycle::spawn_unchecked<test::run_test::{closure#1}, ()>::{closure#1} as core::ops::function::FnOnce<()>>::call_once::{shim:vtable#0}
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   24: <alloc::boxed::Box<dyn core::ops::function::FnOnce<(), Output = ()> + core::marker::Send> as core::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/alloc/src/boxed.rs:2240:9
[INFO] [stdout]   25: <std::sys::thread::unix::Thread>::new::thread_start
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/sys/thread/unix.rs:118:17
[INFO] [stdout]   26: <unknown>
[INFO] [stdout]   27: clone
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x5e3bd3883c7a - std[ec4e911328de40a6]::backtrace_rs::backtrace::libunwind::trace
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9
[INFO] [stdout]    1:     0x5e3bd3883c7a - std[ec4e911328de40a6]::backtrace_rs::backtrace::trace_unsynchronized::<std[ec4e911328de40a6]::sys::backtrace::_print_fmt::{closure#1}>
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14
[INFO] [stdout]    2:     0x5e3bd3883c7a - std[ec4e911328de40a6]::sys::backtrace::_print_fmt
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/sys/backtrace.rs:74:9
[INFO] [stdout]    3:     0x5e3bd3883c7a - <<std[ec4e911328de40a6]::sys::backtrace::BacktraceLock>::print::DisplayBacktrace as core[a96a4c5c53f902a3]::fmt::Display>::fmt
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/sys/backtrace.rs:44:26
[INFO] [stdout]    4:     0x5e3bd389b98a - <core[a96a4c5c53f902a3]::fmt::rt::Argument>::fmt
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/fmt/rt.rs:152:76
[INFO] [stdout]    5:     0x5e3bd389b98a - core[a96a4c5c53f902a3]::fmt::write
[INFO] [stdout]    6:     0x5e3bd38897c2 - std[ec4e911328de40a6]::io::default_write_fmt::<alloc[c960326de6de28e6]::vec::Vec<u8>>
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/io/mod.rs:639:11
[INFO] [stdout]    7:     0x5e3bd38897c2 - <alloc[c960326de6de28e6]::vec::Vec<u8> as std[ec4e911328de40a6]::io::Write>::write_fmt
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/io/mod.rs:1994:13
[INFO] [stdout]    8:     0x5e3bd385d2cf - <std[ec4e911328de40a6]::sys::backtrace::BacktraceLock>::print
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/sys/backtrace.rs:47:9
[INFO] [stdout]    9:     0x5e3bd385d2cf - std[ec4e911328de40a6]::panicking::default_hook::{closure#0}
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:292:27
[INFO] [stdout]   10:     0x5e3bd387a0d9 - std[ec4e911328de40a6]::panicking::default_hook
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:316:9
[INFO] [stdout]   11:     0x5e3bd32c7cbc - <alloc[c960326de6de28e6]::boxed::Box<dyn for<'a, 'b> core[a96a4c5c53f902a3]::ops::function::Fn<(&'a std[ec4e911328de40a6]::panic::PanicHookInfo<'b>,), Output = ()> + core[a96a4c5c53f902a3]::marker::Sync + core[a96a4c5c53f902a3]::marker::Send> as core[a96a4c5c53f902a3]::ops::function::Fn<(&std[ec4e911328de40a6]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/alloc/src/boxed.rs:2254:9
[INFO] [stdout]   12:     0x5e3bd32c7cbc - test[30c43f9fd66fea90]::test_main_with_exit_callback::<test[30c43f9fd66fea90]::test_main::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/test/src/lib.rs:145:21
[INFO] [stdout]   13:     0x5e3bd387a352 - <alloc[c960326de6de28e6]::boxed::Box<dyn for<'a, 'b> core[a96a4c5c53f902a3]::ops::function::Fn<(&'a std[ec4e911328de40a6]::panic::PanicHookInfo<'b>,), Output = ()> + core[a96a4c5c53f902a3]::marker::Sync + core[a96a4c5c53f902a3]::marker::Send> as core[a96a4c5c53f902a3]::ops::function::Fn<(&std[ec4e911328de40a6]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/alloc/src/boxed.rs:2254:9
[INFO] [stdout]   14:     0x5e3bd387a352 - std[ec4e911328de40a6]::panicking::panic_with_hook
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:833:13
[INFO] [stdout]   15:     0x5e3bd385d388 - std[ec4e911328de40a6]::panicking::panic_handler::{closure#0}
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:698:13
[INFO] [stdout]   16:     0x5e3bd38542c9 - std[ec4e911328de40a6]::sys::backtrace::__rust_end_short_backtrace::<std[ec4e911328de40a6]::panicking::panic_handler::{closure#0}, !>
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/sys/backtrace.rs:182:18
[INFO] [stdout]   17:     0x5e3bd385e5cd - __rustc[aa69f48705c57ca8]::rust_begin_unwind
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:689:5
[INFO] [stdout]   18:     0x5e3bd389c14c - core[a96a4c5c53f902a3]::panicking::panic_fmt
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/panicking.rs:80:14
[INFO] [stdout]   19:     0x5e3bd389bec2 - core[a96a4c5c53f902a3]::result::unwrap_failed
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/result.rs:1867:5
[INFO] [stdout]   20:     0x5e3bd2d58a6c - <core[a96a4c5c53f902a3]::result::Result<alloc[c960326de6de28e6]::vec::Vec<u8>, anyhow[14d810d59e45c4dc]::Error>>::expect
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/result.rs:1185:23
[INFO] [stdout]   21:     0x5e3bd2c60063 - main_internal[7525cd43ed7300a8]::prodex_impl::tests::runtime_proxy_does_not_rotate_after_first_sse_chunk_reset
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/support/main_internal_body.rs:9209:14
[INFO] [stdout]   22:     0x5e3bd2c1c5d7 - main_internal[7525cd43ed7300a8]::prodex_impl::tests::runtime_proxy_does_not_rotate_after_first_sse_chunk_reset::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/support/main_internal_body.rs:9152:63
[INFO] [stdout]   23:     0x5e3bd2eb0116 - <main_internal[7525cd43ed7300a8]::prodex_impl::tests::runtime_proxy_does_not_rotate_after_first_sse_chunk_reset::{closure#0} as core[a96a4c5c53f902a3]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   24:     0x5e3bd32bbd9b - <fn() -> core[a96a4c5c53f902a3]::result::Result<(), alloc[c960326de6de28e6]::string::String> as core[a96a4c5c53f902a3]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   25:     0x5e3bd32bbd9b - test[30c43f9fd66fea90]::__rust_begin_short_backtrace::<core[a96a4c5c53f902a3]::result::Result<(), alloc[c960326de6de28e6]::string::String>, fn() -> core[a96a4c5c53f902a3]::result::Result<(), alloc[c960326de6de28e6]::string::String>>
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/test/src/lib.rs:663:18
[INFO] [stdout]   26:     0x5e3bd32c878b - test[30c43f9fd66fea90]::run_test_in_process::{closure#0}
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/test/src/lib.rs:686:74
[INFO] [stdout]   27:     0x5e3bd32c878b - <core[a96a4c5c53f902a3]::panic::unwind_safe::AssertUnwindSafe<test[30c43f9fd66fea90]::run_test_in_process::{closure#0}> as core[a96a4c5c53f902a3]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   28:     0x5e3bd32c878b - std[ec4e911328de40a6]::panicking::catch_unwind::do_call::<core[a96a4c5c53f902a3]::panic::unwind_safe::AssertUnwindSafe<test[30c43f9fd66fea90]::run_test_in_process::{closure#0}>, core[a96a4c5c53f902a3]::result::Result<(), alloc[c960326de6de28e6]::string::String>>
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:581:40
[INFO] [stdout]   29:     0x5e3bd32c878b - std[ec4e911328de40a6]::panicking::catch_unwind::<core[a96a4c5c53f902a3]::result::Result<(), alloc[c960326de6de28e6]::string::String>, core[a96a4c5c53f902a3]::panic::unwind_safe::AssertUnwindSafe<test[30c43f9fd66fea90]::run_test_in_process::{closure#0}>>
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:544:19
[INFO] [stdout]   30:     0x5e3bd32c878b - std[ec4e911328de40a6]::panic::catch_unwind::<core[a96a4c5c53f902a3]::panic::unwind_safe::AssertUnwindSafe<test[30c43f9fd66fea90]::run_test_in_process::{closure#0}>, core[a96a4c5c53f902a3]::result::Result<(), alloc[c960326de6de28e6]::string::String>>
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panic.rs:359:14
[INFO] [stdout]   31:     0x5e3bd32c878b - test[30c43f9fd66fea90]::run_test_in_process
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/test/src/lib.rs:686:27
[INFO] [stdout]   32:     0x5e3bd32c878b - test[30c43f9fd66fea90]::run_test::{closure#0}
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/test/src/lib.rs:607:43
[INFO] [stdout]   33:     0x5e3bd32c3ea4 - test[30c43f9fd66fea90]::run_test::{closure#1}
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/test/src/lib.rs:637:41
[INFO] [stdout]   34:     0x5e3bd32c3ea4 - std[ec4e911328de40a6]::sys::backtrace::__rust_begin_short_backtrace::<test[30c43f9fd66fea90]::run_test::{closure#1}, ()>
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/sys/backtrace.rs:166:18
[INFO] [stdout]   35:     0x5e3bd32cb392 - std[ec4e911328de40a6]::thread::lifecycle::spawn_unchecked::<test[30c43f9fd66fea90]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/thread/lifecycle.rs:91:13
[INFO] [stdout]   36:     0x5e3bd32cb392 - <core[a96a4c5c53f902a3]::panic::unwind_safe::AssertUnwindSafe<std[ec4e911328de40a6]::thread::lifecycle::spawn_unchecked<test[30c43f9fd66fea90]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}> as core[a96a4c5c53f902a3]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   37:     0x5e3bd32cb392 - std[ec4e911328de40a6]::panicking::catch_unwind::do_call::<core[a96a4c5c53f902a3]::panic::unwind_safe::AssertUnwindSafe<std[ec4e911328de40a6]::thread::lifecycle::spawn_unchecked<test[30c43f9fd66fea90]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:581:40
[INFO] [stdout]   38:     0x5e3bd32cb392 - std[ec4e911328de40a6]::panicking::catch_unwind::<(), core[a96a4c5c53f902a3]::panic::unwind_safe::AssertUnwindSafe<std[ec4e911328de40a6]::thread::lifecycle::spawn_unchecked<test[30c43f9fd66fea90]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>>
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:544:19
[INFO] [stdout]   39:     0x5e3bd32cb392 - std[ec4e911328de40a6]::panic::catch_unwind::<core[a96a4c5c53f902a3]::panic::unwind_safe::AssertUnwindSafe<std[ec4e911328de40a6]::thread::lifecycle::spawn_unchecked<test[30c43f9fd66fea90]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panic.rs:359:14
[INFO] [stdout]   40:     0x5e3bd32cb392 - std[ec4e911328de40a6]::thread::lifecycle::spawn_unchecked::<test[30c43f9fd66fea90]::run_test::{closure#1}, ()>::{closure#1}
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/thread/lifecycle.rs:89:26
[INFO] [stdout]   41:     0x5e3bd32cb392 - <std[ec4e911328de40a6]::thread::lifecycle::spawn_unchecked<test[30c43f9fd66fea90]::run_test::{closure#1}, ()>::{closure#1} as core[a96a4c5c53f902a3]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0}
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   42:     0x5e3bd3882a5f - <alloc[c960326de6de28e6]::boxed::Box<dyn core[a96a4c5c53f902a3]::ops::function::FnOnce<(), Output = ()> + core[a96a4c5c53f902a3]::marker::Send> as core[a96a4c5c53f902a3]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/alloc/src/boxed.rs:2240:9
[INFO] [stdout]   43:     0x5e3bd3882a5f - <std[ec4e911328de40a6]::sys::thread::unix::Thread>::new::thread_start
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/sys/thread/unix.rs:118:17
[INFO] [stdout]   44:     0x77a201e27aa4 - <unknown>
[INFO] [stdout]   45:     0x77a201eb4a64 - clone
[INFO] [stdout]   46:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] ---- prodex_impl::tests::runtime_proxy_does_not_rotate_after_multi_chunk_sse_stall stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'prodex_impl::tests::runtime_proxy_does_not_rotate_after_multi_chunk_sse_stall' (604) panicked at tests/support/main_internal_body.rs:9285:14:
[INFO] [stdout] runtime log tail should be readable: failed to open /tmp/prodex-runtime-test-429-1774849886579090795/runtime-logs/prodex-runtime-429-1774849886599.log
[INFO] [stdout] 
[INFO] [stdout] Caused by:
[INFO] [stdout]     No such file or directory (os error 2)
[INFO] [stdout] 
[INFO] [stdout] Stack backtrace:
[INFO] [stdout]    0: <std::io::error::Error as anyhow::context::ext::StdError>::ext_context::<alloc::string::String>
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.102/src/backtrace.rs:10:14
[INFO] [stdout]    1: <core::result::Result<std::fs::File, std::io::error::Error> as anyhow::Context<std::fs::File, std::io::error::Error>>::with_context::<alloc::string::String, main_internal::prodex_impl::read_runtime_log_tail::{closure#0}>
[INFO] [stdout]              at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.102/src/context.rs:65:37
[INFO] [stdout]    2: main_internal::prodex_impl::read_runtime_log_tail
[INFO] [stdout]              at ./tests/../src/main.rs:3764:30
[INFO] [stdout]    3: main_internal::prodex_impl::tests::runtime_proxy_does_not_rotate_after_multi_chunk_sse_stall
[INFO] [stdout]              at ./tests/support/main_internal_body.rs:9284:16
[INFO] [stdout]    4: main_internal::prodex_impl::tests::runtime_proxy_does_not_rotate_after_multi_chunk_sse_stall::{closure#0}
[INFO] [stdout]              at ./tests/support/main_internal_body.rs:9228:63
[INFO] [stdout]    5: <main_internal::prodex_impl::tests::runtime_proxy_does_not_rotate_after_multi_chunk_sse_stall::{closure#0} as core::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/ops/function.rs:250:5
[INFO] [stdout]    6: <fn() -> core::result::Result<(), alloc::string::String> as core::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/ops/function.rs:250:5
[INFO] [stdout]    7: test::__rust_begin_short_backtrace::<core::result::Result<(), alloc::string::String>, fn() -> core::result::Result<(), alloc::string::String>>
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/test/src/lib.rs:663:18
[INFO] [stdout]    8: test::run_test_in_process::{closure#0}
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/test/src/lib.rs:686:74
[INFO] [stdout]    9: <core::panic::unwind_safe::AssertUnwindSafe<test::run_test_in_process::{closure#0}> as core::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   10: std::panicking::catch_unwind::do_call::<core::panic::unwind_safe::AssertUnwindSafe<test::run_test_in_process::{closure#0}>, core::result::Result<(), alloc::string::String>>
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:581:40
[INFO] [stdout]   11: std::panicking::catch_unwind::<core::result::Result<(), alloc::string::String>, core::panic::unwind_safe::AssertUnwindSafe<test::run_test_in_process::{closure#0}>>
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:544:19
[INFO] [stdout]   12: std::panic::catch_unwind::<core::panic::unwind_safe::AssertUnwindSafe<test::run_test_in_process::{closure#0}>, core::result::Result<(), alloc::string::String>>
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panic.rs:359:14
[INFO] [stdout]   13: test::run_test_in_process
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/test/src/lib.rs:686:27
[INFO] [stdout]   14: test::run_test::{closure#0}
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/test/src/lib.rs:607:43
[INFO] [stdout]   15: test::run_test::{closure#1}
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/test/src/lib.rs:637:41
[INFO] [stdout]   16: std::sys::backtrace::__rust_begin_short_backtrace::<test::run_test::{closure#1}, ()>
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/sys/backtrace.rs:166:18
[INFO] [stdout]   17: std::thread::lifecycle::spawn_unchecked::<test::run_test::{closure#1}, ()>::{closure#1}::{closure#0}
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/thread/lifecycle.rs:91:13
[INFO] [stdout]   18: <core::panic::unwind_safe::AssertUnwindSafe<std::thread::lifecycle::spawn_unchecked<test::run_test::{closure#1}, ()>::{closure#1}::{closure#0}> as core::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   19: std::panicking::catch_unwind::do_call::<core::panic::unwind_safe::AssertUnwindSafe<std::thread::lifecycle::spawn_unchecked<test::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:581:40
[INFO] [stdout]   20: std::panicking::catch_unwind::<(), core::panic::unwind_safe::AssertUnwindSafe<std::thread::lifecycle::spawn_unchecked<test::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>>
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:544:19
[INFO] [stdout]   21: std::panic::catch_unwind::<core::panic::unwind_safe::AssertUnwindSafe<std::thread::lifecycle::spawn_unchecked<test::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panic.rs:359:14
[INFO] [stdout]   22: std::thread::lifecycle::spawn_unchecked::<test::run_test::{closure#1}, ()>::{closure#1}
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/thread/lifecycle.rs:89:26
[INFO] [stdout]   23: <std::thread::lifecycle::spawn_unchecked<test::run_test::{closure#1}, ()>::{closure#1} as core::ops::function::FnOnce<()>>::call_once::{shim:vtable#0}
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   24: <alloc::boxed::Box<dyn core::ops::function::FnOnce<(), Output = ()> + core::marker::Send> as core::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/alloc/src/boxed.rs:2240:9
[INFO] [stdout]   25: <std::sys::thread::unix::Thread>::new::thread_start
[INFO] [stdout]              at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/sys/thread/unix.rs:118:17
[INFO] [stdout]   26: <unknown>
[INFO] [stdout]   27: clone
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x5e3bd3883c7a - std[ec4e911328de40a6]::backtrace_rs::backtrace::libunwind::trace
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9
[INFO] [stdout]    1:     0x5e3bd3883c7a - std[ec4e911328de40a6]::backtrace_rs::backtrace::trace_unsynchronized::<std[ec4e911328de40a6]::sys::backtrace::_print_fmt::{closure#1}>
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14
[INFO] [stdout]    2:     0x5e3bd3883c7a - std[ec4e911328de40a6]::sys::backtrace::_print_fmt
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/sys/backtrace.rs:74:9
[INFO] [stdout]    3:     0x5e3bd3883c7a - <<std[ec4e911328de40a6]::sys::backtrace::BacktraceLock>::print::DisplayBacktrace as core[a96a4c5c53f902a3]::fmt::Display>::fmt
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/sys/backtrace.rs:44:26
[INFO] [stdout]    4:     0x5e3bd389b98a - <core[a96a4c5c53f902a3]::fmt::rt::Argument>::fmt
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/fmt/rt.rs:152:76
[INFO] [stdout]    5:     0x5e3bd389b98a - core[a96a4c5c53f902a3]::fmt::write
[INFO] [stdout]    6:     0x5e3bd38897c2 - std[ec4e911328de40a6]::io::default_write_fmt::<alloc[c960326de6de28e6]::vec::Vec<u8>>
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/io/mod.rs:639:11
[INFO] [stdout]    7:     0x5e3bd38897c2 - <alloc[c960326de6de28e6]::vec::Vec<u8> as std[ec4e911328de40a6]::io::Write>::write_fmt
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/io/mod.rs:1994:13
[INFO] [stdout]    8:     0x5e3bd385d2cf - <std[ec4e911328de40a6]::sys::backtrace::BacktraceLock>::print
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/sys/backtrace.rs:47:9
[INFO] [stdout]    9:     0x5e3bd385d2cf - std[ec4e911328de40a6]::panicking::default_hook::{closure#0}
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:292:27
[INFO] [stdout]   10:     0x5e3bd387a0d9 - std[ec4e911328de40a6]::panicking::default_hook
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:316:9
[INFO] [stdout]   11:     0x5e3bd32c7cbc - <alloc[c960326de6de28e6]::boxed::Box<dyn for<'a, 'b> core[a96a4c5c53f902a3]::ops::function::Fn<(&'a std[ec4e911328de40a6]::panic::PanicHookInfo<'b>,), Output = ()> + core[a96a4c5c53f902a3]::marker::Sync + core[a96a4c5c53f902a3]::marker::Send> as core[a96a4c5c53f902a3]::ops::function::Fn<(&std[ec4e911328de40a6]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/alloc/src/boxed.rs:2254:9
[INFO] [stdout]   12:     0x5e3bd32c7cbc - test[30c43f9fd66fea90]::test_main_with_exit_callback::<test[30c43f9fd66fea90]::test_main::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/test/src/lib.rs:145:21
[INFO] [stdout]   13:     0x5e3bd387a352 - <alloc[c960326de6de28e6]::boxed::Box<dyn for<'a, 'b> core[a96a4c5c53f902a3]::ops::function::Fn<(&'a std[ec4e911328de40a6]::panic::PanicHookInfo<'b>,), Output = ()> + core[a96a4c5c53f902a3]::marker::Sync + core[a96a4c5c53f902a3]::marker::Send> as core[a96a4c5c53f902a3]::ops::function::Fn<(&std[ec4e911328de40a6]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/alloc/src/boxed.rs:2254:9
[INFO] [stdout]   14:     0x5e3bd387a352 - std[ec4e911328de40a6]::panicking::panic_with_hook
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:833:13
[INFO] [stdout]   15:     0x5e3bd385d388 - std[ec4e911328de40a6]::panicking::panic_handler::{closure#0}
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:698:13
[INFO] [stdout]   16:     0x5e3bd38542c9 - std[ec4e911328de40a6]::sys::backtrace::__rust_end_short_backtrace::<std[ec4e911328de40a6]::panicking::panic_handler::{closure#0}, !>
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/sys/backtrace.rs:182:18
[INFO] [stdout]   17:     0x5e3bd385e5cd - __rustc[aa69f48705c57ca8]::rust_begin_unwind
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:689:5
[INFO] [stdout]   18:     0x5e3bd389c14c - core[a96a4c5c53f902a3]::panicking::panic_fmt
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/panicking.rs:80:14
[INFO] [stdout]   19:     0x5e3bd389bec2 - core[a96a4c5c53f902a3]::result::unwrap_failed
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/result.rs:1867:5
[INFO] [stdout]   20:     0x5e3bd2d58a6c - <core[a96a4c5c53f902a3]::result::Result<alloc[c960326de6de28e6]::vec::Vec<u8>, anyhow[14d810d59e45c4dc]::Error>>::expect
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/result.rs:1185:23
[INFO] [stdout]   21:     0x5e3bd2c618f3 - main_internal[7525cd43ed7300a8]::prodex_impl::tests::runtime_proxy_does_not_rotate_after_multi_chunk_sse_stall
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/support/main_internal_body.rs:9285:14
[INFO] [stdout]   22:     0x5e3bd2c1c607 - main_internal[7525cd43ed7300a8]::prodex_impl::tests::runtime_proxy_does_not_rotate_after_multi_chunk_sse_stall::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/support/main_internal_body.rs:9228:63
[INFO] [stdout]   23:     0x5e3bd2eb0156 - <main_internal[7525cd43ed7300a8]::prodex_impl::tests::runtime_proxy_does_not_rotate_after_multi_chunk_sse_stall::{closure#0} as core[a96a4c5c53f902a3]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   24:     0x5e3bd32bbd9b - <fn() -> core[a96a4c5c53f902a3]::result::Result<(), alloc[c960326de6de28e6]::string::String> as core[a96a4c5c53f902a3]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   25:     0x5e3bd32bbd9b - test[30c43f9fd66fea90]::__rust_begin_short_backtrace::<core[a96a4c5c53f902a3]::result::Result<(), alloc[c960326de6de28e6]::string::String>, fn() -> core[a96a4c5c53f902a3]::result::Result<(), alloc[c960326de6de28e6]::string::String>>
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/test/src/lib.rs:663:18
[INFO] [stdout]   26:     0x5e3bd32c878b - test[30c43f9fd66fea90]::run_test_in_process::{closure#0}
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/test/src/lib.rs:686:74
[INFO] [stdout]   27:     0x5e3bd32c878b - <core[a96a4c5c53f902a3]::panic::unwind_safe::AssertUnwindSafe<test[30c43f9fd66fea90]::run_test_in_process::{closure#0}> as core[a96a4c5c53f902a3]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   28:     0x5e3bd32c878b - std[ec4e911328de40a6]::panicking::catch_unwind::do_call::<core[a96a4c5c53f902a3]::panic::unwind_safe::AssertUnwindSafe<test[30c43f9fd66fea90]::run_test_in_process::{closure#0}>, core[a96a4c5c53f902a3]::result::Result<(), alloc[c960326de6de28e6]::string::String>>
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:581:40
[INFO] [stdout]   29:     0x5e3bd32c878b - std[ec4e911328de40a6]::panicking::catch_unwind::<core[a96a4c5c53f902a3]::result::Result<(), alloc[c960326de6de28e6]::string::String>, core[a96a4c5c53f902a3]::panic::unwind_safe::AssertUnwindSafe<test[30c43f9fd66fea90]::run_test_in_process::{closure#0}>>
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:544:19
[INFO] [stdout]   30:     0x5e3bd32c878b - std[ec4e911328de40a6]::panic::catch_unwind::<core[a96a4c5c53f902a3]::panic::unwind_safe::AssertUnwindSafe<test[30c43f9fd66fea90]::run_test_in_process::{closure#0}>, core[a96a4c5c53f902a3]::result::Result<(), alloc[c960326de6de28e6]::string::String>>
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panic.rs:359:14
[INFO] [stdout]   31:     0x5e3bd32c878b - test[30c43f9fd66fea90]::run_test_in_process
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/test/src/lib.rs:686:27
[INFO] [stdout]   32:     0x5e3bd32c878b - test[30c43f9fd66fea90]::run_test::{closure#0}
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/test/src/lib.rs:607:43
[INFO] [stdout]   33:     0x5e3bd32c3ea4 - test[30c43f9fd66fea90]::run_test::{closure#1}
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/test/src/lib.rs:637:41
[INFO] [stdout]   34:     0x5e3bd32c3ea4 - std[ec4e911328de40a6]::sys::backtrace::__rust_begin_short_backtrace::<test[30c43f9fd66fea90]::run_test::{closure#1}, ()>
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/sys/backtrace.rs:166:18
[INFO] [stdout]   35:     0x5e3bd32cb392 - std[ec4e911328de40a6]::thread::lifecycle::spawn_unchecked::<test[30c43f9fd66fea90]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/thread/lifecycle.rs:91:13
[INFO] [stdout]   36:     0x5e3bd32cb392 - <core[a96a4c5c53f902a3]::panic::unwind_safe::AssertUnwindSafe<std[ec4e911328de40a6]::thread::lifecycle::spawn_unchecked<test[30c43f9fd66fea90]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}> as core[a96a4c5c53f902a3]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   37:     0x5e3bd32cb392 - std[ec4e911328de40a6]::panicking::catch_unwind::do_call::<core[a96a4c5c53f902a3]::panic::unwind_safe::AssertUnwindSafe<std[ec4e911328de40a6]::thread::lifecycle::spawn_unchecked<test[30c43f9fd66fea90]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:581:40
[INFO] [stdout]   38:     0x5e3bd32cb392 - std[ec4e911328de40a6]::panicking::catch_unwind::<(), core[a96a4c5c53f902a3]::panic::unwind_safe::AssertUnwindSafe<std[ec4e911328de40a6]::thread::lifecycle::spawn_unchecked<test[30c43f9fd66fea90]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>>
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panicking.rs:544:19
[INFO] [stdout]   39:     0x5e3bd32cb392 - std[ec4e911328de40a6]::panic::catch_unwind::<core[a96a4c5c53f902a3]::panic::unwind_safe::AssertUnwindSafe<std[ec4e911328de40a6]::thread::lifecycle::spawn_unchecked<test[30c43f9fd66fea90]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/panic.rs:359:14
[INFO] [stdout]   40:     0x5e3bd32cb392 - std[ec4e911328de40a6]::thread::lifecycle::spawn_unchecked::<test[30c43f9fd66fea90]::run_test::{closure#1}, ()>::{closure#1}
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/thread/lifecycle.rs:89:26
[INFO] [stdout]   41:     0x5e3bd32cb392 - <std[ec4e911328de40a6]::thread::lifecycle::spawn_unchecked<test[30c43f9fd66fea90]::run_test::{closure#1}, ()>::{closure#1} as core[a96a4c5c53f902a3]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0}
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   42:     0x5e3bd3882a5f - <alloc[c960326de6de28e6]::boxed::Box<dyn core[a96a4c5c53f902a3]::ops::function::FnOnce<(), Output = ()> + core[a96a4c5c53f902a3]::marker::Send> as core[a96a4c5c53f902a3]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/alloc/src/boxed.rs:2240:9
[INFO] [stdout]   43:     0x5e3bd3882a5f - <std[ec4e911328de40a6]::sys::thread::unix::Thread>::new::thread_start
[INFO] [stdout]                                at /rustc/0abe69e6c16114311cc2700e972492e64d69c28f/library/std/src/sys/thread/unix.rs:118:17
[INFO] [stdout]   44:     0x77a201e27aa4 - <unknown>
[INFO] [stdout]   45:     0x77a201eb4a64 - clone
[INFO] [stdout]   46:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout]     prodex_impl::tests::runtime_proxy_does_not_rotate_after_first_sse_chunk_reset
[INFO] [stdout]     prodex_impl::tests::runtime_proxy_does_not_rotate_after_multi_chunk_sse_stall
[INFO] [stdout]     prodex_impl::tests::runtime_proxy_retries_after_websocket_reuse_silent_hang
[INFO] [stdout] 
[INFO] [stdout] test result: FAILED. 150 passed; 3 failed; 0 ignored; 0 measured; 0 filtered out; finished in 31.56s
[INFO] [stdout] 
[INFO] [stderr] error: test failed, to rerun pass `--test main_internal`
[INFO] running `Command { std: "docker" "inspect" "eece6d4cb283998c8025f377e0ac51aaf58def10af4401168c3edb96730e9925", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "eece6d4cb283998c8025f377e0ac51aaf58def10af4401168c3edb96730e9925", kill_on_drop: false }`
[INFO] [stdout] eece6d4cb283998c8025f377e0ac51aaf58def10af4401168c3edb96730e9925
