[INFO] cloning repository https://github.com/vllm-project/vllm-bench
[INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/vllm-project/vllm-bench" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fvllm-project%2Fvllm-bench", kill_on_drop: false }`
[INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fvllm-project%2Fvllm-bench'...
[INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }`
[INFO] [stdout] cfa8044cc79f3d2933c2a164d6db596f0efe53fe
[INFO] testing vllm-project/vllm-bench against 1.97.0-beta.6 for beta-1.98-1
[INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fvllm-project%2Fvllm-bench" "/workspace/builds/worker-7-tc1/source", kill_on_drop: false }`
[INFO] [stderr] Cloning into '/workspace/builds/worker-7-tc1/source'...
[INFO] [stderr] done.
[INFO] started tweaking git repo https://github.com/vllm-project/vllm-bench
[INFO] finished tweaking git repo https://github.com/vllm-project/vllm-bench
[INFO] tweaked toml for git repo https://github.com/vllm-project/vllm-bench written to /workspace/builds/worker-7-tc1/source/Cargo.toml
[INFO] validating manifest of git repo https://github.com/vllm-project/vllm-bench on toolchain 1.97.0-beta.6
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.97.0-beta.6" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] crate git repo https://github.com/vllm-project/vllm-bench already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.97.0-beta.6" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] [stderr]     Updating crates.io index
[INFO] [stderr]  Downloading crates ...
[INFO] [stderr]   Downloaded console v0.16.2
[INFO] [stderr]   Downloaded onig v6.5.1
[INFO] [stderr]   Downloaded rlimit v0.11.0
[INFO] [stderr]   Downloaded mimalloc v0.1.52
[INFO] [stderr]   Downloaded dary_heap v0.3.8
[INFO] [stderr]   Downloaded hf-hub v0.5.0
[INFO] [stderr]   Downloaded libmimalloc-sys v0.1.49
[INFO] [stderr]   Downloaded onig_sys v69.9.1
[INFO] [stderr]   Downloaded tiktoken-rs v0.9.1
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-m" "1610612736" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:3d5ced03c013a94a2f102a4510f48a6e9184255caf5fd8244f58017bde7f5210" "sleep" "infinity", kill_on_drop: false }`
[INFO] [stdout] dfdf4035ee5671d4f447d6ef8d7e2682da91af49ce2ceac7a97c526b224ec275
[INFO] running `Command { std: "docker" "start" "dfdf4035ee5671d4f447d6ef8d7e2682da91af49ce2ceac7a97c526b224ec275", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "dfdf4035ee5671d4f447d6ef8d7e2682da91af49ce2ceac7a97c526b224ec275", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-w" "/opt/rustwide/workdir" "--user" "0:0" "dfdf4035ee5671d4f447d6ef8d7e2682da91af49ce2ceac7a97c526b224ec275" "/opt/rustwide/cargo-home/bin/cargo" "+1.97.0-beta.6" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "dfdf4035ee5671d4f447d6ef8d7e2682da91af49ce2ceac7a97c526b224ec275", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "dfdf4035ee5671d4f447d6ef8d7e2682da91af49ce2ceac7a97c526b224ec275" "/opt/rustwide/cargo-home/bin/cargo" "+1.97.0-beta.6" "build" "--frozen" "--message-format=json", kill_on_drop: false }`
[INFO] [stderr]    Compiling memchr v2.8.0
[INFO] [stderr]    Compiling bytes v1.11.1
[INFO] [stderr]    Compiling itoa v1.0.17
[INFO] [stderr]    Compiling cc v1.2.56
[INFO] [stderr]    Compiling zeroize v1.8.2
[INFO] [stderr]    Compiling litemap v0.8.1
[INFO] [stderr]    Compiling zerocopy v0.8.42
[INFO] [stderr]    Compiling writeable v0.6.2
[INFO] [stderr]    Compiling icu_properties_data v2.1.2
[INFO] [stderr]    Compiling syn v2.0.117
[INFO] [stderr]    Compiling getrandom v0.2.17
[INFO] [stderr]    Compiling errno v0.3.14
[INFO] [stderr]    Compiling parking_lot_core v0.9.12
[INFO] [stderr]    Compiling mio v1.1.1
[INFO] [stderr]    Compiling socket2 v0.6.3
[INFO] [stderr]    Compiling icu_normalizer_data v2.1.1
[INFO] [stderr]    Compiling log v0.4.29
[INFO] [stderr]    Compiling signal-hook-registry v1.4.8
[INFO] [stderr]    Compiling parking_lot v0.12.5
[INFO] [stderr]    Compiling rustls-pki-types v1.14.0
[INFO] [stderr]    Compiling rustls v0.23.37
[INFO] [stderr]    Compiling serde_json v1.0.149
[INFO] [stderr]    Compiling getrandom v0.3.4
[INFO] [stderr]    Compiling tracing-core v0.1.36
[INFO] [stderr]    Compiling portable-atomic v1.13.1
[INFO] [stderr]    Compiling simd-adler32 v0.3.8
[INFO] [stderr]    Compiling hashbrown v0.16.1
[INFO] [stderr]    Compiling num-traits v0.2.19
[INFO] [stderr]    Compiling regex-syntax v0.8.10
[INFO] [stderr]    Compiling miniz_oxide v0.8.9
[INFO] [stderr]    Compiling tracing v0.1.44
[INFO] [stderr]    Compiling socks v0.3.4
[INFO] [stderr]    Compiling aho-corasick v1.1.4
[INFO] [stderr]    Compiling rand_core v0.9.5
[INFO] [stderr]    Compiling bitflags v2.11.0
[INFO] [stderr]    Compiling http v1.4.0
[INFO] [stderr]    Compiling indexmap v2.13.0
[INFO] [stderr]    Compiling webpki-roots v1.0.6
[INFO] [stderr]    Compiling flate2 v1.1.9
[INFO] [stderr]    Compiling dirs-sys v0.5.0
[INFO] [stderr]    Compiling webpki-roots v0.26.11
[INFO] [stderr]    Compiling console v0.16.2
[INFO] [stderr]    Compiling console v0.15.11
[INFO] [stderr]    Compiling rand_core v0.6.4
[INFO] [stderr]    Compiling unit-prefix v0.5.2
[INFO] [stderr]    Compiling dirs v6.0.0
[INFO] [stderr]    Compiling number_prefix v0.4.0
[INFO] [stderr]    Compiling iri-string v0.7.10
[INFO] [stderr]    Compiling bit-vec v0.6.3
[INFO] [stderr]    Compiling esaxx-rs v0.1.10
[INFO] [stderr]    Compiling nom v7.1.3
[INFO] [stderr]    Compiling anstream v0.6.21
[INFO] [stderr]    Compiling indicatif v0.17.11
[INFO] [stderr]    Compiling bit-set v0.5.3
[INFO] [stderr]    Compiling http-body v1.0.1
[INFO] [stderr]    Compiling http-body-util v0.1.3
[INFO] [stderr]    Compiling ureq-proto v0.5.3
[INFO] [stderr]    Compiling indicatif v0.18.4
[INFO] [stderr]    Compiling rayon v1.11.0
[INFO] [stderr]    Compiling itertools v0.14.0
[INFO] [stderr]    Compiling ring v0.17.14
[INFO] [stderr]    Compiling onig_sys v69.9.1
[INFO] [stderr]    Compiling libmimalloc-sys v0.1.49
[INFO] [stderr]    Compiling pxfm v0.1.28
[INFO] [stderr]    Compiling macro_rules_attribute-proc_macro v0.2.2
[INFO] [stderr]    Compiling regex-automata v0.4.14
[INFO] [stderr]    Compiling unicode-segmentation v1.12.0
[INFO] [stderr]    Compiling rlimit v0.11.0
[INFO] [stderr]    Compiling clap_lex v1.0.0
[INFO] [stderr]    Compiling macro_rules_attribute v0.2.2
[INFO] [stderr]    Compiling getrandom v0.4.2
[INFO] [stderr]    Compiling clap_builder v4.5.60
[INFO] [stderr]    Compiling dirs-sys v0.4.1
[INFO] [stderr]    Compiling num_cpus v1.17.0
[INFO] [stderr]    Compiling unicode-normalization-alignments v0.1.12
[INFO] [stderr]    Compiling rustc-hash v1.1.0
[INFO] [stderr]    Compiling chrono v0.4.44
[INFO] [stderr]    Compiling mimalloc v0.1.52
[INFO] [stderr]    Compiling dirs v5.0.1
[INFO] [stderr]    Compiling uuid v1.22.0
[INFO] [stderr]    Compiling synstructure v0.13.2
[INFO] [stderr]    Compiling darling_core v0.20.11
[INFO] [stderr]    Compiling moxcms v0.8.1
[INFO] [stderr]    Compiling ppv-lite86 v0.2.21
[INFO] [stderr]    Compiling rayon-cond v0.4.0
[INFO] [stderr]    Compiling rand_chacha v0.9.0
[INFO] [stderr]    Compiling rand_chacha v0.3.1
[INFO] [stderr]    Compiling rand v0.9.2
[INFO] [stderr]    Compiling rand v0.8.5
[INFO] [stderr]    Compiling regex v1.12.3
[INFO] [stderr]    Compiling fancy-regex v0.13.0
[INFO] [stderr]    Compiling bstr v1.12.1
[INFO] [stderr]    Compiling zerofrom-derive v0.1.6
[INFO] [stderr]    Compiling yoke-derive v0.8.1
[INFO] [stderr]    Compiling zerovec-derive v0.11.2
[INFO] [stderr]    Compiling displaydoc v0.2.5
[INFO] [stderr]    Compiling tokio-macros v2.6.1
[INFO] [stderr]    Compiling serde_derive v1.0.228
[INFO] [stderr]    Compiling futures-macro v0.3.32
[INFO] [stderr]    Compiling rustls-webpki v0.103.9
[INFO] [stderr]    Compiling thiserror-impl v2.0.18
[INFO] [stderr]    Compiling monostate-impl v0.1.18
[INFO] [stderr]    Compiling tokio v1.50.0
[INFO] [stderr]    Compiling onig v6.5.1
[INFO] [stderr]    Compiling monostate v0.1.18
[INFO] [stderr]    Compiling futures-util v0.3.32
[INFO] [stderr]    Compiling clap_derive v4.5.55
[INFO] [stderr]    Compiling tiktoken-rs v0.9.1
[INFO] [stderr]    Compiling rand_distr v0.4.3
[INFO] [stderr]    Compiling zerofrom v0.1.6
[INFO] [stderr]    Compiling yoke v0.8.1
[INFO] [stderr]    Compiling zerovec v0.11.5
[INFO] [stderr]    Compiling zerotrie v0.2.3
[INFO] [stderr]    Compiling darling_macro v0.20.11
[INFO] [stderr]    Compiling thiserror v2.0.18
[INFO] [stderr]    Compiling darling v0.20.11
[INFO] [stderr]    Compiling derive_builder_core v0.20.2
[INFO] [stderr]    Compiling tinystr v0.8.2
[INFO] [stderr]    Compiling potential_utf v0.1.4
[INFO] [stderr]    Compiling clap v4.5.60
[INFO] [stderr]    Compiling icu_collections v2.1.1
[INFO] [stderr]    Compiling icu_locale_core v2.1.1
[INFO] [stderr]    Compiling derive_builder_macro v0.20.2
[INFO] [stderr]    Compiling serde v1.0.228
[INFO] [stderr]    Compiling icu_provider v2.1.1
[INFO] [stderr]    Compiling image v0.25.10
[INFO] [stderr]    Compiling derive_builder v0.20.2
[INFO] [stderr]    Compiling icu_normalizer v2.1.1
[INFO] [stderr]    Compiling icu_properties v2.1.2
[INFO] [stderr]    Compiling serde_urlencoded v0.7.1
[INFO] [stderr]    Compiling ahash v0.8.12
[INFO] [stderr]    Compiling spm_precompiled v0.1.4
[INFO] [stderr]    Compiling dary_heap v0.3.8
[INFO] [stderr]    Compiling compact_str v0.9.0
[INFO] [stderr]    Compiling ureq v3.2.0
[INFO] [stderr]    Compiling futures-executor v0.3.32
[INFO] [stderr]    Compiling idna_adapter v1.2.1
[INFO] [stderr]    Compiling idna v1.1.0
[INFO] [stderr]    Compiling futures v0.3.32
[INFO] [stderr]    Compiling url v2.5.8
[INFO] [stderr]    Compiling tokio-util v0.7.18
[INFO] [stderr]    Compiling tower v0.5.3
[INFO] [stderr]    Compiling tokio-rustls v0.26.4
[INFO] [stderr]    Compiling tokio-stream v0.1.18
[INFO] [stderr]    Compiling ureq v2.12.1
[INFO] [stderr]    Compiling tower-http v0.6.8
[INFO] [stderr]    Compiling h2 v0.4.13
[INFO] [stderr]    Compiling hf-hub v0.4.3
[INFO] [stderr]    Compiling tokenizers v0.22.2
[INFO] [stderr]    Compiling hyper v1.8.1
[INFO] [stderr]    Compiling hyper-util v0.1.20
[INFO] [stderr]    Compiling hyper-rustls v0.27.7
[INFO] [stderr]    Compiling reqwest v0.12.28
[INFO] [stderr]    Compiling hf-hub v0.5.0
[INFO] [stderr]    Compiling vllm-bench v0.1.0 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `dev` profile [unoptimized + debuginfo] target(s) in 1m 35s
[INFO] running `Command { std: "docker" "inspect" "dfdf4035ee5671d4f447d6ef8d7e2682da91af49ce2ceac7a97c526b224ec275", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "dfdf4035ee5671d4f447d6ef8d7e2682da91af49ce2ceac7a97c526b224ec275" "/opt/rustwide/cargo-home/bin/cargo" "+1.97.0-beta.6" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }`
[INFO] [stderr]    Compiling vllm-bench v0.1.0 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 12.93s
[INFO] running `Command { std: "docker" "inspect" "dfdf4035ee5671d4f447d6ef8d7e2682da91af49ce2ceac7a97c526b224ec275", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "dfdf4035ee5671d4f447d6ef8d7e2682da91af49ce2ceac7a97c526b224ec275" "/opt/rustwide/cargo-home/bin/cargo" "+1.97.0-beta.6" "test" "--frozen", kill_on_drop: false }`
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 0.44s
[INFO] [stderr]      Running unittests src/main.rs (/opt/rustwide/target/debug/deps/vllm_bench-8b946614785dcbab)
[INFO] [stdout] 
[INFO] [stdout] running 151 tests
[INFO] [stdout] test backends::openai_chat::tests::test_build_mm_payload_is_valid_json ... ok
[INFO] [stdout] test backends::openai_chat::tests::test_mm_payload_tail_fields ... ok
[INFO] [stdout] test backends::pooling::tests::test_embeddings_payload_batched_input ... ok
[INFO] [stdout] test backends::openai_chat::tests::test_chat_messages_json_path_equivalent_to_fragment_path ... ok
[INFO] [stdout] test backends::streaming::tests::test_comment_lines ... ok
[INFO] [stdout] test backends::streaming::tests::test_basic_sse ... ok
[INFO] [stdout] test backends::streaming::tests::test_done_without_newlines ... ok
[INFO] [stdout] test backends::streaming::tests::test_incomplete_json_in_buffer ... ok
[INFO] [stdout] test backends::streaming::tests::test_multi_field_sse_event ... ok
[INFO] [stdout] test backends::streaming::tests::test_multi_field_sse_speculative_parse ... ok
[INFO] [stdout] test benchmark::max_model_len_tests::test_filter_requests_by_max_model_len_keeps_boundary ... ok
[INFO] [stdout] test benchmark::max_model_len_tests::test_filter_requests_by_max_model_len_noop_without_limit ... ok
[INFO] [stdout] test benchmark::tests::test_assign_lora_modules_none_when_unset ... ok
[INFO] [stdout] test benchmark::tests::test_assign_lora_modules_single_adapter ... ok
[INFO] [stdout] test benchmark::tests::test_compute_spec_decode_stats_new_positions_in_after ... ok
[INFO] [stdout] test backends::pooling::tests::test_rerank_payload_query_and_documents ... ok
[INFO] [stdout] test benchmark::tests::test_compute_spec_decode_stats_basic ... ok
[INFO] [stdout] test benchmark::tests::test_compute_spec_decode_stats_zero_drafts ... ok
[INFO] [stdout] test benchmark::tests::test_compute_spec_decode_stats_zero_draft_tokens_returns_none ... ok
[INFO] [stdout] test backends::streaming::tests::test_split_chunks ... ok
[INFO] [stdout] test config::tests::test_range_ratio_bounds_python_semantics ... ok
[INFO] [stdout] test benchmark::tests::test_assign_lora_modules_random_covers_all_modules ... ok
[INFO] [stdout] test config::tests::test_range_ratio_parse_dict ... ok
[INFO] [stdout] test backends::pooling::tests::test_rerank_payload_legacy_single_prompt ... ok
[INFO] [stdout] test config::tests::test_range_ratio_parse_float ... ok
[INFO] [stdout] test benchmark::tests::test_assign_lora_modules_round_robin_cycles ... ok
[INFO] [stdout] test config::tests::test_prefix_sharing_sum_exceeds_one_fails ... ok
[INFO] [stdout] test config::tests::test_prefix_sharing_out_of_range_fails ... ok
[INFO] [stdout] test config::tests::test_sharegpt_multi_turn_max_turns_explicit_cap ... ok
[INFO] [stdout] test config::tests::test_max_model_len_is_configured ... ok
[INFO] [stdout] test config::tests::test_invalid_sweep_summary_percentile_fails ... ok
[INFO] [stdout] test config::tests::test_range_ratio_rejects_old_default_with_hint ... ok
[INFO] [stdout] test config::tests::test_prefix_sharing_valid ... ok
[INFO] [stdout] test config::tests::test_sharegpt_multi_turn_max_turns_default_uncapped ... ok
[INFO] [stdout] test config::tests::test_prefix_sharing_sum_equals_one_fails ... ok
[INFO] [stdout] test config::tests::test_prefix_sharing_requires_random_dataset ... ok
[INFO] [stdout] test config::tests::test_sweep_summary_percentiles_are_deduped_and_merged ... ok
[INFO] [stdout] test config::tests::test_sweep_summary_percentiles_default_empty ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_detect_chat_conversation ... ok
[INFO] [stdout] test config::tests::test_sharegpt_multi_turn_max_turns_1_rejected ... ok
[INFO] [stdout] test config::tests::test_sharegpt_multi_turn_max_turns_2_succeeds ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_detect_chat_sharegpt_format ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_detect_question_answer ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_detect_turns_array ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_detect_plain_prompt ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_detect_chat_messages ... ok
[INFO] [stdout] test config::tests::test_zero_max_model_len_fails ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_detect_combined_context_input ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_detect_no_known_columns ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_detect_user_override ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_extract_chat_completion_gpt ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_extract_chat_completion_no_assistant ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_extract_chat_completion_role_content ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_extract_chat_prompt_empty_messages ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_detect_user_override_missing_column ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_extract_chat_completion_empty_messages ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_detect_user_override_chat_column ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_extract_chat_completion_model_role_not_matched ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_extract_chat_prompt_from_value ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_extract_chat_prompt_model_role_before_user ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_extract_chat_prompt_no_user ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_extract_chat_prompt_model_role_skipped ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_is_chat_array_invalid ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_is_chat_message_invalid ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_extract_chat_prompt_system_first ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_is_chat_array_valid ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_is_chat_message_valid ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_extract_chat_prompt_role_content ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_sanitize_name ... ok
[INFO] [stdout] test datasets::multi_turn::tests::test_per_turn_input_len_default_mode ... ignored
[INFO] [stdout] test datasets::multi_turn::tests::test_per_turn_input_len_prefix_sharing ... ignored
[INFO] [stdout] test datasets::multi_turn::tests::test_prefix_sharing_structure ... ignored
[INFO] [stdout] test datasets::multi_turn::tests::test_variable_turns_fixed ... ignored
[INFO] [stdout] test datasets::multi_turn::tests::test_variable_turns_range ... ignored
[INFO] [stdout] test benchmark::tests::test_assign_lora_modules_random_is_seed_reproducible ... ok
[INFO] [stdout] test config::tests::test_prefix_sharing_defaults_to_zero ... ok
[INFO] [stdout] test datasets::random::tests::test_generate_random_dataset_text ... ignored
[INFO] [stdout] test datasets::random::tests::test_generate_random_dataset_token_ids ... ignored
[INFO] [stdout] test datasets::random::tests::test_tiktoken_roundtrip_stability ... ignored
[INFO] [stdout] test datasets::random::tests::test_token_length_exact_local ... ignored
[INFO] [stdout] test datasets::random::tests::test_token_length_exact_tiktoken ... ignored
[INFO] [stdout] test datasets::random_mm::tests::test_build_chat_messages_json_text_only ... ok
[INFO] [stdout] test datasets::random_mm::tests::test_build_chat_messages_json_valid_and_ordered ... ok
[INFO] [stdout] test datasets::random_mm::tests::test_generate_random_image ... ok
[INFO] [stdout] test datasets::random_mm::tests::test_parse_bucket_config_basic ... ok
[INFO] [stdout] test datasets::random_mm::tests::test_parse_bucket_config_single ... ok
[INFO] [stdout] test datasets::random_mm::tests::test_parse_bucket_config_with_video ... ok
[INFO] [stdout] test datasets::random_mm::tests::test_parse_limit_mm_per_prompt ... ok
[INFO] [stdout] test datasets::random_mm::tests::test_parse_limit_mm_per_prompt_defaults ... ok
[INFO] [stdout] test datasets::random_mm::tests::test_sample_mm_items_basic ... ok
[INFO] [stdout] test datasets::random_mm::tests::test_sample_mm_items_respects_limit ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_load_hf_dataset_request_id_prefix ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_load_hf_dataset_plain_text_format ... ok
[INFO] [stdout] test datasets::sharegpt::tests::test_is_valid_sequence ... ok
[INFO] [stdout] test datasets::tests::test_batch_requests_groups_and_sums ... ok
[INFO] [stdout] test datasets::tests::test_batch_requests_size_one_is_identity ... ok
[INFO] [stdout] test datasets::tests::test_oversample_requests ... ok
[INFO] [stdout] test metrics::calculator::tests::test_mean_empty ... ok
[INFO] [stdout] test metrics::calculator::tests::test_mean_values ... ok
[INFO] [stdout] test metrics::calculator::tests::test_median_even ... ok
[INFO] [stdout] test metrics::calculator::tests::test_median_odd ... ok
[INFO] [stdout] test metrics::calculator::tests::test_percentile_99 ... ok
[INFO] [stdout] test metrics::steady_state::tests::compute_constant_concurrency_matches_full_run ... ok
[INFO] [stdout] test metrics::steady_state::tests::compute_drain_only_tokens_not_counted ... ok
[INFO] [stdout] test metrics::steady_state::tests::compute_pooling_skips_ttft_and_tpot ... ok
[INFO] [stdout] test metrics::steady_state::tests::compute_tpot_matches_per_request_definition ... ok
[INFO] [stdout] test metrics::steady_state::tests::end_to_end_trapezoid_run ... ok
[INFO] [stdout] test metrics::steady_state::tests::json_deserialize_missing_key_as_none ... ok
[INFO] [stdout] test metrics::steady_state::tests::json_roundtrip_some ... ok
[INFO] [stdout] test metrics::steady_state::tests::window_constant_concurrency_equals_full_run ... ok
[INFO] [stdout] test metrics::steady_state::tests::window_none_when_all_fail ... ok
[INFO] [stdout] test metrics::steady_state::tests::window_none_when_never_reaches_threshold ... ok
[INFO] [stdout] test metrics::steady_state::tests::window_none_when_target_none ... ok
[INFO] [stdout] test metrics::steady_state::tests::window_plateau_trapezoid ... ok
[INFO] [stdout] test metrics::steady_state::tests::window_threshold_one ... ok
[INFO] [stdout] test metrics::steady_state::tests::window_ties_net_to_zero ... ok
[INFO] [stdout] test metrics::steady_state::tests::window_warning_when_short ... ok
[INFO] [stdout] test multi_run::tests::compute_stats_opt_all_none ... ok
[INFO] [stdout] test multi_run::tests::compute_stats_opt_excludes_none ... ok
[INFO] [stdout] test multi_turn::tests::test_filter_turns_by_max_model_len_retains_independent_no_history_turns ... ok
[INFO] [stdout] test multi_turn::tests::test_filter_turns_by_max_model_len_truncates_history_conversations ... ok
[INFO] [stdout] test multi_turn::tests::test_valid_prefix_len_for_max_model_len_with_history ... ok
[INFO] [stdout] test output::json::tests::test_collect_failed_requests_empty_when_all_success ... ok
[INFO] [stdout] test output::json::tests::test_collect_failed_requests_preserves_index_and_fields ... ok
[INFO] [stdout] test output::json::tests::test_insert_spec_decode_stats ... ok
[INFO] [stdout] test output::json::tests::test_insert_spec_decode_stats_empty_positions ... ok
[INFO] [stdout] test rate_control::tests::test_exponential_ramp_up ... ok
[INFO] [stdout] test rate_control::tests::test_fixed_rate_monotonic ... ok
[INFO] [stdout] test rate_control::tests::test_infinite_burstiness_constant_delay ... ok
[INFO] [stdout] test rate_control::tests::test_infinite_rate_all_zero_delays ... ok
[INFO] [stdout] test rate_control::tests::test_linear_ramp_up ... ok
[INFO] [stdout] test sweep::tests::summary_columns_follow_requested_percentile_order ... ok
[INFO] [stdout] test sweep::tests::summary_columns_skip_duplicate_p50_and_p90_percentiles ... ok
[INFO] [stdout] test sweep::tests::summary_row_renders_dash_when_steady_state_missing ... ok
[INFO] [stdout] test sweep::tests::summary_row_renders_steady_state_columns ... ok
[INFO] [stdout] test sweep::tests::summary_row_uses_dash_for_missing_requested_percentile_values ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_load_hf_dataset_no_oversample ... ok
[INFO] [stdout] test datasets::custom::tests::test_load_custom_dataset_per_line_output_tokens ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_load_hf_dataset_all_rows_filtered_too_short ... ok
[INFO] [stdout] test datasets::custom::tests::test_load_custom_dataset_basic ... ok
[INFO] [stdout] test datasets::prefix_repetition::tests::test_prefix_repetition_too_few_requests_errors ... ok
[INFO] [stdout] test datasets::random_rerank::tests::test_random_rerank_reranker_mode ... ok
[INFO] [stdout] test datasets::prefix_repetition::tests::test_prefix_repetition_structure ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_load_hf_dataset_disable_shuffle_preserves_order ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_load_hf_dataset_combined_format ... ok
[INFO] [stdout] test datasets::custom::tests::test_load_custom_dataset_missing_output_tokens_errors ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_load_hf_dataset_empty_returns_error ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_load_hf_dataset_chat_format ... ok
[INFO] [stdout] test datasets::custom::tests::test_load_custom_dataset_missing_prompt_errors ... ok
[INFO] [stdout] test datasets::hf_dataset::tests::test_load_hf_dataset_hf_output_len_override ... ok
[INFO] [stdout] test datasets::random_rerank::tests::test_random_rerank_no_reranker_mode ... ok
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 141 passed; 0 failed; 10 ignored; 0 measured; 0 filtered out; finished in 2.61s
[INFO] [stdout] 
[INFO] running `Command { std: "docker" "inspect" "dfdf4035ee5671d4f447d6ef8d7e2682da91af49ce2ceac7a97c526b224ec275", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "dfdf4035ee5671d4f447d6ef8d7e2682da91af49ce2ceac7a97c526b224ec275", kill_on_drop: false }`
[INFO] [stdout] dfdf4035ee5671d4f447d6ef8d7e2682da91af49ce2ceac7a97c526b224ec275
