[INFO] cloning repository https://github.com/kraftaa/raglens
[INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/kraftaa/raglens" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fkraftaa%2Fraglens", kill_on_drop: false }`
[INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fkraftaa%2Fraglens'...
[INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }`
[INFO] [stdout] b6384baa741dd44d404cba8e26e6e2314d4349df
[INFO] testing kraftaa/raglens against 1.97.0-beta.6 for beta-1.98-2
[INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fkraftaa%2Fraglens" "/workspace/builds/worker-7-tc1/source", kill_on_drop: false }`
[INFO] [stderr] Cloning into '/workspace/builds/worker-7-tc1/source'...
[INFO] [stderr] done.
[INFO] started tweaking git repo https://github.com/kraftaa/raglens
[INFO] finished tweaking git repo https://github.com/kraftaa/raglens
[INFO] tweaked toml for git repo https://github.com/kraftaa/raglens written to /workspace/builds/worker-7-tc1/source/Cargo.toml
[INFO] validating manifest of git repo https://github.com/kraftaa/raglens on toolchain 1.97.0-beta.6
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.97.0-beta.6" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] crate git repo https://github.com/kraftaa/raglens already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.97.0-beta.6" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] [stderr]  Downloading crates ...
[INFO] [stderr]   Downloaded assert_cmd v2.2.0
[INFO] [stderr]   Downloaded predicates-core v1.0.10
[INFO] [stderr]   Downloaded predicates v3.1.4
[INFO] [stderr]   Downloaded predicates-tree v1.0.13
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-m" "1610612736" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:3d5ced03c013a94a2f102a4510f48a6e9184255caf5fd8244f58017bde7f5210" "sleep" "infinity", kill_on_drop: false }`
[INFO] [stdout] 135a7b6dfed5e61a3541732d4f6f1460f76300f4277fb4e56e468bf3db5ea969
[INFO] running `Command { std: "docker" "start" "135a7b6dfed5e61a3541732d4f6f1460f76300f4277fb4e56e468bf3db5ea969", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "135a7b6dfed5e61a3541732d4f6f1460f76300f4277fb4e56e468bf3db5ea969", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-w" "/opt/rustwide/workdir" "--user" "0:0" "135a7b6dfed5e61a3541732d4f6f1460f76300f4277fb4e56e468bf3db5ea969" "/opt/rustwide/cargo-home/bin/cargo" "+1.97.0-beta.6" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "135a7b6dfed5e61a3541732d4f6f1460f76300f4277fb4e56e468bf3db5ea969", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "135a7b6dfed5e61a3541732d4f6f1460f76300f4277fb4e56e468bf3db5ea969" "/opt/rustwide/cargo-home/bin/cargo" "+1.97.0-beta.6" "build" "--frozen" "--message-format=json", kill_on_drop: false }`
[INFO] [stderr]    Compiling memchr v2.8.0
[INFO] [stderr]    Compiling cc v1.2.57
[INFO] [stderr]    Compiling typenum v1.19.0
[INFO] [stderr]    Compiling http v0.2.12
[INFO] [stderr]    Compiling syn v2.0.117
[INFO] [stderr]    Compiling getrandom v0.2.17
[INFO] [stderr]    Compiling indexmap v2.13.0
[INFO] [stderr]    Compiling tracing-core v0.1.36
[INFO] [stderr]    Compiling tokio v1.50.0
[INFO] [stderr]    Compiling socket2 v0.5.10
[INFO] [stderr]    Compiling num-traits v0.2.19
[INFO] [stderr]    Compiling winnow v0.7.15
[INFO] [stderr]    Compiling toml_write v0.1.2
[INFO] [stderr]    Compiling clap_builder v4.6.0
[INFO] [stderr]    Compiling tracing v0.1.44
[INFO] [stderr]    Compiling futures-util v0.3.32
[INFO] [stderr]    Compiling aho-corasick v1.1.4
[INFO] [stderr]    Compiling csv-core v0.1.13
[INFO] [stderr]    Compiling serde_json v1.0.149
[INFO] [stderr]    Compiling csv v1.4.0
[INFO] [stderr]    Compiling generic-array v0.14.7
[INFO] [stderr]    Compiling chrono v0.4.44
[INFO] [stderr]    Compiling http-body v0.4.6
[INFO] [stderr]    Compiling ring v0.17.14
[INFO] [stderr]    Compiling block-buffer v0.10.4
[INFO] [stderr]    Compiling crypto-common v0.1.7
[INFO] [stderr]    Compiling digest v0.10.7
[INFO] [stderr]    Compiling regex-automata v0.4.14
[INFO] [stderr]    Compiling sha2 v0.10.9
[INFO] [stderr]    Compiling rustls v0.21.12
[INFO] [stderr]    Compiling regex v1.12.3
[INFO] [stderr]    Compiling synstructure v0.13.2
[INFO] [stderr]    Compiling tokio-util v0.7.18
[INFO] [stderr]    Compiling zerovec-derive v0.11.2
[INFO] [stderr]    Compiling displaydoc v0.2.5
[INFO] [stderr]    Compiling serde_derive v1.0.228
[INFO] [stderr]    Compiling clap_derive v4.6.0
[INFO] [stderr]    Compiling zerofrom-derive v0.1.6
[INFO] [stderr]    Compiling yoke-derive v0.8.1
[INFO] [stderr]    Compiling h2 v0.3.27
[INFO] [stderr]    Compiling rustls-webpki v0.101.7
[INFO] [stderr]    Compiling sct v0.7.1
[INFO] [stderr]    Compiling zerofrom v0.1.6
[INFO] [stderr]    Compiling yoke v0.8.1
[INFO] [stderr]    Compiling zerovec v0.11.5
[INFO] [stderr]    Compiling zerotrie v0.2.3
[INFO] [stderr]    Compiling clap v4.6.0
[INFO] [stderr]    Compiling tinystr v0.8.2
[INFO] [stderr]    Compiling potential_utf v0.1.4
[INFO] [stderr]    Compiling icu_collections v2.1.1
[INFO] [stderr]    Compiling icu_locale_core v2.1.1
[INFO] [stderr]    Compiling serde v1.0.228
[INFO] [stderr]    Compiling icu_provider v2.1.1
[INFO] [stderr]    Compiling icu_properties v2.1.2
[INFO] [stderr]    Compiling icu_normalizer v2.1.1
[INFO] [stderr]    Compiling serde_spanned v0.6.9
[INFO] [stderr]    Compiling toml_datetime v0.6.11
[INFO] [stderr]    Compiling serde_urlencoded v0.7.1
[INFO] [stderr]    Compiling serde_yaml v0.9.34+deprecated
[INFO] [stderr]    Compiling toml_edit v0.22.27
[INFO] [stderr]    Compiling tokio-rustls v0.24.1
[INFO] [stderr]    Compiling hyper v0.14.32
[INFO] [stderr]    Compiling idna_adapter v1.2.1
[INFO] [stderr]    Compiling idna v1.1.0
[INFO] [stderr]    Compiling url v2.5.8
[INFO] [stderr]    Compiling toml v0.8.23
[INFO] [stderr]    Compiling hyper-rustls v0.24.2
[INFO] [stderr]    Compiling reqwest v0.11.27
[INFO] [stderr]    Compiling rag-audit v0.1.3 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `dev` profile [unoptimized + debuginfo] target(s) in 55.82s
[INFO] running `Command { std: "docker" "inspect" "135a7b6dfed5e61a3541732d4f6f1460f76300f4277fb4e56e468bf3db5ea969", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "135a7b6dfed5e61a3541732d4f6f1460f76300f4277fb4e56e468bf3db5ea969" "/opt/rustwide/cargo-home/bin/cargo" "+1.97.0-beta.6" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }`
[INFO] [stderr]    Compiling regex-automata v0.4.14
[INFO] [stderr]    Compiling predicates-core v1.0.10
[INFO] [stderr]    Compiling float-cmp v0.10.0
[INFO] [stderr]    Compiling assert_cmd v2.2.0
[INFO] [stderr]    Compiling difflib v0.4.0
[INFO] [stderr]    Compiling normalize-line-endings v0.3.0
[INFO] [stderr]    Compiling termtree v0.5.1
[INFO] [stderr]    Compiling wait-timeout v0.2.1
[INFO] [stderr]    Compiling predicates-tree v1.0.13
[INFO] [stderr]    Compiling regex v1.12.3
[INFO] [stderr]    Compiling bstr v1.12.1
[INFO] [stderr]    Compiling rag-audit v0.1.3 (/opt/rustwide/workdir)
[INFO] [stderr]    Compiling predicates v3.1.4
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 20.30s
[INFO] running `Command { std: "docker" "inspect" "135a7b6dfed5e61a3541732d4f6f1460f76300f4277fb4e56e468bf3db5ea969", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "135a7b6dfed5e61a3541732d4f6f1460f76300f4277fb4e56e468bf3db5ea969" "/opt/rustwide/cargo-home/bin/cargo" "+1.97.0-beta.6" "test" "--frozen", kill_on_drop: false }`
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 0.29s
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/rag_audit-36b7870c7bcec4a4)
[INFO] [stdout] 
[INFO] [stdout] running 43 tests
[INFO] [stdout] test answer_audit::tests::metric_name_score_prefers_revenue_over_traffic ... ok
[INFO] [stdout] test answer_audit::tests::flags_contradiction_and_missing_driver ... ok
[INFO] [stdout] test answer_audit::tests::month_granularity_accepts_rfc3339_offset_dates ... ok
[INFO] [stdout] test answer_audit::tests::month_granularity_rejects_non_date_period_values ... ok
[INFO] [stdout] test answer_audit::tests::reports_data_quality_when_some_period_rows_are_unparseable ... ok
[INFO] [stdout] test answer_audit::tests::risky_when_answer_mentions_weak_driver ... ok
[INFO] [stdout] test chunker::tests::heading_boundary_keeps_previous_chunk_heading ... ok
[INFO] [stdout] test chunker::tests::long_single_line_is_split_by_token_limit ... ok
[INFO] [stdout] test chunker::tests::sentence_split_keeps_sentence_boundaries_when_possible ... ok
[INFO] [stdout] test answer_audit::tests::supported_when_main_driver_matches_answer ... ok
[INFO] [stdout] test compare_runs::tests::classify_improved_case ... ok
[INFO] [stdout] test compare_runs::tests::classify_regressed_case ... ok
[INFO] [stdout] test compare_runs::tests::dominant_top1_tie_breaks_by_doc_id ... ok
[INFO] [stdout] test compare_runs::tests::merge_top1_tie_breaks_by_doc_id_for_determinism ... ok
[INFO] [stdout] test compare_runs::tests::summarize_fallback_computes_low_and_no_match ... ok
[INFO] [stdout] test config::tests::invalid_dominant_threshold_fails_validation ... ok
[INFO] [stdout] test config::tests::invalid_chunking_parameters_fail_validation ... ok
[INFO] [stdout] test config::tests::invalid_threshold_order_fails_validation ... ok
[INFO] [stdout] test diagnostics::tests::coverage_uses_configurable_thresholds ... ok
[INFO] [stdout] test diagnostics::tests::simulate_summary_counts_empty_ranked_as_no_match ... ok
[INFO] [stdout] test diagnostics::tests::dominant_topk_counts_doc_once_per_query ... ok
[INFO] [stdout] test diagnostics::tests::dominant_cause_hint_has_fallback_for_broad_coverage ... ok
[INFO] [stdout] test answer_audit::tests::ignores_substring_false_positive_for_direction_claim ... ok
[INFO] [stdout] test embeddings::tests::retryable_statuses_are_limited_to_transient_errors ... ok
[INFO] [stdout] test config::tests::supports_top_level_provider_style_config ... ok
[INFO] [stdout] test diagnostics::tests::expectation_checks_best_rank_across_expected_docs ... ok
[INFO] [stdout] test report::tests::expectation_preview_dedupes_duplicate_docs_in_top3 ... ok
[INFO] [stdout] test loader::tests::rejects_missing_root_path ... ok
[INFO] [stdout] test retrieval::tests::load_queries_ignores_blank_and_comment_lines ... ok
[INFO] [stdout] test tests::reduce_fix_message_matches_direction ... ok
[INFO] [stdout] test diagnostics::tests::dominant_detection_requires_top1_share ... ok
[INFO] [stdout] test tests::suggested_smaller_chunk_size_never_increases ... ok
[INFO] [stdout] test diagnostics::tests::overlap_order_uses_numeric_chunk_suffix ... ok
[INFO] [stdout] test diagnostics::tests::dominant_cause_hint_reports_missing_metadata ... ok
[INFO] [stdout] test answer_audit::tests::parses_thousands_separated_metric_values ... ok
[INFO] [stdout] test retrieval::tests::load_queries_fails_fast_for_invalid_yaml_files ... ok
[INFO] [stdout] test retrieval::tests::load_queries_supports_tab_separated_format ... ok
[INFO] [stdout] test run_diff::tests::answer_diff_ignores_case_and_whitespace ... ok
[INFO] [stdout] test provenance::tests::trace_selects_best_evidence_by_answer_overlap ... ok
[INFO] [stdout] test loader::tests::loader_orders_documents_deterministically ... ok
[INFO] [stdout] test loader::tests::parses_crlf_frontmatter ... ok
[INFO] [stdout] test loader::tests::invalid_frontmatter_is_tolerated ... ok
[INFO] [stdout] test loader::tests::supports_uppercase_extensions ... ok
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 43 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.02s
[INFO] [stdout] 
[INFO] [stderr]      Running unittests src/main.rs (/opt/rustwide/target/debug/deps/rag_audit-04526b8c1fc1f951)
[INFO] [stderr]      Running unittests src/bin/raglens.rs (/opt/rustwide/target/debug/deps/raglens-28742380dcbe3b6b)
[INFO] [stdout] 
[INFO] [stderr]      Running tests/integration.rs (/opt/rustwide/target/debug/deps/integration-b5aee3f8382f62a0)
[INFO] [stdout] running 0 tests
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] running 0 tests
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] running 44 tests
[INFO] [stdout] test answer_audit_risky_example ... ok
[INFO] [stdout] test compare_runs_fail_if_top1_dominant_rate_exceeds ... ok
[INFO] [stdout] test compare_runs_json_contains_verdict ... ok
[INFO] [stdout] test compare_runs_fail_if_weak_increases ... ok
[INFO] [stdout] test answer_audit_detects_contradiction_from_example_csv ... ok
[INFO] [stdout] test answer_audit_auto_infers_schema ... ok
[INFO] [stdout] test compare_runs_fail_if_regressed ... ok
[INFO] [stdout] test answer_audit_month_granularity_buckets_dates ... ok
[INFO] [stdout] test compare_gate_exit_code_is_3 ... ok
[INFO] [stdout] test diff_case_a_no_meaningful_change ... ok
[INFO] [stdout] test compare_runs_fail_if_no_match_increases ... ok
[INFO] [stdout] test compare_runs_fail_if_similarity_drops ... ok
[INFO] [stdout] test compare_runs_rejects_readiness_fail_flags ... ok
[INFO] [stdout] test compare_runs_rejects_invalid_dominant_threshold ... ok
[INFO] [stdout] test eval_matches_rule_by_id_when_question_differs ... ok
[INFO] [stdout] test eval_fails_on_invalid_run_json_in_directory ... ok
[INFO] [stdout] test compare_runs_fail_if_top1_dominant_rate_increases ... ok
[INFO] [stdout] test raglens_alias_binary_works ... ok
[INFO] [stdout] test diff_case_e_missing_scores_supported ... ok
[INFO] [stdout] test diff_case_d_retrieval_changed_but_answer_stable ... ok
[INFO] [stdout] test diff_case_c_retrieval_changed_with_answer_change ... ok
[INFO] [stdout] test eval_matches_rule_id_across_separator_variants ... ok
[INFO] [stdout] test explain_writes_html_output ... ok
[INFO] [stdout] test eval_reports_pass_fail_breakdown ... ok
[INFO] [stdout] test help_shows_mvp_commands_and_hides_advanced_commands ... ok
[INFO] [stdout] test diff_case_b_answer_generation_changed ... ok
[INFO] [stdout] test readiness_rejects_invalid_fail_on_dominant ... ok
[INFO] [stdout] test mcp_import_supports_custom_json_pointers ... ok
[INFO] [stdout] test fix_returns_advice_json ... ok
[INFO] [stdout] test mcp_import_autodetects_common_trace_shape ... ok
[INFO] [stdout] test report_generates_markdown_from_eval_rules ... ok
[INFO] [stdout] test self_test_json_contains_ok ... ok
[INFO] [stdout] test answer_audit_supported_example ... ok
[INFO] [stdout] test readiness_fail_flags_require_queries ... ok
[INFO] [stdout] test simulate_requires_queries_flag ... ok
[INFO] [stdout] test simulate_honors_expectations ... ok
[INFO] [stdout] test self_test_passes_on_examples ... ok
[INFO] [stdout] test save_run_writes_artifact_from_retrieved_docs_array ... ok
[INFO] [stdout] test save_run_rejects_duplicate_retrieved_doc_ids ... ok
[INFO] [stdout] test compare_runs_fail_if_query_count_mismatch ... ok
[INFO] [stdout] test readiness_reports_documents_and_chunks ... ok
[INFO] [stdout] test readiness_json_is_emitted_before_fail_gates ... ok
[INFO] [stdout] test readiness_gate_exit_code_is_2 ... ok
[INFO] [stdout] test optimize_returns_best_candidate_json ... ok
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 44 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.21s
[INFO] [stdout] 
[INFO] [stderr]      Running tests/trace.rs (/opt/rustwide/target/debug/deps/trace-f4a1ccf3224366ae)
[INFO] [stdout] 
[INFO] [stdout] running 2 tests
[INFO] [stdout] test trace_run_can_emit_json ... ok
[INFO] [stdout] test trace_run_reports_evidence_chain ... ok
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.06s
[INFO] [stdout] 
[INFO] [stderr]    Doc-tests rag_audit
[INFO] [stdout] 
[INFO] [stdout] running 0 tests
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
[INFO] [stdout] 
[INFO] running `Command { std: "docker" "inspect" "135a7b6dfed5e61a3541732d4f6f1460f76300f4277fb4e56e468bf3db5ea969", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "135a7b6dfed5e61a3541732d4f6f1460f76300f4277fb4e56e468bf3db5ea969", kill_on_drop: false }`
[INFO] [stdout] 135a7b6dfed5e61a3541732d4f6f1460f76300f4277fb4e56e468bf3db5ea969
