[INFO] cloning repository https://github.com/coval-ai/cli
[INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/coval-ai/cli" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fcoval-ai%2Fcli", kill_on_drop: false }`
[INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fcoval-ai%2Fcli'...
[INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }`
[INFO] [stdout] f08539e7eab924edd5ade22d48fc7744c9168150
[INFO] testing coval-ai/cli against 1.97.0-beta.6 for beta-1.98-1
[INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fcoval-ai%2Fcli" "/workspace/builds/worker-7-tc1/source", kill_on_drop: false }`
[INFO] [stderr] Cloning into '/workspace/builds/worker-7-tc1/source'...
[INFO] [stderr] done.
[INFO] started tweaking git repo https://github.com/coval-ai/cli
[INFO] finished tweaking git repo https://github.com/coval-ai/cli
[INFO] tweaked toml for git repo https://github.com/coval-ai/cli written to /workspace/builds/worker-7-tc1/source/Cargo.toml
[INFO] validating manifest of git repo https://github.com/coval-ai/cli on toolchain 1.97.0-beta.6
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.97.0-beta.6" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] crate git repo https://github.com/coval-ai/cli already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.97.0-beta.6" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] [stderr]     Updating crates.io index
[INFO] [stderr]  Downloading crates ...
[INFO] [stderr]   Downloaded tokio-test v0.4.5
[INFO] [stderr]   Downloaded tabled_derive v0.7.0
[INFO] [stderr]   Downloaded papergrid v0.11.0
[INFO] [stderr]   Downloaded wiremock v0.6.5
[INFO] [stderr]   Downloaded wasm-bindgen-shared v0.2.109
[INFO] [stderr]   Downloaded wasm-bindgen-macro v0.2.109
[INFO] [stderr]   Downloaded wasm-bindgen-futures v0.4.59
[INFO] [stderr]   Downloaded wasm-bindgen-macro-support v0.2.109
[INFO] [stderr]   Downloaded wasm-bindgen v0.2.109
[INFO] [stderr]   Downloaded js-sys v0.3.86
[INFO] [stderr]   Downloaded terminal_size v0.4.3
[INFO] [stderr]   Downloaded tabled v0.15.0
[INFO] [stderr]   Downloaded web-sys v0.3.86
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-m" "1610612736" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:3d5ced03c013a94a2f102a4510f48a6e9184255caf5fd8244f58017bde7f5210" "sleep" "infinity", kill_on_drop: false }`
[INFO] [stdout] 59a0a4d4e978d9a9c900912d881b612da124e2ed6ecb0a590f234d97fe120d44
[INFO] running `Command { std: "docker" "start" "59a0a4d4e978d9a9c900912d881b612da124e2ed6ecb0a590f234d97fe120d44", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "59a0a4d4e978d9a9c900912d881b612da124e2ed6ecb0a590f234d97fe120d44", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-w" "/opt/rustwide/workdir" "--user" "0:0" "59a0a4d4e978d9a9c900912d881b612da124e2ed6ecb0a590f234d97fe120d44" "/opt/rustwide/cargo-home/bin/cargo" "+1.97.0-beta.6" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "59a0a4d4e978d9a9c900912d881b612da124e2ed6ecb0a590f234d97fe120d44", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "59a0a4d4e978d9a9c900912d881b612da124e2ed6ecb0a590f234d97fe120d44" "/opt/rustwide/cargo-home/bin/cargo" "+1.97.0-beta.6" "build" "--frozen" "--message-format=json", kill_on_drop: false }`
[INFO] [stderr]    Compiling futures-task v0.3.32
[INFO] [stderr]    Compiling ring v0.17.14
[INFO] [stderr]    Compiling slab v0.4.12
[INFO] [stderr]    Compiling rustls v0.23.36
[INFO] [stderr]    Compiling syn v2.0.117
[INFO] [stderr]    Compiling getrandom v0.2.17
[INFO] [stderr]    Compiling rustix v1.1.3
[INFO] [stderr]    Compiling proc-macro-error v1.0.4
[INFO] [stderr]    Compiling subtle v2.6.1
[INFO] [stderr]    Compiling linux-raw-sys v0.11.0
[INFO] [stderr]    Compiling tracing v0.1.44
[INFO] [stderr]    Compiling syn v1.0.109
[INFO] [stderr]    Compiling proc-macro-error-attr v1.0.4
[INFO] [stderr]    Compiling portable-atomic v1.13.1
[INFO] [stderr]    Compiling webpki-roots v1.0.6
[INFO] [stderr]    Compiling clap_lex v1.0.0
[INFO] [stderr]    Compiling bytecount v0.6.9
[INFO] [stderr]    Compiling unicode-width v0.1.14
[INFO] [stderr]    Compiling dirs-sys v0.4.1
[INFO] [stderr]    Compiling serde_json v1.0.149
[INFO] [stderr]    Compiling console v0.15.11
[INFO] [stderr]    Compiling papergrid v0.11.0
[INFO] [stderr]    Compiling colored v2.2.0
[INFO] [stderr]    Compiling futures-util v0.3.32
[INFO] [stderr]    Compiling dirs v5.0.1
[INFO] [stderr]    Compiling indicatif v0.17.11
[INFO] [stderr]    Compiling terminal_size v0.4.3
[INFO] [stderr]    Compiling clap_builder v4.5.60
[INFO] [stderr]    Compiling tabled_derive v0.7.0
[INFO] [stderr]    Compiling tabled v0.15.0
[INFO] [stderr]    Compiling synstructure v0.13.2
[INFO] [stderr]    Compiling rustls-webpki v0.103.9
[INFO] [stderr]    Compiling zerofrom-derive v0.1.6
[INFO] [stderr]    Compiling yoke-derive v0.8.1
[INFO] [stderr]    Compiling zerovec-derive v0.11.2
[INFO] [stderr]    Compiling displaydoc v0.2.5
[INFO] [stderr]    Compiling serde_derive v1.0.228
[INFO] [stderr]    Compiling tokio-macros v2.6.0
[INFO] [stderr]    Compiling clap_derive v4.5.55
[INFO] [stderr]    Compiling thiserror-impl v1.0.69
[INFO] [stderr]    Compiling tokio v1.49.0
[INFO] [stderr]    Compiling zerofrom v0.1.6
[INFO] [stderr]    Compiling yoke v0.8.1
[INFO] [stderr]    Compiling zerovec v0.11.5
[INFO] [stderr]    Compiling zerotrie v0.2.3
[INFO] [stderr]    Compiling thiserror v1.0.69
[INFO] [stderr]    Compiling tinystr v0.8.2
[INFO] [stderr]    Compiling potential_utf v0.1.4
[INFO] [stderr]    Compiling icu_collections v2.1.1
[INFO] [stderr]    Compiling icu_locale_core v2.1.1
[INFO] [stderr]    Compiling clap v4.5.60
[INFO] [stderr]    Compiling serde v1.0.228
[INFO] [stderr]    Compiling icu_provider v2.1.1
[INFO] [stderr]    Compiling icu_properties v2.1.2
[INFO] [stderr]    Compiling icu_normalizer v2.1.1
[INFO] [stderr]    Compiling serde_spanned v0.6.9
[INFO] [stderr]    Compiling toml_datetime v0.6.11
[INFO] [stderr]    Compiling serde_urlencoded v0.7.1
[INFO] [stderr]    Compiling chrono v0.4.43
[INFO] [stderr]    Compiling toml_edit v0.22.27
[INFO] [stderr]    Compiling idna_adapter v1.2.1
[INFO] [stderr]    Compiling idna v1.1.0
[INFO] [stderr]    Compiling url v2.5.8
[INFO] [stderr]    Compiling hyper v1.8.1
[INFO] [stderr]    Compiling tokio-rustls v0.26.4
[INFO] [stderr]    Compiling tower v0.5.3
[INFO] [stderr]    Compiling toml v0.8.23
[INFO] [stderr]    Compiling tower-http v0.6.8
[INFO] [stderr]    Compiling hyper-util v0.1.20
[INFO] [stderr]    Compiling hyper-rustls v0.27.7
[INFO] [stderr]    Compiling reqwest v0.12.28
[INFO] [stderr]    Compiling coval v0.4.1 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `dev` profile [unoptimized + debuginfo] target(s) in 1m 07s
[INFO] running `Command { std: "docker" "inspect" "59a0a4d4e978d9a9c900912d881b612da124e2ed6ecb0a590f234d97fe120d44", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "59a0a4d4e978d9a9c900912d881b612da124e2ed6ecb0a590f234d97fe120d44" "/opt/rustwide/cargo-home/bin/cargo" "+1.97.0-beta.6" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }`
[INFO] [stderr]    Compiling rustix v1.1.3
[INFO] [stderr]    Compiling futures-macro v0.3.32
[INFO] [stderr]    Compiling tokio v1.49.0
[INFO] [stderr]    Compiling regex-automata v0.4.14
[INFO] [stderr]    Compiling serde_json v1.0.149
[INFO] [stderr]    Compiling getrandom v0.4.1
[INFO] [stderr]    Compiling predicates-core v1.0.10
[INFO] [stderr]    Compiling float-cmp v0.10.0
[INFO] [stderr]    Compiling num_cpus v1.17.0
[INFO] [stderr]    Compiling difflib v0.4.0
[INFO] [stderr]    Compiling termtree v0.5.1
[INFO] [stderr]    Compiling assert_cmd v2.1.2
[INFO] [stderr]    Compiling deadpool-runtime v0.1.4
[INFO] [stderr]    Compiling wait-timeout v0.2.1
[INFO] [stderr]    Compiling predicates-tree v1.0.13
[INFO] [stderr]    Compiling futures-util v0.3.32
[INFO] [stderr]    Compiling assert-json-diff v2.0.2
[INFO] [stderr]    Compiling terminal_size v0.4.3
[INFO] [stderr]    Compiling tempfile v3.25.0
[INFO] [stderr]    Compiling clap_builder v4.5.60
[INFO] [stderr]    Compiling regex v1.12.3
[INFO] [stderr]    Compiling bstr v1.12.1
[INFO] [stderr]    Compiling futures-executor v0.3.32
[INFO] [stderr]    Compiling futures v0.3.32
[INFO] [stderr]    Compiling predicates v3.1.4
[INFO] [stderr]    Compiling tokio-util v0.7.18
[INFO] [stderr]    Compiling tower v0.5.3
[INFO] [stderr]    Compiling tokio-rustls v0.26.4
[INFO] [stderr]    Compiling deadpool v0.12.3
[INFO] [stderr]    Compiling tokio-stream v0.1.18
[INFO] [stderr]    Compiling tokio-test v0.4.5
[INFO] [stderr]    Compiling tower-http v0.6.8
[INFO] [stderr]    Compiling h2 v0.4.13
[INFO] [stderr]    Compiling clap v4.5.60
[INFO] [stderr]    Compiling hyper v1.8.1
[INFO] [stderr]    Compiling hyper-util v0.1.20
[INFO] [stderr]    Compiling hyper-rustls v0.27.7
[INFO] [stderr]    Compiling wiremock v0.6.5
[INFO] [stderr]    Compiling reqwest v0.12.28
[INFO] [stderr]    Compiling coval v0.4.1 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 1m 02s
[INFO] running `Command { std: "docker" "inspect" "59a0a4d4e978d9a9c900912d881b612da124e2ed6ecb0a590f234d97fe120d44", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "59a0a4d4e978d9a9c900912d881b612da124e2ed6ecb0a590f234d97fe120d44" "/opt/rustwide/cargo-home/bin/cargo" "+1.97.0-beta.6" "test" "--frozen", kill_on_drop: false }`
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 0.37s
[INFO] [stderr]      Running unittests src/main.rs (/opt/rustwide/target/debug/deps/coval-bee501aaa8aba043)
[INFO] [stdout] 
[INFO] [stdout] running 2 tests
[INFO] [stdout] test client::models::monitor::tests::monitor_events_redact_dispatched_channel_auth_tokens ... ok
[INFO] [stdout] test client::models::monitor::tests::monitor_channels_redact_auth_tokens ... ok
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s
[INFO] [stdout] 
[INFO] [stderr]      Running tests/cli_tests.rs (/opt/rustwide/target/debug/deps/cli_tests-0e652088cfde9de1)
[INFO] [stdout] 
[INFO] [stdout] running 96 tests
[INFO] [stdout] test test_agent_manifest_skills_require_explicit_local_source ... ok
[INFO] [stdout] test test_agent_skills_list_requires_explicit_source ... ok
[INFO] [stdout] test test_agent_skills_reject_remote_source ... ok
[INFO] [stdout] test test_agent_parse_errors_use_structured_envelope ... ok
[INFO] [stdout] test test_agent_skills_list_local_source ... ok
[INFO] [stdout] test test_agent_doctor_no_auth ... ok
[INFO] [stdout] test test_agent_skills_install_rejects_symlink_source ... ok
[INFO] [stdout] test test_agents_help ... ok
[INFO] [stdout] test test_agent_skills_install_rejects_path_traversal_id ... ok
[INFO] [stdout] test test_agent_skills_install_rejects_symlink_namespace ... ok
[INFO] [stdout] test test_agent_manifest_no_auth ... ok
[INFO] [stdout] test test_agent_skills_install_rejects_symlink_skills_root ... ok
[INFO] [stdout] test test_agent_skills_install_requires_force_for_existing_skill ... ok
[INFO] [stdout] test test_agent_skills_list_reports_installed_state ... ok
[INFO] [stdout] test test_agent_skills_install_local_source ... ok
[INFO] [stdout] test test_agents_list ... ok
[INFO] [stdout] test test_agents_update_invalid_metadata_json ... ok
[INFO] [stdout] test test_api_key_create_warning_agent_mode ... ok
[INFO] [stdout] test test_agents_update_with_metadata ... ok
[INFO] [stdout] test test_agents_delete_agent_mode_next_actions_are_safe ... ok
[INFO] [stdout] test test_agents_delete ... ok
[INFO] [stdout] test test_api_error_handling ... ok
[INFO] [stdout] test test_agents_get ... ok
[INFO] [stdout] test test_agents_list_agent_mode ... ok
[INFO] [stdout] test test_agents_create_with_input_json ... ok
[INFO] [stdout] test test_agents_list_json_is_not_agent_enveloped ... ok
[INFO] [stdout] test test_agents_list_json ... ok
[INFO] [stdout] test test_config_get_masks_unicode_api_key ... ok
[INFO] [stdout] test test_agent_mode_overrides_json_format ... ok
[INFO] [stdout] test test_help ... ok
[INFO] [stdout] test test_dashboard_widgets_agent_mode_error_resource ... ok
[INFO] [stdout] test test_dashboard_widgets_list_agent_mode_resource ... ok
[INFO] [stdout] test test_dashboard_create_rejects_negative_position ... ok
[INFO] [stdout] test test_conversations_audio_json_output ... ok
[INFO] [stdout] test test_api_error_handling_agent_mode ... ok
[INFO] [stdout] test test_input_json_invalid_agent_error ... ok
[INFO] [stdout] test test_agents_create_with_metadata ... ok
[INFO] [stdout] test test_dashboard_create_with_full_fields ... ok
[INFO] [stdout] test test_dashboard_update_rejects_negative_position ... ok
[INFO] [stdout] test test_missing_api_key ... ok
[INFO] [stdout] test test_input_json_flags_override_json ... ok
[INFO] [stdout] test test_missing_api_key_agent_mode ... ok
[INFO] [stdout] test test_conversations_metric_detail_by_metric_id ... ok
[INFO] [stdout] test test_input_json_stdin ... ok
[INFO] [stdout] test test_metrics_test_subcommand ... ok
[INFO] [stdout] test test_agent_doctor_with_connectivity ... ok
[INFO] [stdout] test test_monitors_create_evaluation_type_flag_overrides_input_json ... ok
[INFO] [stdout] test test_metrics_create_composite_test_case ... ok
[INFO] [stdout] test test_metrics_create_composite_metadata_requires_criteria ... ok
[INFO] [stdout] test test_mutations_list ... ok
[INFO] [stdout] test test_monitors_create_preserves_input_json_evaluation_type ... ok
[INFO] [stdout] test test_reports_create_lowercase_permissions_serializes_uppercase ... ok
[INFO] [stdout] test test_reports_create_compare_by_test_case ... ok
[INFO] [stdout] test test_metrics_create_composite_test_case_requires_criteria_path ... ok
[INFO] [stdout] test test_input_json_file ... ok
[INFO] [stdout] test test_personas_background_sounds_upload ... ok
[INFO] [stdout] test test_metrics_test_subcommand_with_dev_id ... ok
[INFO] [stdout] test test_review_annotations_create_with_subvalues ... ok
[INFO] [stdout] test test_reports_list ... ok
[INFO] [stdout] test test_review_annotations_create_with_invalid_subvalues_json ... ok
[INFO] [stdout] test test_personas_background_sounds_list ... ok
[INFO] [stdout] test test_reports_create_metadata_requires_metadata_key ... ok
[INFO] [stdout] test test_review_projects_create ... ok
[INFO] [stdout] test test_reports_get ... ok
[INFO] [stdout] test test_review_annotations_create ... ok
[INFO] [stdout] test test_review_annotations_get ... ok
[INFO] [stdout] test test_personas_background_sounds_update_accepts_custom_value ... ok
[INFO] [stdout] test test_review_annotations_update_with_subvalues ... ok
[INFO] [stdout] test test_review_projects_list ... ok
[INFO] [stdout] test test_runs_list ... ok
[INFO] [stdout] test test_review_projects_get ... ok
[INFO] [stdout] test test_review_annotations_list ... ok
[INFO] [stdout] test test_review_projects_delete ... ok
[INFO] [stdout] test test_runs_watch_agent_mode ... ok
[INFO] [stdout] test test_review_annotations_delete ... ok
[INFO] [stdout] test test_review_projects_update ... ok
[INFO] [stdout] test test_simulations_metric_detail_by_ulid ... ok
[INFO] [stdout] test test_scheduled_runs_list_hyphenated_path ... ok
[INFO] [stdout] test test_reports_create_metadata_key_rejected_without_metadata_compare_by ... ok
[INFO] [stdout] test test_runs_update_tags ... ok
[INFO] [stdout] test test_dashboard_update_sets_default_and_position ... ok
[INFO] [stdout] test test_whoami_masks_unicode_api_key ... ok
[INFO] [stdout] test test_simulations_metric_detail_by_metric_id ... ok
[INFO] [stdout] test test_simulations_audio_url ... ok
[INFO] [stdout] test test_version ... ok
[INFO] [stdout] test test_simulations_metrics_without_subvalues ... ok
[INFO] [stdout] test test_reports_delete ... ok
[INFO] [stdout] test test_test_cases_stdin_json_summary ... ok
[INFO] [stdout] test test_run_templates_list_hyphenated_path ... ok
[INFO] [stdout] test test_simulations_update_is_public_sends_true ... ok
[INFO] [stdout] test test_review_annotations_update ... ok
[INFO] [stdout] test test_test_cases_create_with_expected_behaviors ... ok
[INFO] [stdout] test test_resource_contexts_agent_mode_no_auth ... ok
[INFO] [stdout] test test_simulations_metrics_with_subvalues ... ok
[INFO] [stdout] test test_simulations_update_notes_does_not_send_is_public ... ok
[INFO] [stdout] test test_input_json_help_coverage ... ok
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 96 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 2.96s
[INFO] [stdout] 
[INFO] running `Command { std: "docker" "inspect" "59a0a4d4e978d9a9c900912d881b612da124e2ed6ecb0a590f234d97fe120d44", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "59a0a4d4e978d9a9c900912d881b612da124e2ed6ecb0a590f234d97fe120d44", kill_on_drop: false }`
[INFO] [stdout] 59a0a4d4e978d9a9c900912d881b612da124e2ed6ecb0a590f234d97fe120d44
