[INFO] cloning repository https://github.com/PS-Wizard/SiteSherlock [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/PS-Wizard/SiteSherlock" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FPS-Wizard%2FSiteSherlock", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FPS-Wizard%2FSiteSherlock'... [INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }` [INFO] [stdout] 4e140a1c4d792b6bdfdfc3e1bacbed5fbfc5bd2c [INFO] testing PS-Wizard/SiteSherlock against 1.99.0-beta.1+cargoflags=--release for beta-release-1.99-2 [INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FPS-Wizard%2FSiteSherlock" "/workspace/builds/worker-2-tc2/source", kill_on_drop: false }` [INFO] [stderr] Cloning into '/workspace/builds/worker-2-tc2/source'... [INFO] [stderr] done. [INFO] started tweaking git repo https://github.com/PS-Wizard/SiteSherlock [INFO] finished tweaking git repo https://github.com/PS-Wizard/SiteSherlock [INFO] tweaked toml for git repo https://github.com/PS-Wizard/SiteSherlock written to /workspace/builds/worker-2-tc2/source/Cargo.toml [INFO] validating manifest of git repo https://github.com/PS-Wizard/SiteSherlock on toolchain 1.99.0-beta.1 [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.99.0-beta.1" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }` [INFO] crate git repo https://github.com/PS-Wizard/SiteSherlock already has a lockfile, it will not be regenerated [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.99.0-beta.1" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-m" "1610612736" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:8683fc1fc2eb5c9ac98e0d076ab094b2ffac7f99da555d2b6a2e27f346de2ec7" "sleep" "infinity", kill_on_drop: false }` [INFO] [stdout] 651cb6769548c3a651bfac7c69d95fb3ceec1f4a44ed502422217cb5dce953f5 [INFO] running `Command { std: "docker" "start" "651cb6769548c3a651bfac7c69d95fb3ceec1f4a44ed502422217cb5dce953f5", kill_on_drop: false }` [INFO] running `Command { std: "docker" "inspect" "651cb6769548c3a651bfac7c69d95fb3ceec1f4a44ed502422217cb5dce953f5", kill_on_drop: false }` [INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-w" "/opt/rustwide/workdir" "--user" "0:0" "651cb6769548c3a651bfac7c69d95fb3ceec1f4a44ed502422217cb5dce953f5" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.1" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }` [INFO] running `Command { std: "docker" "inspect" "651cb6769548c3a651bfac7c69d95fb3ceec1f4a44ed502422217cb5dce953f5", kill_on_drop: false }` [INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "651cb6769548c3a651bfac7c69d95fb3ceec1f4a44ed502422217cb5dce953f5" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.1" "build" "--frozen" "--message-format=json" "--release", kill_on_drop: false }` [INFO] [stderr] Compiling syn v3.0.3 [INFO] [stderr] Compiling mio v1.2.2 [INFO] [stderr] Compiling http v1.5.0 [INFO] [stderr] Compiling futures-macro v0.3.33 [INFO] [stderr] Compiling simd-adler32 v0.3.10 [INFO] [stderr] Compiling rustls v0.23.43 [INFO] [stderr] Compiling hashbrown v0.17.1 [INFO] [stderr] Compiling futures-channel v0.3.33 [INFO] [stderr] Compiling compression-core v0.4.32 [INFO] [stderr] Compiling bitflags v2.13.1 [INFO] [stderr] Compiling derive_more-impl v2.1.1 [INFO] [stderr] Compiling quick-xml v0.38.4 [INFO] [stderr] Compiling miniz_oxide v0.8.9 [INFO] [stderr] Compiling futures-util v0.3.33 [INFO] [stderr] Compiling derive_more v2.1.1 [INFO] [stderr] Compiling flate2 v1.1.9 [INFO] [stderr] Compiling selectors v0.38.0 [INFO] [stderr] Compiling indexmap v2.14.0 [INFO] [stderr] Compiling http-body v1.1.0 [INFO] [stderr] Compiling http-body-util v0.1.4 [INFO] [stderr] Compiling compression-codecs v0.4.38 [INFO] [stderr] Compiling scraper v0.27.0 [INFO] [stderr] Compiling displaydoc v0.2.7 [INFO] [stderr] Compiling tokio-macros v2.7.2 [INFO] [stderr] Compiling serde_derive v1.0.229 [INFO] [stderr] Compiling tinystr v0.8.3 [INFO] [stderr] Compiling zerotrie v0.2.4 [INFO] [stderr] Compiling icu_collections v2.2.0 [INFO] [stderr] Compiling tokio v1.53.1 [INFO] [stderr] Compiling icu_locale_core v2.2.0 [INFO] [stderr] Compiling icu_provider v2.2.0 [INFO] [stderr] Compiling icu_normalizer v2.2.0 [INFO] [stderr] Compiling icu_properties v2.2.0 [INFO] [stderr] Compiling serde v1.0.229 [INFO] [stderr] Compiling rustls-platform-verifier v0.7.0 [INFO] [stderr] Compiling idna_adapter v1.2.2 [INFO] [stderr] Compiling idna v1.1.0 [INFO] [stderr] Compiling url v2.5.8 [INFO] [stderr] Compiling tokio-util v0.7.19 [INFO] [stderr] Compiling tower v0.5.3 [INFO] [stderr] Compiling tokio-rustls v0.26.4 [INFO] [stderr] Compiling async-compression v0.4.42 [INFO] [stderr] Compiling h2 v0.4.15 [INFO] [stderr] Compiling tower-http v0.6.11 [INFO] [stderr] Compiling hyper v1.11.0 [INFO] [stderr] Compiling hyper-util v0.1.20 [INFO] [stderr] Compiling hyper-rustls v0.27.9 [INFO] [stderr] Compiling reqwest v0.13.4 [INFO] [stderr] Compiling sitesherlock v0.1.0 (/opt/rustwide/workdir) [INFO] [stderr] Finished `release` profile [optimized] target(s) in 1m 29s [INFO] running `Command { std: "docker" "inspect" "651cb6769548c3a651bfac7c69d95fb3ceec1f4a44ed502422217cb5dce953f5", kill_on_drop: false }` [INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "651cb6769548c3a651bfac7c69d95fb3ceec1f4a44ed502422217cb5dce953f5" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.1" "test" "--frozen" "--no-run" "--message-format=json" "--release", kill_on_drop: false }` [INFO] [stderr] Compiling sitesherlock v0.1.0 (/opt/rustwide/workdir) [INFO] [stderr] Finished `release` profile [optimized] target(s) in 9.01s [INFO] running `Command { std: "docker" "inspect" "651cb6769548c3a651bfac7c69d95fb3ceec1f4a44ed502422217cb5dce953f5", kill_on_drop: false }` [INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "651cb6769548c3a651bfac7c69d95fb3ceec1f4a44ed502422217cb5dce953f5" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.1" "test" "--frozen" "--release", kill_on_drop: false }` [INFO] [stderr] Finished `release` profile [optimized] target(s) in 0.20s [INFO] [stderr] Running unittests src/lib.rs (/opt/rustwide/target/release/deps/sitesherlock-77d304852966ee8c) [INFO] [stdout] [INFO] [stdout] running 76 tests [INFO] [stdout] test crawler::extract::author::tests::ignores_malformed_and_irrelevant_json_ld ... ok [INFO] [stdout] test crawler::extract::author::tests::extracts_author_from_graph_in_order ... ok [INFO] [stdout] test crawler::extract::author::tests::traverses_top_level_type_and_author_arrays ... ok [INFO] [stdout] test crawler::extract::body::tests::extracts_normalized_body_text_in_document_order ... ok [INFO] [stdout] test crawler::extract::body::tests::returns_empty_text_when_body_is_absent ... ok [INFO] [stdout] test crawler::extract::body::tests::skips_script_style_and_noscript_subtrees ... ok [INFO] [stdout] test crawler::extract::body::tests::separates_adjacent_structural_elements_without_changing_inline_text ... ok [INFO] [stdout] test crawler::extract::author::tests::skips_empty_meta_author ... ok [INFO] [stdout] test crawler::extract::headings::tests::counts_empty_headings_and_preserves_an_empty_primary_h1 ... ok [INFO] [stdout] test crawler::extract::headings::tests::ignores_non_heading_elements ... ok [INFO] [stdout] test crawler::extract::images::tests::counts_complete_images ... ok [INFO] [stdout] test crawler::extract::body::tests::decodes_entities_and_ignores_comments ... ok [INFO] [stdout] test crawler::extract::headings::tests::preserves_heading_levels_text_and_document_order ... ok [INFO] [stdout] test crawler::extract::author::tests::meta_author_has_priority_and_normalizes_whitespace ... ok [INFO] [stdout] test crawler::extract::author::tests::extracts_article_author_property ... ok [INFO] [stdout] test crawler::extract::images::tests::counts_missing_and_empty_dimensions_when_either_is_missing ... ok [INFO] [stdout] test crawler::extract::images::tests::counts_missing_empty_and_whitespace_alt ... ok [INFO] [stdout] test crawler::extract::images::tests::returns_zero_counts_when_no_images_exist ... ok [INFO] [stdout] test crawler::extract::links::tests::accepts_valid_https_links ... ok [INFO] [stdout] test crawler::extract::links::tests::marks_external_links_and_case_insensitive_nofollow_tokens ... ok [INFO] [stdout] test crawler::extract::links::tests::ignores_www_and_ports_but_not_subdomains_for_internal_links ... ok [INFO] [stdout] test crawler::extract::links::tests::preserves_duplicate_links ... ok [INFO] [stdout] test crawler::extract::metadata::tests::extracts_trimmed_metadata_and_normalizes_canonical_url ... ok [INFO] [stdout] test crawler::extract::metadata::tests::returns_empty_fields_when_metadata_is_absent ... ok [INFO] [stdout] test crawler::extract::links::tests::resolves_relative_links_and_collapses_descendant_text ... ok [INFO] [stdout] test crawler::extract::links::tests::skips_empty_unsupported_and_invalid_targets ... ok [INFO] [stdout] test crawler::extract::structured_data::tests::ignores_empty_and_wrong_type_scripts ... ok [INFO] [stdout] test crawler::extract::structured_data::tests::retains_malformed_json_unchanged ... ok [INFO] [stdout] test crawler::extract::images::tests::does_not_validate_dimension_values ... ok [INFO] [stdout] test crawler::extract::links::tests::removes_fragments_without_changing_document_order ... ok [INFO] [stdout] test crawler::extract::tests::extracts_links_and_headings_from_one_document ... ok [INFO] [stdout] test crawler::extract::social_metadata::tests::preserves_case_insensitive_article_author_properties ... ok [INFO] [stdout] test crawler::extract::social_metadata::tests::extracts_trimmed_case_insensitive_social_metadata ... ok [INFO] [stdout] test crawler::extract::social_metadata::tests::filters_empty_and_unrelated_values_and_last_duplicate_wins ... ok [INFO] [stdout] test crawler::extract::metadata::tests::uses_first_matching_element_even_when_its_value_is_empty ... ok [INFO] [stdout] test crawler::extract::structured_data::tests::retains_multiple_blocks_in_document_order_and_trims_them ... ok [INFO] [stdout] test crawler::renderer::detector::tests::explicit_javascript_requirement_needs_rendering ... ok [INFO] [stdout] test crawler::renderer::detector::tests::many_scripts_and_sparse_content_need_rendering ... ok [INFO] [stdout] test crawler::renderer::detector::tests::prefers_rendered_page_with_greater_extraction_quality ... ok [INFO] [stdout] test crawler::renderer::detector::tests::retains_raw_page_when_extraction_quality_is_equal ... ok [INFO] [stdout] test crawler::renderer::detector::tests::sparse_react_shell_needs_rendering ... ok [INFO] [stdout] test crawler::renderer::detector::tests::sparse_static_page_does_not_need_rendering ... ok [INFO] [stdout] test crawler::renderer::detector::tests::retains_raw_page_when_rendered_extraction_quality_is_worse ... ok [INFO] [stdout] test crawler::renderer::detector::tests::useful_static_html_does_not_need_rendering ... ok [INFO] [stdout] test crawler::renderer::lightpanda::tests::renders_example_page ... ignored, requires the Lightpanda binary and internet access [INFO] [stdout] test crawler::renderer::lightpanda::tests::rejects_process_output_over_the_limit ... ok [INFO] [stdout] test crawler::fetch::tests::body_over_limit_is_rejected ... ok [INFO] [stdout] test crawler::runner::tests::crawl_stops_scheduling_at_page_limit ... ok [INFO] [stdout] test crawler::sitemap::tests::document_candidates_are_capped_with_room_for_conventional_fallback ... ok [INFO] [stdout] test crawler::sitemap::tests::malformed_or_doctype_sitemaps_are_rejected ... ok [INFO] [stdout] test crawler::fetch::tests::exact_body_limit_is_accepted ... ok [INFO] [stdout] test crawler::fetch::tests::non_html_content_type_does_not_extract_page ... ok [INFO] [stdout] test crawler::sitemap::tests::parses_namespaced_direct_locations_with_entities_and_cdata ... ok [INFO] [stdout] test crawler::fetch::tests::html_content_type_with_parameters_extracts_page ... ok [INFO] [stdout] test crawler::sitemap::tests::raw_gzip_is_capped ... ok [INFO] [stdout] test crawler::sitemap::tests::robots_directives_are_case_insensitive ... ok [INFO] [stdout] test crawler::sitemap::tests::scope_filter_rejects_external_subdomain_and_non_http_urls ... ok [INFO] [stdout] test crawler::fetch::tests::response_metadata_preserves_headers_and_decoded_size ... ok [INFO] [stdout] test crawler::ssrf::tests::resolver_rejects_empty_or_mixed_address_answers ... ok [INFO] [stdout] test crawler::fetch::tests::non_success_html_does_not_extract_page ... ok [INFO] [stdout] test crawler::ssrf::tests::url_validation_rejects_disallowed_literal_addresses ... ok [INFO] [stdout] test crawler::ssrf::tests::url_validation_rejects_unsupported_schemes_and_missing_hosts ... ok [INFO] [stdout] test crawler::fetch::tests::gzip_limit_uses_decompressed_size ... ok [INFO] [stdout] test crawler::fetch::tests::relative_links_resolve_against_redirect_destination ... ok [INFO] [stdout] test crawler::runner::tests::crawl_records_fetch_failure_and_continues ... ok [INFO] [stdout] test crawler::fetch::tests::absent_response_headers_are_none ... ok [INFO] [stdout] test crawler::runner::tests::crawl_is_breadth_first_deduplicated_internal_and_depth_bounded ... ok [INFO] [stdout] test crawler::sitemap::tests::robots_directive_and_conventional_sitemap_are_deduplicated ... ok [INFO] [stdout] test crawler::sitemap::tests::root_sitemap_entry_does_not_consume_page_limit ... ok [INFO] [stdout] test crawler::runner::tests::crawler_rejects_zero_limits ... ok [INFO] [stdout] test crawler::sitemap::tests::sitemap_indexes_recurse_without_refetching_cycles ... ok [INFO] [stdout] test crawler::runner::tests::sitemap_seeds_are_depth_zero_deduplicated_and_page_limited ... ok [INFO] [stdout] test crawler::sitemap::tests::out_of_scope_sitemap_documents_are_not_fetched ... ok [INFO] [stdout] test crawler::runner::tests::crawl_respects_concurrency_limit ... ok [INFO] [stdout] test crawler::fetch::tests::header_and_body_delays_are_timed_separately ... ok [INFO] [stdout] test crawler::fetch::tests::cross_host_redirect_is_rejected_before_destination_request ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 75 passed; 0 failed; 1 ignored; 0 measured; 0 filtered out; finished in 0.38s [INFO] [stdout] [INFO] [stderr] Running unittests src/main.rs (/opt/rustwide/target/release/deps/sitesherlock-73aef85060ce9242) [INFO] [stdout] [INFO] [stdout] running 0 tests [INFO] [stdout] [INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s [INFO] [stdout] [INFO] [stderr] Doc-tests sitesherlock [INFO] [stdout] [INFO] [stdout] running 0 tests [INFO] [stdout] [INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s [INFO] [stdout] [INFO] running `Command { std: "docker" "inspect" "651cb6769548c3a651bfac7c69d95fb3ceec1f4a44ed502422217cb5dce953f5", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "651cb6769548c3a651bfac7c69d95fb3ceec1f4a44ed502422217cb5dce953f5", kill_on_drop: false }` [INFO] [stdout] 651cb6769548c3a651bfac7c69d95fb3ceec1f4a44ed502422217cb5dce953f5