[INFO] fetching crate knee_scraper 0.1.8...
[INFO] testing knee_scraper-0.1.8 against 1.100.0-beta.1+cargoflags=--release for beta-release-1.100-2
[INFO] extracting crate knee_scraper 0.1.8 into /workspace/builds/worker-2-tc2/source
[INFO] started tweaking crates.io crate knee_scraper 0.1.8
[INFO] finished tweaking crates.io crate knee_scraper 0.1.8
[INFO] tweaked toml for crates.io crate knee_scraper 0.1.8 written to /workspace/builds/worker-2-tc2/source/Cargo.toml
[INFO] validating manifest of crates.io crate knee_scraper 0.1.8 on toolchain 1.100.0-beta.1
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.100.0-beta.1" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.100.0-beta.1" "generate-lockfile" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] [stderr]     Updating crates.io index
[INFO] [stderr]      Locking 221 packages to highest compatible versions
[INFO] [stderr]       Adding fs v0.0.5 (available: v0.0.6)
[INFO] [stderr]       Adding rand v0.8.8 (available: v0.10.3)
[INFO] [stderr]       Adding reqwest v0.12.28 (available: v0.13.5)
[INFO] [stderr]       Adding scraper v0.20.0 (available: v0.27.0)
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.100.0-beta.1" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] [stderr] warning: `package.homepage` is redundant with `package.repository`
[INFO] [stderr]   --> Cargo.toml:42:12
[INFO] [stderr]    |
[INFO] [stderr] 42 | homepage = "https://github.com/Code-ish/Knee_Scraper"
[INFO] [stderr]    |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stderr] ...
[INFO] [stderr] 46 | repository = "https://github.com/Code-ish/Knee_Scraper"
[INFO] [stderr]    |              ------------------------------------------
[INFO] [stderr]    |
[INFO] [stderr]    = note: `cargo::redundant_homepage` is set to `warn` by default
[INFO] [stderr] help: consider removing `package.homepage`
[INFO] [stderr] warning: `knee_scraper` (manifest) generated 1 warning
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-m" "1610612736" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:77db811e55d90add9212f6832c23229e3de5f1c1f9905e8cb07319ea15df73ac" "sleep" "infinity", kill_on_drop: false }`
[INFO] [stdout] 07323fd70d7ae2d8b12c56b7ca2733f285c0580ba89fe850ac4c6d226103e0a0
[INFO] running `Command { std: "docker" "start" "07323fd70d7ae2d8b12c56b7ca2733f285c0580ba89fe850ac4c6d226103e0a0", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "07323fd70d7ae2d8b12c56b7ca2733f285c0580ba89fe850ac4c6d226103e0a0", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-w" "/opt/rustwide/workdir" "--user" "0:0" "07323fd70d7ae2d8b12c56b7ca2733f285c0580ba89fe850ac4c6d226103e0a0" "/opt/rustwide/cargo-home/bin/cargo" "+1.100.0-beta.1" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "07323fd70d7ae2d8b12c56b7ca2733f285c0580ba89fe850ac4c6d226103e0a0", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "07323fd70d7ae2d8b12c56b7ca2733f285c0580ba89fe850ac4c6d226103e0a0" "/opt/rustwide/cargo-home/bin/cargo" "+1.100.0-beta.1" "build" "--frozen" "--message-format=json" "--release", kill_on_drop: false }`
[INFO] [stderr] warning: `package.homepage` is redundant with `package.repository`
[INFO] [stderr]   --> Cargo.toml:42:12
[INFO] [stderr]    |
[INFO] [stderr] 42 | homepage = "https://github.com/Code-ish/Knee_Scraper"
[INFO] [stderr]    |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stderr] ...
[INFO] [stderr] 46 | repository = "https://github.com/Code-ish/Knee_Scraper"
[INFO] [stderr]    |              ------------------------------------------
[INFO] [stderr]    |
[INFO] [stderr]    = note: `cargo::redundant_homepage` is set to `warn` by default
[INFO] [stderr] help: consider removing `package.homepage`
[INFO] [stderr] warning: `knee_scraper` (manifest) generated 1 warning
[INFO] [stderr]    Compiling stable_deref_trait v1.2.1
[INFO] [stderr]    Compiling siphasher v1.0.4
[INFO] [stderr]    Compiling zerocopy v0.8.63
[INFO] [stderr]    Compiling syn v3.0.9
[INFO] [stderr]    Compiling getrandom v0.2.17
[INFO] [stderr]    Compiling syn v2.0.119
[INFO] [stderr]    Compiling parking_lot_core v0.9.12
[INFO] [stderr]    Compiling errno v0.3.14
[INFO] [stderr]    Compiling openssl-sys v0.9.117
[INFO] [stderr]    Compiling phf_shared v0.10.0
[INFO] [stderr]    Compiling native-tls v0.2.18
[INFO] [stderr]    Compiling ahash v0.8.12
[INFO] [stderr]    Compiling getrandom v0.3.4
[INFO] [stderr]    Compiling servo_arc v0.3.0
[INFO] [stderr]    Compiling signal-hook-registry v1.4.8
[INFO] [stderr]    Compiling num_cpus v1.17.0
[INFO] [stderr]    Compiling iovec v0.1.4
[INFO] [stderr]    Compiling parking_lot v0.12.5
[INFO] [stderr]    Compiling phf_shared v0.11.3
[INFO] [stderr]    Compiling simdutf8 v0.1.5
[INFO] [stderr]    Compiling rand_core v0.6.4
[INFO] [stderr]    Compiling futures v0.1.31
[INFO] [stderr]    Compiling phf v0.10.1
[INFO] [stderr]    Compiling encoding_rs v0.8.42
[INFO] [stderr]    Compiling getopts v0.2.24
[INFO] [stderr]    Compiling serde_urlencoded v0.7.1
[INFO] [stderr]    Compiling bytes v0.4.12
[INFO] [stderr]    Compiling string_cache v0.8.9
[INFO] [stderr]    Compiling ego-tree v0.6.3
[INFO] [stderr]    Compiling rand_chacha v0.3.1
[INFO] [stderr]    Compiling rand v0.8.8
[INFO] [stderr]    Compiling tempfile v3.27.0
[INFO] [stderr]    Compiling openssl v0.10.81
[INFO] [stderr]    Compiling futures-cpupool v0.1.8
[INFO] [stderr]    Compiling fs v0.0.5
[INFO] [stderr]    Compiling synstructure v0.14.0
[INFO] [stderr]    Compiling zerofrom-derive v0.1.8
[INFO] [stderr]    Compiling yoke-derive v0.8.4
[INFO] [stderr]    Compiling zerovec-derive v0.11.6
[INFO] [stderr]    Compiling displaydoc v0.2.7
[INFO] [stderr]    Compiling tokio-macros v2.7.2
[INFO] [stderr]    Compiling futures-macro v0.3.34
[INFO] [stderr]    Compiling tokio v1.53.3
[INFO] [stderr]    Compiling futures-util v0.3.34
[INFO] [stderr]    Compiling openssl-macros v0.1.1
[INFO] [stderr]    Compiling html5ever v0.27.0
[INFO] [stderr]    Compiling cssparser-macros v0.6.1
[INFO] [stderr]    Compiling derive_more v0.99.20
[INFO] [stderr]    Compiling ppv-lite86 v0.2.21
[INFO] [stderr]    Compiling zerofrom v0.1.8
[INFO] [stderr]    Compiling yoke v0.8.3
[INFO] [stderr]    Compiling zerovec v0.11.8
[INFO] [stderr]    Compiling zerotrie v0.2.5
[INFO] [stderr]    Compiling tinystr v0.8.4
[INFO] [stderr]    Compiling potential_utf v0.1.6
[INFO] [stderr]    Compiling icu_locale_core v2.3.0
[INFO] [stderr]    Compiling icu_collections v2.3.0
[INFO] [stderr]    Compiling phf_generator v0.11.3
[INFO] [stderr]    Compiling phf_generator v0.10.0
[INFO] [stderr]    Compiling phf_codegen v0.10.0
[INFO] [stderr]    Compiling selectors v0.25.0
[INFO] [stderr]    Compiling phf_codegen v0.11.3
[INFO] [stderr]    Compiling string_cache_codegen v0.5.4
[INFO] [stderr]    Compiling phf_macros v0.11.3
[INFO] [stderr]    Compiling markup5ever v0.12.1
[INFO] [stderr]    Compiling icu_provider v2.3.1
[INFO] [stderr]    Compiling phf v0.11.3
[INFO] [stderr]    Compiling cssparser v0.31.2
[INFO] [stderr]    Compiling icu_normalizer v2.3.0
[INFO] [stderr]    Compiling icu_properties v2.3.0
[INFO] [stderr]    Compiling futures-executor v0.3.34
[INFO] [stderr]    Compiling futures v0.3.34
[INFO] [stderr]    Compiling idna_adapter v1.2.2
[INFO] [stderr]    Compiling idna v1.1.0
[INFO] [stderr]    Compiling scraper v0.20.0
[INFO] [stderr]    Compiling url v2.5.8
[INFO] [stderr]    Compiling tokio-util v0.7.20
[INFO] [stderr]    Compiling tower v0.5.3
[INFO] [stderr]    Compiling tokio-native-tls v0.3.1
[INFO] [stderr]    Compiling tower-http v0.6.11
[INFO] [stderr]    Compiling h2 v0.4.20
[INFO] [stderr]    Compiling hyper v1.12.0
[INFO] [stderr]    Compiling hyper-util v0.1.21
[INFO] [stderr]    Compiling hyper-tls v0.6.0
[INFO] [stderr]    Compiling reqwest v0.12.28
[INFO] [stderr]    Compiling knee_scraper v0.1.8 (/opt/rustwide/workdir)
[INFO] [stdout] warning: unused import: `tempfile::TempDir`
[INFO] [stdout]  --> src/lib.rs:9:5
[INFO] [stdout]   |
[INFO] [stdout] 9 | use tempfile::TempDir;
[INFO] [stdout]   |     ^^^^^^^^^^^^^^^^^
[INFO] [stdout]   |
[INFO] [stdout]   = note: `#[warn(unused_imports)]` (part of `#[warn(unused)]`) on by default
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stderr] warning: unused dependency `fs`
[INFO] [stderr]  --> Cargo.toml:1:15
[INFO] [stderr]   |
[INFO] [stderr] 1 | [dependencies.fs]
[INFO] [stderr]   |               ^^^
[INFO] [stderr]   |
[INFO] [stderr]   = note: `cargo::unused_dependencies` is set to `warn` by default
[INFO] [stderr] help: consider removing the dependency on `fs`
[INFO] [stderr] warning: unused dependency `futures`
[INFO] [stderr]  --> Cargo.toml:4:15
[INFO] [stderr]   |
[INFO] [stderr] 4 | [dependencies.futures]
[INFO] [stderr]   |               ^^^^^^^^
[INFO] [stderr]   |
[INFO] [stderr] help: consider removing the dependency on `futures`
[INFO] [stderr] warning: `knee_scraper` (manifest) generated 2 warnings
[INFO] [stderr]     Finished `release` profile [optimized] target(s) in 1m 18s
[INFO] running `Command { std: "docker" "inspect" "07323fd70d7ae2d8b12c56b7ca2733f285c0580ba89fe850ac4c6d226103e0a0", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "07323fd70d7ae2d8b12c56b7ca2733f285c0580ba89fe850ac4c6d226103e0a0" "/opt/rustwide/cargo-home/bin/cargo" "+1.100.0-beta.1" "test" "--frozen" "--no-run" "--message-format=json" "--release", kill_on_drop: false }`
[INFO] [stderr] warning: `package.homepage` is redundant with `package.repository`
[INFO] [stderr]   --> Cargo.toml:42:12
[INFO] [stderr]    |
[INFO] [stderr] 42 | homepage = "https://github.com/Code-ish/Knee_Scraper"
[INFO] [stderr]    |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stderr] ...
[INFO] [stderr] 46 | repository = "https://github.com/Code-ish/Knee_Scraper"
[INFO] [stderr]    |              ------------------------------------------
[INFO] [stderr]    |
[INFO] [stderr]    = note: `cargo::redundant_homepage` is set to `warn` by default
[INFO] [stderr] help: consider removing `package.homepage`
[INFO] [stderr] warning: `knee_scraper` (manifest) generated 1 warning
[INFO] [stderr]    Compiling knee_scraper v0.1.8 (/opt/rustwide/workdir)
[INFO] [stdout] warning: unused import: `tempfile::TempDir`
[INFO] [stdout]  --> src/lib.rs:9:5
[INFO] [stdout]   |
[INFO] [stdout] 9 | use tempfile::TempDir;
[INFO] [stdout]   |     ^^^^^^^^^^^^^^^^^
[INFO] [stdout]   |
[INFO] [stdout]   = note: `#[warn(unused_imports)]` (part of `#[warn(unused)]`) on by default
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused import: `tempfile::TempDir`
[INFO] [stdout]  --> src/lib.rs:9:5
[INFO] [stdout]   |
[INFO] [stdout] 9 | use tempfile::TempDir;
[INFO] [stdout]   |     ^^^^^^^^^^^^^^^^^
[INFO] [stdout]   |
[INFO] [stdout]   = note: `#[warn(unused_imports)]` (part of `#[warn(unused)]`) on by default
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stderr] warning: unused dependency `fs`
[INFO] [stderr]  --> Cargo.toml:1:15
[INFO] [stderr]   |
[INFO] [stderr] 1 | [dependencies.fs]
[INFO] [stderr]   |               ^^^
[INFO] [stderr]   |
[INFO] [stderr]   = note: `cargo::unused_dependencies` is set to `warn` by default
[INFO] [stderr] help: consider removing the dependency on `fs`
[INFO] [stderr] warning: unused dependency `futures`
[INFO] [stderr]  --> Cargo.toml:4:15
[INFO] [stderr]   |
[INFO] [stderr] 4 | [dependencies.futures]
[INFO] [stderr]   |               ^^^^^^^^
[INFO] [stderr]   |
[INFO] [stderr] help: consider removing the dependency on `futures`
[INFO] [stderr] warning: `knee_scraper` (manifest) generated 2 warnings
[INFO] [stderr]     Finished `release` profile [optimized] target(s) in 4.54s
[INFO] running `Command { std: "docker" "inspect" "07323fd70d7ae2d8b12c56b7ca2733f285c0580ba89fe850ac4c6d226103e0a0", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "07323fd70d7ae2d8b12c56b7ca2733f285c0580ba89fe850ac4c6d226103e0a0" "/opt/rustwide/cargo-home/bin/cargo" "+1.100.0-beta.1" "test" "--frozen" "--release", kill_on_drop: false }`
[INFO] [stderr] warning: `package.homepage` is redundant with `package.repository`
[INFO] [stderr]   --> Cargo.toml:42:12
[INFO] [stderr]    |
[INFO] [stderr] 42 | homepage = "https://github.com/Code-ish/Knee_Scraper"
[INFO] [stderr]    |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stderr] ...
[INFO] [stderr] 46 | repository = "https://github.com/Code-ish/Knee_Scraper"
[INFO] [stderr]    |              ------------------------------------------
[INFO] [stderr]    |
[INFO] [stderr]    = note: `cargo::redundant_homepage` is set to `warn` by default
[INFO] [stderr] help: consider removing `package.homepage`
[INFO] [stderr] warning: `knee_scraper` (manifest) generated 1 warning
[INFO] [stderr] warning: unused import: `tempfile::TempDir`
[INFO] [stderr]  --> src/lib.rs:9:5
[INFO] [stderr]   |
[INFO] [stderr] 9 | use tempfile::TempDir;
[INFO] [stderr]   |     ^^^^^^^^^^^^^^^^^
[INFO] [stderr]   |
[INFO] [stderr]   = note: `#[warn(unused_imports)]` (part of `#[warn(unused)]`) on by default
[INFO] [stderr] 
[INFO] [stderr] warning: `knee_scraper` (lib) generated 1 warning (run `cargo fix --lib -p knee_scraper` to apply 1 suggestion)
[INFO] [stderr] warning: `knee_scraper` (lib test) generated 1 warning (1 duplicate)
[INFO] [stderr] warning: unused dependency `fs`
[INFO] [stderr]  --> Cargo.toml:1:15
[INFO] [stderr]   |
[INFO] [stderr] 1 | [dependencies.fs]
[INFO] [stderr]   |               ^^^
[INFO] [stderr]   |
[INFO] [stderr]   = note: `cargo::unused_dependencies` is set to `warn` by default
[INFO] [stderr] help: consider removing the dependency on `fs`
[INFO] [stderr] warning: unused dependency `futures`
[INFO] [stderr]  --> Cargo.toml:4:15
[INFO] [stderr]   |
[INFO] [stderr] 4 | [dependencies.futures]
[INFO] [stderr]   |               ^^^^^^^^
[INFO] [stderr]   |
[INFO] [stderr] help: consider removing the dependency on `futures`
[INFO] [stderr] warning: `knee_scraper` (manifest) generated 2 warnings
[INFO] [stderr]     Finished `release` profile [optimized] target(s) in 0.23s
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/release/build/knee_scraper/13466836d6632f1e/out/knee_scraper-13466836d6632f1e)
[INFO] [stdout] 
[INFO] [stdout] running 7 tests
[INFO] [stdout] test tests::test_normalize_link ... ok
[INFO] [stdout] test tests::test_cleanup ... ok
[INFO] [stdout] test tests::test_scrape_for_emails ... ok
[INFO] [stdout] test tests::test_random_user_agent ... ok
[INFO] [stdout] test tests::test_extract_links ... ok
[INFO] [stdout] test tests::test_download_media ... ok
[INFO] [stdout] test tests::test_recursive_scrape ... ok
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 7 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.08s
[INFO] [stdout] 
[INFO] [stderr]    Doc-tests knee_scraper
[INFO] [stdout] 
[INFO] [stdout] running 16 tests
[INFO] [stdout] test src/lib.rs - random_user_agent (line 33) ... FAILED
[INFO] [stdout] test src/lib.rs - scrape_for_emails (line 422) ... FAILED
[INFO] [stdout] test src/lib.rs - extract_domain (line 364) ... FAILED
[INFO] [stdout] test src/lib.rs - fetch_with_cookies (line 460) ... FAILED
[INFO] [stdout] test src/lib.rs - scrape_js (line 381) ... FAILED
[INFO] [stdout] test src/lib.rs - scrape_content (line 251) ... FAILED
[INFO] [stdout] test src/lib.rs - check_open_directories (line 479) ... FAILED
[INFO] [stdout] test src/lib.rs - download_media (line 179) ... FAILED
[INFO] [stdout] test src/lib.rs - extract_links (line 122) ... FAILED
[INFO] [stdout] test src/lib.rs - ai_scrape (line 995) ... FAILED
[INFO] [stdout] test src/lib.rs - normalize_link (line 153) ... FAILED
[INFO] [stdout] test src/lib.rs - run (line 537) ... FAILED
[INFO] [stdout] test src/lib.rs - fetch_robots_txt (line 503) ... FAILED
[INFO] [stdout] test src/lib.rs - random_delay (line 599) ... FAILED
[INFO] [stdout] test src/lib.rs - scrape_for_errors (line 404) ... FAILED
[INFO] [stdout] test src/lib.rs - recursive_scrape (line 59) ... FAILED
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout] 
[INFO] [stdout] ---- src/lib.rs - random_user_agent (line 33) stdout ----
[INFO] [stdout] error[E0425]: cannot find function `random_user_agent` in this scope
[INFO] [stdout]   --> src/lib.rs:34:18
[INFO] [stdout]    |
[INFO] [stdout] 34 | let user_agent = random_user_agent();
[INFO] [stdout]    |                  ^^^^^^^^^^^^^^^^^ not found in this scope
[INFO] [stdout] 
[INFO] [stdout] error: aborting due to 1 previous error
[INFO] [stdout] 
[INFO] [stdout] For more information about this error, try `rustc --explain E0425`.
[INFO] [stdout] Couldn't compile the test.
[INFO] [stdout] ---- src/lib.rs - scrape_for_emails (line 422) stdout ----
[INFO] [stdout] error[E0425]: cannot find function `scrape_for_emails` in this scope
[INFO] [stdout]    --> src/lib.rs:423:1
[INFO] [stdout]     |
[INFO] [stdout] 423 | scrape_for_emails("<p>Contact us at info@example.com</p>", "./scraped_data/example.com");
[INFO] [stdout]     | ^^^^^^^^^^^^^^^^^ not found in this scope
[INFO] [stdout] 
[INFO] [stdout] error: aborting due to 1 previous error
[INFO] [stdout] 
[INFO] [stdout] For more information about this error, try `rustc --explain E0425`.
[INFO] [stdout] Couldn't compile the test.
[INFO] [stdout] ---- src/lib.rs - extract_domain (line 364) stdout ----
[INFO] [stdout] error[E0425]: cannot find function `extract_domain` in this scope
[INFO] [stdout]    --> src/lib.rs:365:14
[INFO] [stdout]     |
[INFO] [stdout] 365 | let domain = extract_domain("https://example.com/path");
[INFO] [stdout]     |              ^^^^^^^^^^^^^^ not found in this scope
[INFO] [stdout] 
[INFO] [stdout] error: aborting due to 1 previous error
[INFO] [stdout] 
[INFO] [stdout] For more information about this error, try `rustc --explain E0425`.
[INFO] [stdout] Couldn't compile the test.
[INFO] [stdout] ---- src/lib.rs - fetch_with_cookies (line 460) stdout ----
[INFO] [stdout] error[E0425]: cannot find value `client` in this scope
[INFO] [stdout]    --> src/lib.rs:461:44
[INFO] [stdout]     |
[INFO] [stdout] 461 | fetch_with_cookies("https://example.com", &client).await;
[INFO] [stdout]     |                                            ^^^^^^ not found in this scope
[INFO] [stdout] 
[INFO] [stdout] error[E0728]: `await` is only allowed inside `async` functions and blocks
[INFO] [stdout]    --> src/lib.rs:461:52
[INFO] [stdout]     |
[INFO] [stdout] 460 | fn main() { #[allow(non_snake_case)] fn _doctest_main_src_lib_rs_460_0() {
[INFO] [stdout]     |                                      ----------------------------------- this is not `async`
[INFO] [stdout] 461 | fetch_with_cookies("https://example.com", &client).await;
[INFO] [stdout]     |                                                    ^^^^^ only allowed inside `async` functions and blocks
[INFO] [stdout] 
[INFO] [stdout] error[E0425]: cannot find function `fetch_with_cookies` in this scope
[INFO] [stdout]    --> src/lib.rs:461:1
[INFO] [stdout]     |
[INFO] [stdout] 461 | fetch_with_cookies("https://example.com", &client).await;
[INFO] [stdout]     | ^^^^^^^^^^^^^^^^^^ not found in this scope
[INFO] [stdout] 
[INFO] [stdout] error: aborting due to 3 previous errors
[INFO] [stdout] 
[INFO] [stdout] Some errors have detailed explanations: E0425, E0728.
[INFO] [stdout] For more information about an error, try `rustc --explain E0425`.
[INFO] [stdout] Couldn't compile the test.
[INFO] [stdout] ---- src/lib.rs - scrape_js (line 381) stdout ----
[INFO] [stdout] error[E0425]: cannot find function `scrape_js_content` in this scope
[INFO] [stdout]    --> src/lib.rs:382:1
[INFO] [stdout]     |
[INFO] [stdout] 382 | scrape_js_content("<script>var apiKey = '12345';</script>");
[INFO] [stdout]     | ^^^^^^^^^^^^^^^^^ not found in this scope
[INFO] [stdout] 
[INFO] [stdout] error: aborting due to 1 previous error
[INFO] [stdout] 
[INFO] [stdout] For more information about this error, try `rustc --explain E0425`.
[INFO] [stdout] Couldn't compile the test.
[INFO] [stdout] ---- src/lib.rs - scrape_content (line 251) stdout ----
[INFO] [stdout] error[E0425]: cannot find value `client` in this scope
[INFO] [stdout]    --> src/lib.rs:252:60
[INFO] [stdout]     |
[INFO] [stdout] 252 | scrape_content("<html>...</html>", "https://example.com", &client).await;
[INFO] [stdout]     |                                                            ^^^^^^ not found in this scope
[INFO] [stdout] 
[INFO] [stdout] error[E0728]: `await` is only allowed inside `async` functions and blocks
[INFO] [stdout]    --> src/lib.rs:252:68
[INFO] [stdout]     |
[INFO] [stdout] 251 | fn main() { #[allow(non_snake_case)] fn _doctest_main_src_lib_rs_251_0() {
[INFO] [stdout]     |                                      ----------------------------------- this is not `async`
[INFO] [stdout] 252 | scrape_content("<html>...</html>", "https://example.com", &client).await;
[INFO] [stdout]     |                                                                    ^^^^^ only allowed inside `async` functions and blocks
[INFO] [stdout] 
[INFO] [stdout] error[E0425]: cannot find function `scrape_content` in this scope
[INFO] [stdout]    --> src/lib.rs:252:1
[INFO] [stdout]     |
[INFO] [stdout] 252 | scrape_content("<html>...</html>", "https://example.com", &client).await;
[INFO] [stdout]     | ^^^^^^^^^^^^^^ not found in this scope
[INFO] [stdout] 
[INFO] [stdout] error: aborting due to 3 previous errors
[INFO] [stdout] 
[INFO] [stdout] Some errors have detailed explanations: E0425, E0728.
[INFO] [stdout] For more information about an error, try `rustc --explain E0425`.
[INFO] [stdout] Couldn't compile the test.
[INFO] [stdout] ---- src/lib.rs - check_open_directories (line 479) stdout ----
[INFO] [stdout] error[E0425]: cannot find value `client` in this scope
[INFO] [stdout]    --> src/lib.rs:480:48
[INFO] [stdout]     |
[INFO] [stdout] 480 | check_open_directories("https://example.com", &client).await;
[INFO] [stdout]     |                                                ^^^^^^ not found in this scope
[INFO] [stdout] 
[INFO] [stdout] error[E0728]: `await` is only allowed inside `async` functions and blocks
[INFO] [stdout]    --> src/lib.rs:480:56
[INFO] [stdout]     |
[INFO] [stdout] 479 | fn main() { #[allow(non_snake_case)] fn _doctest_main_src_lib_rs_479_0() {
[INFO] [stdout]     |                                      ----------------------------------- this is not `async`
[INFO] [stdout] 480 | check_open_directories("https://example.com", &client).await;
[INFO] [stdout]     |                                                        ^^^^^ only allowed inside `async` functions and blocks
[INFO] [stdout] 
[INFO] [stdout] error[E0425]: cannot find function `check_open_directories` in this scope
[INFO] [stdout]    --> src/lib.rs:480:1
[INFO] [stdout]     |
[INFO] [stdout] 480 | check_open_directories("https://example.com", &client).await;
[INFO] [stdout]     | ^^^^^^^^^^^^^^^^^^^^^^ not found in this scope
[INFO] [stdout] 
[INFO] [stdout] error: aborting due to 3 previous errors
[INFO] [stdout] 
[INFO] [stdout] Some errors have detailed explanations: E0425, E0728.
[INFO] [stdout] For more information about an error, try `rustc --explain E0425`.
[INFO] [stdout] Couldn't compile the test.
[INFO] [stdout] ---- src/lib.rs - download_media (line 179) stdout ----
[INFO] [stdout] error[E0425]: cannot find value `client` in this scope
[INFO] [stdout]    --> src/lib.rs:180:17
[INFO] [stdout]     |
[INFO] [stdout] 180 | download_media(&client, "https://example.com/image.jpg", Path::new("./downloads/image.jpg")).await;
[INFO] [stdout]     |                 ^^^^^^ not found in this scope
[INFO] [stdout] 
[INFO] [stdout] error[E0433]: cannot find type `Path` in this scope
[INFO] [stdout]    --> src/lib.rs:180:58
[INFO] [stdout]     |
[INFO] [stdout] 180 | download_media(&client, "https://example.com/image.jpg", Path::new("./downloads/image.jpg")).await;
[INFO] [stdout]     |                                                          ^^^^ use of undeclared type `Path`
[INFO] [stdout]     |
[INFO] [stdout] help: consider importing this struct
[INFO] [stdout]     |
[INFO] [stdout] 179 + use std::path::Path;
[INFO] [stdout]     |
[INFO] [stdout] 
[INFO] [stdout] error[E0728]: `await` is only allowed inside `async` functions and blocks
[INFO] [stdout]    --> src/lib.rs:180:94
[INFO] [stdout]     |
[INFO] [stdout] 179 | fn main() { #[allow(non_snake_case)] fn _doctest_main_src_lib_rs_179_0() {
[INFO] [stdout]     |                                      ----------------------------------- this is not `async`
[INFO] [stdout] 180 | download_media(&client, "https://example.com/image.jpg", Path::new("./downloads/image.jpg")).await;
[INFO] [stdout]     |                                                                                              ^^^^^ only allowed inside `async` functions and blocks
[INFO] [stdout] 
[INFO] [stdout] error[E0425]: cannot find function `download_media` in this scope
[INFO] [stdout]    --> src/lib.rs:180:1
[INFO] [stdout]     |
[INFO] [stdout] 180 | download_media(&client, "https://example.com/image.jpg", Path::new("./downloads/image.jpg")).await;
[INFO] [stdout]     | ^^^^^^^^^^^^^^ not found in this scope
[INFO] [stdout] 
[INFO] [stdout] error: aborting due to 4 previous errors
[INFO] [stdout] 
[INFO] [stdout] Some errors have detailed explanations: E0425, E0433, E0728.
[INFO] [stdout] For more information about an error, try `rustc --explain E0425`.
[INFO] [stdout] Couldn't compile the test.
[INFO] [stdout] ---- src/lib.rs - extract_links (line 122) stdout ----
[INFO] [stdout] error[E0425]: cannot find function `extract_links` in this scope
[INFO] [stdout]    --> src/lib.rs:123:13
[INFO] [stdout]     |
[INFO] [stdout] 123 | let links = extract_links("<a href='/about'>About</a>", "https://example.com");
[INFO] [stdout]     |             ^^^^^^^^^^^^^ not found in this scope
[INFO] [stdout] 
[INFO] [stdout] error: aborting due to 1 previous error
[INFO] [stdout] 
[INFO] [stdout] For more information about this error, try `rustc --explain E0425`.
[INFO] [stdout] Couldn't compile the test.
[INFO] [stdout] ---- src/lib.rs - ai_scrape (line 995) stdout ----
[INFO] [stdout] error[E0425]: cannot find value `client` in this scope
[INFO] [stdout]    --> src/lib.rs:996:35
[INFO] [stdout]     |
[INFO] [stdout] 996 | ai_scrape("https://example.com", &client, &mut visited).await;
[INFO] [stdout]     |                                   ^^^^^^ not found in this scope
[INFO] [stdout] 
[INFO] [stdout] error[E0425]: cannot find value `visited` in this scope
[INFO] [stdout]    --> src/lib.rs:996:48
[INFO] [stdout]     |
[INFO] [stdout] 996 | ai_scrape("https://example.com", &client, &mut visited).await;
[INFO] [stdout]     |                                                ^^^^^^^ not found in this scope
[INFO] [stdout] 
[INFO] [stdout] error[E0728]: `await` is only allowed inside `async` functions and blocks
[INFO] [stdout]    --> src/lib.rs:996:57
[INFO] [stdout]     |
[INFO] [stdout] 995 | fn main() { #[allow(non_snake_case)] fn _doctest_main_src_lib_rs_995_0() {
[INFO] [stdout]     |                                      ----------------------------------- this is not `async`
[INFO] [stdout] 996 | ai_scrape("https://example.com", &client, &mut visited).await;
[INFO] [stdout]     |                                                         ^^^^^ only allowed inside `async` functions and blocks
[INFO] [stdout] 
[INFO] [stdout] error[E0425]: cannot find function `ai_scrape` in this scope
[INFO] [stdout]    --> src/lib.rs:996:1
[INFO] [stdout]     |
[INFO] [stdout] 996 | ai_scrape("https://example.com", &client, &mut visited).await;
[INFO] [stdout]     | ^^^^^^^^^ not found in this scope
[INFO] [stdout] 
[INFO] [stdout] error: aborting due to 4 previous errors
[INFO] [stdout] 
[INFO] [stdout] Some errors have detailed explanations: E0425, E0728.
[INFO] [stdout] For more information about an error, try `rustc --explain E0425`.
[INFO] [stdout] Couldn't compile the test.
[INFO] [stdout] ---- src/lib.rs - normalize_link (line 153) stdout ----
[INFO] [stdout] error[E0425]: cannot find function `normalize_link` in this scope
[INFO] [stdout]    --> src/lib.rs:154:21
[INFO] [stdout]     |
[INFO] [stdout] 154 | let absolute_link = normalize_link("/about", "https://example.com");
[INFO] [stdout]     |                     ^^^^^^^^^^^^^^ not found in this scope
[INFO] [stdout] 
[INFO] [stdout] error: aborting due to 1 previous error
[INFO] [stdout] 
[INFO] [stdout] For more information about this error, try `rustc --explain E0425`.
[INFO] [stdout] Couldn't compile the test.
[INFO] [stdout] ---- src/lib.rs - run (line 537) stdout ----
[INFO] [stdout] error[E0728]: `await` is only allowed inside `async` functions and blocks
[INFO] [stdout]    --> src/lib.rs:539:37
[INFO] [stdout]     |
[INFO] [stdout] 537 | fn main() { #[allow(non_snake_case)] fn _doctest_main_src_lib_rs_537_0() {
[INFO] [stdout]     |                                      ----------------------------------- this is not `async`
[INFO] [stdout] 538 | let client = Client::new();
[INFO] [stdout] 539 | run("https://example.com", &client).await;
[INFO] [stdout]     |                                     ^^^^^ only allowed inside `async` functions and blocks
[INFO] [stdout] 
[INFO] [stdout] error[E0433]: cannot find type `Client` in this scope
[INFO] [stdout]    --> src/lib.rs:538:14
[INFO] [stdout]     |
[INFO] [stdout] 538 | let client = Client::new();
[INFO] [stdout]     |              ^^^^^^ use of undeclared type `Client`
[INFO] [stdout] 
[INFO] [stdout] error[E0425]: cannot find function `run` in this scope
[INFO] [stdout]    --> src/lib.rs:539:1
[INFO] [stdout]     |
[INFO] [stdout] 539 | run("https://example.com", &client).await;
[INFO] [stdout]     | ^^^ not found in this scope
[INFO] [stdout] 
[INFO] [stdout] error: aborting due to 3 previous errors
[INFO] [stdout] 
[INFO] [stdout] Some errors have detailed explanations: E0425, E0433, E0728.
[INFO] [stdout] For more information about an error, try `rustc --explain E0425`.
[INFO] [stdout] Couldn't compile the test.
[INFO] [stdout] ---- src/lib.rs - fetch_robots_txt (line 503) stdout ----
[INFO] [stdout] error[E0425]: cannot find value `client` in this scope
[INFO] [stdout]    --> src/lib.rs:504:42
[INFO] [stdout]     |
[INFO] [stdout] 504 | fetch_robots_txt("https://example.com", &client).await;
[INFO] [stdout]     |                                          ^^^^^^ not found in this scope
[INFO] [stdout] 
[INFO] [stdout] error[E0728]: `await` is only allowed inside `async` functions and blocks
[INFO] [stdout]    --> src/lib.rs:504:50
[INFO] [stdout]     |
[INFO] [stdout] 503 | fn main() { #[allow(non_snake_case)] fn _doctest_main_src_lib_rs_503_0() {
[INFO] [stdout]     |                                      ----------------------------------- this is not `async`
[INFO] [stdout] 504 | fetch_robots_txt("https://example.com", &client).await;
[INFO] [stdout]     |                                                  ^^^^^ only allowed inside `async` functions and blocks
[INFO] [stdout] 
[INFO] [stdout] error[E0425]: cannot find function `fetch_robots_txt` in this scope
[INFO] [stdout]    --> src/lib.rs:504:1
[INFO] [stdout]     |
[INFO] [stdout] 504 | fetch_robots_txt("https://example.com", &client).await;
[INFO] [stdout]     | ^^^^^^^^^^^^^^^^ not found in this scope
[INFO] [stdout] 
[INFO] [stdout] error: aborting due to 3 previous errors
[INFO] [stdout] 
[INFO] [stdout] Some errors have detailed explanations: E0425, E0728.
[INFO] [stdout] For more information about an error, try `rustc --explain E0425`.
[INFO] [stdout] Couldn't compile the test.
[INFO] [stdout] ---- src/lib.rs - random_delay (line 599) stdout ----
[INFO] [stdout] error[E0728]: `await` is only allowed inside `async` functions and blocks
[INFO] [stdout]    --> src/lib.rs:600:20
[INFO] [stdout]     |
[INFO] [stdout] 599 | fn main() { #[allow(non_snake_case)] fn _doctest_main_src_lib_rs_599_0() {
[INFO] [stdout]     |                                      ----------------------------------- this is not `async`
[INFO] [stdout] 600 | random_delay(1, 5).await;
[INFO] [stdout]     |                    ^^^^^ only allowed inside `async` functions and blocks
[INFO] [stdout] 
[INFO] [stdout] error[E0425]: cannot find function `random_delay` in this scope
[INFO] [stdout]    --> src/lib.rs:600:1
[INFO] [stdout]     |
[INFO] [stdout] 600 | random_delay(1, 5).await;
[INFO] [stdout]     | ^^^^^^^^^^^^ not found in this scope
[INFO] [stdout] 
[INFO] [stdout] error: aborting due to 2 previous errors
[INFO] [stdout] 
[INFO] [stdout] Some errors have detailed explanations: E0425, E0728.
[INFO] [stdout] For more information about an error, try `rustc --explain E0425`.
[INFO] [stdout] Couldn't compile the test.
[INFO] [stdout] ---- src/lib.rs - scrape_for_errors (line 404) stdout ----
[INFO] [stdout] error[E0425]: cannot find function `scrape_for_errors` in this scope
[INFO] [stdout]    --> src/lib.rs:405:1
[INFO] [stdout]     |
[INFO] [stdout] 405 | scrape_for_errors("<html><body>Error: Stack trace</body></html>");
[INFO] [stdout]     | ^^^^^^^^^^^^^^^^^ not found in this scope
[INFO] [stdout] 
[INFO] [stdout] error: aborting due to 1 previous error
[INFO] [stdout] 
[INFO] [stdout] For more information about this error, try `rustc --explain E0425`.
[INFO] [stdout] Couldn't compile the test.
[INFO] [stdout] ---- src/lib.rs - recursive_scrape (line 59) stdout ----
[INFO] [stdout] error[E0433]: cannot find type `HashSet` in this scope
[INFO] [stdout]   --> src/lib.rs:61:19
[INFO] [stdout]    |
[INFO] [stdout] 61 | let mut visited = HashSet::new();
[INFO] [stdout]    |                   ^^^^^^^ use of undeclared type `HashSet`
[INFO] [stdout]    |
[INFO] [stdout] help: consider importing this struct
[INFO] [stdout]    |
[INFO] [stdout] 59 + use std::collections::HashSet;
[INFO] [stdout]    |
[INFO] [stdout] 
[INFO] [stdout] error[E0728]: `await` is only allowed inside `async` functions and blocks
[INFO] [stdout]   --> src/lib.rs:62:64
[INFO] [stdout]    |
[INFO] [stdout] 59 | fn main() { #[allow(non_snake_case)] fn _doctest_main_src_lib_rs_59_0() {
[INFO] [stdout]    |                                      ---------------------------------- this is not `async`
[INFO] [stdout] ...
[INFO] [stdout] 62 | recursive_scrape("https://example.com", &client, &mut visited).await;
[INFO] [stdout]    |                                                                ^^^^^ only allowed inside `async` functions and blocks
[INFO] [stdout] 
[INFO] [stdout] error[E0433]: cannot find type `Client` in this scope
[INFO] [stdout]   --> src/lib.rs:60:14
[INFO] [stdout]    |
[INFO] [stdout] 60 | let client = Client::new();
[INFO] [stdout]    |              ^^^^^^ use of undeclared type `Client`
[INFO] [stdout] 
[INFO] [stdout] error[E0425]: cannot find function `recursive_scrape` in this scope
[INFO] [stdout]   --> src/lib.rs:62:1
[INFO] [stdout]    |
[INFO] [stdout] 62 | recursive_scrape("https://example.com", &client, &mut visited).await;
[INFO] [stdout]    | ^^^^^^^^^^^^^^^^ not found in this scope
[INFO] [stdout] 
[INFO] [stdout] error: aborting due to 4 previous errors
[INFO] [stdout] 
[INFO] [stdout] Some errors have detailed explanations: E0425, E0433, E0728.
[INFO] [stdout] For more information about an error, try `rustc --explain E0425`.
[INFO] [stdout] Couldn't compile the test.
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout]     src/lib.rs - ai_scrape (line 995)
[INFO] [stdout]     src/lib.rs - check_open_directories (line 479)
[INFO] [stdout]     src/lib.rs - download_media (line 179)
[INFO] [stdout]     src/lib.rs - extract_domain (line 364)
[INFO] [stdout]     src/lib.rs - extract_links (line 122)
[INFO] [stdout]     src/lib.rs - fetch_robots_txt (line 503)
[INFO] [stdout]     src/lib.rs - fetch_with_cookies (line 460)
[INFO] [stdout]     src/lib.rs - normalize_link (line 153)
[INFO] [stdout]     src/lib.rs - random_delay (line 599)
[INFO] [stdout]     src/lib.rs - random_user_agent (line 33)
[INFO] [stdout]     src/lib.rs - recursive_scrape (line 59)
[INFO] [stdout]     src/lib.rs - run (line 537)
[INFO] [stdout]     src/lib.rs - scrape_content (line 251)
[INFO] [stdout]     src/lib.rs - scrape_for_emails (line 422)
[INFO] [stdout]     src/lib.rs - scrape_for_errors (line 404)
[INFO] [stdout]     src/lib.rs - scrape_js (line 381)
[INFO] [stdout] 
[INFO] [stdout] test result: FAILED. 0 passed; 16 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.95s
[INFO] [stdout] 
[INFO] [stderr] error: doctest failed, to rerun pass `--doc`
[INFO] running `Command { std: "docker" "inspect" "07323fd70d7ae2d8b12c56b7ca2733f285c0580ba89fe850ac4c6d226103e0a0", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "07323fd70d7ae2d8b12c56b7ca2733f285c0580ba89fe850ac4c6d226103e0a0", kill_on_drop: false }`
[INFO] [stdout] 07323fd70d7ae2d8b12c56b7ca2733f285c0580ba89fe850ac4c6d226103e0a0
