[INFO] fetching crate rust_tokenizers 8.1.0...
[INFO] documenting rust_tokenizers-8.1.0 against 1.69.0 for beta-1.70-rustdoc-1
[INFO] extracting crate rust_tokenizers 8.1.0 into /workspace/builds/worker-3-tc1/source
[INFO] validating manifest of crates.io crate rust_tokenizers 8.1.0 on toolchain 1.69.0
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.69.0" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] started tweaking crates.io crate rust_tokenizers 8.1.0
[INFO] finished tweaking crates.io crate rust_tokenizers 8.1.0
[INFO] tweaked toml for crates.io crate rust_tokenizers 8.1.0 written to /workspace/builds/worker-3-tc1/source/Cargo.toml
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" __CARGO_TEST_CHANNEL_OVERRIDE_DO_NOT_USE_THIS="nightly" "/workspace/cargo-home/bin/cargo" "+1.69.0" "generate-lockfile" "--manifest-path" "Cargo.toml" "-Zno-index-update", kill_on_drop: false }`
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.69.0" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] [stderr]  Downloading crates ...
[INFO] [stderr]   Downloaded unicode-normalization-alignments v0.1.12
[INFO] [stderr]   Downloaded cached-path v0.6.1
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:5ff2268d62e97bff2cde7d5815dd6ed5b47097566f13b8d0ca110b04b60e07ed" "/opt/rustwide/cargo-home/bin/cargo" "+1.69.0" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] [stdout] 26eabda64a94d63b311d9125ba8b042a1590127e13c635bbad6ee84e58d0305d
[INFO] running `Command { std: "docker" "start" "-a" "26eabda64a94d63b311d9125ba8b042a1590127e13c635bbad6ee84e58d0305d", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "26eabda64a94d63b311d9125ba8b042a1590127e13c635bbad6ee84e58d0305d", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "26eabda64a94d63b311d9125ba8b042a1590127e13c635bbad6ee84e58d0305d", kill_on_drop: false }`
[INFO] [stdout] 26eabda64a94d63b311d9125ba8b042a1590127e13c635bbad6ee84e58d0305d
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:5ff2268d62e97bff2cde7d5815dd6ed5b47097566f13b8d0ca110b04b60e07ed" "/opt/rustwide/cargo-home/bin/cargo" "+1.69.0" "doc" "--frozen" "--no-deps" "--document-private-items" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] ee73e5755f265dfd14fe9c2ab63480346a7b6707a38b15645598f1a61557d6f0
[INFO] running `Command { std: "docker" "start" "-a" "ee73e5755f265dfd14fe9c2ab63480346a7b6707a38b15645598f1a61557d6f0", kill_on_drop: false }`
[INFO] [stderr]    Compiling protobuf v2.28.0
[INFO] [stderr]     Checking once_cell v1.17.1
[INFO] [stderr]    Compiling rust_tokenizers v8.1.0 (/opt/rustwide/workdir)
[INFO] [stderr]     Checking csv-core v0.1.10
[INFO] [stderr]     Checking unicode-normalization-alignments v0.1.12
[INFO] [stderr]    Compiling thiserror-impl v1.0.40
[INFO] [stderr]     Checking serde v1.0.160
[INFO] [stderr]     Checking rayon-core v1.11.0
[INFO] [stderr]     Checking ahash v0.8.3
[INFO] [stderr]     Checking hashbrown v0.13.2
[INFO] [stderr]     Checking rayon v1.7.0
[INFO] [stderr]     Checking thiserror v1.0.40
[INFO] [stderr]     Checking csv v1.2.1
[INFO] [stderr]     Checking serde_json v1.0.96
[INFO] [stderr]  Documenting rust_tokenizers v8.1.0 (/opt/rustwide/workdir)
[INFO] [stdout] warning: unresolved link to `SEP`
[INFO] [stdout]    --> src/tokenizer/base_tokenizer.rs:374:82
[INFO] [stdout]     |
[INFO] [stdout] 374 |     /// Vector segments ids (for example for BERT segments are separated with a [SEP] marker, each incrementing the segment ID).
[INFO] [stdout]     |                                                                                  ^^^ no item named `SEP` in scope
[INFO] [stdout]     |
[INFO] [stdout]     = help: to escape `[` and `]` characters, add '\' before them like `\[` or `\]`
[INFO] [stdout]     = note: `#[warn(rustdoc::broken_intra_doc_links)]` on by default
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unresolved link to `SEP`
[INFO] [stdout]    --> src/tokenizer/base_tokenizer.rs:406:82
[INFO] [stdout]     |
[INFO] [stdout] 406 |     /// Vector segments ids (for example for BERT segments are separated with a [SEP] marker, each incrementing the segment ID).
[INFO] [stdout]     |                                                                                  ^^^ no item named `SEP` in scope
[INFO] [stdout]     |
[INFO] [stdout]     = help: to escape `[` and `]` characters, add '\' before them like `\[` or `\]`
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unresolved link to `UNK`
[INFO] [stdout]    --> src/vocab/base_vocab.rs:411:27
[INFO] [stdout]     |
[INFO] [stdout] 411 | /// Base vocabulary with [UNK] unknown token used as a pre-tokenization step for BERT-class tokenizers.
[INFO] [stdout]     |                           ^^^ no item named `UNK` in scope
[INFO] [stdout]     |
[INFO] [stdout]     = help: to escape `[` and `]` characters, add '\' before them like `\[` or `\]`
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unopened HTML tag `s`
[INFO] [stdout]     --> src/tokenizer/base_tokenizer.rs:1122:40
[INFO] [stdout]      |
[INFO] [stdout] 1122 |     /// - pair of sequences: <s> A </s></s> B </s>
[INFO] [stdout]      |                                        ^^^^
[INFO] [stdout]      |
[INFO] [stdout]      = note: `#[warn(rustdoc::invalid_html_tags)]` on by default
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unopened HTML tag `s`
[INFO] [stdout]     --> src/tokenizer/base_tokenizer.rs:1122:47
[INFO] [stdout]      |
[INFO] [stdout] 1122 |     /// - pair of sequences: <s> A </s></s> B </s>
[INFO] [stdout]      |                                               ^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: 5 warnings emitted
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stderr]     Finished dev [unoptimized + debuginfo] target(s) in 4.01s
[INFO] running `Command { std: "docker" "inspect" "ee73e5755f265dfd14fe9c2ab63480346a7b6707a38b15645598f1a61557d6f0", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "ee73e5755f265dfd14fe9c2ab63480346a7b6707a38b15645598f1a61557d6f0", kill_on_drop: false }`
[INFO] [stdout] ee73e5755f265dfd14fe9c2ab63480346a7b6707a38b15645598f1a61557d6f0
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "RUSTC_BOOTSTRAP=1" "-e" "DOCS_RS=1" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:5ff2268d62e97bff2cde7d5815dd6ed5b47097566f13b8d0ca110b04b60e07ed" "/opt/rustwide/cargo-home/bin/cargo" "+1.69.0" "rustdoc" "--lib" "-Zrustdoc-map" "-Z" "unstable-options" "--config" "build.rustdocflags=[\"-Z\", \"unstable-options\", \"--document-private-items\"]" "--frozen" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] 358c1cfe8609d5012e34a2a3401986f365923652fe9866e140e524e3ff97dcf7
[INFO] running `Command { std: "docker" "start" "-a" "358c1cfe8609d5012e34a2a3401986f365923652fe9866e140e524e3ff97dcf7", kill_on_drop: false }`
[INFO] [stderr]  Documenting rust_tokenizers v8.1.0 (/opt/rustwide/workdir)
[INFO] [stdout] warning: unresolved link to `SEP`
[INFO] [stdout]    --> src/tokenizer/base_tokenizer.rs:374:82
[INFO] [stdout]     |
[INFO] [stdout] 374 |     /// Vector segments ids (for example for BERT segments are separated with a [SEP] marker, each incrementing the segment ID).
[INFO] [stdout]     |                                                                                  ^^^ no item named `SEP` in scope
[INFO] [stdout]     |
[INFO] [stdout]     = help: to escape `[` and `]` characters, add '\' before them like `\[` or `\]`
[INFO] [stdout]     = note: `#[warn(rustdoc::broken_intra_doc_links)]` on by default
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unresolved link to `SEP`
[INFO] [stdout]    --> src/tokenizer/base_tokenizer.rs:406:82
[INFO] [stdout]     |
[INFO] [stdout] 406 |     /// Vector segments ids (for example for BERT segments are separated with a [SEP] marker, each incrementing the segment ID).
[INFO] [stdout]     |                                                                                  ^^^ no item named `SEP` in scope
[INFO] [stdout]     |
[INFO] [stdout]     = help: to escape `[` and `]` characters, add '\' before them like `\[` or `\]`
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unresolved link to `UNK`
[INFO] [stdout]    --> src/vocab/base_vocab.rs:411:27
[INFO] [stdout]     |
[INFO] [stdout] 411 | /// Base vocabulary with [UNK] unknown token used as a pre-tokenization step for BERT-class tokenizers.
[INFO] [stdout]     |                           ^^^ no item named `UNK` in scope
[INFO] [stdout]     |
[INFO] [stdout]     = help: to escape `[` and `]` characters, add '\' before them like `\[` or `\]`
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unopened HTML tag `s`
[INFO] [stdout]     --> src/tokenizer/base_tokenizer.rs:1122:40
[INFO] [stdout]      |
[INFO] [stdout] 1122 |     /// - pair of sequences: <s> A </s></s> B </s>
[INFO] [stdout]      |                                        ^^^^
[INFO] [stdout]      |
[INFO] [stdout]      = note: `#[warn(rustdoc::invalid_html_tags)]` on by default
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unopened HTML tag `s`
[INFO] [stdout]     --> src/tokenizer/base_tokenizer.rs:1122:47
[INFO] [stdout]      |
[INFO] [stdout] 1122 |     /// - pair of sequences: <s> A </s></s> B </s>
[INFO] [stdout]      |                                               ^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: 5 warnings emitted
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stderr]     Finished dev [unoptimized + debuginfo] target(s) in 1.05s
[INFO] running `Command { std: "docker" "inspect" "358c1cfe8609d5012e34a2a3401986f365923652fe9866e140e524e3ff97dcf7", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "358c1cfe8609d5012e34a2a3401986f365923652fe9866e140e524e3ff97dcf7", kill_on_drop: false }`
[INFO] [stdout] 358c1cfe8609d5012e34a2a3401986f365923652fe9866e140e524e3ff97dcf7
