[INFO] fetching crate semchunk-rs 0.1.1...
[INFO] testing semchunk-rs-0.1.1 against master#ec6f9a5b4413f74386267ef8efc93712c2ce6db6 for pr-155739-1
[INFO] extracting crate semchunk-rs 0.1.1 into /workspace/builds/worker-4-tc1/source
[INFO] started tweaking crates.io crate semchunk-rs 0.1.1
[INFO] finished tweaking crates.io crate semchunk-rs 0.1.1
[INFO] tweaked toml for crates.io crate semchunk-rs 0.1.1 written to /workspace/builds/worker-4-tc1/source/Cargo.toml
[INFO] validating manifest of crates.io crate semchunk-rs 0.1.1 on toolchain ec6f9a5b4413f74386267ef8efc93712c2ce6db6
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+ec6f9a5b4413f74386267ef8efc93712c2ce6db6" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+ec6f9a5b4413f74386267ef8efc93712c2ce6db6" "generate-lockfile" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] [stderr]     Blocking waiting for file lock on package cache
[INFO] [stderr]     Updating crates.io index
[INFO] [stderr]      Locking 312 packages to latest compatible versions
[INFO] [stderr]       Adding criterion v0.5.1 (available: v0.8.2)
[INFO] [stderr]       Adding generic-array v0.14.7 (available: v0.14.9)
[INFO] [stderr]       Adding tiktoken-rs v0.6.0 (available: v0.11.0)
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+ec6f9a5b4413f74386267ef8efc93712c2ce6db6" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] [stderr]     Blocking waiting for file lock on package cache
[INFO] [stderr]  Downloading crates ...
[INFO] [stderr]   Downloaded bit-set v0.5.3
[INFO] [stderr]   Downloaded fancy-regex v0.13.0
[INFO] [stderr]   Downloaded webpki-roots v0.26.11
[INFO] [stderr]   Downloaded pbkdf2 v0.11.0
[INFO] [stderr]   Downloaded dirs v5.0.1
[INFO] [stderr]   Downloaded zstd v0.11.2+zstd.1.5.2
[INFO] [stderr]   Downloaded password-hash v0.4.2
[INFO] [stderr]   Downloaded redox_users v0.4.6
[INFO] [stderr]   Downloaded csv-core v0.1.13
[INFO] [stderr]   Downloaded safetensors v0.3.3
[INFO] [stderr]   Downloaded filetime v0.2.29
[INFO] [stderr]   Downloaded system-configuration v0.5.1
[INFO] [stderr]   Downloaded system-configuration-sys v0.5.0
[INFO] [stderr]   Downloaded sync_wrapper v0.1.2
[INFO] [stderr]   Downloaded hyper-tls v0.5.0
[INFO] [stderr]   Downloaded wasm-bindgen-futures v0.4.71
[INFO] [stderr]   Downloaded zstd-safe v5.0.2+zstd.1.5.2
[INFO] [stderr]   Downloaded dirs-sys v0.4.1
[INFO] [stderr]   Downloaded bzip2 v0.4.4
[INFO] [stderr]   Downloaded ordered-float v4.6.0
[INFO] [stderr]   Downloaded is-terminal v0.4.17
[INFO] [stderr]   Downloaded bisection v0.1.0
[INFO] [stderr]   Downloaded matrixmultiply v0.3.10
[INFO] [stderr]   Downloaded winreg v0.50.0
[INFO] [stderr]   Downloaded criterion-plot v0.5.0
[INFO] [stderr]   Downloaded rust_tokenizers v8.1.1
[INFO] [stderr]   Downloaded unicode-normalization-alignments v0.1.12
[INFO] [stderr]   Downloaded zip v0.6.6
[INFO] [stderr]   Downloaded indicatif v0.16.2
[INFO] [stderr]   Downloaded cached-path v0.6.2
[INFO] [stderr]   Downloaded tar v0.4.45
[INFO] [stderr]   Downloaded openssl-sys v0.9.115
[INFO] [stderr]   Downloaded ureq v2.12.1
[INFO] [stderr]   Downloaded criterion v0.5.1
[INFO] [stderr]   Downloaded protobuf v2.28.0
[INFO] [stderr]   Downloaded reqwest v0.11.27
[INFO] [stderr]   Downloaded torch-sys v0.17.0
[INFO] [stderr]   Downloaded webpki-roots v1.0.7
[INFO] [stderr]   Downloaded ndarray v0.15.6
[INFO] [stderr]   Downloaded openssl v0.10.79
[INFO] [stderr]   Downloaded rust-bert v0.23.0
[INFO] [stderr]   Downloaded bzip2-sys v0.1.13+1.0.8
[INFO] [stderr]   Downloaded web-sys v0.3.98
[INFO] [stderr]   Downloaded csv v1.4.0
[INFO] [stderr]   Downloaded tch v0.17.0
[INFO] [stderr]   Downloaded tiktoken-rs v0.6.0
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-4-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-4-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+ec6f9a5b4413f74386267ef8efc93712c2ce6db6" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] [stdout] 6df32877f0a8bce941072daf75e2f148c53cf6d7f6c820498ad0ef3c507f7031
[INFO] running `Command { std: "docker" "start" "-a" "6df32877f0a8bce941072daf75e2f148c53cf6d7f6c820498ad0ef3c507f7031", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "6df32877f0a8bce941072daf75e2f148c53cf6d7f6c820498ad0ef3c507f7031", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "6df32877f0a8bce941072daf75e2f148c53cf6d7f6c820498ad0ef3c507f7031", kill_on_drop: false }`
[INFO] [stdout] 6df32877f0a8bce941072daf75e2f148c53cf6d7f6c820498ad0ef3c507f7031
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-4-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-4-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+ec6f9a5b4413f74386267ef8efc93712c2ce6db6" "build" "--frozen" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] b90cf1841c5210a46dcd918082c2d93f498c6e54926bc015a0596339d94dfe77
[INFO] running `Command { std: "docker" "start" "-a" "b90cf1841c5210a46dcd918082c2d93f498c6e54926bc015a0596339d94dfe77", kill_on_drop: false }`
[INFO] [stderr]    Compiling bisection v0.1.0
[INFO] [stderr]    Compiling semchunk-rs v0.1.1 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `dev` profile [unoptimized + debuginfo] target(s) in 0.78s
[INFO] running `Command { std: "docker" "inspect" "b90cf1841c5210a46dcd918082c2d93f498c6e54926bc015a0596339d94dfe77", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "b90cf1841c5210a46dcd918082c2d93f498c6e54926bc015a0596339d94dfe77", kill_on_drop: false }`
[INFO] [stdout] b90cf1841c5210a46dcd918082c2d93f498c6e54926bc015a0596339d94dfe77
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-4-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-4-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+ec6f9a5b4413f74386267ef8efc93712c2ce6db6" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] 6521428a400858df276fb4c179e3f8de3378b1549503b49bce39eaffcfe78865
[INFO] running `Command { std: "docker" "start" "-a" "6521428a400858df276fb4c179e3f8de3378b1549503b49bce39eaffcfe78865", kill_on_drop: false }`
[INFO] [stderr]    Compiling proc-macro2 v1.0.106
[INFO] [stderr]    Compiling quote v1.0.45
[INFO] [stderr]    Compiling zerocopy v0.8.48
[INFO] [stderr]    Compiling zmij v1.0.21
[INFO] [stderr]    Compiling serde v1.0.228
[INFO] [stderr]    Compiling either v1.15.0
[INFO] [stderr]    Compiling serde_json v1.0.149
[INFO] [stderr]    Compiling rayon-core v1.13.0
[INFO] [stderr]    Compiling num-traits v0.2.19
[INFO] [stderr]    Compiling ciborium-io v0.2.2
[INFO] [stderr]    Compiling plotters-backend v0.3.7
[INFO] [stderr]    Compiling clap_lex v1.1.0
[INFO] [stderr]    Compiling itoa v1.0.18
[INFO] [stderr]    Compiling anstyle v1.0.14
[INFO] [stderr]    Compiling cast v0.3.0
[INFO] [stderr]    Compiling is-terminal v0.4.17
[INFO] [stderr]    Compiling anes v0.1.6
[INFO] [stderr]    Compiling oorandom v11.1.5
[INFO] [stderr]    Compiling once_cell v1.21.4
[INFO] [stderr]    Compiling itertools v0.10.5
[INFO] [stderr]    Compiling glob v0.3.3
[INFO] [stderr]    Compiling clap_builder v4.6.0
[INFO] [stderr]    Compiling plotters-svg v0.3.7
[INFO] [stderr]    Compiling rayon v1.12.0
[INFO] [stderr]    Compiling plotters v0.3.7
[INFO] [stderr]    Compiling syn v2.0.117
[INFO] [stderr]    Compiling criterion-plot v0.5.0
[INFO] [stderr]    Compiling clap v4.6.1
[INFO] [stderr]    Compiling zerocopy-derive v0.8.48
[INFO] [stderr]    Compiling serde_derive v1.0.228
[INFO] [stderr]    Compiling tinytemplate v1.2.1
[INFO] [stderr]    Compiling half v2.7.1
[INFO] [stderr]    Compiling ciborium-ll v0.2.2
[INFO] [stderr]    Compiling ciborium v0.2.2
[INFO] [stderr]    Compiling criterion v0.5.1
[INFO] [stderr]    Compiling semchunk-rs v0.1.1 (/opt/rustwide/workdir)
[INFO] [stdout] warning: function `get_data_path` is never used
[INFO] [stdout]    --> src/chunker.rs:238:8
[INFO] [stdout]     |
[INFO] [stdout] 238 |     fn get_data_path() -> PathBuf {
[INFO] [stdout]     |        ^^^^^^^^^^^^^
[INFO] [stdout]     |
[INFO] [stdout]     = note: `#[warn(dead_code)]` (part of `#[warn(unused)]`) on by default
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: function `get_roberta_vocab_path` is never used
[INFO] [stdout]    --> src/chunker.rs:242:8
[INFO] [stdout]     |
[INFO] [stdout] 242 |     fn get_roberta_vocab_path() -> PathBuf {
[INFO] [stdout]     |        ^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: function `get_roberta_merges_path` is never used
[INFO] [stdout]    --> src/chunker.rs:246:8
[INFO] [stdout]     |
[INFO] [stdout] 246 |     fn get_roberta_merges_path() -> PathBuf {
[INFO] [stdout]     |        ^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: function `get_gutenberg_path` is never used
[INFO] [stdout]    --> src/chunker.rs:250:8
[INFO] [stdout]     |
[INFO] [stdout] 250 |     fn get_gutenberg_path() -> PathBuf {
[INFO] [stdout]     |        ^^^^^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: function `get_gutenberg_corpus_path` is never used
[INFO] [stdout]    --> src/chunker.rs:254:8
[INFO] [stdout]     |
[INFO] [stdout] 254 |     fn get_gutenberg_corpus_path(corpus_filename: &str) -> PathBuf {
[INFO] [stdout]     |        ^^^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: function `read_gutenberg_corpus` is never used
[INFO] [stdout]    --> src/chunker.rs:258:8
[INFO] [stdout]     |
[INFO] [stdout] 258 |     fn read_gutenberg_corpus(corpus_filename: &str) -> String {
[INFO] [stdout]     |        ^^^^^^^^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 27.33s
[INFO] running `Command { std: "docker" "inspect" "6521428a400858df276fb4c179e3f8de3378b1549503b49bce39eaffcfe78865", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "6521428a400858df276fb4c179e3f8de3378b1549503b49bce39eaffcfe78865", kill_on_drop: false }`
[INFO] [stdout] 6521428a400858df276fb4c179e3f8de3378b1549503b49bce39eaffcfe78865
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-4-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-4-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+ec6f9a5b4413f74386267ef8efc93712c2ce6db6" "test" "--frozen", kill_on_drop: false }`
[INFO] [stdout] da8f9fda6aa9693eb4e33879595d396daa2900bc07386cab9b5ab4dbce2a5ef7
[INFO] running `Command { std: "docker" "start" "-a" "da8f9fda6aa9693eb4e33879595d396daa2900bc07386cab9b5ab4dbce2a5ef7", kill_on_drop: false }`
[INFO] [stderr] warning: function `get_data_path` is never used
[INFO] [stderr]    --> src/chunker.rs:238:8
[INFO] [stderr]     |
[INFO] [stderr] 238 |     fn get_data_path() -> PathBuf {
[INFO] [stderr]     |        ^^^^^^^^^^^^^
[INFO] [stderr]     |
[INFO] [stderr]     = note: `#[warn(dead_code)]` (part of `#[warn(unused)]`) on by default
[INFO] [stderr] 
[INFO] [stderr] warning: function `get_roberta_vocab_path` is never used
[INFO] [stderr]    --> src/chunker.rs:242:8
[INFO] [stderr]     |
[INFO] [stderr] 242 |     fn get_roberta_vocab_path() -> PathBuf {
[INFO] [stderr]     |        ^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stderr] 
[INFO] [stderr] warning: function `get_roberta_merges_path` is never used
[INFO] [stderr]    --> src/chunker.rs:246:8
[INFO] [stderr]     |
[INFO] [stderr] 246 |     fn get_roberta_merges_path() -> PathBuf {
[INFO] [stderr]     |        ^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stderr] 
[INFO] [stderr] warning: function `get_gutenberg_path` is never used
[INFO] [stderr]    --> src/chunker.rs:250:8
[INFO] [stderr]     |
[INFO] [stderr] 250 |     fn get_gutenberg_path() -> PathBuf {
[INFO] [stderr]     |        ^^^^^^^^^^^^^^^^^^
[INFO] [stderr] 
[INFO] [stderr] warning: function `get_gutenberg_corpus_path` is never used
[INFO] [stderr]    --> src/chunker.rs:254:8
[INFO] [stderr]     |
[INFO] [stderr] 254 |     fn get_gutenberg_corpus_path(corpus_filename: &str) -> PathBuf {
[INFO] [stderr]     |        ^^^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stderr] 
[INFO] [stderr] warning: function `read_gutenberg_corpus` is never used
[INFO] [stderr]    --> src/chunker.rs:258:8
[INFO] [stderr]     |
[INFO] [stderr] 258 |     fn read_gutenberg_corpus(corpus_filename: &str) -> String {
[INFO] [stderr]     |        ^^^^^^^^^^^^^^^^^^^^^
[INFO] [stderr] 
[INFO] [stderr] warning: `semchunk-rs` (lib test) generated 6 warnings
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 0.18s
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/semchunk_rs-3f28b91221540019)
[INFO] [stdout] 
[INFO] [stdout] running 5 tests
[INFO] [stdout] test splitter::splitter_tests::test_simple_semantic_chars_split ... ok
[INFO] [stdout] test chunker::chunker_tests::test_merge_splits_uneven ... ok
[INFO] [stdout] test chunker::chunker_tests::test_merge_splits_simple ... ok
[INFO] [stdout] test splitter::splitter_tests::test_whitespace_split ... ok
[INFO] [stdout] test splitter::splitter_tests::test_no_match_split ... ok
[INFO] [stderr]    Doc-tests semchunk_rs
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 5 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] running 8 tests
[INFO] [stdout] test src/chunker.rs - chunker::Chunker (line 48) ... FAILED
[INFO] [stdout] test src/lib.rs - (line 40) ... FAILED
[INFO] [stdout] test src/chunker.rs - chunker::Chunker::merge_splits (line 157) ... ok
[INFO] [stdout] test src/splitter.rs - splitter::Splitter (line 36) ... ok
[INFO] [stdout] test src/chunker.rs - chunker::Chunker (line 38) ... ok
[INFO] [stdout] test src/splitter.rs - splitter::Splitter::split_text (line 86) ... ok
[INFO] [stdout] test src/chunker.rs - chunker::Chunker::chunk (line 215) ... ok
[INFO] [stdout] test src/lib.rs - (line 29) ... ok
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout] 
[INFO] [stdout] ---- src/chunker.rs - chunker::Chunker (line 48) stdout ----
[INFO] [stdout] error[E0433]: cannot find module or crate `rust_tokenizers` in this scope
[INFO] [stdout]   --> src/chunker.rs:50:5
[INFO] [stdout]    |
[INFO] [stdout] 50 | use rust_tokenizers::tokenizer::{RobertaTokenizer, Tokenizer};
[INFO] [stdout]    |     ^^^^^^^^^^^^^^^ use of unresolved module or unlinked crate `rust_tokenizers`
[INFO] [stdout]    |
[INFO] [stdout]    = help: if you wanted to use a crate named `rust_tokenizers`, use `cargo add rust_tokenizers` to add it to your `Cargo.toml`
[INFO] [stdout] 
[INFO] [stdout] error: aborting due to 1 previous error
[INFO] [stdout] 
[INFO] [stdout] For more information about this error, try `rustc --explain E0433`.
[INFO] [stdout] Couldn't compile the test.
[INFO] [stdout] ---- src/lib.rs - (line 40) stdout ----
[INFO] [stdout] error[E0433]: cannot find module or crate `rust_tokenizers` in this scope
[INFO] [stdout]   --> src/lib.rs:42:5
[INFO] [stdout]    |
[INFO] [stdout] 42 | use rust_tokenizers::tokenizer::{RobertaTokenizer, Tokenizer};
[INFO] [stdout]    |     ^^^^^^^^^^^^^^^ use of unresolved module or unlinked crate `rust_tokenizers`
[INFO] [stdout]    |
[INFO] [stdout]    = help: if you wanted to use a crate named `rust_tokenizers`, use `cargo add rust_tokenizers` to add it to your `Cargo.toml`
[INFO] [stdout] 
[INFO] [stdout] error: aborting due to 1 previous error
[INFO] [stdout] 
[INFO] [stdout] For more information about this error, try `rustc --explain E0433`.
[INFO] [stdout] Couldn't compile the test.
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout]     src/chunker.rs - chunker::Chunker (line 48)
[INFO] [stdout]     src/lib.rs - (line 40)
[INFO] [stdout] 
[INFO] [stdout] test result: FAILED. 6 passed; 2 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.92s
[INFO] [stdout] 
[INFO] [stderr] error: doctest failed, to rerun pass `--doc`
[INFO] running `Command { std: "docker" "inspect" "da8f9fda6aa9693eb4e33879595d396daa2900bc07386cab9b5ab4dbce2a5ef7", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "da8f9fda6aa9693eb4e33879595d396daa2900bc07386cab9b5ab4dbce2a5ef7", kill_on_drop: false }`
[INFO] [stdout] da8f9fda6aa9693eb4e33879595d396daa2900bc07386cab9b5ab4dbce2a5ef7
