[INFO] cloning repository https://github.com/poliakovva/pbpe
[INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/poliakovva/pbpe" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fpoliakovva%2Fpbpe", kill_on_drop: false }`
[INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fpoliakovva%2Fpbpe'...
[INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }`
[INFO] [stdout] e7ca8ee957b59f29f30abd00fbe3b4f8f6353948
[INFO] checking poliakovva/pbpe/e7ca8ee957b59f29f30abd00fbe3b4f8f6353948 against master#c756124775121dea0e640652c5ee3c89e3dd0eb4 for pr-154971
[INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fpoliakovva%2Fpbpe" "/workspace/builds/worker-5-tc1/source", kill_on_drop: false }`
[INFO] [stderr] Cloning into '/workspace/builds/worker-5-tc1/source'...
[INFO] [stderr] done.
[INFO] [stderr] Updating files:   6% (1709/27889)
Updating files:   7% (1953/27889)
Updating files:   7% (2068/27889)
Updating files:   8% (2232/27889)
Updating files:   9% (2511/27889)
Updating files:   9% (2713/27889)
Updating files:  10% (2789/27889)
Updating files:  10% (2841/27889)
Updating files:  10% (2890/27889)
Updating files:  10% (2937/27889)
Updating files:  10% (2982/27889)
Updating files:  10% (3065/27889)
Updating files:  11% (3068/27889)
Updating files:  12% (3347/27889)
Updating files:  13% (3626/27889)
Updating files:  14% (3905/27889)
Updating files:  15% (4184/27889)
Updating files:  15% (4322/27889)
Updating files:  16% (4463/27889)
Updating files:  17% (4742/27889)
Updating files:  18% (5021/27889)
Updating files:  19% (5299/27889)
Updating files:  19% (5302/27889)
Updating files:  20% (5578/27889)
Updating files:  21% (5857/27889)
Updating files:  22% (6136/27889)
Updating files:  22% (6277/27889)
Updating files:  23% (6415/27889)
Updating files:  24% (6694/27889)
Updating files:  25% (6973/27889)
Updating files:  26% (7252/27889)
Updating files:  26% (7253/27889)
Updating files:  27% (7531/27889)
Updating files:  28% (7809/27889)
Updating files:  29% (8088/27889)
Updating files:  30% (8367/27889)
Updating files:  30% (8397/27889)
Updating files:  31% (8646/27889)
Updating files:  32% (8925/27889)
Updating files:  32% (8981/27889)
Updating files:  33% (9204/27889)
Updating files:  34% (9483/27889)
Updating files:  35% (9762/27889)
Updating files:  35% (9881/27889)
Updating files:  36% (10041/27889)
Updating files:  37% (10319/27889)
Updating files:  38% (10598/27889)
Updating files:  39% (10877/27889)
Updating files:  39% (10990/27889)
Updating files:  40% (11156/27889)
Updating files:  41% (11435/27889)
Updating files:  41% (11473/27889)
Updating files:  42% (11714/27889)
Updating files:  43% (11993/27889)
Updating files:  43% (11997/27889)
Updating files:  43% (12260/27889)
Updating files:  44% (12272/27889)
Updating files:  45% (12551/27889)
Updating files:  45% (12629/27889)
Updating files:  46% (12829/27889)
Updating files:  47% (13108/27889)
Updating files:  48% (13387/27889)
Updating files:  48% (13498/27889)
Updating files:  49% (13666/27889)
Updating files:  49% (13730/27889)
Updating files:  50% (13945/27889)
Updating files:  51% (14224/27889)
Updating files:  52% (14503/27889)
Updating files:  53% (14782/27889)
Updating files:  54% (15061/27889)
Updating files:  55% (15339/27889)
Updating files:  56% (15618/27889)
Updating files:  57% (15897/27889)
Updating files:  58% (16176/27889)
Updating files:  59% (16455/27889)
Updating files:  60% (16734/27889)
Updating files:  61% (17013/27889)
Updating files:  62% (17292/27889)
Updating files:  63% (17571/27889)
Updating files:  64% (17849/27889)
Updating files:  65% (18128/27889)
Updating files:  66% (18407/27889)
Updating files:  66% (18585/27889)
Updating files:  67% (18686/27889)
Updating files:  68% (18965/27889)
Updating files:  69% (19244/27889)
Updating files:  70% (19523/27889)
Updating files:  71% (19802/27889)
Updating files:  72% (20081/27889)
Updating files:  73% (20359/27889)
Updating files:  74% (20638/27889)
Updating files:  75% (20917/27889)
Updating files:  76% (21196/27889)
Updating files:  77% (21475/27889)
Updating files:  78% (21754/27889)
Updating files:  79% (22033/27889)
Updating files:  80% (22312/27889)
Updating files:  81% (22591/27889)
Updating files:  82% (22869/27889)
Updating files:  83% (23148/27889)
Updating files:  84% (23427/27889)
Updating files:  85% (23706/27889)
Updating files:  86% (23985/27889)
Updating files:  87% (24264/27889)
Updating files:  88% (24543/27889)
Updating files:  89% (24822/27889)
Updating files:  90% (25101/27889)
Updating files:  90% (25199/27889)
Updating files:  91% (25379/27889)
Updating files:  92% (25658/27889)
Updating files:  93% (25937/27889)
Updating files:  94% (26216/27889)
Updating files:  95% (26495/27889)
Updating files:  96% (26774/27889)
Updating files:  97% (27053/27889)
Updating files:  98% (27332/27889)
Updating files:  99% (27611/27889)
Updating files: 100% (27889/27889)
Updating files: 100% (27889/27889), done.
[INFO] removed /workspace/builds/worker-5-tc1/source/rust-toolchain
[INFO] started tweaking git repo https://github.com/poliakovva/pbpe
[INFO] removed 0 missing examples
[INFO] finished tweaking git repo https://github.com/poliakovva/pbpe
[INFO] tweaked toml for git repo https://github.com/poliakovva/pbpe written to /workspace/builds/worker-5-tc1/source/Cargo.toml
[INFO] validating manifest of git repo https://github.com/poliakovva/pbpe on toolchain c756124775121dea0e640652c5ee3c89e3dd0eb4
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+c756124775121dea0e640652c5ee3c89e3dd0eb4" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] crate git repo https://github.com/poliakovva/pbpe already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+c756124775121dea0e640652c5ee3c89e3dd0eb4" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] [stderr]     Updating crates.io index
[INFO] [stderr]  Downloading crates ...
[INFO] [stderr]   Downloaded unicode-normalization-alignments v0.1.12
[INFO] [stderr]   Downloaded monostate v0.1.13
[INFO] [stderr]   Downloaded oorandom v11.1.4
[INFO] [stderr]   Downloaded zerofrom v0.1.4
[INFO] [stderr]   Downloaded monostate-impl v0.1.13
[INFO] [stderr]   Downloaded macro_rules_attribute-proc_macro v0.2.0
[INFO] [stderr]   Downloaded yoke-derive v0.7.4
[INFO] [stderr]   Downloaded zerofrom-derive v0.1.4
[INFO] [stderr]   Downloaded yoke v0.7.4
[INFO] [stderr]   Downloaded litemap v0.7.3
[INFO] [stderr]   Downloaded clap v4.5.20
[INFO] [stderr]   Downloaded schannel v0.1.26
[INFO] [stderr]   Downloaded fancy-regex v0.13.0
[INFO] [stderr]   Downloaded ureq v2.10.1
[INFO] [stderr]   Downloaded cc v1.1.34
[INFO] [stderr]   Downloaded url v2.5.3
[INFO] [stderr]   Downloaded serde_derive v1.0.214
[INFO] [stderr]   Downloaded clap_builder v4.5.20
[INFO] [stderr]   Downloaded esaxx-rs v0.1.10
[INFO] [stderr]   Downloaded onig v6.4.0
[INFO] [stderr]   Downloaded priority-queue v2.3.1
[INFO] [stderr]   Downloaded hf-hub v0.3.2
[INFO] [stderr]   Downloaded thiserror v1.0.67
[INFO] [stderr]   Downloaded macro_rules_attribute v0.2.0
[INFO] [stderr]   Downloaded webpki-roots v0.26.6
[INFO] [stderr]   Downloaded rustls v0.23.16
[INFO] [stderr]   Downloaded thiserror-impl v1.0.67
[INFO] [stderr]   Downloaded rayon-cond v0.3.0
[INFO] [stderr]   Downloaded serde v1.0.214
[INFO] [stderr]   Downloaded spm_precompiled v0.1.4
[INFO] [stderr]   Downloaded onig_sys v69.8.1
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+c756124775121dea0e640652c5ee3c89e3dd0eb4" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] [stdout] da50079f3cbce91708d6102fb8708f7f8045b56e5541bc857e7b0a0364d59f04
[INFO] running `Command { std: "docker" "start" "-a" "da50079f3cbce91708d6102fb8708f7f8045b56e5541bc857e7b0a0364d59f04", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "da50079f3cbce91708d6102fb8708f7f8045b56e5541bc857e7b0a0364d59f04", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "da50079f3cbce91708d6102fb8708f7f8045b56e5541bc857e7b0a0364d59f04", kill_on_drop: false }`
[INFO] [stdout] da50079f3cbce91708d6102fb8708f7f8045b56e5541bc857e7b0a0364d59f04
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+c756124775121dea0e640652c5ee3c89e3dd0eb4" "check" "--frozen" "--all" "--all-targets" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] ff6a61476eb29275c61b59efc5dd13b01366e5b6d35a06c3d29488cbc0b4e787
[INFO] running `Command { std: "docker" "start" "-a" "ff6a61476eb29275c61b59efc5dd13b01366e5b6d35a06c3d29488cbc0b4e787", kill_on_drop: false }`
[INFO] [stderr]    Compiling proc-macro2 v1.0.89
[INFO] [stderr]    Compiling libc v0.2.161
[INFO] [stderr]    Compiling serde v1.0.214
[INFO] [stderr]    Compiling cc v1.1.34
[INFO] [stderr]     Checking byteorder v1.5.0
[INFO] [stderr]    Compiling pkg-config v0.3.31
[INFO] [stderr]     Checking aho-corasick v1.1.3
[INFO] [stderr]     Checking regex-syntax v0.8.5
[INFO] [stderr]    Compiling portable-atomic v1.9.0
[INFO] [stderr]    Compiling num-traits v0.2.19
[INFO] [stderr]     Checking half v2.4.1
[INFO] [stderr]     Checking tracing-core v0.1.32
[INFO] [stderr]     Checking smallvec v1.13.2
[INFO] [stderr]     Checking plotters-backend v0.3.7
[INFO] [stderr]    Compiling thiserror v1.0.67
[INFO] [stderr]    Compiling rustix v0.38.38
[INFO] [stderr]     Checking ciborium-io v0.2.2
[INFO] [stderr]     Checking hashbrown v0.15.2
[INFO] [stderr]     Checking nom v7.1.3
[INFO] [stderr]     Checking clap_builder v4.5.20
[INFO] [stderr]     Checking plotters-svg v0.3.7
[INFO] [stderr]     Checking itertools v0.11.0
[INFO] [stderr]     Checking cast v0.3.0
[INFO] [stderr]    Compiling macro_rules_attribute-proc_macro v0.2.0
[INFO] [stderr]     Checking ciborium-ll v0.2.2
[INFO] [stderr]     Checking overload v0.1.1
[INFO] [stderr]     Checking criterion-plot v0.5.0
[INFO] [stderr]     Checking nu-ansi-term v0.46.0
[INFO] [stderr]     Checking tracing-log v0.2.0
[INFO] [stderr]    Compiling quote v1.0.37
[INFO] [stderr]     Checking macro_rules_attribute v0.2.0
[INFO] [stderr]     Checking unicode-normalization-alignments v0.1.12
[INFO] [stderr]    Compiling syn v2.0.87
[INFO] [stderr]     Checking itertools v0.12.1
[INFO] [stderr]     Checking indexmap v2.9.0
[INFO] [stderr]     Checking thread_local v1.1.8
[INFO] [stderr]     Checking fastrand v2.1.1
[INFO] [stderr]     Checking unicode_categories v0.1.1
[INFO] [stderr]     Checking anes v0.1.6
[INFO] [stderr]     Checking oorandom v11.1.4
[INFO] [stderr]     Checking tracing-subscriber v0.3.18
[INFO] [stderr]     Checking assert_approx_eq v1.1.0
[INFO] [stderr]    Compiling onig_sys v69.8.1
[INFO] [stderr]    Compiling esaxx-rs v0.1.10
[INFO] [stderr]     Checking priority-queue v2.3.1
[INFO] [stderr]     Checking plotters v0.3.7
[INFO] [stderr]     Checking rayon-cond v0.3.0
[INFO] [stderr]     Checking getrandom v0.2.15
[INFO] [stderr]     Checking console v0.15.8
[INFO] [stderr]     Checking is-terminal v0.4.13
[INFO] [stderr]     Checking rand_core v0.6.4
[INFO] [stderr]     Checking indicatif v0.17.8
[INFO] [stderr]     Checking clap v4.5.20
[INFO] [stderr]     Checking regex-automata v0.4.8
[INFO] [stderr]     Checking tempfile v3.13.0
[INFO] [stderr]     Checking regex v1.11.1
[INFO] [stderr]    Compiling darling_core v0.20.10
[INFO] [stderr]     Checking onig v6.4.0
[INFO] [stderr]    Compiling serde_derive v1.0.214
[INFO] [stderr]    Compiling zerocopy-derive v0.7.35
[INFO] [stderr]    Compiling monostate-impl v0.1.13
[INFO] [stderr]    Compiling thiserror-impl v1.0.67
[INFO] [stderr]    Compiling tracing-attributes v0.1.27
[INFO] [stderr]     Checking zerocopy v0.7.35
[INFO] [stderr]     Checking tracing v0.1.40
[INFO] [stderr]     Checking ppv-lite86 v0.2.20
[INFO] [stderr]    Compiling darling_macro v0.20.10
[INFO] [stderr]     Checking rand_chacha v0.3.1
[INFO] [stderr]     Checking rand v0.8.5
[INFO] [stderr]    Compiling darling v0.20.10
[INFO] [stderr]    Compiling derive_builder_core v0.20.2
[INFO] [stderr]    Compiling derive_builder_macro v0.20.2
[INFO] [stderr]     Checking derive_builder v0.20.2
[INFO] [stderr]     Checking serde_json v1.0.132
[INFO] [stderr]     Checking spm_precompiled v0.1.4
[INFO] [stderr]     Checking ciborium v0.2.2
[INFO] [stderr]     Checking monostate v0.1.13
[INFO] [stderr]     Checking tinytemplate v1.2.1
[INFO] [stderr]     Checking pbpe_tokenizer v0.1.0 (/opt/rustwide/workdir)
[INFO] [stderr]     Checking criterion v0.5.1
[INFO] [stdout] warning: unused import: `super::OrderedVocabIter`
[INFO] [stdout]  --> src/models/pbpe/model.rs:1:13
[INFO] [stdout]   |
[INFO] [stdout] 1 | use super::{super::OrderedVocabIter, trainer::PbpeTrainer, Error, Pair, Word};
[INFO] [stdout]   |             ^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stdout]   |
[INFO] [stdout]   = note: `#[warn(unused_imports)]` (part of `#[warn(unused)]`) on by default
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused import: `crate::pre_tokenizers::split`
[INFO] [stdout]  --> src/models/pbpe/model.rs:2:5
[INFO] [stdout]   |
[INFO] [stdout] 2 | use crate::pre_tokenizers::split;
[INFO] [stdout]   |     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused import: `regex::Split`
[INFO] [stdout]  --> src/models/pbpe/model.rs:5:5
[INFO] [stdout]   |
[INFO] [stdout] 5 | use regex::Split;
[INFO] [stdout]   |     ^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused import: `serde_json::Value`
[INFO] [stdout]  --> src/models/pbpe/model.rs:6:5
[INFO] [stdout]   |
[INFO] [stdout] 6 | use serde_json::Value;
[INFO] [stdout]   |     ^^^^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused imports: `BufRead`, `BufReader`, and `fs::File`
[INFO] [stdout]   --> src/models/pbpe/model.rs:10:5
[INFO] [stdout]    |
[INFO] [stdout] 10 |     fs::File,
[INFO] [stdout]    |     ^^^^^^^^
[INFO] [stdout] 11 |     io::prelude::*,
[INFO] [stdout] 12 |     io::{BufRead, BufReader},
[INFO] [stdout]    |          ^^^^^^^  ^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused import: `std::process::id`
[INFO] [stdout]   --> src/models/pbpe/trainer.rs:12:5
[INFO] [stdout]    |
[INFO] [stdout] 12 | use std::process::id;
[INFO] [stdout]    |     ^^^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused import: `std::sync::atomic`
[INFO] [stdout]   --> src/models/pbpe/trainer.rs:13:5
[INFO] [stdout]    |
[INFO] [stdout] 13 | use std::sync::atomic;
[INFO] [stdout]    |     ^^^^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused imports: `Rng` and `thread_rng`
[INFO] [stdout]  --> src/models/pbpe/word.rs:2:12
[INFO] [stdout]   |
[INFO] [stdout] 2 | use rand::{thread_rng, Rng};
[INFO] [stdout]   |            ^^^^^^^^^^  ^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused import: `io::prelude`
[INFO] [stdout]   --> src/models/pbpe/model.rs:11:5
[INFO] [stdout]    |
[INFO] [stdout] 11 |     io::prelude::*,
[INFO] [stdout]    |     ^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: variable does not need to be mutable
[INFO] [stdout]    --> src/models/pbpe/model.rs:127:18
[INFO] [stdout]     |
[INFO] [stdout] 127 |     pub fn build(mut self) -> Result<PBPE> {
[INFO] [stdout]     |                  ----^^^^
[INFO] [stdout]     |                  |
[INFO] [stdout]     |                  help: remove this `mut`
[INFO] [stdout]     |
[INFO] [stdout]     = note: `#[warn(unused_mut)]` (part of `#[warn(unused)]`) on by default
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused variable: `folder`
[INFO] [stdout]    --> src/models/pbpe/model.rs:404:20
[INFO] [stdout]     |
[INFO] [stdout] 404 |     fn save(&self, folder: &Path, prefix: Option<&str>) -> Result<Vec<PathBuf>> {
[INFO] [stdout]     |                    ^^^^^^ help: if this is intentional, prefix it with an underscore: `_folder`
[INFO] [stdout]     |
[INFO] [stdout]     = note: `#[warn(unused_variables)]` (part of `#[warn(unused)]`) on by default
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused variable: `prefix`
[INFO] [stdout]    --> src/models/pbpe/model.rs:404:35
[INFO] [stdout]     |
[INFO] [stdout] 404 |     fn save(&self, folder: &Path, prefix: Option<&str>) -> Result<Vec<PathBuf>> {
[INFO] [stdout]     |                                   ^^^^^^ help: if this is intentional, prefix it with an underscore: `_prefix`
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: variable does not need to be mutable
[INFO] [stdout]    --> src/models/pbpe/trainer.rs:564:17
[INFO] [stdout]     |
[INFO] [stdout] 564 |             let mut priority = top.1;
[INFO] [stdout]     |                 ----^^^^^^^^
[INFO] [stdout]     |                 |
[INFO] [stdout]     |                 help: remove this `mut`
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused import: `crate::pre_tokenizers::split`
[INFO] [stdout]  --> src/models/pbpe/model.rs:2:5
[INFO] [stdout]   |
[INFO] [stdout] 2 | use crate::pre_tokenizers::split;
[INFO] [stdout]   |     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stdout]   |
[INFO] [stdout]   = note: `#[warn(unused_imports)]` (part of `#[warn(unused)]`) on by default
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused import: `regex::Split`
[INFO] [stdout]  --> src/models/pbpe/model.rs:5:5
[INFO] [stdout]   |
[INFO] [stdout] 5 | use regex::Split;
[INFO] [stdout]   |     ^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused import: `serde_json::Value`
[INFO] [stdout]  --> src/models/pbpe/model.rs:6:5
[INFO] [stdout]   |
[INFO] [stdout] 6 | use serde_json::Value;
[INFO] [stdout]   |     ^^^^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused imports: `BufRead`, `BufReader`, and `fs::File`
[INFO] [stdout]   --> src/models/pbpe/model.rs:10:5
[INFO] [stdout]    |
[INFO] [stdout] 10 |     fs::File,
[INFO] [stdout]    |     ^^^^^^^^
[INFO] [stdout] 11 |     io::prelude::*,
[INFO] [stdout] 12 |     io::{BufRead, BufReader},
[INFO] [stdout]    |          ^^^^^^^  ^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused import: `tempfile::NamedTempFile`
[INFO] [stdout]    --> src/models/pbpe/model.rs:412:9
[INFO] [stdout]     |
[INFO] [stdout] 412 |     use tempfile::NamedTempFile;
[INFO] [stdout]     |         ^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused import: `std::process::id`
[INFO] [stdout]   --> src/models/pbpe/trainer.rs:12:5
[INFO] [stdout]    |
[INFO] [stdout] 12 | use std::process::id;
[INFO] [stdout]    |     ^^^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused import: `std::sync::atomic`
[INFO] [stdout]   --> src/models/pbpe/trainer.rs:13:5
[INFO] [stdout]    |
[INFO] [stdout] 13 | use std::sync::atomic;
[INFO] [stdout]    |     ^^^^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused imports: `Rng` and `thread_rng`
[INFO] [stdout]  --> src/models/pbpe/word.rs:2:12
[INFO] [stdout]   |
[INFO] [stdout] 2 | use rand::{thread_rng, Rng};
[INFO] [stdout]   |            ^^^^^^^^^^  ^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: type `pbpe::word::Word` is more private than the item `pbpe::model::PBPE::cache`
[INFO] [stdout]    --> src/models/pbpe/model.rs:168:5
[INFO] [stdout]     |
[INFO] [stdout] 168 |     pub(crate) cache: Option<Cache<String, Word>>,
[INFO] [stdout]     |     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ field `pbpe::model::PBPE::cache` is reachable at visibility `pub(crate)`
[INFO] [stdout]     |
[INFO] [stdout] note: but type `pbpe::word::Word` is only usable at visibility `pub(in crate::models::pbpe)`
[INFO] [stdout]    --> src/models/pbpe/word.rs:128:1
[INFO] [stdout]     |
[INFO] [stdout] 128 | pub(super) struct Word {
[INFO] [stdout]     | ^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stdout]     = note: `#[warn(private_interfaces)]` on by default
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: hiding a lifetime that's elided elsewhere is confusing
[INFO] [stdout]    --> src/models/unigram/model.rs:364:17
[INFO] [stdout]     |
[INFO] [stdout] 364 |     pub fn iter(&self) -> UnigramIterator {
[INFO] [stdout]     |                 ^^^^^     ^^^^^^^^^^^^^^^ the same lifetime is hidden here
[INFO] [stdout]     |                 |
[INFO] [stdout]     |                 the lifetime is elided here
[INFO] [stdout]     |
[INFO] [stdout]     = help: the same lifetime is referred to in inconsistent ways, making the signature confusing
[INFO] [stdout]     = note: `#[warn(mismatched_lifetime_syntaxes)]` on by default
[INFO] [stdout] help: use `'_` for type paths
[INFO] [stdout]     |
[INFO] [stdout] 364 |     pub fn iter(&self) -> UnigramIterator<'_> {
[INFO] [stdout]     |                                          ++++
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: hiding a lifetime that's elided elsewhere is confusing
[INFO] [stdout]   --> src/models/unigram/trie.rs:33:36
[INFO] [stdout]    |
[INFO] [stdout] 33 |     pub fn common_prefix_search<T>(&self, iterator: T) -> TrieIterator<Label, T>
[INFO] [stdout]    |                                    ^^^^^                  ^^^^^^^^^^^^^^^^^^^^^^ the same lifetime is hidden here
[INFO] [stdout]    |                                    |
[INFO] [stdout]    |                                    the lifetime is elided here
[INFO] [stdout]    |
[INFO] [stdout]    = help: the same lifetime is referred to in inconsistent ways, making the signature confusing
[INFO] [stdout] help: use `'_` for type paths
[INFO] [stdout]    |
[INFO] [stdout] 33 |     pub fn common_prefix_search<T>(&self, iterator: T) -> TrieIterator<'_, Label, T>
[INFO] [stdout]    |                                                                        +++
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused import: `io::prelude`
[INFO] [stdout]   --> src/models/pbpe/model.rs:11:5
[INFO] [stdout]    |
[INFO] [stdout] 11 |     io::prelude::*,
[INFO] [stdout]    |     ^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: variable does not need to be mutable
[INFO] [stdout]    --> src/models/pbpe/model.rs:127:18
[INFO] [stdout]     |
[INFO] [stdout] 127 |     pub fn build(mut self) -> Result<PBPE> {
[INFO] [stdout]     |                  ----^^^^
[INFO] [stdout]     |                  |
[INFO] [stdout]     |                  help: remove this `mut`
[INFO] [stdout]     |
[INFO] [stdout]     = note: `#[warn(unused_mut)]` (part of `#[warn(unused)]`) on by default
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused variable: `folder`
[INFO] [stdout]    --> src/models/pbpe/model.rs:404:20
[INFO] [stdout]     |
[INFO] [stdout] 404 |     fn save(&self, folder: &Path, prefix: Option<&str>) -> Result<Vec<PathBuf>> {
[INFO] [stdout]     |                    ^^^^^^ help: if this is intentional, prefix it with an underscore: `_folder`
[INFO] [stdout]     |
[INFO] [stdout]     = note: `#[warn(unused_variables)]` (part of `#[warn(unused)]`) on by default
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused variable: `prefix`
[INFO] [stdout]    --> src/models/pbpe/model.rs:404:35
[INFO] [stdout]     |
[INFO] [stdout] 404 |     fn save(&self, folder: &Path, prefix: Option<&str>) -> Result<Vec<PathBuf>> {
[INFO] [stdout]     |                                   ^^^^^^ help: if this is intentional, prefix it with an underscore: `_prefix`
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: variable does not need to be mutable
[INFO] [stdout]    --> src/models/pbpe/model.rs:540:13
[INFO] [stdout]     |
[INFO] [stdout] 540 |         let mut pbpe = PBPE::new(vocab, merges, splits);
[INFO] [stdout]     |             ----^^^^
[INFO] [stdout]     |             |
[INFO] [stdout]     |             help: remove this `mut`
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: variable does not need to be mutable
[INFO] [stdout]    --> src/models/pbpe/trainer.rs:564:17
[INFO] [stdout]     |
[INFO] [stdout] 564 |             let mut priority = top.1;
[INFO] [stdout]     |                 ----^^^^^^^^
[INFO] [stdout]     |                 |
[INFO] [stdout]     |                 help: remove this `mut`
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: type `pbpe::word::Word` is more private than the item `pbpe::model::PBPE::cache`
[INFO] [stdout]    --> src/models/pbpe/model.rs:168:5
[INFO] [stdout]     |
[INFO] [stdout] 168 |     pub(crate) cache: Option<Cache<String, Word>>,
[INFO] [stdout]     |     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ field `pbpe::model::PBPE::cache` is reachable at visibility `pub(crate)`
[INFO] [stdout]     |
[INFO] [stdout] note: but type `pbpe::word::Word` is only usable at visibility `pub(in crate::models::pbpe)`
[INFO] [stdout]    --> src/models/pbpe/word.rs:128:1
[INFO] [stdout]     |
[INFO] [stdout] 128 | pub(super) struct Word {
[INFO] [stdout]     | ^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stdout]     = note: `#[warn(private_interfaces)]` on by default
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: hiding a lifetime that's elided elsewhere is confusing
[INFO] [stdout]    --> src/models/unigram/model.rs:364:17
[INFO] [stdout]     |
[INFO] [stdout] 364 |     pub fn iter(&self) -> UnigramIterator {
[INFO] [stdout]     |                 ^^^^^     ^^^^^^^^^^^^^^^ the same lifetime is hidden here
[INFO] [stdout]     |                 |
[INFO] [stdout]     |                 the lifetime is elided here
[INFO] [stdout]     |
[INFO] [stdout]     = help: the same lifetime is referred to in inconsistent ways, making the signature confusing
[INFO] [stdout]     = note: `#[warn(mismatched_lifetime_syntaxes)]` on by default
[INFO] [stdout] help: use `'_` for type paths
[INFO] [stdout]     |
[INFO] [stdout] 364 |     pub fn iter(&self) -> UnigramIterator<'_> {
[INFO] [stdout]     |                                          ++++
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: hiding a lifetime that's elided elsewhere is confusing
[INFO] [stdout]   --> src/models/unigram/trie.rs:33:36
[INFO] [stdout]    |
[INFO] [stdout] 33 |     pub fn common_prefix_search<T>(&self, iterator: T) -> TrieIterator<Label, T>
[INFO] [stdout]    |                                    ^^^^^                  ^^^^^^^^^^^^^^^^^^^^^^ the same lifetime is hidden here
[INFO] [stdout]    |                                    |
[INFO] [stdout]    |                                    the lifetime is elided here
[INFO] [stdout]    |
[INFO] [stdout]    = help: the same lifetime is referred to in inconsistent ways, making the signature confusing
[INFO] [stdout] help: use `'_` for type paths
[INFO] [stdout]    |
[INFO] [stdout] 33 |     pub fn common_prefix_search<T>(&self, iterator: T) -> TrieIterator<'_, Label, T>
[INFO] [stdout]    |                                                                        +++
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stderr]     Finished `dev` profile [unoptimized + debuginfo] target(s) in 42.95s
[INFO] running `Command { std: "docker" "inspect" "ff6a61476eb29275c61b59efc5dd13b01366e5b6d35a06c3d29488cbc0b4e787", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "ff6a61476eb29275c61b59efc5dd13b01366e5b6d35a06c3d29488cbc0b4e787", kill_on_drop: false }`
[INFO] [stdout] ff6a61476eb29275c61b59efc5dd13b01366e5b6d35a06c3d29488cbc0b4e787
