[INFO] cloning repository https://github.com/YdrMaster/ggml-tokenizer
[INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/YdrMaster/ggml-tokenizer" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FYdrMaster%2Fggml-tokenizer", kill_on_drop: false }`
[INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FYdrMaster%2Fggml-tokenizer'...
[INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }`
[INFO] [stdout] ce8462b5ff70ffc6babc97311215655a47c6aa03
[INFO] checking YdrMaster/ggml-tokenizer against 1.95.0 for pr-155915
[INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FYdrMaster%2Fggml-tokenizer" "/workspace/builds/worker-0-tc1/source", kill_on_drop: false }`
[INFO] [stderr] Cloning into '/workspace/builds/worker-0-tc1/source'...
[INFO] [stderr] done.
[INFO] started tweaking git repo https://github.com/YdrMaster/ggml-tokenizer
[INFO] finished tweaking git repo https://github.com/YdrMaster/ggml-tokenizer
[INFO] tweaked toml for git repo https://github.com/YdrMaster/ggml-tokenizer written to /workspace/builds/worker-0-tc1/source/Cargo.toml
[INFO] validating manifest of git repo https://github.com/YdrMaster/ggml-tokenizer on toolchain 1.95.0
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.95.0" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] crate git repo https://github.com/YdrMaster/ggml-tokenizer already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.95.0" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] [stderr]     Updating crates.io index
[INFO] [stderr]  Downloading crates ...
[INFO] [stderr]   Downloaded ggml-quants v0.0.0
[INFO] [stderr]   Downloaded memmap2 v0.9.5
[INFO] [stderr]   Downloaded digit-layout v0.2.0
[INFO] [stderr]   Downloaded winnow v0.7.6
[INFO] [stderr]   Downloaded fancy-regex v0.14.0
[INFO] [stderr]   Downloaded ggus v0.4.0
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+1.95.0" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] [stdout] 57f2fb13390d0de9e68522908fad6f5e2359e476767a704b9bff1a7f939fa9a3
[INFO] running `Command { std: "docker" "start" "-a" "57f2fb13390d0de9e68522908fad6f5e2359e476767a704b9bff1a7f939fa9a3", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "57f2fb13390d0de9e68522908fad6f5e2359e476767a704b9bff1a7f939fa9a3", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "57f2fb13390d0de9e68522908fad6f5e2359e476767a704b9bff1a7f939fa9a3", kill_on_drop: false }`
[INFO] [stdout] 57f2fb13390d0de9e68522908fad6f5e2359e476767a704b9bff1a7f939fa9a3
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+1.95.0" "check" "--frozen" "--all" "--all-targets" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] b1d9a40e1c12a84352fb905b58c04857383751f8a995e33cb87d3c1e24cebf83
[INFO] running `Command { std: "docker" "start" "-a" "b1d9a40e1c12a84352fb905b58c04857383751f8a995e33cb87d3c1e24cebf83", kill_on_drop: false }`
[INFO] [stderr]    Compiling crossbeam-utils v0.8.21
[INFO] [stderr]    Compiling proc-macro2 v1.0.95
[INFO] [stderr]    Compiling equivalent v1.0.2
[INFO] [stderr]    Compiling hashbrown v0.15.2
[INFO] [stderr]    Compiling unicode-ident v1.0.18
[INFO] [stderr]    Compiling rayon-core v1.12.1
[INFO] [stderr]    Compiling toml_datetime v0.6.8
[INFO] [stderr]     Checking memchr v2.7.4
[INFO] [stderr]    Compiling winnow v0.7.6
[INFO] [stderr]     Checking regex-syntax v0.8.5
[INFO] [stderr]    Compiling libc v0.2.172
[INFO] [stderr]     Checking bit-vec v0.8.0
[INFO] [stderr]     Checking either v1.15.0
[INFO] [stderr]     Checking half v2.6.0
[INFO] [stderr]     Checking log v0.4.27
[INFO] [stderr]     Checking bit-set v0.8.0
[INFO] [stderr]     Checking digit-layout v0.2.0
[INFO] [stderr]     Checking aho-corasick v1.1.3
[INFO] [stderr]    Compiling quote v1.0.40
[INFO] [stderr]     Checking crossbeam-epoch v0.9.18
[INFO] [stderr]    Compiling indexmap v2.9.0
[INFO] [stderr]     Checking crossbeam-deque v0.8.6
[INFO] [stderr]    Compiling syn v2.0.100
[INFO] [stderr]     Checking memmap2 v0.9.5
[INFO] [stderr]     Checking rayon v1.10.0
[INFO] [stderr]     Checking regex-automata v0.4.9
[INFO] [stderr]    Compiling toml_edit v0.22.24
[INFO] [stderr]     Checking ggml-quants v0.0.0
[INFO] [stderr]     Checking fancy-regex v0.14.0
[INFO] [stderr]     Checking regex v1.11.1
[INFO] [stderr]    Compiling proc-macro-crate v3.3.0
[INFO] [stderr]    Compiling num_enum_derive v0.7.3
[INFO] [stderr]     Checking num_enum v0.7.3
[INFO] [stderr]     Checking ggus v0.4.0
[INFO] [stderr]     Checking try-tokenize v0.1.0 (/opt/rustwide/workdir)
[INFO] [stdout] error[E0554]: `#![feature]` may not be used on the stable release channel
[INFO] [stdout]  --> src/main.rs:1:1
[INFO] [stdout]   |
[INFO] [stdout] 1 | #![feature(linked_list_cursors)]
[INFO] [stdout]   | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused import: `TokenAttribute`
[INFO] [stdout]  --> src/main.rs:2:20
[INFO] [stdout]   |
[INFO] [stdout] 2 | use common::{NULL, TokenAttribute};
[INFO] [stdout]   |                    ^^^^^^^^^^^^^^
[INFO] [stdout]   |
[INFO] [stdout]   = note: `#[warn(unused_imports)]` (part of `#[warn(unused)]`) on by default
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused import: `VocabType`
[INFO] [stdout]  --> src/main.rs:3:14
[INFO] [stdout]   |
[INFO] [stdout] 3 | use config::{VocabType, load};
[INFO] [stdout]   |              ^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused import: `untils::llama_escape_whitespace`
[INFO] [stdout]  --> src/main.rs:6:5
[INFO] [stdout]   |
[INFO] [stdout] 6 | use untils::llama_escape_whitespace;
[INFO] [stdout]   |     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused import: `std::collections::LinkedList`
[INFO] [stdout]  --> src/main.rs:8:5
[INFO] [stdout]   |
[INFO] [stdout] 8 | use std::collections::LinkedList;
[INFO] [stdout]   |     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused imports: `LlmTokenizerBpeSession` and `LlmTokenizerSpmSession`
[INFO] [stdout]  --> src/common.rs:1:22
[INFO] [stdout]   |
[INFO] [stdout] 1 | use crate::session::{LlmTokenizerBpeSession, LlmTokenizerSpmSession};
[INFO] [stdout]   |                      ^^^^^^^^^^^^^^^^^^^^^^  ^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused import: `VecDeque`
[INFO] [stdout]  --> src/session.rs:3:40
[INFO] [stdout]   |
[INFO] [stdout] 3 |     collections::{BinaryHeap, HashMap, VecDeque},
[INFO] [stdout]   |                                        ^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: type `unicode_cpt_flags` should have an upper camel case name
[INFO] [stdout]    --> src/unicode.rs:469:12
[INFO] [stdout]     |
[INFO] [stdout] 469 | pub struct unicode_cpt_flags {
[INFO] [stdout]     |            ^^^^^^^^^^^^^^^^^ help: convert the identifier to upper camel case: `UnicodeCptFlags`
[INFO] [stdout]     |
[INFO] [stdout]     = note: `#[warn(non_camel_case_types)]` (part of `#[warn(nonstandard_style)]`) on by default
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unnecessary parentheses around `if` condition
[INFO] [stdout]    --> src/unicode.rs:593:8
[INFO] [stdout]     |
[INFO] [stdout] 593 |     if (cpt >= '0' as u32 && cpt <= '9' as u32) {
[INFO] [stdout]     |        ^                                      ^
[INFO] [stdout]     |
[INFO] [stdout]     = note: `#[warn(unused_parens)]` (part of `#[warn(unused)]`) on by default
[INFO] [stdout] help: remove these parentheses
[INFO] [stdout]     |
[INFO] [stdout] 593 -     if (cpt >= '0' as u32 && cpt <= '9' as u32) {
[INFO] [stdout] 593 +     if cpt >= '0' as u32 && cpt <= '9' as u32  {
[INFO] [stdout]     |
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused import: `ggus::GGufMetaError`
[INFO] [stdout]  --> src/untils.rs:1:5
[INFO] [stdout]   |
[INFO] [stdout] 1 | use ggus::GGufMetaError;
[INFO] [stdout]   |     ^^^^^^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unreachable statement
[INFO] [stdout]    --> src/config.rs:568:25
[INFO] [stdout]     |
[INFO] [stdout] 565 |                         todo!();
[INFO] [stdout]     |                         ------- any code following this expression is unreachable
[INFO] [stdout] ...
[INFO] [stdout] 568 |                         is_prev_special = false;
[INFO] [stdout]     |                         ^^^^^^^^^^^^^^^^^^^^^^^^ unreachable statement
[INFO] [stdout]     |
[INFO] [stdout]     = note: `#[warn(unreachable_code)]` (part of `#[warn(unused)]`) on by default
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unreachable statement
[INFO] [stdout]   --> src/session.rs:66:17
[INFO] [stdout]    |
[INFO] [stdout] 65 |                   todo!();
[INFO] [stdout]    |                   ------- any code following this expression is unreachable
[INFO] [stdout] 66 | /                 self.symbols.push(LlmSymbol {
[INFO] [stdout] 67 | |                     prev: -1,
[INFO] [stdout] 68 | |                     next: -1,
[INFO] [stdout] 69 | |                     text: word.to_string(),
[INFO] [stdout] 70 | |                     n: word.len(),
[INFO] [stdout] 71 | |                 });
[INFO] [stdout]    | |___________________^ unreachable statement
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] For more information about this error, try `rustc --explain E0554`.
[INFO] [stdout] 
[INFO] [stderr] error: could not compile `try-tokenize` (bin "try-tokenize" test) due to 1 previous error; 11 warnings emitted
[INFO] [stderr] warning: build failed, waiting for other jobs to finish...
[INFO] [stdout] error[E0554]: `#![feature]` may not be used on the stable release channel
[INFO] [stdout]  --> src/main.rs:1:1
[INFO] [stdout]   |
[INFO] [stdout] 1 | #![feature(linked_list_cursors)]
[INFO] [stdout]   | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused import: `TokenAttribute`
[INFO] [stdout]  --> src/main.rs:2:20
[INFO] [stdout]   |
[INFO] [stdout] 2 | use common::{NULL, TokenAttribute};
[INFO] [stdout]   |                    ^^^^^^^^^^^^^^
[INFO] [stdout]   |
[INFO] [stdout]   = note: `#[warn(unused_imports)]` (part of `#[warn(unused)]`) on by default
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused import: `VocabType`
[INFO] [stdout]  --> src/main.rs:3:14
[INFO] [stdout]   |
[INFO] [stdout] 3 | use config::{VocabType, load};
[INFO] [stdout]   |              ^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused import: `untils::llama_escape_whitespace`
[INFO] [stdout]  --> src/main.rs:6:5
[INFO] [stdout]   |
[INFO] [stdout] 6 | use untils::llama_escape_whitespace;
[INFO] [stdout]   |     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused import: `std::collections::LinkedList`
[INFO] [stdout]  --> src/main.rs:8:5
[INFO] [stdout]   |
[INFO] [stdout] 8 | use std::collections::LinkedList;
[INFO] [stdout]   |     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused imports: `LlmTokenizerBpeSession` and `LlmTokenizerSpmSession`
[INFO] [stdout]  --> src/common.rs:1:22
[INFO] [stdout]   |
[INFO] [stdout] 1 | use crate::session::{LlmTokenizerBpeSession, LlmTokenizerSpmSession};
[INFO] [stdout]   |                      ^^^^^^^^^^^^^^^^^^^^^^  ^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused import: `VecDeque`
[INFO] [stdout]  --> src/session.rs:3:40
[INFO] [stdout]   |
[INFO] [stdout] 3 |     collections::{BinaryHeap, HashMap, VecDeque},
[INFO] [stdout]   |                                        ^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: type `unicode_cpt_flags` should have an upper camel case name
[INFO] [stdout]    --> src/unicode.rs:469:12
[INFO] [stdout]     |
[INFO] [stdout] 469 | pub struct unicode_cpt_flags {
[INFO] [stdout]     |            ^^^^^^^^^^^^^^^^^ help: convert the identifier to upper camel case: `UnicodeCptFlags`
[INFO] [stdout]     |
[INFO] [stdout]     = note: `#[warn(non_camel_case_types)]` (part of `#[warn(nonstandard_style)]`) on by default
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unnecessary parentheses around `if` condition
[INFO] [stdout]    --> src/unicode.rs:593:8
[INFO] [stdout]     |
[INFO] [stdout] 593 |     if (cpt >= '0' as u32 && cpt <= '9' as u32) {
[INFO] [stdout]     |        ^                                      ^
[INFO] [stdout]     |
[INFO] [stdout]     = note: `#[warn(unused_parens)]` (part of `#[warn(unused)]`) on by default
[INFO] [stdout] help: remove these parentheses
[INFO] [stdout]     |
[INFO] [stdout] 593 -     if (cpt >= '0' as u32 && cpt <= '9' as u32) {
[INFO] [stdout] 593 +     if cpt >= '0' as u32 && cpt <= '9' as u32  {
[INFO] [stdout]     |
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused import: `ggus::GGufMetaError`
[INFO] [stdout]  --> src/untils.rs:1:5
[INFO] [stdout]   |
[INFO] [stdout] 1 | use ggus::GGufMetaError;
[INFO] [stdout]   |     ^^^^^^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unreachable statement
[INFO] [stdout]    --> src/config.rs:568:25
[INFO] [stdout]     |
[INFO] [stdout] 565 |                         todo!();
[INFO] [stdout]     |                         ------- any code following this expression is unreachable
[INFO] [stdout] ...
[INFO] [stdout] 568 |                         is_prev_special = false;
[INFO] [stdout]     |                         ^^^^^^^^^^^^^^^^^^^^^^^^ unreachable statement
[INFO] [stdout]     |
[INFO] [stdout]     = note: `#[warn(unreachable_code)]` (part of `#[warn(unused)]`) on by default
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unreachable statement
[INFO] [stdout]   --> src/session.rs:66:17
[INFO] [stdout]    |
[INFO] [stdout] 65 |                   todo!();
[INFO] [stdout]    |                   ------- any code following this expression is unreachable
[INFO] [stdout] 66 | /                 self.symbols.push(LlmSymbol {
[INFO] [stdout] 67 | |                     prev: -1,
[INFO] [stdout] 68 | |                     next: -1,
[INFO] [stdout] 69 | |                     text: word.to_string(),
[INFO] [stdout] 70 | |                     n: word.len(),
[INFO] [stdout] 71 | |                 });
[INFO] [stdout]    | |___________________^ unreachable statement
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] For more information about this error, try `rustc --explain E0554`.
[INFO] [stdout] 
[INFO] [stderr] error: could not compile `try-tokenize` (bin "try-tokenize") due to 1 previous error; 11 warnings emitted
[INFO] running `Command { std: "docker" "inspect" "b1d9a40e1c12a84352fb905b58c04857383751f8a995e33cb87d3c1e24cebf83", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "b1d9a40e1c12a84352fb905b58c04857383751f8a995e33cb87d3c1e24cebf83", kill_on_drop: false }`
[INFO] [stdout] b1d9a40e1c12a84352fb905b58c04857383751f8a995e33cb87d3c1e24cebf83
