[INFO] cloning repository https://github.com/deltartificial/tokenizer [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/deltartificial/tokenizer" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fdeltartificial%2Ftokenizer", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fdeltartificial%2Ftokenizer'... [INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }` [INFO] [stdout] 8782c3753f6cf34c0fa7cc617233b21ad6824b20 [INFO] testing deltartificial/tokenizer against try#b83b707f97d809763b7861afa7638871f3339a33 for pr-145838-1 [INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fdeltartificial%2Ftokenizer" "/workspace/builds/worker-3-tc2/source", kill_on_drop: false }` [INFO] [stderr] Cloning into '/workspace/builds/worker-3-tc2/source'... [INFO] [stderr] done. [INFO] started tweaking git repo https://github.com/deltartificial/tokenizer [INFO] finished tweaking git repo https://github.com/deltartificial/tokenizer [INFO] tweaked toml for git repo https://github.com/deltartificial/tokenizer written to /workspace/builds/worker-3-tc2/source/Cargo.toml [INFO] validating manifest of git repo https://github.com/deltartificial/tokenizer on toolchain b83b707f97d809763b7861afa7638871f3339a33 [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+b83b707f97d809763b7861afa7638871f3339a33" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }` [INFO] crate git repo https://github.com/deltartificial/tokenizer already has a lockfile, it will not be regenerated [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+b83b707f97d809763b7861afa7638871f3339a33" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:7ad1b28ee6f5f7f699f6cf7015098d6ccdd96d6f2d78dd06228f5b4c9faf309c" "/opt/rustwide/cargo-home/bin/cargo" "+b83b707f97d809763b7861afa7638871f3339a33" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }` [INFO] [stdout] 78dc6a86afca6e6bb4908fff22c152877f6243ed05701aba308dfc240cdde15a [INFO] running `Command { std: "docker" "start" "-a" "78dc6a86afca6e6bb4908fff22c152877f6243ed05701aba308dfc240cdde15a", kill_on_drop: false }` [INFO] running `Command { std: "docker" "inspect" "78dc6a86afca6e6bb4908fff22c152877f6243ed05701aba308dfc240cdde15a", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "78dc6a86afca6e6bb4908fff22c152877f6243ed05701aba308dfc240cdde15a", kill_on_drop: false }` [INFO] [stdout] 78dc6a86afca6e6bb4908fff22c152877f6243ed05701aba308dfc240cdde15a [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:7ad1b28ee6f5f7f699f6cf7015098d6ccdd96d6f2d78dd06228f5b4c9faf309c" "/opt/rustwide/cargo-home/bin/cargo" "+b83b707f97d809763b7861afa7638871f3339a33" "build" "--frozen" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] 6153ea005a20f2da54c77c32add6f30a099c63d0f56d2e9ce61fc44c59b9ce32 [INFO] running `Command { std: "docker" "start" "-a" "6153ea005a20f2da54c77c32add6f30a099c63d0f56d2e9ce61fc44c59b9ce32", kill_on_drop: false }` [INFO] [stderr] Compiling proc-macro2 v1.0.94 [INFO] [stderr] Compiling libc v0.2.171 [INFO] [stderr] Compiling zerocopy v0.8.24 [INFO] [stderr] Compiling smallvec v1.15.0 [INFO] [stderr] Compiling serde v1.0.219 [INFO] [stderr] Compiling memchr v2.7.4 [INFO] [stderr] Compiling cc v1.2.18 [INFO] [stderr] Compiling icu_locid_transform_data v1.5.1 [INFO] [stderr] Compiling litemap v0.7.5 [INFO] [stderr] Compiling log v0.4.27 [INFO] [stderr] Compiling icu_properties_data v1.5.1 [INFO] [stderr] Compiling phf_shared v0.11.3 [INFO] [stderr] Compiling icu_normalizer_data v1.5.1 [INFO] [stderr] Compiling phf_shared v0.10.0 [INFO] [stderr] Compiling ahash v0.8.11 [INFO] [stderr] Compiling crc32fast v1.4.2 [INFO] [stderr] Compiling rustls-pki-types v1.11.0 [INFO] [stderr] Compiling aho-corasick v1.1.3 [INFO] [stderr] Compiling crossbeam-epoch v0.9.18 [INFO] [stderr] Compiling block-padding v0.3.3 [INFO] [stderr] Compiling num-traits v0.2.19 [INFO] [stderr] Compiling adler2 v2.0.0 [INFO] [stderr] Compiling rayon-core v1.12.1 [INFO] [stderr] Compiling zerocopy v0.7.35 [INFO] [stderr] Compiling rustls v0.23.25 [INFO] [stderr] Compiling portable-atomic v1.11.0 [INFO] [stderr] Compiling form_urlencoded v1.2.1 [INFO] [stderr] Compiling phf v0.10.1 [INFO] [stderr] Compiling inout v0.1.4 [INFO] [stderr] Compiling miniz_oxide v0.8.7 [INFO] [stderr] Compiling cipher v0.4.4 [INFO] [stderr] Compiling webpki-roots v0.26.8 [INFO] [stderr] Compiling core2 v0.4.0 [INFO] [stderr] Compiling rle-decode-fast v1.0.3 [INFO] [stderr] Compiling nom v7.1.3 [INFO] [stderr] Compiling unicode-normalization v0.1.24 [INFO] [stderr] Compiling itertools v0.11.0 [INFO] [stderr] Compiling anyhow v1.0.97 [INFO] [stderr] Compiling crossbeam-deque v0.8.6 [INFO] [stderr] Compiling hashbrown v0.14.5 [INFO] [stderr] Compiling clap_lex v0.7.4 [INFO] [stderr] Compiling flate2 v1.1.1 [INFO] [stderr] Compiling quote v1.0.40 [INFO] [stderr] Compiling getrandom v0.2.15 [INFO] [stderr] Compiling syn v2.0.100 [INFO] [stderr] Compiling ppv-lite86 v0.2.21 [INFO] [stderr] Compiling syn v1.0.109 [INFO] [stderr] Compiling unicode-properties v0.1.3 [INFO] [stderr] Compiling ring v0.17.14 [INFO] [stderr] Compiling parking_lot_core v0.9.10 [INFO] [stderr] Compiling onig_sys v69.8.1 [INFO] [stderr] Compiling rand_core v0.6.4 [INFO] [stderr] Compiling console v0.15.11 [INFO] [stderr] Compiling dirs-sys v0.4.1 [INFO] [stderr] Compiling parking_lot v0.12.3 [INFO] [stderr] Compiling rand_chacha v0.3.1 [INFO] [stderr] Compiling socks v0.3.4 [INFO] [stderr] Compiling esaxx-rs v0.1.10 [INFO] [stderr] Compiling rayon v1.10.0 [INFO] [stderr] Compiling regex-automata v0.4.9 [INFO] [stderr] Compiling rand v0.8.5 [INFO] [stderr] Compiling indicatif v0.17.11 [INFO] [stderr] Compiling dirs v5.0.1 [INFO] [stderr] Compiling libflate_lz77 v2.1.0 [INFO] [stderr] Compiling macro_rules_attribute-proc_macro v0.2.0 [INFO] [stderr] Compiling unicode-bidi v0.3.18 [INFO] [stderr] Compiling dary_heap v0.3.7 [INFO] [stderr] Compiling mio v1.0.3 [INFO] [stderr] Compiling libflate v2.1.0 [INFO] [stderr] Compiling macro_rules_attribute v0.2.0 [INFO] [stderr] Compiling signal-hook-registry v1.4.2 [INFO] [stderr] Compiling phf_generator v0.11.3 [INFO] [stderr] Compiling phf_generator v0.10.0 [INFO] [stderr] Compiling phf_codegen v0.10.0 [INFO] [stderr] Compiling string_cache_codegen v0.5.4 [INFO] [stderr] Compiling stringprep v0.1.5 [INFO] [stderr] Compiling socket2 v0.5.9 [INFO] [stderr] Compiling indexmap v2.9.0 [INFO] [stderr] Compiling clap_builder v4.5.35 [INFO] [stderr] Compiling cbc v0.1.2 [INFO] [stderr] Compiling aes v0.8.4 [INFO] [stderr] Compiling sha2 v0.10.8 [INFO] [stderr] Compiling markup5ever v0.11.0 [INFO] [stderr] Compiling deflate v1.0.0 [INFO] [stderr] Compiling unicode-normalization-alignments v0.1.12 [INFO] [stderr] Compiling itertools v0.13.0 [INFO] [stderr] Compiling itertools v0.10.5 [INFO] [stderr] Compiling jpeg-decoder v0.3.1 [INFO] [stderr] Compiling md5 v0.7.0 [INFO] [stderr] Compiling jiff v0.2.5 [INFO] [stderr] Compiling rayon-cond v0.3.0 [INFO] [stderr] Compiling weezl v0.1.8 [INFO] [stderr] Compiling humantime v2.2.0 [INFO] [stderr] Compiling regex v1.11.1 [INFO] [stderr] Compiling env_filter v0.1.3 [INFO] [stderr] Compiling synstructure v0.13.1 [INFO] [stderr] Compiling darling_core v0.20.11 [INFO] [stderr] Compiling datasize_derive v0.2.15 [INFO] [stderr] Compiling html5ever v0.26.0 [INFO] [stderr] Compiling fax_derive v0.1.0 [INFO] [stderr] Compiling snafu-derive v0.7.5 [INFO] [stderr] Compiling pdf_derive v0.2.0 [INFO] [stderr] Compiling rustls-webpki v0.103.1 [INFO] [stderr] Compiling onig v6.4.0 [INFO] [stderr] Compiling datasize v0.2.15 [INFO] [stderr] Compiling zerofrom-derive v0.1.6 [INFO] [stderr] Compiling serde_derive v1.0.219 [INFO] [stderr] Compiling yoke-derive v0.7.5 [INFO] [stderr] Compiling zerovec-derive v0.10.3 [INFO] [stderr] Compiling displaydoc v0.2.5 [INFO] [stderr] Compiling icu_provider_macros v1.5.0 [INFO] [stderr] Compiling thiserror-impl v2.0.12 [INFO] [stderr] Compiling async-trait v0.1.88 [INFO] [stderr] Compiling monostate-impl v0.1.14 [INFO] [stderr] Compiling istring v0.3.4 [INFO] [stderr] Compiling fax v0.2.4 [INFO] [stderr] Compiling tokio-macros v2.5.0 [INFO] [stderr] Compiling clap_derive v4.5.32 [INFO] [stderr] Compiling zerofrom v0.1.6 [INFO] [stderr] Compiling yoke v0.7.5 [INFO] [stderr] Compiling tokio v1.44.2 [INFO] [stderr] Compiling thiserror v2.0.12 [INFO] [stderr] Compiling snafu v0.7.5 [INFO] [stderr] Compiling zerovec v0.10.4 [INFO] [stderr] Compiling darling_macro v0.20.11 [INFO] [stderr] Compiling darling v0.20.11 [INFO] [stderr] Compiling derive_builder_core v0.20.2 [INFO] [stderr] Compiling tinystr v0.7.6 [INFO] [stderr] Compiling icu_collections v1.5.0 [INFO] [stderr] Compiling env_logger v0.11.8 [INFO] [stderr] Compiling clap v4.5.35 [INFO] [stderr] Compiling icu_locid v1.5.0 [INFO] [stderr] Compiling derive_builder_macro v0.20.2 [INFO] [stderr] Compiling derive_builder v0.20.2 [INFO] [stderr] Compiling icu_provider v1.5.0 [INFO] [stderr] Compiling icu_locid_transform v1.5.0 [INFO] [stderr] Compiling icu_properties v1.5.1 [INFO] [stderr] Compiling string_cache v0.8.9 [INFO] [stderr] Compiling serde_json v1.0.140 [INFO] [stderr] Compiling tuple v0.5.2 [INFO] [stderr] Compiling monostate v0.1.14 [INFO] [stderr] Compiling spm_precompiled v0.1.4 [INFO] [stderr] Compiling xml5ever v0.17.0 [INFO] [stderr] Compiling icu_normalizer v1.5.0 [INFO] [stderr] Compiling html2text v0.6.0 [INFO] [stderr] Compiling globalcache v0.2.4 [INFO] [stderr] Compiling idna_adapter v1.2.0 [INFO] [stderr] Compiling idna v1.0.3 [INFO] [stderr] Compiling pdf v0.9.0 [INFO] [stderr] Compiling url v2.5.4 [INFO] [stderr] Compiling ureq v2.12.1 [INFO] [stderr] Compiling hf-hub v0.4.2 [INFO] [stderr] Compiling tokenizers v0.21.1 [INFO] [stderr] Compiling tokenizer v0.1.0 (/opt/rustwide/workdir) [INFO] [stdout] warning: associated function `new` is never used [INFO] [stdout] --> src/infrastructure/token_counter.rs:17:12 [INFO] [stdout] | [INFO] [stdout] 16 | impl HuggingFaceTokenizerService { [INFO] [stdout] | -------------------------------- associated function in this implementation [INFO] [stdout] 17 | pub fn new() -> Result { [INFO] [stdout] | ^^^ [INFO] [stdout] | [INFO] [stdout] = note: `#[warn(dead_code)]` (part of `#[warn(unused)]`) on by default [INFO] [stdout] [INFO] [stdout] [INFO] [stderr] Finished `dev` profile [unoptimized + debuginfo] target(s) in 1m 37s [INFO] [stderr] warning: the following packages contain code that will be rejected by a future version of Rust: pdf v0.9.0 [INFO] [stderr] note: to see what the problems were, use the option `--future-incompat-report`, or run `cargo report future-incompatibilities --id 3` [INFO] running `Command { std: "docker" "inspect" "6153ea005a20f2da54c77c32add6f30a099c63d0f56d2e9ce61fc44c59b9ce32", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "6153ea005a20f2da54c77c32add6f30a099c63d0f56d2e9ce61fc44c59b9ce32", kill_on_drop: false }` [INFO] [stdout] 6153ea005a20f2da54c77c32add6f30a099c63d0f56d2e9ce61fc44c59b9ce32 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:7ad1b28ee6f5f7f699f6cf7015098d6ccdd96d6f2d78dd06228f5b4c9faf309c" "/opt/rustwide/cargo-home/bin/cargo" "+b83b707f97d809763b7861afa7638871f3339a33" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] 5673b88b062f18b4765a7640fd5a45823662a0f1df85f92ae40476166eea74e7 [INFO] running `Command { std: "docker" "start" "-a" "5673b88b062f18b4765a7640fd5a45823662a0f1df85f92ae40476166eea74e7", kill_on_drop: false }` [INFO] [stderr] Compiling tokenizer v0.1.0 (/opt/rustwide/workdir) [INFO] [stdout] warning: associated function `new` is never used [INFO] [stdout] --> src/infrastructure/token_counter.rs:17:12 [INFO] [stdout] | [INFO] [stdout] 16 | impl HuggingFaceTokenizerService { [INFO] [stdout] | -------------------------------- associated function in this implementation [INFO] [stdout] 17 | pub fn new() -> Result { [INFO] [stdout] | ^^^ [INFO] [stdout] | [INFO] [stdout] = note: `#[warn(dead_code)]` (part of `#[warn(unused)]`) on by default [INFO] [stdout] [INFO] [stdout] [INFO] [stderr] Finished `test` profile [unoptimized + debuginfo] target(s) in 1.27s [INFO] [stderr] warning: the following packages contain code that will be rejected by a future version of Rust: pdf v0.9.0 [INFO] [stderr] note: to see what the problems were, use the option `--future-incompat-report`, or run `cargo report future-incompatibilities --id 3` [INFO] running `Command { std: "docker" "inspect" "5673b88b062f18b4765a7640fd5a45823662a0f1df85f92ae40476166eea74e7", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "5673b88b062f18b4765a7640fd5a45823662a0f1df85f92ae40476166eea74e7", kill_on_drop: false }` [INFO] [stdout] 5673b88b062f18b4765a7640fd5a45823662a0f1df85f92ae40476166eea74e7 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:7ad1b28ee6f5f7f699f6cf7015098d6ccdd96d6f2d78dd06228f5b4c9faf309c" "/opt/rustwide/cargo-home/bin/cargo" "+b83b707f97d809763b7861afa7638871f3339a33" "test" "--frozen", kill_on_drop: false }` [INFO] [stdout] bf08cf68cda6ddb76ec76524b051f8376fc45d35615da11fda4750e759cb8893 [INFO] running `Command { std: "docker" "start" "-a" "bf08cf68cda6ddb76ec76524b051f8376fc45d35615da11fda4750e759cb8893", kill_on_drop: false }` [INFO] [stderr] warning: associated function `new` is never used [INFO] [stderr] --> src/infrastructure/token_counter.rs:17:12 [INFO] [stderr] | [INFO] [stderr] 16 | impl HuggingFaceTokenizerService { [INFO] [stderr] | -------------------------------- associated function in this implementation [INFO] [stderr] 17 | pub fn new() -> Result { [INFO] [stderr] | ^^^ [INFO] [stderr] | [INFO] [stderr] = note: `#[warn(dead_code)]` (part of `#[warn(unused)]`) on by default [INFO] [stderr] [INFO] [stderr] warning: `tokenizer` (bin "tokenizer" test) generated 1 warning [INFO] [stderr] Finished `test` profile [unoptimized + debuginfo] target(s) in 0.26s [INFO] [stderr] warning: the following packages contain code that will be rejected by a future version of Rust: pdf v0.9.0 [INFO] [stderr] note: to see what the problems were, use the option `--future-incompat-report`, or run `cargo report future-incompatibilities --id 3` [INFO] [stderr] Running unittests src/main.rs (/opt/rustwide/target/debug/deps/tokenizer-9e783296a7068372) [INFO] [stdout] [INFO] [stdout] running 0 tests [INFO] [stdout] [INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s [INFO] [stdout] [INFO] running `Command { std: "docker" "inspect" "bf08cf68cda6ddb76ec76524b051f8376fc45d35615da11fda4750e759cb8893", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "bf08cf68cda6ddb76ec76524b051f8376fc45d35615da11fda4750e759cb8893", kill_on_drop: false }` [INFO] [stdout] bf08cf68cda6ddb76ec76524b051f8376fc45d35615da11fda4750e759cb8893