[INFO] cloning repository https://github.com/deltartificial/tokenizer
[INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/deltartificial/tokenizer" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fdeltartificial%2Ftokenizer", kill_on_drop: false }`
[INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fdeltartificial%2Ftokenizer'...
[INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }`
[INFO] [stdout] 8782c3753f6cf34c0fa7cc617233b21ad6824b20
[INFO] testing deltartificial/tokenizer against master#ad85bc524b1ad696e42061ad8338d382dffbdbe5 for pr-146237
[INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fdeltartificial%2Ftokenizer" "/workspace/builds/worker-5-tc1/source", kill_on_drop: false }`
[INFO] [stderr] Cloning into '/workspace/builds/worker-5-tc1/source'...
[INFO] [stderr] done.
[INFO] started tweaking git repo https://github.com/deltartificial/tokenizer
[INFO] finished tweaking git repo https://github.com/deltartificial/tokenizer
[INFO] tweaked toml for git repo https://github.com/deltartificial/tokenizer written to /workspace/builds/worker-5-tc1/source/Cargo.toml
[INFO] validating manifest of git repo https://github.com/deltartificial/tokenizer on toolchain ad85bc524b1ad696e42061ad8338d382dffbdbe5
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+ad85bc524b1ad696e42061ad8338d382dffbdbe5" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] crate git repo https://github.com/deltartificial/tokenizer already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+ad85bc524b1ad696e42061ad8338d382dffbdbe5" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] [stderr]     Updating crates.io index
[INFO] [stderr]  Downloading crates ...
[INFO] [stderr]   Downloaded proc-macro2 v1.0.94
[INFO] [stderr]   Downloaded signal-hook-registry v1.4.2
[INFO] [stderr]   Downloaded tokio-macros v2.5.0
[INFO] [stderr]   Downloaded parking_lot_core v0.9.10
[INFO] [stderr]   Downloaded js-sys v0.3.77
[INFO] [stderr]   Downloaded parking_lot v0.12.3
[INFO] [stderr]   Downloaded hf-hub v0.4.2
[INFO] [stderr]   Downloaded tinyvec v1.9.0
[INFO] [stderr]   Downloaded socks v0.3.4
[INFO] [stderr]   Downloaded mac v0.1.1
[INFO] [stderr]   Downloaded crossbeam-deque v0.8.6
[INFO] [stderr]   Downloaded phf v0.10.1
[INFO] [stderr]   Downloaded humantime v2.2.0
[INFO] [stderr]   Downloaded string_cache v0.8.9
[INFO] [stderr]   Downloaded anyhow v1.0.97
[INFO] [stderr]   Downloaded clap_lex v0.7.4
[INFO] [stderr]   Downloaded anstyle-wincon v3.0.7
[INFO] [stderr]   Downloaded clap v4.5.35
[INFO] [stderr]   Downloaded portable-atomic-util v0.2.4
[INFO] [stderr]   Downloaded cbc v0.1.2
[INFO] [stderr]   Downloaded zerocopy v0.7.35
[INFO] [stderr]   Downloaded webpki-roots v0.26.8
[INFO] [stderr]   Downloaded clap_builder v4.5.35
[INFO] [stderr]   Downloaded jpeg-decoder v0.3.1
[INFO] [stderr]   Downloaded html5ever v0.26.0
[INFO] [stderr]   Downloaded unicode-width v0.1.14
[INFO] [stderr]   Downloaded hashbrown v0.15.2
[INFO] [stderr]   Downloaded zerovec v0.10.4
[INFO] [stderr]   Downloaded tokenizers v0.21.1
[INFO] [stderr]   Downloaded mio v1.0.3
[INFO] [stderr]   Downloaded gimli v0.31.1
[INFO] [stderr]   Downloaded object v0.36.7
[INFO] [stderr]   Downloaded jiff v0.2.5
[INFO] [stderr]   Downloaded inout v0.1.4
[INFO] [stderr]   Downloaded typenum v1.18.0
[INFO] [stderr]   Downloaded ring v0.17.14
[INFO] [stderr]   Downloaded jiff-static v0.2.5
[INFO] [stderr]   Downloaded unicode_categories v0.1.1
[INFO] [stderr]   Downloaded dirs-sys v0.4.1
[INFO] [stderr]   Downloaded miniz_oxide v0.8.7
[INFO] [stderr]   Downloaded serde_json v1.0.140
[INFO] [stderr]   Downloaded pdf v0.9.0
[INFO] [stderr]   Downloaded zerocopy-derive v0.8.24
[INFO] [stderr]   Downloaded spm_precompiled v0.1.4
[INFO] [stderr]   Downloaded http v1.3.1
[INFO] [stderr]   Downloaded rustls-webpki v0.103.1
[INFO] [stderr]   Downloaded onig_sys v69.8.1
[INFO] [stderr]   Downloaded itertools v0.11.0
[INFO] [stderr]   Downloaded deflate v1.0.0
[INFO] [stderr]   Downloaded indexmap v2.9.0
[INFO] [stderr]   Downloaded snafu-derive v0.7.5
[INFO] [stderr]   Downloaded rustls v0.23.25
[INFO] [stderr]   Downloaded anstyle-parse v0.2.6
[INFO] [stderr]   Downloaded anstyle-query v1.1.2
[INFO] [stderr]   Downloaded precomputed-hash v0.1.1
[INFO] [stderr]   Downloaded fax_derive v0.1.0
[INFO] [stderr]   Downloaded async-trait v0.1.88
[INFO] [stderr]   Downloaded libflate_lz77 v2.1.0
[INFO] [stderr]   Downloaded libflate v2.1.0
[INFO] [stderr]   Downloaded pdf_derive v0.2.0
[INFO] [stderr]   Downloaded cpufeatures v0.2.17
[INFO] [stderr]   Downloaded icu_properties_data v1.5.1
[INFO] [stderr]   Downloaded colorchoice v1.0.3
[INFO] [stderr]   Downloaded anstyle v1.0.10
[INFO] [stderr]   Downloaded env_filter v0.1.3
[INFO] [stderr]   Downloaded phf_generator v0.10.0
[INFO] [stderr]   Downloaded phf_codegen v0.10.0
[INFO] [stderr]   Downloaded utf-8 v0.7.6
[INFO] [stderr]   Downloaded html2text v0.6.0
[INFO] [stderr]   Downloaded aes v0.8.4
[INFO] [stderr]   Downloaded cipher v0.4.4
[INFO] [stderr]   Downloaded istring v0.3.4
[INFO] [stderr]   Downloaded allocator-api2 v0.2.21
[INFO] [stderr]   Downloaded snafu v0.7.5
[INFO] [stderr]   Downloaded flate2 v1.1.1
[INFO] [stderr]   Downloaded idna v1.0.3
[INFO] [stderr]   Downloaded bytes v1.10.1
[INFO] [stderr]   Downloaded phf_generator v0.11.3
[INFO] [stderr]   Downloaded string_cache_codegen v0.5.4
[INFO] [stderr]   Downloaded futf v0.1.5
[INFO] [stderr]   Downloaded tendril v0.4.3
[INFO] [stderr]   Downloaded xml5ever v0.17.0
[INFO] [stderr]   Downloaded tuple v0.5.2
[INFO] [stderr]   Downloaded dary_heap v0.3.7
[INFO] [stderr]   Downloaded zerocopy-derive v0.7.35
[INFO] [stderr]   Downloaded ahash v0.8.11
[INFO] [stderr]   Downloaded rle-decode-fast v1.0.3
[INFO] [stderr]   Downloaded md5 v0.7.0
[INFO] [stderr]   Downloaded unicode-bidi v0.3.18
[INFO] [stderr]   Downloaded icu_collections v1.5.0
[INFO] [stderr]   Downloaded url v2.5.4
[INFO] [stderr]   Downloaded ureq v2.12.1
[INFO] [stderr]   Downloaded indicatif v0.17.11
[INFO] [stderr]   Downloaded cc v1.2.18
[INFO] [stderr]   Downloaded backtrace v0.3.74
[INFO] [stderr]   Downloaded clap_derive v4.5.32
[INFO] [stderr]   Downloaded anstream v0.6.18
[INFO] [stderr]   Downloaded env_logger v0.11.8
[INFO] [stderr]   Downloaded siphasher v1.0.1
[INFO] [stderr]   Downloaded markup5ever v0.11.0
[INFO] [stderr]   Downloaded block-padding v0.3.3
[INFO] [stderr]   Downloaded datasize v0.2.15
[INFO] [stderr]   Downloaded adler32 v1.2.0
[INFO] [stderr]   Downloaded core2 v0.4.0
[INFO] [stderr]   Downloaded unicode-properties v0.1.3
[INFO] [stderr]   Downloaded esaxx-rs v0.1.10
[INFO] [stderr]   Downloaded base64 v0.22.1
[INFO] [stderr]   Downloaded unicode-width v0.2.0
[INFO] [stderr]   Downloaded zerocopy v0.8.24
[INFO] [stderr]   Downloaded unicode-normalization-alignments v0.1.12
[INFO] [stderr]   Downloaded phf_shared v0.11.3
[INFO] [stderr]   Downloaded icu_properties v1.5.1
[INFO] [stderr]   Downloaded rustls-pki-types v1.11.0
[INFO] [stderr]   Downloaded onig v6.4.0
[INFO] [stderr]   Downloaded crossbeam-epoch v0.9.18
[INFO] [stderr]   Downloaded autocfg v1.4.0
[INFO] [stderr]   Downloaded lock_api v0.4.12
[INFO] [stderr]   Downloaded fax v0.2.4
[INFO] [stderr]   Downloaded darling_core v0.20.11
[INFO] [stderr]   Downloaded dirs v5.0.1
[INFO] [stderr]   Downloaded crc32fast v1.4.2
[INFO] [stderr]   Downloaded zeroize v1.8.1
[INFO] [stderr]   Downloaded icu_normalizer_data v1.5.1
[INFO] [stderr]   Downloaded icu_locid_transform v1.5.0
[INFO] [stderr]   Downloaded icu_locid v1.5.0
[INFO] [stderr]   Downloaded yoke v0.7.5
[INFO] [stderr]   Downloaded portable-atomic v1.11.0
[INFO] [stderr]   Downloaded bumpalo v3.17.0
[INFO] [stderr]   Downloaded itertools v0.13.0
[INFO] [stderr]   Downloaded either v1.15.0
[INFO] [stderr]   Downloaded crossbeam-utils v0.8.21
[INFO] [stderr]   Downloaded rayon-cond v0.3.0
[INFO] [stderr]   Downloaded base64 v0.13.1
[INFO] [stderr]   Downloaded addr2line v0.24.2
[INFO] [stderr]   Downloaded smallvec v1.15.0
[INFO] [stderr]   Downloaded tokio v1.44.2
[INFO] [stderr]   Downloaded phf_shared v0.10.0
[INFO] [stderr]   Downloaded globalcache v0.2.4
[INFO] [stderr]   Downloaded weezl v0.1.8
[INFO] [stderr]   Downloaded derive_builder_core v0.20.2
[INFO] [stderr]   Downloaded derive_builder v0.20.2
[INFO] [stderr]   Downloaded option-ext v0.2.0
[INFO] [stderr]   Downloaded utf16_iter v1.0.5
[INFO] [stderr]   Downloaded icu_normalizer v1.5.0
[INFO] [stderr]   Downloaded icu_locid_transform_data v1.5.1
[INFO] [stderr]   Downloaded litemap v0.7.5
[INFO] [stderr]   Downloaded icu_provider v1.5.0
[INFO] [stderr]   Downloaded encode_unicode v1.0.0
[INFO] [stderr]   Downloaded redox_syscall v0.5.11
[INFO] [stderr]   Downloaded datasize_derive v0.2.15
[INFO] [stderr]   Downloaded stringprep v0.1.5
[INFO] [stderr]   Downloaded ident_case v1.0.1
[INFO] [stderr]   Downloaded darling_macro v0.20.11
[INFO] [stderr]   Downloaded darling v0.20.11
[INFO] [stderr]   Downloaded derive_builder_macro v0.20.2
[INFO] [stderr]   Downloaded libredox v0.1.3
[INFO] [stderr]   Downloaded redox_users v0.4.6
[INFO] [stderr]   Downloaded untrusted v0.9.0
[INFO] [stderr]   Downloaded subtle v2.6.1
[INFO] [stderr]   Downloaded tinystr v0.7.6
[INFO] [stderr]   Downloaded yoke-derive v0.7.5
[INFO] [stderr]   Downloaded synstructure v0.13.1
[INFO] [stderr]   Downloaded zerovec-derive v0.10.3
[INFO] [stderr]   Downloaded idna_adapter v1.2.0
[INFO] [stderr]   Downloaded web-time v1.1.0
[INFO] [stderr]   Downloaded adler2 v2.0.0
[INFO] [stderr]   Downloaded bitflags v2.9.0
[INFO] [stderr]   Downloaded libc v0.2.171
[INFO] [stderr]   Downloaded write16 v1.0.0
[INFO] [stderr]   Downloaded icu_provider_macros v1.5.0
[INFO] [stderr]   Downloaded writeable v0.5.5
[INFO] [stderr]   Downloaded monostate v0.1.14
[INFO] [stderr]   Downloaded console v0.15.11
[INFO] [stderr]   Downloaded macro_rules_attribute-proc_macro v0.2.0
[INFO] [stderr]   Downloaded macro_rules_attribute v0.2.0
[INFO] [stderr]   Downloaded monostate-impl v0.1.14
[INFO] [stderr]   Downloaded syn v2.0.100
[INFO] [stderr]   Downloaded socket2 v0.5.9
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:7ad1b28ee6f5f7f699f6cf7015098d6ccdd96d6f2d78dd06228f5b4c9faf309c" "/opt/rustwide/cargo-home/bin/cargo" "+ad85bc524b1ad696e42061ad8338d382dffbdbe5" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] [stdout] 6920f5f5c0d62991797cd6eb3d2289cd5f178480f4ce6196eb957ece75f933ea
[INFO] running `Command { std: "docker" "start" "-a" "6920f5f5c0d62991797cd6eb3d2289cd5f178480f4ce6196eb957ece75f933ea", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "6920f5f5c0d62991797cd6eb3d2289cd5f178480f4ce6196eb957ece75f933ea", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "6920f5f5c0d62991797cd6eb3d2289cd5f178480f4ce6196eb957ece75f933ea", kill_on_drop: false }`
[INFO] [stdout] 6920f5f5c0d62991797cd6eb3d2289cd5f178480f4ce6196eb957ece75f933ea
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:7ad1b28ee6f5f7f699f6cf7015098d6ccdd96d6f2d78dd06228f5b4c9faf309c" "/opt/rustwide/cargo-home/bin/cargo" "+ad85bc524b1ad696e42061ad8338d382dffbdbe5" "build" "--frozen" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] 4495471ac1d93e11ecfe675bbf1c24b810c44d09fb10d8673f8a5e5f51b609c2
[INFO] running `Command { std: "docker" "start" "-a" "4495471ac1d93e11ecfe675bbf1c24b810c44d09fb10d8673f8a5e5f51b609c2", kill_on_drop: false }`
[INFO] [stderr]    Compiling proc-macro2 v1.0.94
[INFO] [stderr]    Compiling unicode-ident v1.0.18
[INFO] [stderr]    Compiling libc v0.2.171
[INFO] [stderr]    Compiling version_check v0.9.5
[INFO] [stderr]    Compiling zerocopy v0.8.24
[INFO] [stderr]    Compiling shlex v1.3.0
[INFO] [stderr]    Compiling smallvec v1.15.0
[INFO] [stderr]    Compiling serde v1.0.219
[INFO] [stderr]    Compiling autocfg v1.4.0
[INFO] [stderr]    Compiling memchr v2.7.4
[INFO] [stderr]    Compiling stable_deref_trait v1.2.0
[INFO] [stderr]    Compiling syn v1.0.109
[INFO] [stderr]    Compiling typenum v1.18.0
[INFO] [stderr]    Compiling once_cell v1.21.3
[INFO] [stderr]    Compiling siphasher v0.3.11
[INFO] [stderr]    Compiling log v0.4.27
[INFO] [stderr]    Compiling icu_locid_transform_data v1.5.1
[INFO] [stderr]    Compiling cc v1.2.18
[INFO] [stderr]    Compiling writeable v0.5.5
[INFO] [stderr]    Compiling litemap v0.7.5
[INFO] [stderr]    Compiling siphasher v1.0.1
[INFO] [stderr]    Compiling icu_properties_data v1.5.1
[INFO] [stderr]    Compiling strsim v0.11.1
[INFO] [stderr]    Compiling fnv v1.0.7
[INFO] [stderr]    Compiling parking_lot_core v0.9.10
[INFO] [stderr]    Compiling icu_normalizer_data v1.5.1
[INFO] [stderr]    Compiling phf_shared v0.11.3
[INFO] [stderr]    Compiling generic-array v0.14.7
[INFO] [stderr]    Compiling phf_shared v0.10.0
[INFO] [stderr]    Compiling crossbeam-utils v0.8.21
[INFO] [stderr]    Compiling scopeguard v1.2.0
[INFO] [stderr]    Compiling new_debug_unreachable v1.0.6
[INFO] [stderr]    Compiling utf8_iter v1.0.4
[INFO] [stderr]    Compiling either v1.15.0
[INFO] [stderr]    Compiling utf16_iter v1.0.5
[INFO] [stderr]    Compiling lock_api v0.4.12
[INFO] [stderr]    Compiling write16 v1.0.0
[INFO] [stderr]    Compiling ident_case v1.0.1
[INFO] [stderr]    Compiling ahash v0.8.11
[INFO] [stderr]    Compiling crc32fast v1.4.2
[INFO] [stderr]    Compiling mac v0.1.1
[INFO] [stderr]    Compiling quote v1.0.40
[INFO] [stderr]    Compiling untrusted v0.9.0
[INFO] [stderr]    Compiling rustls-pki-types v1.11.0
[INFO] [stderr]    Compiling futf v0.1.5
[INFO] [stderr]    Compiling num-traits v0.2.19
[INFO] [stderr]    Compiling aho-corasick v1.1.3
[INFO] [stderr]    Compiling adler2 v2.0.0
[INFO] [stderr]    Compiling pkg-config v0.3.32
[INFO] [stderr]    Compiling serde_json v1.0.140
[INFO] [stderr]    Compiling utf8parse v0.2.2
[INFO] [stderr]    Compiling rayon-core v1.12.1
[INFO] [stderr]    Compiling syn v2.0.100
[INFO] [stderr]    Compiling getrandom v0.2.15
[INFO] [stderr]    Compiling rand_core v0.6.4
[INFO] [stderr]    Compiling utf-8 v0.7.6
[INFO] [stderr]    Compiling precomputed-hash v0.1.1
[INFO] [stderr]    Compiling zerocopy v0.7.35
[INFO] [stderr]    Compiling percent-encoding v2.3.1
[INFO] [stderr]    Compiling portable-atomic v1.11.0
[INFO] [stderr]    Compiling itoa v1.0.15
[INFO] [stderr]    Compiling regex-syntax v0.8.5
[INFO] [stderr]    Compiling parking_lot v0.12.3
[INFO] [stderr]    Compiling crossbeam-epoch v0.9.18
[INFO] [stderr]    Compiling rustls v0.23.25
[INFO] [stderr]    Compiling form_urlencoded v1.2.1
[INFO] [stderr]    Compiling crossbeam-deque v0.8.6
[INFO] [stderr]    Compiling tendril v0.4.3
[INFO] [stderr]    Compiling anstyle-parse v0.2.6
[INFO] [stderr]    Compiling ring v0.17.14
[INFO] [stderr]    Compiling miniz_oxide v0.8.7
[INFO] [stderr]    Compiling phf v0.10.1
[INFO] [stderr]    Compiling subtle v2.6.1
[INFO] [stderr]    Compiling colorchoice v1.0.3
[INFO] [stderr]    Compiling bytes v1.10.1
[INFO] [stderr]    Compiling anstyle v1.0.10
[INFO] [stderr]    Compiling tinyvec_macros v0.1.1
[INFO] [stderr]    Compiling zeroize v1.8.1
[INFO] [stderr]    Compiling ryu v1.0.20
[INFO] [stderr]    Compiling doc-comment v0.3.3
[INFO] [stderr]    Compiling byteorder v1.5.0
[INFO] [stderr]    Compiling anstyle-query v1.1.2
[INFO] [stderr]    Compiling thiserror v2.0.12
[INFO] [stderr]    Compiling unicode-width v0.2.0
[INFO] [stderr]    Compiling is_terminal_polyfill v1.70.1
[INFO] [stderr]    Compiling onig_sys v69.8.1
[INFO] [stderr]    Compiling allocator-api2 v0.2.21
[INFO] [stderr]    Compiling option-ext v0.2.0
[INFO] [stderr]    Compiling paste v1.0.15
[INFO] [stderr]    Compiling anstream v0.6.18
[INFO] [stderr]    Compiling console v0.15.11
[INFO] [stderr]    Compiling dirs-sys v0.4.1
[INFO] [stderr]    Compiling socks v0.3.4
[INFO] [stderr]    Compiling ppv-lite86 v0.2.21
[INFO] [stderr]    Compiling hashbrown v0.14.5
[INFO] [stderr]    Compiling crypto-common v0.1.6
[INFO] [stderr]    Compiling block-padding v0.3.3
[INFO] [stderr]    Compiling block-buffer v0.10.4
[INFO] [stderr]    Compiling flate2 v1.1.1
[INFO] [stderr]    Compiling inout v0.1.4
[INFO] [stderr]    Compiling tinyvec v1.9.0
[INFO] [stderr]    Compiling cipher v0.4.4
[INFO] [stderr]    Compiling esaxx-rs v0.1.10
[INFO] [stderr]    Compiling rand_chacha v0.3.1
[INFO] [stderr]    Compiling webpki-roots v0.26.8
[INFO] [stderr]    Compiling core2 v0.4.0
[INFO] [stderr]    Compiling heck v0.4.1
[INFO] [stderr]    Compiling adler32 v1.2.0
[INFO] [stderr]    Compiling rle-decode-fast v1.0.3
[INFO] [stderr]    Compiling base64 v0.22.1
[INFO] [stderr]    Compiling minimal-lexical v0.2.1
[INFO] [stderr]    Compiling rand v0.8.5
[INFO] [stderr]    Compiling cpufeatures v0.2.17
[INFO] [stderr]    Compiling indicatif v0.17.11
[INFO] [stderr]    Compiling nom v7.1.3
[INFO] [stderr]    Compiling rayon v1.10.0
[INFO] [stderr]    Compiling digest v0.10.7
[INFO] [stderr]    Compiling regex-automata v0.4.9
[INFO] [stderr]    Compiling phf_generator v0.10.0
[INFO] [stderr]    Compiling phf_generator v0.11.3
[INFO] [stderr]    Compiling phf_codegen v0.10.0
[INFO] [stderr]    Compiling unicode-normalization v0.1.24
[INFO] [stderr]    Compiling string_cache_codegen v0.5.4
[INFO] [stderr]    Compiling libflate_lz77 v2.1.0
[INFO] [stderr]    Compiling dirs v5.0.1
[INFO] [stderr]    Compiling http v1.3.1
[INFO] [stderr]    Compiling itertools v0.11.0
[INFO] [stderr]    Compiling markup5ever v0.11.0
[INFO] [stderr]    Compiling hashbrown v0.15.2
[INFO] [stderr]    Compiling heck v0.5.0
[INFO] [stderr]    Compiling unicode-segmentation v1.12.0
[INFO] [stderr]    Compiling web-time v1.1.0
[INFO] [stderr]    Compiling dary_heap v0.3.7
[INFO] [stderr]    Compiling unicode-bidi v0.3.18
[INFO] [stderr]    Compiling anyhow v1.0.97
[INFO] [stderr]    Compiling macro_rules_attribute-proc_macro v0.2.0
[INFO] [stderr]    Compiling clap_lex v0.7.4
[INFO] [stderr]    Compiling unicode-properties v0.1.3
[INFO] [stderr]    Compiling equivalent v1.0.2
[INFO] [stderr]    Compiling base64 v0.13.1
[INFO] [stderr]    Compiling indexmap v2.9.0
[INFO] [stderr]    Compiling stringprep v0.1.5
[INFO] [stderr]    Compiling clap_builder v4.5.35
[INFO] [stderr]    Compiling macro_rules_attribute v0.2.0
[INFO] [stderr]    Compiling libflate v2.1.0
[INFO] [stderr]    Compiling sha2 v0.10.8
[INFO] [stderr]    Compiling aes v0.8.4
[INFO] [stderr]    Compiling deflate v1.0.0
[INFO] [stderr]    Compiling cbc v0.1.2
[INFO] [stderr]    Compiling mio v1.0.3
[INFO] [stderr]    Compiling synstructure v0.13.1
[INFO] [stderr]    Compiling darling_core v0.20.11
[INFO] [stderr]    Compiling rayon-cond v0.3.0
[INFO] [stderr]    Compiling socket2 v0.5.9
[INFO] [stderr]    Compiling signal-hook-registry v1.4.2
[INFO] [stderr]    Compiling itertools v0.13.0
[INFO] [stderr]    Compiling itertools v0.10.5
[INFO] [stderr]    Compiling unicode-normalization-alignments v0.1.12
[INFO] [stderr]    Compiling weezl v0.1.8
[INFO] [stderr]    Compiling regex v1.11.1
[INFO] [stderr]    Compiling jpeg-decoder v0.3.1
[INFO] [stderr]    Compiling unicode_categories v0.1.1
[INFO] [stderr]    Compiling unicode-width v0.1.14
[INFO] [stderr]    Compiling onig v6.4.0
[INFO] [stderr]    Compiling jiff v0.2.5
[INFO] [stderr]    Compiling pin-project-lite v0.2.16
[INFO] [stderr]    Compiling lazy_static v1.5.0
[INFO] [stderr]    Compiling md5 v0.7.0
[INFO] [stderr]    Compiling rustls-webpki v0.103.1
[INFO] [stderr]    Compiling humantime v2.2.0
[INFO] [stderr]    Compiling env_filter v0.1.3
[INFO] [stderr]    Compiling html5ever v0.26.0
[INFO] [stderr]    Compiling datasize_derive v0.2.15
[INFO] [stderr]    Compiling fax_derive v0.1.0
[INFO] [stderr]    Compiling snafu-derive v0.7.5
[INFO] [stderr]    Compiling pdf_derive v0.2.0
[INFO] [stderr]    Compiling zerofrom-derive v0.1.6
[INFO] [stderr]    Compiling serde_derive v1.0.219
[INFO] [stderr]    Compiling yoke-derive v0.7.5
[INFO] [stderr]    Compiling zerovec-derive v0.10.3
[INFO] [stderr]    Compiling displaydoc v0.2.5
[INFO] [stderr]    Compiling icu_provider_macros v1.5.0
[INFO] [stderr]    Compiling thiserror-impl v2.0.12
[INFO] [stderr]    Compiling datasize v0.2.15
[INFO] [stderr]    Compiling monostate-impl v0.1.14
[INFO] [stderr]    Compiling async-trait v0.1.88
[INFO] [stderr]    Compiling darling_macro v0.20.11
[INFO] [stderr]    Compiling istring v0.3.4
[INFO] [stderr]    Compiling fax v0.2.4
[INFO] [stderr]    Compiling clap_derive v4.5.32
[INFO] [stderr]    Compiling darling v0.20.11
[INFO] [stderr]    Compiling tokio-macros v2.5.0
[INFO] [stderr]    Compiling derive_builder_core v0.20.2
[INFO] [stderr]    Compiling snafu v0.7.5
[INFO] [stderr]    Compiling tokio v1.44.2
[INFO] [stderr]    Compiling zerofrom v0.1.6
[INFO] [stderr]    Compiling yoke v0.7.5
[INFO] [stderr]    Compiling zerovec v0.10.4
[INFO] [stderr]    Compiling derive_builder_macro v0.20.2
[INFO] [stderr]    Compiling derive_builder v0.20.2
[INFO] [stderr]    Compiling tinystr v0.7.6
[INFO] [stderr]    Compiling icu_collections v1.5.0
[INFO] [stderr]    Compiling icu_locid v1.5.0
[INFO] [stderr]    Compiling clap v4.5.35
[INFO] [stderr]    Compiling icu_provider v1.5.0
[INFO] [stderr]    Compiling icu_locid_transform v1.5.0
[INFO] [stderr]    Compiling env_logger v0.11.8
[INFO] [stderr]    Compiling icu_properties v1.5.1
[INFO] [stderr]    Compiling string_cache v0.8.9
[INFO] [stderr]    Compiling tuple v0.5.2
[INFO] [stderr]    Compiling monostate v0.1.14
[INFO] [stderr]    Compiling spm_precompiled v0.1.4
[INFO] [stderr]    Compiling xml5ever v0.17.0
[INFO] [stderr]    Compiling icu_normalizer v1.5.0
[INFO] [stderr]    Compiling html2text v0.6.0
[INFO] [stderr]    Compiling idna_adapter v1.2.0
[INFO] [stderr]    Compiling idna v1.0.3
[INFO] [stderr]    Compiling url v2.5.4
[INFO] [stderr]    Compiling globalcache v0.2.4
[INFO] [stderr]    Compiling pdf v0.9.0
[INFO] [stderr]    Compiling ureq v2.12.1
[INFO] [stderr]    Compiling hf-hub v0.4.2
[INFO] [stderr]    Compiling tokenizers v0.21.1
[INFO] [stderr]    Compiling tokenizer v0.1.0 (/opt/rustwide/workdir)
[INFO] [stdout] warning: associated function `new` is never used
[INFO] [stdout]   --> src/infrastructure/token_counter.rs:17:12
[INFO] [stdout]    |
[INFO] [stdout] 16 | impl HuggingFaceTokenizerService {
[INFO] [stdout]    | -------------------------------- associated function in this implementation
[INFO] [stdout] 17 |     pub fn new() -> Result<Self> {
[INFO] [stdout]    |            ^^^
[INFO] [stdout]    |
[INFO] [stdout]    = note: `#[warn(dead_code)]` (part of `#[warn(unused)]`) on by default
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stderr]     Finished `dev` profile [unoptimized + debuginfo] target(s) in 1m 29s
[INFO] [stderr] warning: the following packages contain code that will be rejected by a future version of Rust: pdf v0.9.0
[INFO] [stderr] note: to see what the problems were, use the option `--future-incompat-report`, or run `cargo report future-incompatibilities --id 1`
[INFO] running `Command { std: "docker" "inspect" "4495471ac1d93e11ecfe675bbf1c24b810c44d09fb10d8673f8a5e5f51b609c2", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "4495471ac1d93e11ecfe675bbf1c24b810c44d09fb10d8673f8a5e5f51b609c2", kill_on_drop: false }`
[INFO] [stdout] 4495471ac1d93e11ecfe675bbf1c24b810c44d09fb10d8673f8a5e5f51b609c2
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:7ad1b28ee6f5f7f699f6cf7015098d6ccdd96d6f2d78dd06228f5b4c9faf309c" "/opt/rustwide/cargo-home/bin/cargo" "+ad85bc524b1ad696e42061ad8338d382dffbdbe5" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] 875267ad472ec95cde5c3ec31a458c1f501b3079556424e6819f9d74dc5b9a16
[INFO] running `Command { std: "docker" "start" "-a" "875267ad472ec95cde5c3ec31a458c1f501b3079556424e6819f9d74dc5b9a16", kill_on_drop: false }`
[INFO] [stderr]    Compiling tokenizer v0.1.0 (/opt/rustwide/workdir)
[INFO] [stdout] warning: associated function `new` is never used
[INFO] [stdout]   --> src/infrastructure/token_counter.rs:17:12
[INFO] [stdout]    |
[INFO] [stdout] 16 | impl HuggingFaceTokenizerService {
[INFO] [stdout]    | -------------------------------- associated function in this implementation
[INFO] [stdout] 17 |     pub fn new() -> Result<Self> {
[INFO] [stdout]    |            ^^^
[INFO] [stdout]    |
[INFO] [stdout]    = note: `#[warn(dead_code)]` (part of `#[warn(unused)]`) on by default
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 0.90s
[INFO] [stderr] warning: the following packages contain code that will be rejected by a future version of Rust: pdf v0.9.0
[INFO] [stderr] note: to see what the problems were, use the option `--future-incompat-report`, or run `cargo report future-incompatibilities --id 1`
[INFO] running `Command { std: "docker" "inspect" "875267ad472ec95cde5c3ec31a458c1f501b3079556424e6819f9d74dc5b9a16", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "875267ad472ec95cde5c3ec31a458c1f501b3079556424e6819f9d74dc5b9a16", kill_on_drop: false }`
[INFO] [stdout] 875267ad472ec95cde5c3ec31a458c1f501b3079556424e6819f9d74dc5b9a16
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:7ad1b28ee6f5f7f699f6cf7015098d6ccdd96d6f2d78dd06228f5b4c9faf309c" "/opt/rustwide/cargo-home/bin/cargo" "+ad85bc524b1ad696e42061ad8338d382dffbdbe5" "test" "--frozen", kill_on_drop: false }`
[INFO] [stdout] bcedf48cdbd32e3d5e8758d5ee0e58981b120b98255799ef47794c53319e51de
[INFO] running `Command { std: "docker" "start" "-a" "bcedf48cdbd32e3d5e8758d5ee0e58981b120b98255799ef47794c53319e51de", kill_on_drop: false }`
[INFO] [stderr] warning: associated function `new` is never used
[INFO] [stderr]   --> src/infrastructure/token_counter.rs:17:12
[INFO] [stderr]    |
[INFO] [stderr] 16 | impl HuggingFaceTokenizerService {
[INFO] [stderr]    | -------------------------------- associated function in this implementation
[INFO] [stderr] 17 |     pub fn new() -> Result<Self> {
[INFO] [stderr]    |            ^^^
[INFO] [stderr]    |
[INFO] [stderr]    = note: `#[warn(dead_code)]` (part of `#[warn(unused)]`) on by default
[INFO] [stderr] 
[INFO] [stderr] warning: `tokenizer` (bin "tokenizer" test) generated 1 warning
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 0.32s
[INFO] [stderr] warning: the following packages contain code that will be rejected by a future version of Rust: pdf v0.9.0
[INFO] [stderr] note: to see what the problems were, use the option `--future-incompat-report`, or run `cargo report future-incompatibilities --id 1`
[INFO] [stderr]      Running unittests src/main.rs (/opt/rustwide/target/debug/deps/tokenizer-9e783296a7068372)
[INFO] [stdout] 
[INFO] [stdout] running 0 tests
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
[INFO] [stdout] 
[INFO] running `Command { std: "docker" "inspect" "bcedf48cdbd32e3d5e8758d5ee0e58981b120b98255799ef47794c53319e51de", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "bcedf48cdbd32e3d5e8758d5ee0e58981b120b98255799ef47794c53319e51de", kill_on_drop: false }`
[INFO] [stdout] bcedf48cdbd32e3d5e8758d5ee0e58981b120b98255799ef47794c53319e51de