[INFO] fetching crate shimmytok 0.7.0... [INFO] testing shimmytok-0.7.0 against try#33835004928d3bf65db4d4712e1330766263b0bd for pr-155739-1 [INFO] extracting crate shimmytok 0.7.0 into /workspace/builds/worker-2-tc2/source [INFO] started tweaking crates.io crate shimmytok 0.7.0 [INFO] removed 0 missing examples [INFO] removed 0 missing tests [INFO] finished tweaking crates.io crate shimmytok 0.7.0 [INFO] tweaked toml for crates.io crate shimmytok 0.7.0 written to /workspace/builds/worker-2-tc2/source/Cargo.toml [INFO] validating manifest of crates.io crate shimmytok 0.7.0 on toolchain 33835004928d3bf65db4d4712e1330766263b0bd [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+33835004928d3bf65db4d4712e1330766263b0bd" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }` [INFO] crate crates.io crate shimmytok 0.7.0 already has a lockfile, it will not be regenerated [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+33835004928d3bf65db4d4712e1330766263b0bd" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] [stderr] Blocking waiting for file lock on package cache [ERROR] error running command: no output for 300 seconds [INFO] testing shimmytok-0.7.0 against try#33835004928d3bf65db4d4712e1330766263b0bd for pr-155739-1 [INFO] extracting crate shimmytok 0.7.0 into /workspace/builds/worker-2-tc2/source [INFO] started tweaking crates.io crate shimmytok 0.7.0 [INFO] removed 0 missing examples [INFO] removed 0 missing tests [INFO] finished tweaking crates.io crate shimmytok 0.7.0 [INFO] tweaked toml for crates.io crate shimmytok 0.7.0 written to /workspace/builds/worker-2-tc2/source/Cargo.toml [INFO] validating manifest of crates.io crate shimmytok 0.7.0 on toolchain 33835004928d3bf65db4d4712e1330766263b0bd [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+33835004928d3bf65db4d4712e1330766263b0bd" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }` [INFO] crate crates.io crate shimmytok 0.7.0 already has a lockfile, it will not be regenerated [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+33835004928d3bf65db4d4712e1330766263b0bd" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] [stderr] Blocking waiting for file lock on package cache [INFO] [stderr] Blocking waiting for file lock on package cache [INFO] [stderr] Downloading crates ... [INFO] [stderr] Downloaded zmij v1.0.14 [INFO] [stderr] Downloaded web-sys v0.3.83 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+33835004928d3bf65db4d4712e1330766263b0bd" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }` [INFO] [stdout] a78c54e391c22c4e2fad2800839fe9252a7e1f630bab450243966b197e2fe6b6 [INFO] running `Command { std: "docker" "start" "-a" "a78c54e391c22c4e2fad2800839fe9252a7e1f630bab450243966b197e2fe6b6", kill_on_drop: false }` [INFO] running `Command { std: "docker" "inspect" "a78c54e391c22c4e2fad2800839fe9252a7e1f630bab450243966b197e2fe6b6", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "a78c54e391c22c4e2fad2800839fe9252a7e1f630bab450243966b197e2fe6b6", kill_on_drop: false }` [INFO] [stdout] a78c54e391c22c4e2fad2800839fe9252a7e1f630bab450243966b197e2fe6b6 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+33835004928d3bf65db4d4712e1330766263b0bd" "build" "--frozen" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] 226a78c25c01cae582ce3c737ef45a6a68f91e3608a41d7dbfe68140fae34454 [INFO] running `Command { std: "docker" "start" "-a" "226a78c25c01cae582ce3c737ef45a6a68f91e3608a41d7dbfe68140fae34454", kill_on_drop: false }` [INFO] [stderr] Compiling proc-macro2 v1.0.105 [INFO] [stderr] Compiling crossbeam-utils v0.8.21 [INFO] [stderr] Compiling quote v1.0.43 [INFO] [stderr] Compiling unicode-ident v1.0.22 [INFO] [stderr] Compiling memchr v2.7.6 [INFO] [stderr] Compiling regex-syntax v0.8.8 [INFO] [stderr] Compiling rayon-core v1.13.0 [INFO] [stderr] Compiling thiserror v2.0.17 [INFO] [stderr] Compiling bit-vec v0.6.3 [INFO] [stderr] Compiling either v1.15.0 [INFO] [stderr] Compiling bit-set v0.5.3 [INFO] [stderr] Compiling aho-corasick v1.1.4 [INFO] [stderr] Compiling crossbeam-epoch v0.9.18 [INFO] [stderr] Compiling crossbeam-deque v0.8.6 [INFO] [stderr] Compiling syn v2.0.114 [INFO] [stderr] Compiling regex-automata v0.4.13 [INFO] [stderr] Compiling rayon v1.11.0 [INFO] [stderr] Compiling thiserror-impl v2.0.17 [INFO] [stderr] Compiling regex v1.12.2 [INFO] [stderr] Compiling fancy-regex v0.13.0 [INFO] [stderr] Compiling shimmytok v0.7.0 (/opt/rustwide/workdir) [INFO] [stderr] Finished `dev` profile [unoptimized + debuginfo] target(s) in 15.75s [INFO] running `Command { std: "docker" "inspect" "226a78c25c01cae582ce3c737ef45a6a68f91e3608a41d7dbfe68140fae34454", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "226a78c25c01cae582ce3c737ef45a6a68f91e3608a41d7dbfe68140fae34454", kill_on_drop: false }` [INFO] [stdout] 226a78c25c01cae582ce3c737ef45a6a68f91e3608a41d7dbfe68140fae34454 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+33835004928d3bf65db4d4712e1330766263b0bd" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] d669ac9b8699b967d917874b2661bdc5c047cab47ccc5f97f42cb4a2b6af67b2 [INFO] running `Command { std: "docker" "start" "-a" "d669ac9b8699b967d917874b2661bdc5c047cab47ccc5f97f42cb4a2b6af67b2", kill_on_drop: false }` [INFO] [stderr] Compiling libc v0.2.180 [INFO] [stderr] Compiling zerocopy v0.8.33 [INFO] [stderr] Compiling zmij v1.0.14 [INFO] [stderr] Compiling num-traits v0.2.19 [INFO] [stderr] Compiling plotters-backend v0.3.7 [INFO] [stderr] Compiling getrandom v0.3.4 [INFO] [stderr] Compiling rustix v1.1.3 [INFO] [stderr] Compiling clap_lex v0.7.7 [INFO] [stderr] Compiling syn v2.0.114 [INFO] [stderr] Compiling option-ext v0.2.0 [INFO] [stderr] Compiling cast v0.3.0 [INFO] [stderr] Compiling linux-raw-sys v0.11.0 [INFO] [stderr] Compiling bitflags v2.10.0 [INFO] [stderr] Compiling fastrand v2.3.0 [INFO] [stderr] Compiling oorandom v11.1.5 [INFO] [stderr] Compiling rayon v1.11.0 [INFO] [stderr] Compiling criterion-plot v0.5.0 [INFO] [stderr] Compiling plotters-svg v0.3.7 [INFO] [stderr] Compiling anes v0.1.6 [INFO] [stderr] Compiling clap_builder v4.5.54 [INFO] [stderr] Compiling serde_json v1.0.149 [INFO] [stderr] Compiling plotters v0.3.7 [INFO] [stderr] Compiling dirs-sys v0.4.1 [INFO] [stderr] Compiling is-terminal v0.4.17 [INFO] [stderr] Compiling dirs v5.0.1 [INFO] [stderr] Compiling tempfile v3.24.0 [INFO] [stderr] Compiling clap v4.5.54 [INFO] [stderr] Compiling zerocopy-derive v0.8.33 [INFO] [stderr] Compiling serde_derive v1.0.228 [INFO] [stderr] Compiling thiserror-impl v2.0.17 [INFO] [stderr] Compiling thiserror v2.0.17 [INFO] [stderr] Compiling shimmytok v0.7.0 (/opt/rustwide/workdir) [INFO] [stderr] Compiling serde v1.0.228 [INFO] [stderr] Compiling tinytemplate v1.2.1 [INFO] [stderr] Compiling half v2.7.1 [INFO] [stderr] Compiling ciborium-ll v0.2.2 [INFO] [stderr] Compiling ciborium v0.2.2 [INFO] [stderr] Compiling criterion v0.5.1 [INFO] [stderr] Finished `test` profile [unoptimized + debuginfo] target(s) in 33.21s [INFO] running `Command { std: "docker" "inspect" "d669ac9b8699b967d917874b2661bdc5c047cab47ccc5f97f42cb4a2b6af67b2", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "d669ac9b8699b967d917874b2661bdc5c047cab47ccc5f97f42cb4a2b6af67b2", kill_on_drop: false }` [INFO] [stdout] d669ac9b8699b967d917874b2661bdc5c047cab47ccc5f97f42cb4a2b6af67b2 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+33835004928d3bf65db4d4712e1330766263b0bd" "test" "--frozen", kill_on_drop: false }` [INFO] [stdout] fa7310070ad74cfd28e7e71a6f2b55933f8ae43f0b712acb56ceaea87f6036da [INFO] running `Command { std: "docker" "start" "-a" "fa7310070ad74cfd28e7e71a6f2b55933f8ae43f0b712acb56ceaea87f6036da", kill_on_drop: false }` [INFO] [stderr] Finished `test` profile [unoptimized + debuginfo] target(s) in 0.15s [INFO] [stdout] [INFO] [stderr] Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/shimmytok-80ac53e7f4441e89) [INFO] [stdout] running 16 tests [INFO] [stdout] test rwkv::tests::test_unescape_carriage_return ... ok [INFO] [stdout] test rwkv::tests::test_unescape_hex ... ok [INFO] [stdout] test rwkv::tests::test_unescape_mixed ... ok [INFO] [stdout] test byte_encoder::tests::test_hello ... ok [INFO] [stdout] test byte_encoder::tests::test_space_encoding ... ok [INFO] [stdout] test ugm::tests::test_trie_insert_and_traverse ... ok [INFO] [stdout] test ugm::tests::test_utf8_cp_len ... ok [INFO] [stdout] test wpm::tests::test_is_cjk_char ... ok [INFO] [stdout] test wpm::tests::test_preprocess_wpm_basic ... ok [INFO] [stdout] test rwkv::tests::test_unescape_plain ... ok [INFO] [stdout] test wpm::tests::test_preprocess_wpm_cjk ... ok [INFO] [stdout] test wpm::tests::test_preprocess_wpm_whitespace ... ok [INFO] [stdout] test rwkv::tests::test_unescape_newline ... ok [INFO] [stdout] test rwkv::tests::test_unescape_tab ... ok [INFO] [stdout] test plamo2::tests::test_constants ... ok [INFO] [stdout] test plamo2::tests::test_table_columns ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 16 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] running 1 test [INFO] [stdout] test debug_gpt2_merges ... ignored, Debug test - run manually to inspect merge sequence [INFO] [stdout] [INFO] [stdout] test result: ok. 0 passed; 0 failed; 1 ignored; 0 measured; 0 filtered out; finished in 0.00s [INFO] [stdout] [INFO] [stderr] Running tests/debug_merges.rs (/opt/rustwide/target/debug/deps/debug_merges-cd43223007e91312) [INFO] [stderr] Running tests/test_basic.rs (/opt/rustwide/target/debug/deps/test_basic-c0d7848faf38c632) [INFO] [stdout] [INFO] [stdout] running 2 tests [INFO] [stdout] test test_encode_batch ... ok [INFO] [stdout] test test_load_gguf ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s [INFO] [stdout] [INFO] [stderr] Running tests/test_bpe.rs (/opt/rustwide/target/debug/deps/test_bpe-46d451794b676172) [INFO] [stdout] [INFO] [stdout] running 1 test [INFO] [stdout] test test_gpt2_tokenization ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s [INFO] [stdout] [INFO] [stderr] Running tests/test_bpe_edge_cases.rs (/opt/rustwide/target/debug/deps/test_bpe_edge_cases-3948010d00effab1) [INFO] [stdout] [INFO] [stdout] running 8 tests [INFO] [stdout] test test_empty_string ... ok [INFO] [stdout] test test_long_string ... ok [INFO] [stdout] test test_multiple_spaces ... ok [INFO] [stdout] test test_newlines_and_tabs ... ok [INFO] [stdout] test test_single_char ... ok [INFO] [stdout] test test_unicode_cjk ... ok [INFO] [stdout] test test_special_chars ... ok [INFO] [stderr] Running tests/test_bpe_merge.rs (/opt/rustwide/target/debug/deps/test_bpe_merge-cb793efdda209443) [INFO] [stdout] test test_unicode_emoji ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 8 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.05s [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] running 9 tests [INFO] [stdout] test test_byte_fallback_mechanism ... ok [INFO] [stdout] test test_bigram_validation ... ok [INFO] [stdout] test test_empty_symbol_handling ... ok [INFO] [stdout] test test_merge_priority_ordering ... ok [INFO] [stdout] test test_neighbor_merge_updates ... ok [INFO] [stdout] test test_single_character_symbols ... ok [INFO] [stdout] test test_work_queue_exhaustion ... ok [INFO] [stdout] test test_linked_list_integrity ... ok [INFO] [stdout] test test_no_valid_merges ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 9 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.04s [INFO] [stdout] [INFO] [stderr] Running tests/test_bpe_validation.rs (/opt/rustwide/target/debug/deps/test_bpe_validation-f35bc498bdc0909d) [INFO] [stdout] [INFO] [stdout] running 6 tests [INFO] [stderr] Running tests/test_clean_spaces.rs (/opt/rustwide/target/debug/deps/test_clean_spaces-8f044abb32f94119) [INFO] [stdout] test test_deepseek_coder_validation ... ignored, Requires model file [INFO] [stdout] test test_deepseek_llm_validation ... ignored, Requires model file [INFO] [stdout] test test_gpt2_validation ... ignored, Requires model file - run with: cargo test test_gpt2_validation -- --ignored [INFO] [stdout] test test_phi2_validation ... ignored, Requires model file [INFO] [stdout] test test_qwen2_validation ... ignored, Requires model file [INFO] [stdout] test test_starcoder_validation ... ignored, Requires model file [INFO] [stdout] [INFO] [stdout] test result: ok. 0 passed; 0 failed; 6 ignored; 0 measured; 0 filtered out; finished in 0.00s [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] running 4 tests [INFO] [stderr] Running tests/test_comprehensive.rs (/opt/rustwide/target/debug/deps/test_comprehensive-19592e6a072e7ced) [INFO] [stdout] test test_clean_spaces_apostrophe_contractions ... ok [INFO] [stdout] test test_clean_spaces_combined ... ok [INFO] [stdout] test test_clean_spaces_isolated_apostrophe ... ok [INFO] [stdout] test test_clean_spaces_punctuation ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 4 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] running 1 test [INFO] [stdout] test test_against_llama_cpp ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s [INFO] [stdout] [INFO] [stderr] Running tests/test_debug.rs (/opt/rustwide/target/debug/deps/test_debug-029550235bcd1a53) [INFO] [stdout] [INFO] [stdout] running 1 test [INFO] [stdout] test test_debug_tokens ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s [INFO] [stdout] [INFO] [stderr] Running tests/test_detailed.rs (/opt/rustwide/target/debug/deps/test_detailed-2a2bac00ba278c1b) [INFO] [stdout] [INFO] [stdout] running 1 test [INFO] [stdout] test test_detailed_merge ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s [INFO] [stdout] [INFO] [stderr] Running tests/test_error_handling.rs (/opt/rustwide/target/debug/deps/test_error_handling-79c45163588c0e84) [INFO] [stdout] [INFO] [stdout] running 7 tests [INFO] [stdout] test test_decode_with_special_tokens ... ok [INFO] [stdout] test test_invalid_token_id ... ok [INFO] [stdout] test test_empty_input ... ok [INFO] [stdout] test test_round_trip_fuzz ... ok [INFO] [stdout] test test_max_token_validation ... ok [INFO] [stdout] test test_very_large_input ... ok [INFO] [stdout] test test_missing_file ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 7 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.02s [INFO] [stdout] [INFO] [stderr] Running tests/test_llama_cpp_parity.rs (/opt/rustwide/target/debug/deps/test_llama_cpp_parity-6356fb17c57989c2) [INFO] [stdout] [INFO] [stdout] running 13 tests [INFO] [stdout] test test_decode_lstrip_option ... ok [INFO] [stdout] test test_decode_skip_special_text ... ok [INFO] [stdout] test test_decode_with_options_api ... ok [INFO] [stdout] test test_is_special_token_includes_new_ids ... ok [INFO] [stdout] test test_parse_special_splits_correctly ... ok [INFO] [stdout] test test_space_prefix_flag_honored ... ok [INFO] [stdout] test test_parse_special_enabled ... ok [INFO] [stdout] test test_token_to_piece ... ok [INFO] [stdout] test test_token_type_accessor ... ok [INFO] [stdout] test test_byte_token_decode_unit ... ok [INFO] [stdout] test test_special_token_accessors_exist ... ok [INFO] [stdout] test test_spm_newline_round_trip ... ok [INFO] [stderr] Running tests/test_merge_debug.rs (/opt/rustwide/target/debug/deps/test_merge_debug-d41bc90cb9f4f509) [INFO] [stdout] test test_encode_with_options_api ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 13 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] running 1 test [INFO] [stdout] test test_merge_sequence ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s [INFO] [stdout] [INFO] [stderr] Running tests/test_multi_pattern.rs (/opt/rustwide/target/debug/deps/test_multi_pattern-242e50938e2f8f27) [INFO] [stdout] [INFO] [stdout] running 7 tests [INFO] [stdout] test test_default_fallback_pattern ... ok [INFO] [stdout] test test_gap_preservation ... ok [INFO] [stdout] test test_unicode_in_multi_pattern ... ok [INFO] [stdout] test test_six_pattern_splitting ... ok [INFO] [stdout] test test_pattern_with_no_matches ... ok [INFO] [stdout] test test_two_pattern_splitting ... ok [INFO] [stdout] test test_empty_fragments ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 7 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.05s [INFO] [stdout] [INFO] [stderr] Running tests/test_pattern_debug.rs (/opt/rustwide/target/debug/deps/test_pattern_debug-f4a92b61a8f62b61) [INFO] [stdout] [INFO] [stdout] running 1 test [INFO] [stdout] test test_gpt2_pattern_multiline ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.04s [INFO] [stdout] [INFO] [stderr] Running tests/test_starcoder_debug.rs (/opt/rustwide/target/debug/deps/test_starcoder_debug-fcb5835c94bc4aa4) [INFO] [stdout] [INFO] [stdout] running 1 test [INFO] [stderr] Running tests/test_streaming.rs (/opt/rustwide/target/debug/deps/test_streaming-c43c69f642fb98f7) [INFO] [stdout] test test_starcoder_sequential ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.04s [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] running 6 tests [INFO] [stdout] test test_decode_single ... ok [INFO] [stdout] test test_decode_single_with_special_tokens ... ok [INFO] [stdout] test test_streaming_simulation ... ok [INFO] [stdout] test test_is_special_token ... ok [INFO] [stdout] test test_token_to_piece ... ok [INFO] [stdout] test test_token_type ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 6 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s [INFO] [stdout] [INFO] [stderr] Running tests/test_tokens.rs (/opt/rustwide/target/debug/deps/test_tokens-b4f5894ba472af6a) [INFO] [stdout] [INFO] [stdout] running 1 test [INFO] [stdout] test test_vocabulary_loading ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s [INFO] [stdout] [INFO] [stderr] Doc-tests shimmytok [INFO] [stdout] [INFO] [stdout] running 13 tests [INFO] [stdout] test src/lib.rs - Tokenizer::is_special_token (line 718) - compile ... ok [INFO] [stdout] test src/lib.rs - Tokenizer::model_type (line 526) - compile ... ok [INFO] [stdout] test src/lib.rs - Tokenizer (line 142) - compile ... ok [INFO] [stdout] test src/lib.rs - Tokenizer::decode_single (line 612) - compile ... ok [INFO] [stdout] test src/lib.rs - Tokenizer::encode (line 290) - compile ... ok [INFO] [stdout] test src/lib.rs - Tokenizer::decode_with_options (line 420) - compile ... ok [INFO] [stdout] test src/lib.rs - Tokenizer::from_gguf_file (line 232) - compile ... ok [INFO] [stdout] test src/lib.rs - Tokenizer::encode_batch (line 570) - compile ... ok [INFO] [stdout] test src/lib.rs - Tokenizer::decode (line 388) - compile ... ok [INFO] [stdout] test src/lib.rs - (line 15) - compile ... ok [INFO] [stdout] test src/lib.rs - Tokenizer::token_to_piece (line 654) - compile ... ok [INFO] [stdout] test src/lib.rs - Tokenizer::token_type (line 686) - compile ... ok [INFO] [stdout] test src/lib.rs - Tokenizer::encode_with_options (line 321) - compile ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 13 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.31s [INFO] [stdout] [INFO] running `Command { std: "docker" "inspect" "fa7310070ad74cfd28e7e71a6f2b55933f8ae43f0b712acb56ceaea87f6036da", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "fa7310070ad74cfd28e7e71a6f2b55933f8ae43f0b712acb56ceaea87f6036da", kill_on_drop: false }` [INFO] [stdout] fa7310070ad74cfd28e7e71a6f2b55933f8ae43f0b712acb56ceaea87f6036da