[INFO] cloning repository https://github.com/qbit-ai/tokenx-rs [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/qbit-ai/tokenx-rs" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fqbit-ai%2Ftokenx-rs", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fqbit-ai%2Ftokenx-rs'... [INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }` [INFO] [stdout] ab74d4bb314c4693cdf76c05a7a6be8249649336 [INFO] testing qbit-ai/tokenx-rs against try#dec9417b8611e34e787a3e4c37686b5131f9e5c5 for pr-154210-1 [INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fqbit-ai%2Ftokenx-rs" "/workspace/builds/worker-1-tc2/source", kill_on_drop: false }` [INFO] [stderr] Cloning into '/workspace/builds/worker-1-tc2/source'... [INFO] [stderr] done. [INFO] started tweaking git repo https://github.com/qbit-ai/tokenx-rs [INFO] finished tweaking git repo https://github.com/qbit-ai/tokenx-rs [INFO] tweaked toml for git repo https://github.com/qbit-ai/tokenx-rs written to /workspace/builds/worker-1-tc2/source/Cargo.toml [INFO] validating manifest of git repo https://github.com/qbit-ai/tokenx-rs on toolchain dec9417b8611e34e787a3e4c37686b5131f9e5c5 [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+dec9417b8611e34e787a3e4c37686b5131f9e5c5" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }` [INFO] crate git repo https://github.com/qbit-ai/tokenx-rs already has a lockfile, it will not be regenerated [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+dec9417b8611e34e787a3e4c37686b5131f9e5c5" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+dec9417b8611e34e787a3e4c37686b5131f9e5c5" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }` [INFO] [stdout] 6dfc59f615e951e78fae069f3b5b6ec280f16de1dd716046adcf7f17e8b4b235 [INFO] running `Command { std: "docker" "start" "-a" "6dfc59f615e951e78fae069f3b5b6ec280f16de1dd716046adcf7f17e8b4b235", kill_on_drop: false }` [INFO] running `Command { std: "docker" "inspect" "6dfc59f615e951e78fae069f3b5b6ec280f16de1dd716046adcf7f17e8b4b235", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "6dfc59f615e951e78fae069f3b5b6ec280f16de1dd716046adcf7f17e8b4b235", kill_on_drop: false }` [INFO] [stdout] 6dfc59f615e951e78fae069f3b5b6ec280f16de1dd716046adcf7f17e8b4b235 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+dec9417b8611e34e787a3e4c37686b5131f9e5c5" "build" "--frozen" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] 58fb35368703f9445b23e12525b4c9f3986066f3661eb81e0e21aeaf54172d92 [INFO] running `Command { std: "docker" "start" "-a" "58fb35368703f9445b23e12525b4c9f3986066f3661eb81e0e21aeaf54172d92", kill_on_drop: false }` [INFO] [stderr] Compiling tokenx-rs v0.1.0 (/opt/rustwide/workdir) [INFO] [stderr] Finished `dev` profile [unoptimized + debuginfo] target(s) in 0.39s [INFO] running `Command { std: "docker" "inspect" "58fb35368703f9445b23e12525b4c9f3986066f3661eb81e0e21aeaf54172d92", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "58fb35368703f9445b23e12525b4c9f3986066f3661eb81e0e21aeaf54172d92", kill_on_drop: false }` [INFO] [stdout] 58fb35368703f9445b23e12525b4c9f3986066f3661eb81e0e21aeaf54172d92 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+dec9417b8611e34e787a3e4c37686b5131f9e5c5" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] 365b9f2d7b1092f7761e839a5b3030cee14a82bbb7549e3240c9fc0c1919e4d4 [INFO] running `Command { std: "docker" "start" "-a" "365b9f2d7b1092f7761e839a5b3030cee14a82bbb7549e3240c9fc0c1919e4d4", kill_on_drop: false }` [INFO] [stderr] Compiling quote v1.0.44 [INFO] [stderr] Compiling libc v0.2.180 [INFO] [stderr] Compiling zerocopy v0.8.39 [INFO] [stderr] Compiling proc-macro2 v1.0.106 [INFO] [stderr] Compiling serde_core v1.0.228 [INFO] [stderr] Compiling num-traits v0.2.19 [INFO] [stderr] Compiling rustix v1.1.3 [INFO] [stderr] Compiling zmij v1.0.19 [INFO] [stderr] Compiling serde v1.0.228 [INFO] [stderr] Compiling linux-raw-sys v0.11.0 [INFO] [stderr] Compiling rayon-core v1.13.0 [INFO] [stderr] Compiling bitflags v2.10.0 [INFO] [stderr] Compiling either v1.15.0 [INFO] [stderr] Compiling regex-syntax v0.8.9 [INFO] [stderr] Compiling clap_lex v0.7.7 [INFO] [stderr] Compiling ciborium-io v0.2.2 [INFO] [stderr] Compiling syn v2.0.114 [INFO] [stderr] Compiling plotters-backend v0.3.7 [INFO] [stderr] Compiling itoa v1.0.17 [INFO] [stderr] Compiling anstyle v1.0.13 [INFO] [stderr] Compiling fastrand v2.3.0 [INFO] [stderr] Compiling getrandom v0.3.4 [INFO] [stderr] Compiling wait-timeout v0.2.1 [INFO] [stderr] Compiling clap_builder v4.5.57 [INFO] [stderr] Compiling plotters-svg v0.3.7 [INFO] [stderr] Compiling rand_core v0.9.5 [INFO] [stderr] Compiling itertools v0.10.5 [INFO] [stderr] Compiling bit-vec v0.8.0 [INFO] [stderr] Compiling cast v0.3.0 [INFO] [stderr] Compiling quick-error v1.2.3 [INFO] [stderr] Compiling rayon v1.11.0 [INFO] [stderr] Compiling tempfile v3.24.0 [INFO] [stderr] Compiling serde_json v1.0.149 [INFO] [stderr] Compiling regex-automata v0.4.14 [INFO] [stderr] Compiling criterion-plot v0.5.0 [INFO] [stderr] Compiling rusty-fork v0.3.1 [INFO] [stderr] Compiling clap v4.5.57 [INFO] [stderr] Compiling bit-set v0.8.0 [INFO] [stderr] Compiling rand v0.9.2 [INFO] [stderr] Compiling rand_xorshift v0.4.0 [INFO] [stderr] Compiling plotters v0.3.7 [INFO] [stderr] Compiling is-terminal v0.4.17 [INFO] [stderr] Compiling unarray v0.1.4 [INFO] [stderr] Compiling anes v0.1.6 [INFO] [stderr] Compiling oorandom v11.1.5 [INFO] [stderr] Compiling zerocopy-derive v0.8.39 [INFO] [stderr] Compiling serde_derive v1.0.228 [INFO] [stderr] Compiling regex v1.12.3 [INFO] [stderr] Compiling tinytemplate v1.2.1 [INFO] [stderr] Compiling half v2.7.1 [INFO] [stderr] Compiling ppv-lite86 v0.2.21 [INFO] [stderr] Compiling ciborium-ll v0.2.2 [INFO] [stderr] Compiling rand_chacha v0.9.0 [INFO] [stderr] Compiling ciborium v0.2.2 [INFO] [stderr] Compiling proptest v1.10.0 [INFO] [stderr] Compiling criterion v0.5.1 [INFO] [stderr] Compiling tokenx-rs v0.1.0 (/opt/rustwide/workdir) [INFO] [stderr] Finished `test` profile [unoptimized + debuginfo] target(s) in 1m 05s [INFO] running `Command { std: "docker" "inspect" "365b9f2d7b1092f7761e839a5b3030cee14a82bbb7549e3240c9fc0c1919e4d4", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "365b9f2d7b1092f7761e839a5b3030cee14a82bbb7549e3240c9fc0c1919e4d4", kill_on_drop: false }` [INFO] [stdout] 365b9f2d7b1092f7761e839a5b3030cee14a82bbb7549e3240c9fc0c1919e4d4 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+dec9417b8611e34e787a3e4c37686b5131f9e5c5" "test" "--frozen", kill_on_drop: false }` [INFO] [stdout] 3381e345bc798b75ece945856cda3a3305cce55ddd9a0c5a3ad126af74671fac [INFO] running `Command { std: "docker" "start" "-a" "3381e345bc798b75ece945856cda3a3305cce55ddd9a0c5a3ad126af74671fac", kill_on_drop: false }` [INFO] [stderr] Finished `test` profile [unoptimized + debuginfo] target(s) in 0.13s [INFO] [stderr] Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/tokenx_rs-33539050c9d80692) [INFO] [stdout] [INFO] [stdout] running 22 tests [INFO] [stdout] test estimator::tests::default_chars_per_token_constant ... ok [INFO] [stdout] test estimator::tests::empty_string ... ok [INFO] [stdout] test estimator::tests::english_sentence ... ok [INFO] [stdout] test estimator::tests::french_text ... ok [INFO] [stdout] test estimator::tests::german_text ... ok [INFO] [stdout] test estimator::tests::mixed_content ... ok [INFO] [stdout] test estimator::tests::numeric_string ... ok [INFO] [stdout] test estimator::tests::pure_cjk ... ok [INFO] [stdout] test estimator::tests::pure_punctuation ... ok [INFO] [stdout] test estimator::tests::pure_whitespace ... ok [INFO] [stdout] test estimator::tests::short_words ... ok [INFO] [stdout] test estimator::tests::underscore_identifiers ... ok [INFO] [stdout] test utils::tests::slice_empty ... ok [INFO] [stdout] test utils::tests::slice_full_range ... ok [INFO] [stdout] test utils::tests::slice_inverted_range ... ok [INFO] [stdout] test utils::tests::slice_negative_start ... ok [INFO] [stdout] test utils::tests::split_basic ... ok [INFO] [stdout] test utils::tests::split_empty ... ok [INFO] [stdout] test utils::tests::split_with_overlap ... ok [INFO] [stdout] test utils::tests::split_zero_chunk_size ... ok [INFO] [stdout] test utils::tests::within_limit_basic ... ok [INFO] [stdout] test estimator::tests::custom_options ... ok [INFO] [stderr] Running tests/accuracy.rs (/opt/rustwide/target/debug/deps/accuracy-4490674dbcb2163c) [INFO] [stdout] [INFO] [stdout] test result: ok. 22 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.02s [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] running 9 tests [INFO] [stdout] test empty_and_whitespace ... ok [INFO] [stdout] test mixed_language_content ... ok [INFO] [stdout] test japanese_text ... ok [INFO] [stdout] test short_english_text ... ok [INFO] [stdout] test single_character ... ok [INFO] [stdout] test chinese_text ... ok [INFO] [stdout] test code_snippet ... ok [INFO] [stdout] test pure_numbers ... ok [INFO] [stdout] test german_text_with_umlauts ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 9 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.13s [INFO] [stdout] [INFO] [stderr] Running tests/proptest.rs (/opt/rustwide/target/debug/deps/proptest-baf4da0ea183d326) [INFO] [stdout] [INFO] [stdout] running 7 tests [INFO] [stdout] test empty_input_returns_zero ... ok [INFO] [stdout] test split_produces_nonempty_chunks ... ok [INFO] [stdout] test never_panics_on_arbitrary_input ... ok [INFO] [stdout] test is_within_limit_consistent ... ok [INFO] [stdout] test slice_by_tokens_subset ... ok [INFO] [stdout] test split_by_tokens_covers_all_content ... ok [INFO] [stdout] test result_is_consistent ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 7 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.75s [INFO] [stdout] [INFO] [stderr] Doc-tests tokenx_rs [INFO] [stdout] [INFO] [stdout] running 6 tests [INFO] [stdout] test src/estimator.rs - estimator::estimate_token_count (line 147) ... ok [INFO] [stdout] test src/utils.rs - utils::is_within_token_limit (line 10) ... ok [INFO] [stdout] test src/utils.rs - utils::slice_by_tokens (line 40) ... ok [INFO] [stdout] test src/utils.rs - utils::split_by_tokens (line 110) ... ok [INFO] [stdout] test src/estimator.rs - estimator::estimate_token_count_with_options (line 161) ... ok [INFO] [stdout] test src/lib.rs - (line 11) ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 6 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.68s [INFO] [stdout] [INFO] running `Command { std: "docker" "inspect" "3381e345bc798b75ece945856cda3a3305cce55ddd9a0c5a3ad126af74671fac", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "3381e345bc798b75ece945856cda3a3305cce55ddd9a0c5a3ad126af74671fac", kill_on_drop: false }` [INFO] [stdout] 3381e345bc798b75ece945856cda3a3305cce55ddd9a0c5a3ad126af74671fac