[INFO] cloning repository https://github.com/qbit-ai/tokenx-rs [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/qbit-ai/tokenx-rs" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fqbit-ai%2Ftokenx-rs", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fqbit-ai%2Ftokenx-rs'... [INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }` [INFO] [stdout] ab74d4bb314c4693cdf76c05a7a6be8249649336 [INFO] testing qbit-ai/tokenx-rs against master#562dee4820c458d823175268e41601d4c060588a for pr-154210-1 [INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fqbit-ai%2Ftokenx-rs" "/workspace/builds/worker-1-tc1/source", kill_on_drop: false }` [INFO] [stderr] Cloning into '/workspace/builds/worker-1-tc1/source'... [INFO] [stderr] done. [INFO] started tweaking git repo https://github.com/qbit-ai/tokenx-rs [INFO] finished tweaking git repo https://github.com/qbit-ai/tokenx-rs [INFO] tweaked toml for git repo https://github.com/qbit-ai/tokenx-rs written to /workspace/builds/worker-1-tc1/source/Cargo.toml [INFO] validating manifest of git repo https://github.com/qbit-ai/tokenx-rs on toolchain 562dee4820c458d823175268e41601d4c060588a [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+562dee4820c458d823175268e41601d4c060588a" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }` [INFO] crate git repo https://github.com/qbit-ai/tokenx-rs already has a lockfile, it will not be regenerated [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+562dee4820c458d823175268e41601d4c060588a" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] [stderr] Downloading crates ... [INFO] [stderr] Downloaded proptest v1.10.0 [INFO] [stderr] Downloaded regex-syntax v0.8.9 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+562dee4820c458d823175268e41601d4c060588a" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }` [INFO] [stdout] a7c50e8b898450370b57d5a4e04b71f7908ce3fa81e0647ae483245d7019befa [INFO] running `Command { std: "docker" "start" "-a" "a7c50e8b898450370b57d5a4e04b71f7908ce3fa81e0647ae483245d7019befa", kill_on_drop: false }` [INFO] running `Command { std: "docker" "inspect" "a7c50e8b898450370b57d5a4e04b71f7908ce3fa81e0647ae483245d7019befa", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "a7c50e8b898450370b57d5a4e04b71f7908ce3fa81e0647ae483245d7019befa", kill_on_drop: false }` [INFO] [stdout] a7c50e8b898450370b57d5a4e04b71f7908ce3fa81e0647ae483245d7019befa [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+562dee4820c458d823175268e41601d4c060588a" "build" "--frozen" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] 143cc06dec666cb3bfacf481057c6f5d85a6f9e9d96ba102f2c6d14507b1a993 [INFO] running `Command { std: "docker" "start" "-a" "143cc06dec666cb3bfacf481057c6f5d85a6f9e9d96ba102f2c6d14507b1a993", kill_on_drop: false }` [INFO] [stderr] Compiling tokenx-rs v0.1.0 (/opt/rustwide/workdir) [INFO] [stderr] Finished `dev` profile [unoptimized + debuginfo] target(s) in 0.49s [INFO] running `Command { std: "docker" "inspect" "143cc06dec666cb3bfacf481057c6f5d85a6f9e9d96ba102f2c6d14507b1a993", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "143cc06dec666cb3bfacf481057c6f5d85a6f9e9d96ba102f2c6d14507b1a993", kill_on_drop: false }` [INFO] [stdout] 143cc06dec666cb3bfacf481057c6f5d85a6f9e9d96ba102f2c6d14507b1a993 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+562dee4820c458d823175268e41601d4c060588a" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] b46e5e3f3db15eae411616706d32cc2a8e40b0bb8936d430ba1aee1c0eec12b2 [INFO] running `Command { std: "docker" "start" "-a" "b46e5e3f3db15eae411616706d32cc2a8e40b0bb8936d430ba1aee1c0eec12b2", kill_on_drop: false }` [INFO] [stderr] Compiling quote v1.0.44 [INFO] [stderr] Compiling libc v0.2.180 [INFO] [stderr] Compiling zerocopy v0.8.39 [INFO] [stderr] Compiling proc-macro2 v1.0.106 [INFO] [stderr] Compiling serde_core v1.0.228 [INFO] [stderr] Compiling num-traits v0.2.19 [INFO] [stderr] Compiling serde v1.0.228 [INFO] [stderr] Compiling zmij v1.0.19 [INFO] [stderr] Compiling rustix v1.1.3 [INFO] [stderr] Compiling linux-raw-sys v0.11.0 [INFO] [stderr] Compiling bitflags v2.10.0 [INFO] [stderr] Compiling regex-syntax v0.8.9 [INFO] [stderr] Compiling rayon-core v1.13.0 [INFO] [stderr] Compiling either v1.15.0 [INFO] [stderr] Compiling syn v2.0.114 [INFO] [stderr] Compiling itoa v1.0.17 [INFO] [stderr] Compiling fastrand v2.3.0 [INFO] [stderr] Compiling ciborium-io v0.2.2 [INFO] [stderr] Compiling plotters-backend v0.3.7 [INFO] [stderr] Compiling anstyle v1.0.13 [INFO] [stderr] Compiling clap_lex v0.7.7 [INFO] [stderr] Compiling plotters-svg v0.3.7 [INFO] [stderr] Compiling clap_builder v4.5.57 [INFO] [stderr] Compiling itertools v0.10.5 [INFO] [stderr] Compiling getrandom v0.3.4 [INFO] [stderr] Compiling rand_core v0.9.5 [INFO] [stderr] Compiling wait-timeout v0.2.1 [INFO] [stderr] Compiling regex-automata v0.4.14 [INFO] [stderr] Compiling quick-error v1.2.3 [INFO] [stderr] Compiling cast v0.3.0 [INFO] [stderr] Compiling bit-vec v0.8.0 [INFO] [stderr] Compiling tempfile v3.24.0 [INFO] [stderr] Compiling criterion-plot v0.5.0 [INFO] [stderr] Compiling rusty-fork v0.3.1 [INFO] [stderr] Compiling bit-set v0.8.0 [INFO] [stderr] Compiling serde_json v1.0.149 [INFO] [stderr] Compiling clap v4.5.57 [INFO] [stderr] Compiling rand_xorshift v0.4.0 [INFO] [stderr] Compiling rand v0.9.2 [INFO] [stderr] Compiling rayon v1.11.0 [INFO] [stderr] Compiling is-terminal v0.4.17 [INFO] [stderr] Compiling plotters v0.3.7 [INFO] [stderr] Compiling anes v0.1.6 [INFO] [stderr] Compiling oorandom v11.1.5 [INFO] [stderr] Compiling unarray v0.1.4 [INFO] [stderr] Compiling regex v1.12.3 [INFO] [stderr] Compiling zerocopy-derive v0.8.39 [INFO] [stderr] Compiling serde_derive v1.0.228 [INFO] [stderr] Compiling tinytemplate v1.2.1 [INFO] [stderr] Compiling half v2.7.1 [INFO] [stderr] Compiling ppv-lite86 v0.2.21 [INFO] [stderr] Compiling ciborium-ll v0.2.2 [INFO] [stderr] Compiling ciborium v0.2.2 [INFO] [stderr] Compiling rand_chacha v0.9.0 [INFO] [stderr] Compiling proptest v1.10.0 [INFO] [stderr] Compiling criterion v0.5.1 [INFO] [stderr] Compiling tokenx-rs v0.1.0 (/opt/rustwide/workdir) [INFO] [stderr] Finished `test` profile [unoptimized + debuginfo] target(s) in 57.09s [INFO] running `Command { std: "docker" "inspect" "b46e5e3f3db15eae411616706d32cc2a8e40b0bb8936d430ba1aee1c0eec12b2", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "b46e5e3f3db15eae411616706d32cc2a8e40b0bb8936d430ba1aee1c0eec12b2", kill_on_drop: false }` [INFO] [stdout] b46e5e3f3db15eae411616706d32cc2a8e40b0bb8936d430ba1aee1c0eec12b2 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+562dee4820c458d823175268e41601d4c060588a" "test" "--frozen", kill_on_drop: false }` [INFO] [stdout] 4eb786d0fe3de4212d4aa7a81403ab10da3a48109686132813f323ec2234d98e [INFO] running `Command { std: "docker" "start" "-a" "4eb786d0fe3de4212d4aa7a81403ab10da3a48109686132813f323ec2234d98e", kill_on_drop: false }` [INFO] [stderr] Finished `test` profile [unoptimized + debuginfo] target(s) in 0.17s [INFO] [stderr] Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/tokenx_rs-33539050c9d80692) [INFO] [stdout] [INFO] [stdout] running 22 tests [INFO] [stdout] test estimator::tests::custom_options ... ok [INFO] [stdout] test estimator::tests::german_text ... ok [INFO] [stdout] test estimator::tests::english_sentence ... ok [INFO] [stdout] test estimator::tests::empty_string ... ok [INFO] [stdout] test estimator::tests::french_text ... ok [INFO] [stdout] test estimator::tests::mixed_content ... ok [INFO] [stdout] test estimator::tests::numeric_string ... ok [INFO] [stdout] test estimator::tests::pure_cjk ... ok [INFO] [stdout] test estimator::tests::pure_punctuation ... ok [INFO] [stdout] test estimator::tests::short_words ... ok [INFO] [stdout] test estimator::tests::underscore_identifiers ... ok [INFO] [stdout] test utils::tests::slice_empty ... ok [INFO] [stdout] test utils::tests::slice_full_range ... ok [INFO] [stdout] test utils::tests::slice_inverted_range ... ok [INFO] [stdout] test utils::tests::slice_negative_start ... ok [INFO] [stdout] test utils::tests::split_empty ... ok [INFO] [stdout] test utils::tests::split_with_overlap ... ok [INFO] [stdout] test utils::tests::split_basic ... ok [INFO] [stdout] test utils::tests::within_limit_basic ... ok [INFO] [stdout] test estimator::tests::pure_whitespace ... ok [INFO] [stdout] test utils::tests::split_zero_chunk_size ... ok [INFO] [stderr] Running tests/accuracy.rs (/opt/rustwide/target/debug/deps/accuracy-4490674dbcb2163c) [INFO] [stdout] test estimator::tests::default_chars_per_token_constant ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 22 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.13s [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] running 9 tests [INFO] [stdout] test chinese_text ... ok [INFO] [stdout] test code_snippet ... ok [INFO] [stdout] test japanese_text ... ok [INFO] [stdout] test pure_numbers ... ok [INFO] [stdout] test mixed_language_content ... ok [INFO] [stdout] test single_character ... ok [INFO] [stdout] test short_english_text ... ok [INFO] [stdout] test german_text_with_umlauts ... ok [INFO] [stderr] Running tests/proptest.rs (/opt/rustwide/target/debug/deps/proptest-baf4da0ea183d326) [INFO] [stdout] test empty_and_whitespace ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 9 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] running 7 tests [INFO] [stdout] test empty_input_returns_zero ... ok [INFO] [stdout] test never_panics_on_arbitrary_input ... ok [INFO] [stdout] test split_produces_nonempty_chunks ... ok [INFO] [stdout] test is_within_limit_consistent ... ok [INFO] [stdout] test split_by_tokens_covers_all_content ... ok [INFO] [stdout] test result_is_consistent ... ok [INFO] [stdout] test slice_by_tokens_subset ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 7 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.81s [INFO] [stdout] [INFO] [stderr] Doc-tests tokenx_rs [INFO] [stdout] [INFO] [stdout] running 6 tests [INFO] [stdout] test src/utils.rs - utils::split_by_tokens (line 110) ... ok [INFO] [stdout] test src/utils.rs - utils::is_within_token_limit (line 10) ... ok [INFO] [stdout] test src/estimator.rs - estimator::estimate_token_count (line 147) ... ok [INFO] [stdout] test src/estimator.rs - estimator::estimate_token_count_with_options (line 161) ... ok [INFO] [stdout] test src/utils.rs - utils::slice_by_tokens (line 40) ... ok [INFO] [stdout] test src/lib.rs - (line 11) ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 6 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.50s [INFO] [stdout] [INFO] running `Command { std: "docker" "inspect" "4eb786d0fe3de4212d4aa7a81403ab10da3a48109686132813f323ec2234d98e", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "4eb786d0fe3de4212d4aa7a81403ab10da3a48109686132813f323ec2234d98e", kill_on_drop: false }` [INFO] [stdout] 4eb786d0fe3de4212d4aa7a81403ab10da3a48109686132813f323ec2234d98e