[INFO] cloning repository https://github.com/qbit-ai/tokenx-rs [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/qbit-ai/tokenx-rs" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fqbit-ai%2Ftokenx-rs", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fqbit-ai%2Ftokenx-rs'... [INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }` [INFO] [stdout] ab74d4bb314c4693cdf76c05a7a6be8249649336 [INFO] testing qbit-ai/tokenx-rs against try#dec9417b8611e34e787a3e4c37686b5131f9e5c5 for pr-154210 [INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fqbit-ai%2Ftokenx-rs" "/workspace/builds/worker-1-tc2/source", kill_on_drop: false }` [INFO] [stderr] Cloning into '/workspace/builds/worker-1-tc2/source'... [INFO] [stderr] done. [INFO] started tweaking git repo https://github.com/qbit-ai/tokenx-rs [INFO] finished tweaking git repo https://github.com/qbit-ai/tokenx-rs [INFO] tweaked toml for git repo https://github.com/qbit-ai/tokenx-rs written to /workspace/builds/worker-1-tc2/source/Cargo.toml [INFO] validating manifest of git repo https://github.com/qbit-ai/tokenx-rs on toolchain dec9417b8611e34e787a3e4c37686b5131f9e5c5 [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+dec9417b8611e34e787a3e4c37686b5131f9e5c5" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }` [INFO] crate git repo https://github.com/qbit-ai/tokenx-rs already has a lockfile, it will not be regenerated [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+dec9417b8611e34e787a3e4c37686b5131f9e5c5" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] [stderr] Blocking waiting for file lock on package cache [INFO] [stderr] Blocking waiting for file lock on package cache [INFO] [stderr] Downloading crates ... [INFO] [stderr] Downloaded proptest v1.10.0 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+dec9417b8611e34e787a3e4c37686b5131f9e5c5" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }` [INFO] [stdout] 1ce6f8c21d61dfd16666407fe19c06c0bc507433bbf45b08f70d5bd2d38235a5 [INFO] running `Command { std: "docker" "start" "-a" "1ce6f8c21d61dfd16666407fe19c06c0bc507433bbf45b08f70d5bd2d38235a5", kill_on_drop: false }` [INFO] running `Command { std: "docker" "inspect" "1ce6f8c21d61dfd16666407fe19c06c0bc507433bbf45b08f70d5bd2d38235a5", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "1ce6f8c21d61dfd16666407fe19c06c0bc507433bbf45b08f70d5bd2d38235a5", kill_on_drop: false }` [INFO] [stdout] 1ce6f8c21d61dfd16666407fe19c06c0bc507433bbf45b08f70d5bd2d38235a5 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+dec9417b8611e34e787a3e4c37686b5131f9e5c5" "build" "--frozen" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] 2702194097c32af6c4a00a0dfe7610104cb43f52ff74ece19634a9fc6b4cd2c4 [INFO] running `Command { std: "docker" "start" "-a" "2702194097c32af6c4a00a0dfe7610104cb43f52ff74ece19634a9fc6b4cd2c4", kill_on_drop: false }` [INFO] [stderr] Compiling tokenx-rs v0.1.0 (/opt/rustwide/workdir) [INFO] [stderr] Finished `dev` profile [unoptimized + debuginfo] target(s) in 0.27s [INFO] running `Command { std: "docker" "inspect" "2702194097c32af6c4a00a0dfe7610104cb43f52ff74ece19634a9fc6b4cd2c4", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "2702194097c32af6c4a00a0dfe7610104cb43f52ff74ece19634a9fc6b4cd2c4", kill_on_drop: false }` [INFO] [stdout] 2702194097c32af6c4a00a0dfe7610104cb43f52ff74ece19634a9fc6b4cd2c4 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+dec9417b8611e34e787a3e4c37686b5131f9e5c5" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] 74daaae6cca1f9238b0e3773eca3b7c9d2e20c96fe15d0fb7163fcdbc39b1ced [INFO] running `Command { std: "docker" "start" "-a" "74daaae6cca1f9238b0e3773eca3b7c9d2e20c96fe15d0fb7163fcdbc39b1ced", kill_on_drop: false }` [INFO] [stderr] Compiling zerocopy v0.8.39 [INFO] [stderr] Compiling zmij v1.0.19 [INFO] [stderr] Compiling rustix v1.1.3 [INFO] [stderr] Compiling regex-syntax v0.8.9 [INFO] [stderr] Compiling plotters-backend v0.3.7 [INFO] [stderr] Compiling syn v2.0.114 [INFO] [stderr] Compiling getrandom v0.3.4 [INFO] [stderr] Compiling wait-timeout v0.2.1 [INFO] [stderr] Compiling itertools v0.10.5 [INFO] [stderr] Compiling clap_builder v4.5.57 [INFO] [stderr] Compiling is-terminal v0.4.17 [INFO] [stderr] Compiling oorandom v11.1.5 [INFO] [stderr] Compiling anes v0.1.6 [INFO] [stderr] Compiling unarray v0.1.4 [INFO] [stderr] Compiling rayon v1.11.0 [INFO] [stderr] Compiling rand_core v0.9.5 [INFO] [stderr] Compiling rand_xorshift v0.4.0 [INFO] [stderr] Compiling rand v0.9.2 [INFO] [stderr] Compiling plotters-svg v0.3.7 [INFO] [stderr] Compiling serde_json v1.0.149 [INFO] [stderr] Compiling plotters v0.3.7 [INFO] [stderr] Compiling criterion-plot v0.5.0 [INFO] [stderr] Compiling tempfile v3.24.0 [INFO] [stderr] Compiling clap v4.5.57 [INFO] [stderr] Compiling rusty-fork v0.3.1 [INFO] [stderr] Compiling regex-automata v0.4.14 [INFO] [stderr] Compiling zerocopy-derive v0.8.39 [INFO] [stderr] Compiling serde_derive v1.0.228 [INFO] [stderr] Compiling regex v1.12.3 [INFO] [stderr] Compiling serde v1.0.228 [INFO] [stderr] Compiling tinytemplate v1.2.1 [INFO] [stderr] Compiling half v2.7.1 [INFO] [stderr] Compiling ppv-lite86 v0.2.21 [INFO] [stderr] Compiling ciborium-ll v0.2.2 [INFO] [stderr] Compiling rand_chacha v0.9.0 [INFO] [stderr] Compiling ciborium v0.2.2 [INFO] [stderr] Compiling proptest v1.10.0 [INFO] [stderr] Compiling criterion v0.5.1 [INFO] [stderr] Compiling tokenx-rs v0.1.0 (/opt/rustwide/workdir) [INFO] [stderr] Finished `test` profile [unoptimized + debuginfo] target(s) in 27.47s [INFO] running `Command { std: "docker" "inspect" "74daaae6cca1f9238b0e3773eca3b7c9d2e20c96fe15d0fb7163fcdbc39b1ced", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "74daaae6cca1f9238b0e3773eca3b7c9d2e20c96fe15d0fb7163fcdbc39b1ced", kill_on_drop: false }` [INFO] [stdout] 74daaae6cca1f9238b0e3773eca3b7c9d2e20c96fe15d0fb7163fcdbc39b1ced [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-1-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+dec9417b8611e34e787a3e4c37686b5131f9e5c5" "test" "--frozen", kill_on_drop: false }` [INFO] [stdout] d6821bd3dae410243e07a291dcd337159ee847f8a334cda429b97b90de736d85 [INFO] running `Command { std: "docker" "start" "-a" "d6821bd3dae410243e07a291dcd337159ee847f8a334cda429b97b90de736d85", kill_on_drop: false }` [INFO] [stderr] Finished `test` profile [unoptimized + debuginfo] target(s) in 0.12s [INFO] [stderr] Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/tokenx_rs-33539050c9d80692) [INFO] [stdout] [INFO] [stdout] running 22 tests [INFO] [stdout] test estimator::tests::german_text ... ok [INFO] [stdout] test estimator::tests::default_chars_per_token_constant ... ok [INFO] [stdout] test estimator::tests::french_text ... ok [INFO] [stdout] test estimator::tests::english_sentence ... ok [INFO] [stdout] test estimator::tests::empty_string ... ok [INFO] [stdout] test estimator::tests::custom_options ... ok [INFO] [stdout] test estimator::tests::mixed_content ... ok [INFO] [stdout] test estimator::tests::numeric_string ... ok [INFO] [stdout] test estimator::tests::pure_cjk ... ok [INFO] [stdout] test estimator::tests::pure_punctuation ... ok [INFO] [stdout] test estimator::tests::pure_whitespace ... ok [INFO] [stdout] test estimator::tests::underscore_identifiers ... ok [INFO] [stdout] test utils::tests::slice_full_range ... ok [INFO] [stdout] test utils::tests::slice_inverted_range ... ok [INFO] [stdout] test utils::tests::slice_negative_start ... ok [INFO] [stdout] test utils::tests::split_basic ... ok [INFO] [stdout] test utils::tests::split_empty ... ok [INFO] [stdout] test utils::tests::split_zero_chunk_size ... ok [INFO] [stdout] test utils::tests::split_with_overlap ... ok [INFO] [stdout] test utils::tests::within_limit_basic ... ok [INFO] [stdout] test utils::tests::slice_empty ... ok [INFO] [stdout] test estimator::tests::short_words ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 22 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s [INFO] [stdout] [INFO] [stderr] Running tests/accuracy.rs (/opt/rustwide/target/debug/deps/accuracy-4490674dbcb2163c) [INFO] [stdout] [INFO] [stdout] running 9 tests [INFO] [stdout] test chinese_text ... ok [INFO] [stdout] test code_snippet ... ok [INFO] [stdout] test german_text_with_umlauts ... ok [INFO] [stdout] test empty_and_whitespace ... ok [INFO] [stdout] test japanese_text ... ok [INFO] [stdout] test mixed_language_content ... ok [INFO] [stdout] test pure_numbers ... ok [INFO] [stdout] test short_english_text ... ok [INFO] [stdout] test single_character ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 9 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s [INFO] [stdout] [INFO] [stderr] Running tests/proptest.rs (/opt/rustwide/target/debug/deps/proptest-baf4da0ea183d326) [INFO] [stdout] [INFO] [stdout] running 7 tests [INFO] [stdout] test never_panics_on_arbitrary_input ... ok [INFO] [stdout] test empty_input_returns_zero ... ok [INFO] [stdout] test split_produces_nonempty_chunks ... ok [INFO] [stdout] test is_within_limit_consistent ... ok [INFO] [stdout] test split_by_tokens_covers_all_content ... ok [INFO] [stdout] test slice_by_tokens_subset ... ok [INFO] [stdout] test result_is_consistent ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 7 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.25s [INFO] [stdout] [INFO] [stderr] Doc-tests tokenx_rs [INFO] [stdout] [INFO] [stdout] running 6 tests [INFO] [stdout] test src/utils.rs - utils::slice_by_tokens (line 40) ... ok [INFO] [stdout] test src/estimator.rs - estimator::estimate_token_count_with_options (line 161) ... ok [INFO] [stdout] test src/utils.rs - utils::split_by_tokens (line 110) ... ok [INFO] [stdout] test src/utils.rs - utils::is_within_token_limit (line 10) ... ok [INFO] [stdout] test src/estimator.rs - estimator::estimate_token_count (line 147) ... ok [INFO] [stdout] test src/lib.rs - (line 11) ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 6 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.15s [INFO] [stdout] [INFO] running `Command { std: "docker" "inspect" "d6821bd3dae410243e07a291dcd337159ee847f8a334cda429b97b90de736d85", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "d6821bd3dae410243e07a291dcd337159ee847f8a334cda429b97b90de736d85", kill_on_drop: false }` [INFO] [stdout] d6821bd3dae410243e07a291dcd337159ee847f8a334cda429b97b90de736d85