[INFO] cloning repository https://github.com/gnp/minbpe-rs [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/gnp/minbpe-rs" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fgnp%2Fminbpe-rs", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fgnp%2Fminbpe-rs'... [INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }` [INFO] [stdout] b69dfa9f1cd16b25ffafb7cc384ce13acaec5689 [INFO] testing gnp/minbpe-rs against master#562dee4820c458d823175268e41601d4c060588a for pr-154210-1 [INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fgnp%2Fminbpe-rs" "/workspace/builds/worker-3-tc1/source", kill_on_drop: false }` [INFO] [stderr] Cloning into '/workspace/builds/worker-3-tc1/source'... [INFO] [stderr] done. [INFO] removed /workspace/builds/worker-3-tc1/source/.cargo/config.toml [INFO] started tweaking git repo https://github.com/gnp/minbpe-rs [INFO] removed 0 missing examples [INFO] finished tweaking git repo https://github.com/gnp/minbpe-rs [INFO] tweaked toml for git repo https://github.com/gnp/minbpe-rs written to /workspace/builds/worker-3-tc1/source/Cargo.toml [INFO] validating manifest of git repo https://github.com/gnp/minbpe-rs on toolchain 562dee4820c458d823175268e41601d4c060588a [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+562dee4820c458d823175268e41601d4c060588a" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }` [INFO] crate git repo https://github.com/gnp/minbpe-rs already has a lockfile, it will not be regenerated [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+562dee4820c458d823175268e41601d4c060588a" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] [stderr] Updating crates.io index [INFO] [stderr] Downloading crates ... [INFO] [stderr] Downloaded rusty-fork v0.3.0 [INFO] [stderr] Downloaded anyhow v1.0.81 [INFO] [stderr] Downloaded fancy-regex v0.12.0 [INFO] [stderr] Downloaded fancy-regex v0.13.0 [INFO] [stderr] Downloaded proptest v1.4.0 [INFO] [stderr] Downloaded syn v2.0.55 [INFO] [stderr] Downloaded tiktoken-rs v0.5.8 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+562dee4820c458d823175268e41601d4c060588a" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }` [INFO] [stdout] d0f651e311590228dfb901bb90b2396dfccdcc94a78a0747b8e57be99e243fd1 [INFO] running `Command { std: "docker" "start" "-a" "d0f651e311590228dfb901bb90b2396dfccdcc94a78a0747b8e57be99e243fd1", kill_on_drop: false }` [INFO] running `Command { std: "docker" "inspect" "d0f651e311590228dfb901bb90b2396dfccdcc94a78a0747b8e57be99e243fd1", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "d0f651e311590228dfb901bb90b2396dfccdcc94a78a0747b8e57be99e243fd1", kill_on_drop: false }` [INFO] [stdout] d0f651e311590228dfb901bb90b2396dfccdcc94a78a0747b8e57be99e243fd1 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+562dee4820c458d823175268e41601d4c060588a" "build" "--frozen" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] 45cfbcd0813a88c2b4f98d766b276b9bd6971ff83b247a642b708e77e65b69d1 [INFO] running `Command { std: "docker" "start" "-a" "45cfbcd0813a88c2b4f98d766b276b9bd6971ff83b247a642b708e77e65b69d1", kill_on_drop: false }` [INFO] [stderr] Compiling memchr v2.7.1 [INFO] [stderr] Compiling regex-syntax v0.8.2 [INFO] [stderr] Compiling bit-vec v0.6.3 [INFO] [stderr] Compiling hashbrown v0.14.3 [INFO] [stderr] Compiling equivalent v1.0.1 [INFO] [stderr] Compiling base64 v0.21.7 [INFO] [stderr] Compiling bit-set v0.5.3 [INFO] [stderr] Compiling aho-corasick v1.1.3 [INFO] [stderr] Compiling indexmap v2.2.6 [INFO] [stderr] Compiling regex-automata v0.4.6 [INFO] [stderr] Compiling fancy-regex v0.13.0 [INFO] [stderr] Compiling regex v1.10.4 [INFO] [stderr] Compiling minbpe v0.1.0 (/opt/rustwide/workdir) [INFO] [stderr] Finished `dev` profile [unoptimized + debuginfo] target(s) in 18.33s [INFO] running `Command { std: "docker" "inspect" "45cfbcd0813a88c2b4f98d766b276b9bd6971ff83b247a642b708e77e65b69d1", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "45cfbcd0813a88c2b4f98d766b276b9bd6971ff83b247a642b708e77e65b69d1", kill_on_drop: false }` [INFO] [stdout] 45cfbcd0813a88c2b4f98d766b276b9bd6971ff83b247a642b708e77e65b69d1 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+562dee4820c458d823175268e41601d4c060588a" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] 15a4c602667b2835fb13d289f975a955c64d5f4e78bc10c105d78991cfa7d394 [INFO] running `Command { std: "docker" "start" "-a" "15a4c602667b2835fb13d289f975a955c64d5f4e78bc10c105d78991cfa7d394", kill_on_drop: false }` [INFO] [stderr] Compiling libc v0.2.153 [INFO] [stderr] Compiling cfg-if v1.0.0 [INFO] [stderr] Compiling rustix v0.38.32 [INFO] [stderr] Compiling libm v0.2.8 [INFO] [stderr] Compiling autocfg v1.2.0 [INFO] [stderr] Compiling bit-vec v0.6.3 [INFO] [stderr] Compiling bitflags v2.5.0 [INFO] [stderr] Compiling linux-raw-sys v0.4.13 [INFO] [stderr] Compiling fastrand v2.0.2 [INFO] [stderr] Compiling bit-set v0.5.3 [INFO] [stderr] Compiling ppv-lite86 v0.2.17 [INFO] [stderr] Compiling fnv v1.0.7 [INFO] [stderr] Compiling quick-error v1.2.3 [INFO] [stderr] Compiling num-traits v0.2.18 [INFO] [stderr] Compiling fancy-regex v0.13.0 [INFO] [stderr] Compiling unarray v0.1.4 [INFO] [stderr] Compiling getrandom v0.2.13 [INFO] [stderr] Compiling wait-timeout v0.2.0 [INFO] [stderr] Compiling rand_core v0.6.4 [INFO] [stderr] Compiling minbpe v0.1.0 (/opt/rustwide/workdir) [INFO] [stderr] Compiling rand_chacha v0.3.1 [INFO] [stderr] Compiling rand_xorshift v0.3.0 [INFO] [stderr] Compiling rand v0.8.5 [INFO] [stderr] Compiling tempfile v3.10.1 [INFO] [stderr] Compiling rusty-fork v0.3.0 [INFO] [stderr] Compiling proptest v1.4.0 [INFO] [stderr] Finished `test` profile [unoptimized + debuginfo] target(s) in 19.40s [INFO] running `Command { std: "docker" "inspect" "15a4c602667b2835fb13d289f975a955c64d5f4e78bc10c105d78991cfa7d394", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "15a4c602667b2835fb13d289f975a955c64d5f4e78bc10c105d78991cfa7d394", kill_on_drop: false }` [INFO] [stdout] 15a4c602667b2835fb13d289f975a955c64d5f4e78bc10c105d78991cfa7d394 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+562dee4820c458d823175268e41601d4c060588a" "test" "--frozen", kill_on_drop: false }` [INFO] [stdout] 019b0388bf9bce482fd90ca203eb9b1b1e4e30207a43c7e792e9988c828414c5 [INFO] running `Command { std: "docker" "start" "-a" "019b0388bf9bce482fd90ca203eb9b1b1e4e30207a43c7e792e9988c828414c5", kill_on_drop: false }` [INFO] [stderr] Finished `test` profile [unoptimized + debuginfo] target(s) in 0.07s [INFO] [stderr] Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/minbpe-ab0ff45bfa08abc0) [INFO] [stdout] [INFO] [stdout] running 6 tests [INFO] [stdout] test base::tests::test_render_token ... ok [INFO] [stdout] test base::tests::test_indexmap_order ... ok [INFO] [stdout] test base::tests::test_replace_control_characters ... ok [INFO] [stdout] test regex::tests::test_pattern_matching ... ok [INFO] [stdout] test regex::tests::test_encode_special_panic - should panic ... ok [INFO] [stdout] test regex::tests::test_encode_special ... ok [INFO] [stderr] Running tests/tiktoken_compat.rs (/opt/rustwide/target/debug/deps/tiktoken_compat-c046ef518a824545) [INFO] [stdout] [INFO] [stderr] Running tests/tokenizer_tests.rs (/opt/rustwide/target/debug/deps/tokenizer_tests-ad5fc59328f22a9a) [INFO] [stdout] test result: ok. 6 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.23s [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] running 0 tests [INFO] [stdout] [INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] running 2 tests [INFO] [stdout] test tests::test_wikipedia_example ... ok [INFO] [stdout] test tests::test_save_load ... ok [INFO] [stderr] Running tests/tokenizer_tests_gpt4.rs (/opt/rustwide/target/debug/deps/tokenizer_tests_gpt4-5016b24491cf8553) [INFO] [stdout] [INFO] [stdout] test result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.53s [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] running 0 tests [INFO] [stdout] [INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s [INFO] [stderr] Doc-tests minbpe [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] running 10 tests [INFO] [stdout] test src/base.rs - base::render_token (line 403) ... ignored [INFO] [stdout] test src/base.rs - base::replace_control_characters (line 373) ... ignored [INFO] [stdout] test src/basic.rs - basic::BasicTokenizer (line 18) ... ok [INFO] [stdout] test src/base.rs - base::update_stats (line 264) ... ok [INFO] [stdout] test src/regex.rs - regex::AllowedSpecial (line 36) ... ok [INFO] [stdout] test src/base.rs - base::Saveable::save (line 60) ... ok [INFO] [stdout] test src/base.rs - base::merge (line 312) ... ok [INFO] [stdout] test src/base.rs - base::get_stats (line 248) ... ok [INFO] [stdout] test src/base.rs - base::Loadable::load (line 148) ... ok [INFO] [stdout] test src/regex.rs - regex::RegexTokenizerStruct (line 238) ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 8 passed; 0 failed; 2 ignored; 0 measured; 0 filtered out; finished in 1.83s [INFO] [stdout] [INFO] running `Command { std: "docker" "inspect" "019b0388bf9bce482fd90ca203eb9b1b1e4e30207a43c7e792e9988c828414c5", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "019b0388bf9bce482fd90ca203eb9b1b1e4e30207a43c7e792e9988c828414c5", kill_on_drop: false }` [INFO] [stdout] 019b0388bf9bce482fd90ca203eb9b1b1e4e30207a43c7e792e9988c828414c5