[INFO] fetching crate minbpe 0.1.0... [INFO] testing minbpe-0.1.0 against master#562dee4820c458d823175268e41601d4c060588a for pr-154210-1 [INFO] extracting crate minbpe 0.1.0 into /workspace/builds/worker-6-tc1/source [INFO] started tweaking crates.io crate minbpe 0.1.0 [INFO] removed 0 missing examples [INFO] finished tweaking crates.io crate minbpe 0.1.0 [INFO] tweaked toml for crates.io crate minbpe 0.1.0 written to /workspace/builds/worker-6-tc1/source/Cargo.toml [INFO] validating manifest of crates.io crate minbpe 0.1.0 on toolchain 562dee4820c458d823175268e41601d4c060588a [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+562dee4820c458d823175268e41601d4c060588a" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }` [INFO] crate crates.io crate minbpe 0.1.0 already has a lockfile, it will not be regenerated [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+562dee4820c458d823175268e41601d4c060588a" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] [stderr] Downloading crates ... [INFO] [stderr] Downloaded autocfg v1.2.0 [INFO] [stderr] Downloaded serde_derive v1.0.197 [INFO] [stderr] Downloaded fastrand v2.0.2 [INFO] [stderr] Downloaded quote v1.0.35 [INFO] [stderr] Downloaded errno v0.3.8 [INFO] [stderr] Downloaded fancy-regex v0.12.0 [INFO] [stderr] Downloaded getrandom v0.2.13 [INFO] [stderr] Downloaded num-traits v0.2.18 [INFO] [stderr] Downloaded serde v1.0.197 [INFO] [stderr] Downloaded libm v0.2.8 [INFO] [stderr] Downloaded memchr v2.7.1 [INFO] [stderr] Downloaded rusty-fork v0.3.0 [INFO] [stderr] Downloaded anyhow v1.0.81 [INFO] [stderr] Downloaded proc-macro2 v1.0.79 [INFO] [stderr] Downloaded proptest v1.4.0 [INFO] [stderr] Downloaded windows-targets v0.52.4 [INFO] [stderr] Downloaded syn v2.0.55 [INFO] [stderr] Downloaded rustix v0.38.32 [INFO] [stderr] Downloaded bstr v1.9.1 [INFO] [stderr] Downloaded windows_aarch64_gnullvm v0.52.4 [INFO] [stderr] Downloaded windows_x86_64_gnullvm v0.52.4 [INFO] [stderr] Downloaded libc v0.2.153 [INFO] [stderr] Downloaded windows_x86_64_gnu v0.52.4 [INFO] [stderr] Downloaded windows_x86_64_msvc v0.52.4 [INFO] [stderr] Downloaded windows_aarch64_msvc v0.52.4 [INFO] [stderr] Downloaded windows_i686_gnu v0.52.4 [INFO] [stderr] Downloaded windows_i686_msvc v0.52.4 [INFO] [stderr] Downloaded linux-raw-sys v0.4.13 [INFO] [stderr] Downloaded tiktoken-rs v0.5.8 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+562dee4820c458d823175268e41601d4c060588a" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }` [INFO] [stdout] 6a5a4667a3c1591292e9893ed1e1b54c7ba57fab80e833cd01bfae85f1e758c7 [INFO] running `Command { std: "docker" "start" "-a" "6a5a4667a3c1591292e9893ed1e1b54c7ba57fab80e833cd01bfae85f1e758c7", kill_on_drop: false }` [INFO] running `Command { std: "docker" "inspect" "6a5a4667a3c1591292e9893ed1e1b54c7ba57fab80e833cd01bfae85f1e758c7", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "6a5a4667a3c1591292e9893ed1e1b54c7ba57fab80e833cd01bfae85f1e758c7", kill_on_drop: false }` [INFO] [stdout] 6a5a4667a3c1591292e9893ed1e1b54c7ba57fab80e833cd01bfae85f1e758c7 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+562dee4820c458d823175268e41601d4c060588a" "build" "--frozen" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] 91dde24dd1e19c9925f20d1743722ea5aa6d0231f49814a24c30b516898744f5 [INFO] running `Command { std: "docker" "start" "-a" "91dde24dd1e19c9925f20d1743722ea5aa6d0231f49814a24c30b516898744f5", kill_on_drop: false }` [INFO] [stderr] Compiling memchr v2.7.1 [INFO] [stderr] Compiling regex-syntax v0.8.2 [INFO] [stderr] Compiling bit-vec v0.6.3 [INFO] [stderr] Compiling equivalent v1.0.1 [INFO] [stderr] Compiling hashbrown v0.14.3 [INFO] [stderr] Compiling base64 v0.21.7 [INFO] [stderr] Compiling lazy_static v1.4.0 [INFO] [stderr] Compiling bit-set v0.5.3 [INFO] [stderr] Compiling aho-corasick v1.1.3 [INFO] [stderr] Compiling indexmap v2.2.6 [INFO] [stderr] Compiling regex-automata v0.4.6 [INFO] [stderr] Compiling regex v1.10.4 [INFO] [stderr] Compiling fancy-regex v0.13.0 [INFO] [stderr] Compiling minbpe v0.1.0 (/opt/rustwide/workdir) [INFO] [stderr] Finished `dev` profile [unoptimized + debuginfo] target(s) in 10.62s [INFO] running `Command { std: "docker" "inspect" "91dde24dd1e19c9925f20d1743722ea5aa6d0231f49814a24c30b516898744f5", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "91dde24dd1e19c9925f20d1743722ea5aa6d0231f49814a24c30b516898744f5", kill_on_drop: false }` [INFO] [stdout] 91dde24dd1e19c9925f20d1743722ea5aa6d0231f49814a24c30b516898744f5 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+562dee4820c458d823175268e41601d4c060588a" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] 7cc8f2f96cdd7d910d447de840906fd4ca356199f8ab74a73db76a19877b3b08 [INFO] running `Command { std: "docker" "start" "-a" "7cc8f2f96cdd7d910d447de840906fd4ca356199f8ab74a73db76a19877b3b08", kill_on_drop: false }` [INFO] [stderr] Compiling libc v0.2.153 [INFO] [stderr] Compiling cfg-if v1.0.0 [INFO] [stderr] Compiling rustix v0.38.32 [INFO] [stderr] Compiling bitflags v2.5.0 [INFO] [stderr] Compiling libm v0.2.8 [INFO] [stderr] Compiling autocfg v1.2.0 [INFO] [stderr] Compiling bit-vec v0.6.3 [INFO] [stderr] Compiling linux-raw-sys v0.4.13 [INFO] [stderr] Compiling fastrand v2.0.2 [INFO] [stderr] Compiling ppv-lite86 v0.2.17 [INFO] [stderr] Compiling quick-error v1.2.3 [INFO] [stderr] Compiling unarray v0.1.4 [INFO] [stderr] Compiling bit-set v0.5.3 [INFO] [stderr] Compiling fancy-regex v0.13.0 [INFO] [stderr] Compiling num-traits v0.2.18 [INFO] [stderr] Compiling minbpe v0.1.0 (/opt/rustwide/workdir) [INFO] [stderr] Compiling getrandom v0.2.13 [INFO] [stderr] Compiling wait-timeout v0.2.0 [INFO] [stderr] Compiling rand_core v0.6.4 [INFO] [stderr] Compiling rand_chacha v0.3.1 [INFO] [stderr] Compiling rand_xorshift v0.3.0 [INFO] [stderr] Compiling rand v0.8.5 [INFO] [stderr] Compiling tempfile v3.10.1 [INFO] [stderr] Compiling rusty-fork v0.3.0 [INFO] [stderr] Compiling proptest v1.4.0 [INFO] [stderr] Finished `test` profile [unoptimized + debuginfo] target(s) in 11.81s [INFO] running `Command { std: "docker" "inspect" "7cc8f2f96cdd7d910d447de840906fd4ca356199f8ab74a73db76a19877b3b08", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "7cc8f2f96cdd7d910d447de840906fd4ca356199f8ab74a73db76a19877b3b08", kill_on_drop: false }` [INFO] [stdout] 7cc8f2f96cdd7d910d447de840906fd4ca356199f8ab74a73db76a19877b3b08 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+562dee4820c458d823175268e41601d4c060588a" "test" "--frozen", kill_on_drop: false }` [INFO] [stdout] fb8965a46c39d1149d5ffc1873ea60cdf6852c0c59ffb9ed993de79c4de7623d [INFO] running `Command { std: "docker" "start" "-a" "fb8965a46c39d1149d5ffc1873ea60cdf6852c0c59ffb9ed993de79c4de7623d", kill_on_drop: false }` [INFO] [stderr] Finished `test` profile [unoptimized + debuginfo] target(s) in 0.08s [INFO] [stderr] Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/minbpe-ab0ff45bfa08abc0) [INFO] [stdout] [INFO] [stdout] running 6 tests [INFO] [stdout] test base::tests::test_indexmap_order ... ok [INFO] [stdout] test base::tests::test_render_token ... ok [INFO] [stdout] test base::tests::test_replace_control_characters ... ok [INFO] [stdout] test regex::tests::test_pattern_matching ... ok [INFO] [stdout] test regex::tests::test_encode_special ... ok [INFO] [stdout] test regex::tests::test_encode_special_panic - should panic ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 6 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.08s [INFO] [stdout] [INFO] [stderr] Running tests/tiktoken_compat.rs (/opt/rustwide/target/debug/deps/tiktoken_compat-c046ef518a824545) [INFO] [stdout] [INFO] [stdout] running 0 tests [INFO] [stdout] [INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s [INFO] [stdout] [INFO] [stderr] Running tests/tokenizer_tests.rs (/opt/rustwide/target/debug/deps/tokenizer_tests-ad5fc59328f22a9a) [INFO] [stdout] [INFO] [stdout] running 2 tests [INFO] [stdout] test tests::test_wikipedia_example ... ok [INFO] [stdout] test tests::test_save_load ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.45s [INFO] [stdout] [INFO] [stderr] Running tests/tokenizer_tests_gpt4.rs (/opt/rustwide/target/debug/deps/tokenizer_tests_gpt4-5016b24491cf8553) [INFO] [stdout] [INFO] [stdout] running 0 tests [INFO] [stdout] [INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s [INFO] [stdout] [INFO] [stderr] Doc-tests minbpe [INFO] [stdout] [INFO] [stdout] running 10 tests [INFO] [stdout] test src/base.rs - base::render_token (line 403) ... ignored [INFO] [stdout] test src/base.rs - base::replace_control_characters (line 373) ... ignored [INFO] [stdout] test src/basic.rs - basic::BasicTokenizer (line 18) ... ok [INFO] [stdout] test src/base.rs - base::Loadable::load (line 148) ... ok [INFO] [stdout] test src/base.rs - base::get_stats (line 248) ... ok [INFO] [stdout] test src/regex.rs - regex::AllowedSpecial (line 36) ... ok [INFO] [stdout] test src/base.rs - base::merge (line 312) ... ok [INFO] [stdout] test src/base.rs - base::update_stats (line 264) ... ok [INFO] [stdout] test src/base.rs - base::Saveable::save (line 60) ... ok [INFO] [stdout] test src/regex.rs - regex::RegexTokenizerStruct (line 238) ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 8 passed; 0 failed; 2 ignored; 0 measured; 0 filtered out; finished in 0.98s [INFO] [stdout] [INFO] running `Command { std: "docker" "inspect" "fb8965a46c39d1149d5ffc1873ea60cdf6852c0c59ffb9ed993de79c4de7623d", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "fb8965a46c39d1149d5ffc1873ea60cdf6852c0c59ffb9ed993de79c4de7623d", kill_on_drop: false }` [INFO] [stdout] fb8965a46c39d1149d5ffc1873ea60cdf6852c0c59ffb9ed993de79c4de7623d