[INFO] updating cached repository mklf/bert_tokenizer [INFO] running `"git" "fetch" "--all"` [INFO] [stdout] Fetching origin [INFO] [stderr] From git://github.com/mklf/bert_tokenizer [INFO] [stderr] * branch HEAD -> FETCH_HEAD [INFO] running `"git" "clone" "work/cache/sources/gh/mklf/bert_tokenizer" "work/ex/pr-57967/sources/master#c1c3c4e95b69dfeaca5c5db6c622d7f90ad30a54/gh/mklf/bert_tokenizer"` [INFO] [stderr] Cloning into 'work/ex/pr-57967/sources/master#c1c3c4e95b69dfeaca5c5db6c622d7f90ad30a54/gh/mklf/bert_tokenizer'... [INFO] [stderr] done. [INFO] running `"git" "clone" "work/cache/sources/gh/mklf/bert_tokenizer" "work/ex/pr-57967/sources/try#7fea0229842e79db1159ea58ad9a653b288efee9/gh/mklf/bert_tokenizer"` [INFO] [stderr] Cloning into 'work/ex/pr-57967/sources/try#7fea0229842e79db1159ea58ad9a653b288efee9/gh/mklf/bert_tokenizer'... [INFO] [stderr] done. [INFO] running `"git" "rev-parse" "HEAD"` [INFO] [stdout] db07849c04e6fdf60405fcb0ee97a69acc0a8b85 [INFO] sha for GitHub repo mklf/bert_tokenizer: db07849c04e6fdf60405fcb0ee97a69acc0a8b85 [INFO] validating manifest of mklf/bert_tokenizer on toolchain master#c1c3c4e95b69dfeaca5c5db6c622d7f90ad30a54 [INFO] running `"/mnt/big/crater/work/local/cargo-home/bin/cargo" "+c1c3c4e95b69dfeaca5c5db6c622d7f90ad30a54-alt" "read-manifest" "--manifest-path" "Cargo.toml"` [INFO] validating manifest of mklf/bert_tokenizer on toolchain try#7fea0229842e79db1159ea58ad9a653b288efee9 [INFO] running `"/mnt/big/crater/work/local/cargo-home/bin/cargo" "+7fea0229842e79db1159ea58ad9a653b288efee9-alt" "read-manifest" "--manifest-path" "Cargo.toml"` [INFO] started frobbing mklf/bert_tokenizer [INFO] finished frobbing mklf/bert_tokenizer [INFO] frobbed toml for mklf/bert_tokenizer written to work/ex/pr-57967/sources/master#c1c3c4e95b69dfeaca5c5db6c622d7f90ad30a54/gh/mklf/bert_tokenizer/Cargo.toml [INFO] started frobbing mklf/bert_tokenizer [INFO] finished frobbing mklf/bert_tokenizer [INFO] frobbed toml for mklf/bert_tokenizer written to work/ex/pr-57967/sources/try#7fea0229842e79db1159ea58ad9a653b288efee9/gh/mklf/bert_tokenizer/Cargo.toml [INFO] crate mklf/bert_tokenizer has a lockfile. skipping [INFO] running `"/mnt/big/crater/work/local/cargo-home/bin/cargo" "+c1c3c4e95b69dfeaca5c5db6c622d7f90ad30a54-alt" "fetch" "--locked" "--manifest-path" "Cargo.toml"` [INFO] running `"/mnt/big/crater/work/local/cargo-home/bin/cargo" "+7fea0229842e79db1159ea58ad9a653b288efee9-alt" "fetch" "--locked" "--manifest-path" "Cargo.toml"` [INFO] testing mklf/bert_tokenizer against master#c1c3c4e95b69dfeaca5c5db6c622d7f90ad30a54 for pr-57967 [INFO] running `"docker" "create" "-v" "/mnt/big/crater/work/local/target-dirs/pr-57967/worker-2/master#c1c3c4e95b69dfeaca5c5db6c622d7f90ad30a54:/opt/crater/target:rw,Z" "-v" "/mnt/big/crater/work/ex/pr-57967/sources/master#c1c3c4e95b69dfeaca5c5db6c622d7f90ad30a54/gh/mklf/bert_tokenizer:/opt/crater/workdir:ro,Z" "-v" "/mnt/big/crater/work/local/cargo-home:/opt/crater/cargo-home:ro,Z" "-v" "/mnt/big/crater/work/local/rustup-home:/opt/crater/rustup-home:ro,Z" "-e" "USER_ID=1000" "-e" "SOURCE_DIR=/opt/crater/workdir" "-e" "MAP_USER_ID=1000" "-e" "CARGO_TARGET_DIR=/opt/crater/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/crater/cargo-home" "-e" "RUSTUP_HOME=/opt/crater/rustup-home" "-w" "/opt/crater/workdir" "-m" "1536M" "--network" "none" "rustops/crates-build-env" "/opt/crater/cargo-home/bin/cargo" "+c1c3c4e95b69dfeaca5c5db6c622d7f90ad30a54-alt" "build" "--frozen"` [INFO] [stdout] 3cf1c9f05a7cf66f455e42b96c2cb7a69d3f7f4f9849576cc109434974a72ab0 [INFO] running `"docker" "start" "-a" "3cf1c9f05a7cf66f455e42b96c2cb7a69d3f7f4f9849576cc109434974a72ab0"` [INFO] [stderr] Compiling unicode_categories v0.1.1 [INFO] [stderr] Compiling bert_tokenizer v0.1.0 (/opt/crater/workdir) [INFO] [stderr] Finished dev [unoptimized + debuginfo] target(s) in 2.29s [INFO] running `"docker" "inspect" "3cf1c9f05a7cf66f455e42b96c2cb7a69d3f7f4f9849576cc109434974a72ab0"` [INFO] running `"docker" "rm" "-f" "3cf1c9f05a7cf66f455e42b96c2cb7a69d3f7f4f9849576cc109434974a72ab0"` [INFO] [stdout] 3cf1c9f05a7cf66f455e42b96c2cb7a69d3f7f4f9849576cc109434974a72ab0 [INFO] running `"docker" "create" "-v" "/mnt/big/crater/work/local/target-dirs/pr-57967/worker-2/master#c1c3c4e95b69dfeaca5c5db6c622d7f90ad30a54:/opt/crater/target:rw,Z" "-v" "/mnt/big/crater/work/ex/pr-57967/sources/master#c1c3c4e95b69dfeaca5c5db6c622d7f90ad30a54/gh/mklf/bert_tokenizer:/opt/crater/workdir:ro,Z" "-v" "/mnt/big/crater/work/local/cargo-home:/opt/crater/cargo-home:ro,Z" "-v" "/mnt/big/crater/work/local/rustup-home:/opt/crater/rustup-home:ro,Z" "-e" "USER_ID=1000" "-e" "SOURCE_DIR=/opt/crater/workdir" "-e" "MAP_USER_ID=1000" "-e" "CARGO_TARGET_DIR=/opt/crater/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/crater/cargo-home" "-e" "RUSTUP_HOME=/opt/crater/rustup-home" "-w" "/opt/crater/workdir" "-m" "1536M" "--network" "none" "rustops/crates-build-env" "/opt/crater/cargo-home/bin/cargo" "+c1c3c4e95b69dfeaca5c5db6c622d7f90ad30a54-alt" "test" "--frozen" "--no-run"` [INFO] [stdout] a5e74650ede9691663d621defa84a87df7bdac567d5d815fffaa85aee6009bcd [INFO] running `"docker" "start" "-a" "a5e74650ede9691663d621defa84a87df7bdac567d5d815fffaa85aee6009bcd"` [INFO] [stderr] Compiling bert_tokenizer v0.1.0 (/opt/crater/workdir) [INFO] [stderr] Finished dev [unoptimized + debuginfo] target(s) in 3.07s [INFO] running `"docker" "inspect" "a5e74650ede9691663d621defa84a87df7bdac567d5d815fffaa85aee6009bcd"` [INFO] running `"docker" "rm" "-f" "a5e74650ede9691663d621defa84a87df7bdac567d5d815fffaa85aee6009bcd"` [INFO] [stdout] a5e74650ede9691663d621defa84a87df7bdac567d5d815fffaa85aee6009bcd [INFO] running `"docker" "create" "-v" "/mnt/big/crater/work/local/target-dirs/pr-57967/worker-2/master#c1c3c4e95b69dfeaca5c5db6c622d7f90ad30a54:/opt/crater/target:rw,Z" "-v" "/mnt/big/crater/work/ex/pr-57967/sources/master#c1c3c4e95b69dfeaca5c5db6c622d7f90ad30a54/gh/mklf/bert_tokenizer:/opt/crater/workdir:ro,Z" "-v" "/mnt/big/crater/work/local/cargo-home:/opt/crater/cargo-home:ro,Z" "-v" "/mnt/big/crater/work/local/rustup-home:/opt/crater/rustup-home:ro,Z" "-e" "USER_ID=1000" "-e" "SOURCE_DIR=/opt/crater/workdir" "-e" "MAP_USER_ID=1000" "-e" "CARGO_TARGET_DIR=/opt/crater/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/crater/cargo-home" "-e" "RUSTUP_HOME=/opt/crater/rustup-home" "-w" "/opt/crater/workdir" "-m" "1536M" "--network" "none" "rustops/crates-build-env" "/opt/crater/cargo-home/bin/cargo" "+c1c3c4e95b69dfeaca5c5db6c622d7f90ad30a54-alt" "test" "--frozen"` [INFO] [stdout] ddb7307a3cc902f4823ead375515f6c6fac88c12294e862d6a0cf2a7a73985c4 [INFO] running `"docker" "start" "-a" "ddb7307a3cc902f4823ead375515f6c6fac88c12294e862d6a0cf2a7a73985c4"` [INFO] [stderr] Finished dev [unoptimized + debuginfo] target(s) in 0.02s [INFO] [stderr] Running /opt/crater/target/debug/deps/bert_tokenizer-3fc4b7a67aa63f77 [INFO] [stdout] [INFO] [stdout] running 9 tests [INFO] [stdout] test tokenization::test::test_chinese ... ok [INFO] [stdout] test tokenization::test::test_basic_tokenizer_no_lower ... ok [INFO] [stdout] test tokenization::test::test_full_tokenizer ... ok [INFO] [stdout] test tokenization::test::test_is_control ... ok [INFO] [stdout] test tokenization::test::test_basic_tokenizer_lower ... ok [INFO] [stdout] test tokenization::test::test_is_punctuation ... ok [INFO] [stdout] test tokenization::test::test_wordpiece_tokenizer ... ok [INFO] [stdout] test tokenization::test::test_is_whitespace ... ok [INFO] [stdout] test tokenization::test::test_convert_tokens_to_ids ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 9 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out [INFO] [stdout] [INFO] running `"docker" "inspect" "ddb7307a3cc902f4823ead375515f6c6fac88c12294e862d6a0cf2a7a73985c4"` [INFO] running `"docker" "rm" "-f" "ddb7307a3cc902f4823ead375515f6c6fac88c12294e862d6a0cf2a7a73985c4"` [INFO] [stdout] ddb7307a3cc902f4823ead375515f6c6fac88c12294e862d6a0cf2a7a73985c4