[INFO] fetching crate tokenizers 0.15.0...
[INFO] testing tokenizers-0.15.0 against 1.76.0 for beta-1.77-1
[INFO] extracting crate tokenizers 0.15.0 into /workspace/builds/worker-7-tc1/source
[INFO] validating manifest of crates.io crate tokenizers 0.15.0 on toolchain 1.76.0
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.76.0" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] started tweaking crates.io crate tokenizers 0.15.0
[INFO] finished tweaking crates.io crate tokenizers 0.15.0
[INFO] tweaked toml for crates.io crate tokenizers 0.15.0 written to /workspace/builds/worker-7-tc1/source/Cargo.toml
[INFO] crate crates.io crate tokenizers 0.15.0 already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.76.0" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] [stderr]     Updating crates.io index
[INFO] [stderr]  Downloading crates ...
[INFO] [stderr]   Downloaded monostate-impl v0.1.9
[INFO] [stderr]   Downloaded macro_rules_attribute v0.2.0
[INFO] [stderr]   Downloaded monostate v0.1.9
[INFO] [stderr]   Downloaded rayon-cond v0.3.0
[INFO] [stderr]   Downloaded macro_rules_attribute-proc_macro v0.2.0
[INFO] [stderr]   Downloaded hf-hub v0.3.2
[INFO] [stderr]   Downloaded esaxx-rs v0.1.10
[INFO] [stderr]   Downloaded spm_precompiled v0.1.4
[INFO] [stderr]   Downloaded rustix v0.38.23
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:2788e3201cd34a07e3172128adcd8b3090168a8e3bcc40d7c032b9dda1df7d1c" "/opt/rustwide/cargo-home/bin/cargo" "+1.76.0" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] [stdout] dd4198dba549de4959391d23c778f468226b27113bd5bdd568a345485482de81
[INFO] running `Command { std: "docker" "start" "-a" "dd4198dba549de4959391d23c778f468226b27113bd5bdd568a345485482de81", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "dd4198dba549de4959391d23c778f468226b27113bd5bdd568a345485482de81", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "dd4198dba549de4959391d23c778f468226b27113bd5bdd568a345485482de81", kill_on_drop: false }`
[INFO] [stdout] dd4198dba549de4959391d23c778f468226b27113bd5bdd568a345485482de81
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:2788e3201cd34a07e3172128adcd8b3090168a8e3bcc40d7c032b9dda1df7d1c" "/opt/rustwide/cargo-home/bin/cargo" "+1.76.0" "build" "--frozen" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] 4e0729657e7c84f142ccc4839ac174b22e5904a892c97e4ff2cff0447547d345
[INFO] running `Command { std: "docker" "start" "-a" "4e0729657e7c84f142ccc4839ac174b22e5904a892c97e4ff2cff0447547d345", kill_on_drop: false }`
[INFO] [stderr]    Compiling proc-macro2 v1.0.69
[INFO] [stderr]    Compiling libc v0.2.150
[INFO] [stderr]    Compiling strsim v0.10.0
[INFO] [stderr]    Compiling syn v1.0.109
[INFO] [stderr]    Compiling crossbeam-utils v0.8.16
[INFO] [stderr]    Compiling memoffset v0.9.0
[INFO] [stderr]    Compiling crossbeam-epoch v0.9.15
[INFO] [stderr]    Compiling fnv v1.0.7
[INFO] [stderr]    Compiling ident_case v1.0.1
[INFO] [stderr]    Compiling serde v1.0.192
[INFO] [stderr]    Compiling memchr v2.6.4
[INFO] [stderr]    Compiling rayon-core v1.12.0
[INFO] [stderr]    Compiling utf8parse v0.2.1
[INFO] [stderr]    Compiling pkg-config v0.3.27
[INFO] [stderr]    Compiling anstyle-parse v0.2.2
[INFO] [stderr]    Compiling anstyle v1.0.4
[INFO] [stderr]    Compiling portable-atomic v1.5.1
[INFO] [stderr]    Compiling anstyle-query v1.0.0
[INFO] [stderr]    Compiling colorchoice v1.0.0
[INFO] [stderr]    Compiling quote v1.0.33
[INFO] [stderr]    Compiling crossbeam-deque v0.8.3
[INFO] [stderr]    Compiling either v1.9.0
[INFO] [stderr]    Compiling syn v2.0.39
[INFO] [stderr]    Compiling paste v1.0.14
[INFO] [stderr]    Compiling aho-corasick v1.1.2
[INFO] [stderr]    Compiling anstream v0.6.4
[INFO] [stderr]    Compiling serde_json v1.0.108
[INFO] [stderr]    Compiling heck v0.4.1
[INFO] [stderr]    Compiling clap_lex v0.6.0
[INFO] [stderr]    Compiling unicode-width v0.1.11
[INFO] [stderr]    Compiling minimal-lexical v0.2.1
[INFO] [stderr]    Compiling cc v1.0.83
[INFO] [stderr]    Compiling getrandom v0.2.11
[INFO] [stderr]    Compiling regex-syntax v0.8.2
[INFO] [stderr]    Compiling rand_core v0.6.4
[INFO] [stderr]    Compiling thiserror v1.0.50
[INFO] [stderr]    Compiling rand_chacha v0.3.1
[INFO] [stderr]    Compiling console v0.15.7
[INFO] [stderr]    Compiling nom v7.1.3
[INFO] [stderr]    Compiling clap_builder v4.4.8
[INFO] [stderr]    Compiling onig_sys v69.8.1
[INFO] [stderr]    Compiling esaxx-rs v0.1.10
[INFO] [stderr]    Compiling darling_core v0.14.4
[INFO] [stderr]    Compiling regex-automata v0.4.3
[INFO] [stderr]    Compiling rayon v1.8.0
[INFO] [stderr]    Compiling serde_derive v1.0.192
[INFO] [stderr]    Compiling thiserror-impl v1.0.50
[INFO] [stderr]    Compiling monostate-impl v0.1.9
[INFO] [stderr]    Compiling darling_macro v0.14.4
[INFO] [stderr]    Compiling clap_derive v4.4.7
[INFO] [stderr]    Compiling darling v0.14.4
[INFO] [stderr]    Compiling derive_builder_core v0.12.0
[INFO] [stderr]    Compiling itertools v0.11.0
[INFO] [stderr]    Compiling number_prefix v0.4.0
[INFO] [stderr]    Compiling bitflags v1.3.2
[INFO] [stderr]    Compiling smallvec v1.11.2
[INFO] [stderr]    Compiling once_cell v1.18.0
[INFO] [stderr]    Compiling macro_rules_attribute-proc_macro v0.2.0
[INFO] [stderr]    Compiling ryu v1.0.15
[INFO] [stderr]    Compiling itoa v1.0.9
[INFO] [stderr]    Compiling unicode-segmentation v1.10.1
[INFO] [stderr]    Compiling unicode-normalization-alignments v0.1.12
[INFO] [stderr]    Compiling derive_builder_macro v0.12.0
[INFO] [stderr]    Compiling rayon-cond v0.3.0
[INFO] [stderr]    Compiling onig v6.4.0
[INFO] [stderr]    Compiling macro_rules_attribute v0.2.0
[INFO] [stderr]    Compiling indicatif v0.17.7
[INFO] [stderr]    Compiling regex v1.10.2
[INFO] [stderr]    Compiling clap v4.4.8
[INFO] [stderr]    Compiling rand v0.8.5
[INFO] [stderr]    Compiling derive_builder v0.12.0
[INFO] [stderr]    Compiling regex-syntax v0.7.5
[INFO] [stderr]    Compiling unicode_categories v0.1.1
[INFO] [stderr]    Compiling monostate v0.1.9
[INFO] [stderr]    Compiling spm_precompiled v0.1.4
[INFO] [stderr]    Compiling tokenizers v0.15.0 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished dev [unoptimized + debuginfo] target(s) in 21.43s
[INFO] running `Command { std: "docker" "inspect" "4e0729657e7c84f142ccc4839ac174b22e5904a892c97e4ff2cff0447547d345", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "4e0729657e7c84f142ccc4839ac174b22e5904a892c97e4ff2cff0447547d345", kill_on_drop: false }`
[INFO] [stdout] 4e0729657e7c84f142ccc4839ac174b22e5904a892c97e4ff2cff0447547d345
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:2788e3201cd34a07e3172128adcd8b3090168a8e3bcc40d7c032b9dda1df7d1c" "/opt/rustwide/cargo-home/bin/cargo" "+1.76.0" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] 2230edb2f625773e0bc9801897ec075725efc673ee1a726d09f55912775f9856
[INFO] running `Command { std: "docker" "start" "-a" "2230edb2f625773e0bc9801897ec075725efc673ee1a726d09f55912775f9856", kill_on_drop: false }`
[INFO] [stderr]    Compiling rustix v0.38.23
[INFO] [stderr]    Compiling num-traits v0.2.17
[INFO] [stderr]    Compiling linux-raw-sys v0.4.11
[INFO] [stderr]    Compiling bitflags v2.4.1
[INFO] [stderr]    Compiling half v1.8.2
[INFO] [stderr]    Compiling plotters-backend v0.3.5
[INFO] [stderr]    Compiling ciborium-io v0.2.1
[INFO] [stderr]    Compiling itertools v0.10.5
[INFO] [stderr]    Compiling cast v0.3.0
[INFO] [stderr]    Compiling plotters-svg v0.3.5
[INFO] [stderr]    Compiling ciborium-ll v0.2.1
[INFO] [stderr]    Compiling same-file v1.0.6
[INFO] [stderr]    Compiling tinytemplate v1.2.1
[INFO] [stderr]    Compiling walkdir v2.4.0
[INFO] [stderr]    Compiling ciborium v0.2.1
[INFO] [stderr]    Compiling anes v0.1.6
[INFO] [stderr]    Compiling oorandom v11.1.3
[INFO] [stderr]    Compiling fastrand v2.0.1
[INFO] [stderr]    Compiling assert_approx_eq v1.1.0
[INFO] [stderr]    Compiling criterion-plot v0.5.0
[INFO] [stderr]    Compiling plotters v0.3.5
[INFO] [stderr]    Compiling is-terminal v0.4.9
[INFO] [stderr]    Compiling tempfile v3.8.1
[INFO] [stderr]    Compiling criterion v0.5.1
[INFO] [stderr]    Compiling tokenizers v0.15.0 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished test [unoptimized + debuginfo] target(s) in 23.54s
[INFO] running `Command { std: "docker" "inspect" "2230edb2f625773e0bc9801897ec075725efc673ee1a726d09f55912775f9856", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "2230edb2f625773e0bc9801897ec075725efc673ee1a726d09f55912775f9856", kill_on_drop: false }`
[INFO] [stdout] 2230edb2f625773e0bc9801897ec075725efc673ee1a726d09f55912775f9856
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:2788e3201cd34a07e3172128adcd8b3090168a8e3bcc40d7c032b9dda1df7d1c" "/opt/rustwide/cargo-home/bin/cargo" "+1.76.0" "test" "--frozen", kill_on_drop: false }`
[INFO] [stdout] b83480b98bc4c34a5f405715142ee6b25b26ddff401ea7e4918bf07a10bda62a
[INFO] running `Command { std: "docker" "start" "-a" "b83480b98bc4c34a5f405715142ee6b25b26ddff401ea7e4918bf07a10bda62a", kill_on_drop: false }`
[INFO] [stderr]     Finished test [unoptimized + debuginfo] target(s) in 0.13s
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/tokenizers-cb3c4ea6110b246d)
[INFO] [stdout] 
[INFO] [stdout] running 174 tests
[INFO] [stdout] test decoders::byte_fallback::tests::decode ... ok
[INFO] [stdout] test decoders::fuse::tests::decode ... ok
[INFO] [stdout] test decoders::tests::decoder_serialization_no_decode ... ok
[INFO] [stdout] test decoders::tests::decoder_serialization_other_no_arg ... ok
[INFO] [stdout] test decoders::wordpiece::tests::wordpiece_decoder ... ok
[INFO] [stdout] test models::bpe::model::tests::test_bpe_byte_fallback ... ok
[INFO] [stdout] test models::bpe::model::tests::test_bpe_byte_fallback_newline ... ok
[INFO] [stdout] test decoders::tests::decoder_serialization ... ok
[INFO] [stdout] test models::bpe::model::tests::test_bpe_from_file_bad_merges ... ok
[INFO] [stdout] test decoders::strip::tests::decode ... ok
[INFO] [stdout] test decoders::ctc::tests::handmade_with_delimiter_sample ... ok
[INFO] [stdout] test decoders::sequence::tests::sequence_basic ... ok
[INFO] [stdout] test decoders::ctc::tests::another_librispeech_sample ... ok
[INFO] [stdout] test decoders::ctc::tests::handmade_sample ... ok
[INFO] [stdout] test decoders::ctc::tests::librispeech_sample ... ok
[INFO] [stdout] test models::bpe::model::tests::test_bpe_with_continuing_subword_prefix ... ok
[INFO] [stdout] test models::bpe::model::tests::test_tokenize_with_and_without_dropout ... ok
[INFO] [stdout] test models::bpe::model::tests::test_bpe_from_file ... ok
[INFO] [stdout] test models::bpe::model::tests::test_bpe_from_file_merge_token_oov ... ok
[INFO] [stdout] test models::bpe::model::tests::test_ordered_vocab_iter ... ok
[INFO] [stdout] test models::bpe::model::tests::test_unk_get_fused ... ok
[INFO] [stdout] test models::bpe::model::tests::test_unk_not_fused ... ok
[INFO] [stdout] test models::bpe::word::tests::test_merge ... ok
[INFO] [stdout] test models::tests::incomplete_ordered_vocab ... ok
[INFO] [stdout] test models::bpe::word::tests::test_merge_max_length ... ok
[INFO] [stdout] test models::unigram::lattice::tests::insert_test ... ok
[INFO] [stdout] test models::unigram::lattice::tests::set_sentence ... ok
[INFO] [stdout] test models::tests::trainer_wrapper_train_model_wrapper ... ok
[INFO] [stdout] test models::unigram::lattice::tests::test_log_sum_exp ... ok
[INFO] [stdout] test models::unigram::lattice::tests::test_nbest ... ok
[INFO] [stdout] test models::unigram::lattice::tests::test_viterbi ... ok
[INFO] [stdout] test models::unigram::lattice::tests::test_populate ... ok
[INFO] [stdout] test models::unigram::lattice::tests::test_viterbi2 ... ok
[INFO] [stdout] test models::unigram::model::tests::test_encode ... ok
[INFO] [stdout] test models::unigram::model::tests::test_populate_nodes ... ok
[INFO] [stdout] test models::unigram::model::tests::test_populate_nodes_unk ... ok
[INFO] [stdout] test models::unigram::model::tests::test_unigram_bytefallback ... ok
[INFO] [stdout] test models::unigram::serialization::test::test_serialization ... ok
[INFO] [stdout] test models::unigram::trainer::tests::test_initial_alphabet ... ok
[INFO] [stdout] test models::unigram::trainer::tests::test_to_log_prob ... ok
[INFO] [stdout] test models::unigram::serialization::test::test_serialization_no_unk_id ... ok
[INFO] [stdout] test models::bpe::trainer::tests::test_train ... ok
[INFO] [stdout] test models::bpe::trainer::tests::bpe_test_max_token_length_direct_assert ... ok
[INFO] [stdout] test models::wordlevel::serialization::tests::deserialization_should_fail ... ok
[INFO] [stdout] test models::unigram::serialization::test::test_serialization_unk_id_not_zero ... ok
[INFO] [stdout] test models::wordlevel::serialization::tests::incomplete_vocab ... ok
[INFO] [stdout] test models::wordlevel::serialization::tests::serde ... ok
[INFO] [stdout] test models::unigram::model::tests::test_encode2 ... ok
[INFO] [stdout] test models::wordlevel::tests::test_tokenize_unk ... ok
[INFO] [stdout] test models::wordlevel::trainer::tests::test_train ... ok
[INFO] [stdout] test models::wordlevel::tests::test_tokenize_missing_unk_token ... ok
[INFO] [stdout] test models::wordpiece::serialization::tests::deserialization_should_fail ... ok
[INFO] [stdout] test models::wordpiece::tests::test_error_display ... ok
[INFO] [stdout] test normalizers::precompiled::tests::expansion_followed_by_removal ... ok
[INFO] [stdout] test normalizers::replace::tests::serialization ... ok
[INFO] [stdout] test normalizers::prepend::tests::test_prepend ... ok
[INFO] [stdout] test normalizers::replace::tests::test_replace ... ok
[INFO] [stdout] test normalizers::replace::tests::test_replace_decode ... ok
[INFO] [stdout] test normalizers::strip::tests::test_strip_accents ... ok
[INFO] [stdout] test normalizers::strip::tests::test_strip_accents_multiple ... ok
[INFO] [stdout] test normalizers::replace::tests::test_replace_regex ... ok
[INFO] [stdout] test models::wordpiece::serialization::tests::serde ... ok
[INFO] [stdout] test pre_tokenizers::bert::tests::basic ... ok
[INFO] [stdout] test normalizers::strip::tests::test_vietnamese_bug ... ok
[INFO] [stdout] test normalizers::strip::tests::test_thai_bug ... ok
[INFO] [stdout] test pre_tokenizers::bert::tests::chinese_chars ... ok
[INFO] [stdout] test pre_tokenizers::byte_level::tests::decode_unknown_characters ... ok
[INFO] [stdout] test normalizers::unicode::tests::test_nfkc ... ok
[INFO] [stdout] test models::unigram::trainer::tests::test_unigram_chars ... ok
[INFO] [stdout] test pre_tokenizers::byte_level::tests::decoding ... ok
[INFO] [stdout] test pre_tokenizers::byte_level::tests::deserialization ... ok
[INFO] [stdout] test pre_tokenizers::byte_level::tests::add_prefix_space ... ok
[INFO] [stdout] test pre_tokenizers::byte_level::tests::handling_of_multiple_whitespaces ... ok
[INFO] [stdout] test pre_tokenizers::byte_level::tests::pre_tokenization_no_regex ... ok
[INFO] [stdout] test pre_tokenizers::byte_level::tests::handling_of_newlines ... ok
[INFO] [stdout] test pre_tokenizers::byte_level::tests::processor_trims_offsets ... ok
[INFO] [stdout] test pre_tokenizers::byte_level::tests::offsets_when_char_split_up ... ok
[INFO] [stdout] test pre_tokenizers::byte_level::tests::processor_trims_offsets_pre_tokenized ... ok
[INFO] [stdout] test pre_tokenizers::byte_level::tests::pre_tokenization ... ok
[INFO] [stdout] test pre_tokenizers::digits::tests::individual_digits ... ok
[INFO] [stdout] test pre_tokenizers::metaspace::tests::multiple_spaces ... ok
[INFO] [stdout] test pre_tokenizers::metaspace::tests::basic ... ok
[INFO] [stdout] test pre_tokenizers::byte_level::tests::decode_works_on_separated_tokens ... ok
[INFO] [stdout] test pre_tokenizers::punctuation::tests::deserialization ... ok
[INFO] [stdout] test pre_tokenizers::metaspace::tests::serialization ... ok
[INFO] [stdout] test models::unigram::trainer::tests::test_special_tokens ... ok
[INFO] [stdout] test pre_tokenizers::metaspace::tests::non_legacy_meta_space ... ok
[INFO] [stdout] test pre_tokenizers::digits::tests::numbers ... ok
[INFO] [stdout] test pre_tokenizers::split::tests::basic ... ok
[INFO] [stdout] test pre_tokenizers::split::tests::invert ... ok
[INFO] [stdout] test pre_tokenizers::split::tests::regex_string ... ok
[INFO] [stdout] test pre_tokenizers::split::tests::serialization ... ok
[INFO] [stdout] test pre_tokenizers::tests::test_deserialize_whitespace_split ... ok
[INFO] [stdout] test pre_tokenizers::punctuation::tests::punctuation_basic ... ok
[INFO] [stdout] test pre_tokenizers::unicode_scripts::pre_tokenizer::tests::basic ... ok
[INFO] [stdout] test pre_tokenizers::metaspace::tests::decode ... ok
[INFO] [stdout] test models::bpe::trainer::tests::bpe_test_max_token_length_16 ... ok
[INFO] [stdout] test pre_tokenizers::sequence::tests::sequence_basic ... ok
[INFO] [stdout] test pre_tokenizers::tests::test_deserialize ... ok
[INFO] [stdout] test pre_tokenizers::unicode_scripts::pre_tokenizer::tests::spaces_are_included_in_every_script ... ok
[INFO] [stdout] test processors::bert::tests::bert_processing ... ok
[INFO] [stdout] test processors::bert::tests::serde ... ok
[INFO] [stdout] test processors::roberta::tests::roberta_processing ... ok
[INFO] [stdout] test processors::roberta::tests::serde ... ok
[INFO] [stdout] test pre_tokenizers::unicode_scripts::pre_tokenizer::tests::test_unicode_script ... ok
[INFO] [stdout] test pre_tokenizers::whitespace::tests::whitespace_split ... ok
[INFO] [stdout] test models::unigram::trainer::tests::test_unk_token ... ok
[INFO] [stdout] test pre_tokenizers::unicode_scripts::scripts::tests::test_unicode_script ... ok
[INFO] [stdout] test processors::sequence::tests::process_chain ... ok
[INFO] [stdout] test processors::template::tests::expect_wrong_error_message ... ok
[INFO] [stdout] test processors::template::tests::missing_special_tokens ... ok
[INFO] [stdout] test processors::template::tests::piece_serde ... ok
[INFO] [stdout] test processors::template::tests::special_token_serde ... ok
[INFO] [stdout] test processors::template::tests::pair_must_use_both_sequences ... ok
[INFO] [stdout] test processors::template::tests::piece ... ok
[INFO] [stdout] test processors::template::tests::template_processing ... ok
[INFO] [stdout] test processors::template::tests::template_processing_serde ... ok
[INFO] [stdout] test processors::template::tests::tokens_serde ... ok
[INFO] [stdout] test pre_tokenizers::whitespace::tests::basic ... ok
[INFO] [stdout] test processors::template::tests::template_processing_overflowing ... ok
[INFO] [stdout] test tokenizer::added_vocabulary::tests::can_add_tokens ... ok
[INFO] [stdout] test processors::template::tests::template_serde ... ok
[INFO] [stdout] test processors::tests::deserialize_bert_roberta_correctly ... ok
[INFO] [stdout] test tokenizer::added_vocabulary::tests::can_extract_added_tokens ... ok
[INFO] [stdout] test tokenizer::added_vocabulary::tests::empty_matches ... ok
[INFO] [stdout] test tokenizer::added_vocabulary::tests::test_lstrip_unicode_space ... ok
[INFO] [stdout] test tokenizer::added_vocabulary::tests::test_single_word_is_unicode_correct ... ok
[INFO] [stdout] test tokenizer::encoding::tests::merge_encodings ... ok
[INFO] [stdout] test tokenizer::added_vocabulary::tests::options_use_cases ... ok
[INFO] [stdout] test tokenizer::encoding::tests::mappings ... ok
[INFO] [stdout] test tokenizer::added_vocabulary::tests::can_add_special_tokens ... ok
[INFO] [stdout] test tokenizer::added_vocabulary::tests::test_single_word_is_correct ... ok
[INFO] [stdout] test tokenizer::encoding::tests::padding ... ok
[INFO] [stdout] test tokenizer::encoding::tests::truncate ... ok
[INFO] [stdout] test tokenizer::encoding::tests::truncate_to_empty ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::added_around_edges ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::lstrip ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::append ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::get_range ... ok
[INFO] [stdout] test tokenizer::encoding::tests::truncate_overflow_with_stride ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::mixed_addition_and_removal ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::nfd_adds_new_chars ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::original_range ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::prepend ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::range_conversion ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::remove_at_beginning ... ok
[INFO] [stdout] test pre_tokenizers::punctuation::tests::deserialization_erroneous - should panic ... ok
[INFO] [stdout] test tokenizer::encoding::tests::truncate_left ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::slice ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::remove_at_end ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::remove_chars ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::strip ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::remove_chars_added_by_nfd ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::rstrip ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::added_characters_alignment ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::strip_unicode ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::removed_around_both_edges ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::transform_check ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::split ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::transform_range_multiple_bytes ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::transform_range_single_bytes ... ok
[INFO] [stdout] test tokenizer::pattern::tests::regex ... ok
[INFO] [stdout] test tokenizer::pattern::tests::str ... ok
[INFO] [stdout] test tokenizer::pattern::tests::sys_regex ... ok
[INFO] [stdout] test tokenizer::pattern::tests::char ... ok
[INFO] [stdout] test tokenizer::pattern::tests::functions ... ok
[INFO] [stdout] test utils::parallelism::tests::test_maybe_parallel_iterator ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::replace ... ok
[INFO] [stdout] test utils::padding::tests::pad_to_multiple ... ok
[INFO] [stdout] test utils::truncation::tests::truncate_encodings_longest_first ... ok
[INFO] [stdout] test utils::truncation::tests::test_deserialize_defaults ... ok
[INFO] [stdout] test utils::truncation::tests::truncate_encodings_empty ... ok
[INFO] [stdout] test tokenizer::serialization::tests::test_deserialization_serialization_invariant ... ok
[INFO] [stdout] test utils::parallelism::tests::test_maybe_parallel_slice ... ok
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 174 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.37s
[INFO] [stdout] 
[INFO] [stderr]      Running unittests src/cli.rs (/opt/rustwide/target/debug/deps/cli-68d9c480a44fffd4)
[INFO] [stdout] 
[INFO] [stderr]      Running tests/added_tokens.rs (/opt/rustwide/target/debug/deps/added_tokens-ad35ed26c7ac4836)
[INFO] [stdout] running 0 tests
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] running 5 tests
[INFO] [stdout] test add_tokens ... ok
[INFO] [stdout] test overlapping_tokens ... FAILED
[INFO] [stdout] test single_word_tokens ... FAILED
[INFO] [stdout] test lstrip_tokens ... FAILED
[INFO] [stderr] error: test failed, to rerun pass `--test added_tokens`
[INFO] [stdout] test rstrip_tokens ... FAILED
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout] 
[INFO] [stdout] ---- overlapping_tokens stdout ----
[INFO] [stdout] thread 'overlapping_tokens' panicked at tests/common/mod.rs:19:10:
[INFO] [stdout] Files not found, run `make test` to download these files: Os { code: 2, kind: NotFound, message: "No such file or directory" }
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x5589b9995076 - std::backtrace_rs::backtrace::libunwind::trace::hbee8a7973eeb6c93
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/../../backtrace/src/backtrace/libunwind.rs:104:5
[INFO] [stdout]    1:     0x5589b9995076 - std::backtrace_rs::backtrace::trace_unsynchronized::hc8ac75eea3aa6899
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
[INFO] [stdout]    2:     0x5589b9995076 - std::sys_common::backtrace::_print_fmt::hc7f3e3b5298b1083
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/sys_common/backtrace.rs:68:5
[INFO] [stdout]    3:     0x5589b9995076 - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::hbb235daedd7c6190
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/sys_common/backtrace.rs:44:22
[INFO] [stdout]    4:     0x5589b99be690 - core::fmt::rt::Argument::fmt::h76c38a80d925a410
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/fmt/rt.rs:142:9
[INFO] [stdout]    5:     0x5589b99be690 - core::fmt::write::h3ed6aeaa977c8e45
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/fmt/mod.rs:1120:17
[INFO] [stdout]    6:     0x5589b9992a8f - std::io::Write::write_fmt::h1299aa7741865f2b
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/io/mod.rs:1810:15
[INFO] [stdout]    7:     0x5589b9994e54 - std::sys_common::backtrace::_print::h5d645a07e0fcfdbb
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/sys_common/backtrace.rs:47:5
[INFO] [stdout]    8:     0x5589b9994e54 - std::sys_common::backtrace::print::h85035a511aafe7a8
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/sys_common/backtrace.rs:34:9
[INFO] [stdout]    9:     0x5589b9996bc7 - std::panicking::default_hook::{{closure}}::hcce8cea212785a25
[INFO] [stdout]   10:     0x5589b99968ad - std::panicking::default_hook::hf5fcb0f213fe709a
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:289:9
[INFO] [stdout]   11:     0x5589b94a25c7 - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::h60265c2dfa87ee34
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/alloc/src/boxed.rs:2029:9
[INFO] [stdout]   12:     0x5589b94a25c7 - test::test_main::{{closure}}::h77865bd3127078c6
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/test/src/lib.rs:138:21
[INFO] [stdout]   13:     0x5589b99971e6 - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::hbc5ccf4eb663e1e5
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/alloc/src/boxed.rs:2029:9
[INFO] [stdout]   14:     0x5589b99971e6 - std::panicking::rust_panic_with_hook::h095fccf1dc9379ee
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:783:13
[INFO] [stdout]   15:     0x5589b9996f32 - std::panicking::begin_panic_handler::{{closure}}::h032ba12139b353db
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:657:13
[INFO] [stdout]   16:     0x5589b9995576 - std::sys_common::backtrace::__rust_end_short_backtrace::h9259bc2ff8fd0f76
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/sys_common/backtrace.rs:171:18
[INFO] [stdout]   17:     0x5589b9996c90 - rust_begin_unwind
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:645:5
[INFO] [stdout]   18:     0x5589b945d315 - core::panicking::panic_fmt::h784f20a50eaab275
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/panicking.rs:72:14
[INFO] [stdout]   19:     0x5589b945d8f3 - core::result::unwrap_failed::h03d8a5018196e1cd
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/result.rs:1649:5
[INFO] [stdout]   20:     0x5589b946be6a - core::result::Result<T,E>::expect::hecefcd02d3a92a82
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/result.rs:1030:23
[INFO] [stdout]   21:     0x5589b946d9ab - added_tokens::common::get_byte_level_bpe::h00f14f659390a841
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/common/mod.rs:17:5
[INFO] [stdout]   22:     0x5589b946da03 - added_tokens::common::get_byte_level::h0166bfb93e59bbc2
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/common/mod.rs:24:40
[INFO] [stdout]   23:     0x5589b94667fb - added_tokens::overlapping_tokens::hcb26a80f888e1f6b
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/added_tokens.rs:99:25
[INFO] [stdout]   24:     0x5589b94667a7 - added_tokens::overlapping_tokens::{{closure}}::hb94c9f828e628231
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/added_tokens.rs:98:24
[INFO] [stdout]   25:     0x5589b946a8d6 - core::ops::function::FnOnce::call_once::h9370f5baef83252b
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   26:     0x5589b94a7e9f - core::ops::function::FnOnce::call_once::h8dc6907944022cf6
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   27:     0x5589b94a7e9f - test::__rust_begin_short_backtrace::haae1a87433f1efb3
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/test/src/lib.rs:627:18
[INFO] [stdout]   28:     0x5589b94a6c21 - test::run_test_in_process::{{closure}}::h8c7decfa7c14e152
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/test/src/lib.rs:650:60
[INFO] [stdout]   29:     0x5589b94a6c21 - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::h19e6ff056d9d21e9
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/panic/unwind_safe.rs:272:9
[INFO] [stdout]   30:     0x5589b94a6c21 - std::panicking::try::do_call::h89c848fcaa37c035
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:552:40
[INFO] [stdout]   31:     0x5589b94a6c21 - std::panicking::try::h57ab3dc74e2839b8
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:516:19
[INFO] [stdout]   32:     0x5589b94a6c21 - std::panic::catch_unwind::hfb6a1b1abc120fb9
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panic.rs:142:14
[INFO] [stdout]   33:     0x5589b94a6c21 - test::run_test_in_process::h5ae2f9875edd562d
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/test/src/lib.rs:650:27
[INFO] [stdout]   34:     0x5589b94a6c21 - test::run_test::{{closure}}::h35d7300d8928a067
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/test/src/lib.rs:573:43
[INFO] [stdout]   35:     0x5589b946df56 - test::run_test::{{closure}}::h7525ced405d23d1b
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/test/src/lib.rs:601:41
[INFO] [stdout]   36:     0x5589b946df56 - std::sys_common::backtrace::__rust_begin_short_backtrace::h4e7db78ce05afad8
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/sys_common/backtrace.rs:155:18
[INFO] [stdout]   37:     0x5589b9472fb7 - std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}}::hcfbcb64f1a1b3482
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/thread/mod.rs:529:17
[INFO] [stdout]   38:     0x5589b9472fb7 - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::h9d89c5c4108bd689
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/panic/unwind_safe.rs:272:9
[INFO] [stdout]   39:     0x5589b9472fb7 - std::panicking::try::do_call::h8a4869bc94ec50c9
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:552:40
[INFO] [stdout]   40:     0x5589b9472fb7 - std::panicking::try::h9a576f20ff81ac30
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:516:19
[INFO] [stdout]   41:     0x5589b9472fb7 - std::panic::catch_unwind::hbcb4e3f860ef9830
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panic.rs:142:14
[INFO] [stdout]   42:     0x5589b9472fb7 - std::thread::Builder::spawn_unchecked_::{{closure}}::h93c79a6be1505948
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/thread/mod.rs:528:30
[INFO] [stdout]   43:     0x5589b9472fb7 - core::ops::function::FnOnce::call_once{{vtable.shim}}::h426d96740c81bdaf
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   44:     0x5589b999bda5 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h12de4fc57affb195
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/alloc/src/boxed.rs:2015:9
[INFO] [stdout]   45:     0x5589b999bda5 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h3c619f45059d5cf1
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/alloc/src/boxed.rs:2015:9
[INFO] [stdout]   46:     0x5589b999bda5 - std::sys::unix::thread::Thread::new::thread_start::hbac657605e4b7389
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/sys/unix/thread.rs:108:17
[INFO] [stdout]   47:     0x7f8c0b060ac3 - <unknown>
[INFO] [stdout]   48:     0x7f8c0b0f1bf4 - __clone
[INFO] [stdout]   49:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] ---- single_word_tokens stdout ----
[INFO] [stdout] thread 'single_word_tokens' panicked at tests/common/mod.rs:19:10:
[INFO] [stdout] Files not found, run `make test` to download these files: Os { code: 2, kind: NotFound, message: "No such file or directory" }
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x5589b9995076 - std::backtrace_rs::backtrace::libunwind::trace::hbee8a7973eeb6c93
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/../../backtrace/src/backtrace/libunwind.rs:104:5
[INFO] [stdout]    1:     0x5589b9995076 - std::backtrace_rs::backtrace::trace_unsynchronized::hc8ac75eea3aa6899
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
[INFO] [stdout]    2:     0x5589b9995076 - std::sys_common::backtrace::_print_fmt::hc7f3e3b5298b1083
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/sys_common/backtrace.rs:68:5
[INFO] [stdout]    3:     0x5589b9995076 - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::hbb235daedd7c6190
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/sys_common/backtrace.rs:44:22
[INFO] [stdout]    4:     0x5589b99be690 - core::fmt::rt::Argument::fmt::h76c38a80d925a410
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/fmt/rt.rs:142:9
[INFO] [stdout]    5:     0x5589b99be690 - core::fmt::write::h3ed6aeaa977c8e45
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/fmt/mod.rs:1120:17
[INFO] [stdout]    6:     0x5589b9992a8f - std::io::Write::write_fmt::h1299aa7741865f2b
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/io/mod.rs:1810:15
[INFO] [stdout]    7:     0x5589b9994e54 - std::sys_common::backtrace::_print::h5d645a07e0fcfdbb
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/sys_common/backtrace.rs:47:5
[INFO] [stdout]    8:     0x5589b9994e54 - std::sys_common::backtrace::print::h85035a511aafe7a8
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/sys_common/backtrace.rs:34:9
[INFO] [stdout]    9:     0x5589b9996bc7 - std::panicking::default_hook::{{closure}}::hcce8cea212785a25
[INFO] [stdout]   10:     0x5589b99968ad - std::panicking::default_hook::hf5fcb0f213fe709a
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:289:9
[INFO] [stdout]   11:     0x5589b94a25c7 - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::h60265c2dfa87ee34
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/alloc/src/boxed.rs:2029:9
[INFO] [stdout]   12:     0x5589b94a25c7 - test::test_main::{{closure}}::h77865bd3127078c6
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/test/src/lib.rs:138:21
[INFO] [stdout]   13:     0x5589b99971e6 - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::hbc5ccf4eb663e1e5
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/alloc/src/boxed.rs:2029:9
[INFO] [stdout]   14:     0x5589b99971e6 - std::panicking::rust_panic_with_hook::h095fccf1dc9379ee
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:783:13
[INFO] [stdout]   15:     0x5589b9996f32 - std::panicking::begin_panic_handler::{{closure}}::h032ba12139b353db
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:657:13
[INFO] [stdout]   16:     0x5589b9995576 - std::sys_common::backtrace::__rust_end_short_backtrace::h9259bc2ff8fd0f76
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/sys_common/backtrace.rs:171:18
[INFO] [stdout]   17:     0x5589b9996c90 - rust_begin_unwind
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:645:5
[INFO] [stdout]   18:     0x5589b945d315 - core::panicking::panic_fmt::h784f20a50eaab275
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/panicking.rs:72:14
[INFO] [stdout]   19:     0x5589b945d8f3 - core::result::unwrap_failed::h03d8a5018196e1cd
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/result.rs:1649:5
[INFO] [stdout]   20:     0x5589b946be6a - core::result::Result<T,E>::expect::hecefcd02d3a92a82
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/result.rs:1030:23
[INFO] [stdout]   21:     0x5589b946d9ab - added_tokens::common::get_byte_level_bpe::h00f14f659390a841
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/common/mod.rs:17:5
[INFO] [stdout]   22:     0x5589b946da03 - added_tokens::common::get_byte_level::h0166bfb93e59bbc2
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/common/mod.rs:24:40
[INFO] [stdout]   23:     0x5589b946627c - added_tokens::single_word_tokens::hde1c6c6eae5c9850
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/added_tokens.rs:79:25
[INFO] [stdout]   24:     0x5589b9466217 - added_tokens::single_word_tokens::{{closure}}::he3527911b3240f0c
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/added_tokens.rs:77:24
[INFO] [stdout]   25:     0x5589b946a896 - core::ops::function::FnOnce::call_once::h70cf921fa7301845
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   26:     0x5589b94a7e9f - core::ops::function::FnOnce::call_once::h8dc6907944022cf6
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   27:     0x5589b94a7e9f - test::__rust_begin_short_backtrace::haae1a87433f1efb3
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/test/src/lib.rs:627:18
[INFO] [stdout]   28:     0x5589b94a6c21 - test::run_test_in_process::{{closure}}::h8c7decfa7c14e152
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/test/src/lib.rs:650:60
[INFO] [stdout]   29:     0x5589b94a6c21 - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::h19e6ff056d9d21e9
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/panic/unwind_safe.rs:272:9
[INFO] [stdout]   30:     0x5589b94a6c21 - std::panicking::try::do_call::h89c848fcaa37c035
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:552:40
[INFO] [stdout]   31:     0x5589b94a6c21 - std::panicking::try::h57ab3dc74e2839b8
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:516:19
[INFO] [stdout]   32:     0x5589b94a6c21 - std::panic::catch_unwind::hfb6a1b1abc120fb9
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panic.rs:142:14
[INFO] [stdout]   33:     0x5589b94a6c21 - test::run_test_in_process::h5ae2f9875edd562d
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/test/src/lib.rs:650:27
[INFO] [stdout]   34:     0x5589b94a6c21 - test::run_test::{{closure}}::h35d7300d8928a067
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/test/src/lib.rs:573:43
[INFO] [stdout]   35:     0x5589b946df56 - test::run_test::{{closure}}::h7525ced405d23d1b
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/test/src/lib.rs:601:41
[INFO] [stdout]   36:     0x5589b946df56 - std::sys_common::backtrace::__rust_begin_short_backtrace::h4e7db78ce05afad8
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/sys_common/backtrace.rs:155:18
[INFO] [stdout]   37:     0x5589b9472fb7 - std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}}::hcfbcb64f1a1b3482
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/thread/mod.rs:529:17
[INFO] [stdout]   38:     0x5589b9472fb7 - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::h9d89c5c4108bd689
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/panic/unwind_safe.rs:272:9
[INFO] [stdout]   39:     0x5589b9472fb7 - std::panicking::try::do_call::h8a4869bc94ec50c9
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:552:40
[INFO] [stdout]   40:     0x5589b9472fb7 - std::panicking::try::h9a576f20ff81ac30
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:516:19
[INFO] [stdout]   41:     0x5589b9472fb7 - std::panic::catch_unwind::hbcb4e3f860ef9830
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panic.rs:142:14
[INFO] [stdout]   42:     0x5589b9472fb7 - std::thread::Builder::spawn_unchecked_::{{closure}}::h93c79a6be1505948
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/thread/mod.rs:528:30
[INFO] [stdout]   43:     0x5589b9472fb7 - core::ops::function::FnOnce::call_once{{vtable.shim}}::h426d96740c81bdaf
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   44:     0x5589b999bda5 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h12de4fc57affb195
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/alloc/src/boxed.rs:2015:9
[INFO] [stdout]   45:     0x5589b999bda5 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h3c619f45059d5cf1
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/alloc/src/boxed.rs:2015:9
[INFO] [stdout]   46:     0x5589b999bda5 - std::sys::unix::thread::Thread::new::thread_start::hbac657605e4b7389
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/sys/unix/thread.rs:108:17
[INFO] [stdout]   47:     0x7f8c0b060ac3 - <unknown>
[INFO] [stdout]   48:     0x7f8c0b0f1bf4 - __clone
[INFO] [stdout]   49:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] ---- lstrip_tokens stdout ----
[INFO] [stdout] thread 'lstrip_tokens' panicked at tests/common/mod.rs:19:10:
[INFO] [stdout] Files not found, run `make test` to download these files: Os { code: 2, kind: NotFound, message: "No such file or directory" }
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x5589b9995076 - std::backtrace_rs::backtrace::libunwind::trace::hbee8a7973eeb6c93
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/../../backtrace/src/backtrace/libunwind.rs:104:5
[INFO] [stdout]    1:     0x5589b9995076 - std::backtrace_rs::backtrace::trace_unsynchronized::hc8ac75eea3aa6899
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
[INFO] [stdout]    2:     0x5589b9995076 - std::sys_common::backtrace::_print_fmt::hc7f3e3b5298b1083
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/sys_common/backtrace.rs:68:5
[INFO] [stdout]    3:     0x5589b9995076 - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::hbb235daedd7c6190
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/sys_common/backtrace.rs:44:22
[INFO] [stdout]    4:     0x5589b99be690 - core::fmt::rt::Argument::fmt::h76c38a80d925a410
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/fmt/rt.rs:142:9
[INFO] [stdout]    5:     0x5589b99be690 - core::fmt::write::h3ed6aeaa977c8e45
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/fmt/mod.rs:1120:17
[INFO] [stdout]    6:     0x5589b9992a8f - std::io::Write::write_fmt::h1299aa7741865f2b
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/io/mod.rs:1810:15
[INFO] [stdout]    7:     0x5589b9994e54 - std::sys_common::backtrace::_print::h5d645a07e0fcfdbb
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/sys_common/backtrace.rs:47:5
[INFO] [stdout]    8:     0x5589b9994e54 - std::sys_common::backtrace::print::h85035a511aafe7a8
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/sys_common/backtrace.rs:34:9
[INFO] [stdout]    9:     0x5589b9996bc7 - std::panicking::default_hook::{{closure}}::hcce8cea212785a25
[INFO] [stdout]   10:     0x5589b99968ad - std::panicking::default_hook::hf5fcb0f213fe709a
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:289:9
[INFO] [stdout]   11:     0x5589b94a25c7 - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::h60265c2dfa87ee34
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/alloc/src/boxed.rs:2029:9
[INFO] [stdout]   12:     0x5589b94a25c7 - test::test_main::{{closure}}::h77865bd3127078c6
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/test/src/lib.rs:138:21
[INFO] [stdout]   13:     0x5589b99971e6 - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::hbc5ccf4eb663e1e5
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/alloc/src/boxed.rs:2029:9
[INFO] [stdout]   14:     0x5589b99971e6 - std::panicking::rust_panic_with_hook::h095fccf1dc9379ee
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:783:13
[INFO] [stdout]   15:     0x5589b9996f32 - std::panicking::begin_panic_handler::{{closure}}::h032ba12139b353db
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:657:13
[INFO] [stdout]   16:     0x5589b9995576 - std::sys_common::backtrace::__rust_end_short_backtrace::h9259bc2ff8fd0f76
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/sys_common/backtrace.rs:171:18
[INFO] [stdout]   17:     0x5589b9996c90 - rust_begin_unwind
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:645:5
[INFO] [stdout]   18:     0x5589b945d315 - core::panicking::panic_fmt::h784f20a50eaab275
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/panicking.rs:72:14
[INFO] [stdout]   19:     0x5589b945d8f3 - core::result::unwrap_failed::h03d8a5018196e1cd
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/result.rs:1649:5
[INFO] [stdout]   20:     0x5589b946be6a - core::result::Result<T,E>::expect::hecefcd02d3a92a82
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/result.rs:1030:23
[INFO] [stdout]   21:     0x5589b946d9ab - added_tokens::common::get_byte_level_bpe::h00f14f659390a841
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/common/mod.rs:17:5
[INFO] [stdout]   22:     0x5589b946da03 - added_tokens::common::get_byte_level::h0166bfb93e59bbc2
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/common/mod.rs:24:40
[INFO] [stdout]   23:     0x5589b9465905 - added_tokens::lstrip_tokens::h2a04b5c9bb79cc90
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/added_tokens.rs:33:25
[INFO] [stdout]   24:     0x5589b94658b7 - added_tokens::lstrip_tokens::{{closure}}::h97ff3f020388af4c
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/added_tokens.rs:32:19
[INFO] [stdout]   25:     0x5589b946a926 - core::ops::function::FnOnce::call_once::hbfdbf1fc388cf126
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   26:     0x5589b94a7e9f - core::ops::function::FnOnce::call_once::h8dc6907944022cf6
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   27:     0x5589b94a7e9f - test::__rust_begin_short_backtrace::haae1a87433f1efb3
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/test/src/lib.rs:627:18
[INFO] [stdout]   28:     0x5589b94a6c21 - test::run_test_in_process::{{closure}}::h8c7decfa7c14e152
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/test/src/lib.rs:650:60
[INFO] [stdout]   29:     0x5589b94a6c21 - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::h19e6ff056d9d21e9
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/panic/unwind_safe.rs:272:9
[INFO] [stdout]   30:     0x5589b94a6c21 - std::panicking::try::do_call::h89c848fcaa37c035
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:552:40
[INFO] [stdout]   31:     0x5589b94a6c21 - std::panicking::try::h57ab3dc74e2839b8
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:516:19
[INFO] [stdout]   32:     0x5589b94a6c21 - std::panic::catch_unwind::hfb6a1b1abc120fb9
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panic.rs:142:14
[INFO] [stdout]   33:     0x5589b94a6c21 - test::run_test_in_process::h5ae2f9875edd562d
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/test/src/lib.rs:650:27
[INFO] [stdout]   34:     0x5589b94a6c21 - test::run_test::{{closure}}::h35d7300d8928a067
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/test/src/lib.rs:573:43
[INFO] [stdout]   35:     0x5589b946df56 - test::run_test::{{closure}}::h7525ced405d23d1b
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/test/src/lib.rs:601:41
[INFO] [stdout]   36:     0x5589b946df56 - std::sys_common::backtrace::__rust_begin_short_backtrace::h4e7db78ce05afad8
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/sys_common/backtrace.rs:155:18
[INFO] [stdout]   37:     0x5589b9472fb7 - std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}}::hcfbcb64f1a1b3482
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/thread/mod.rs:529:17
[INFO] [stdout]   38:     0x5589b9472fb7 - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::h9d89c5c4108bd689
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/panic/unwind_safe.rs:272:9
[INFO] [stdout]   39:     0x5589b9472fb7 - std::panicking::try::do_call::h8a4869bc94ec50c9
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:552:40
[INFO] [stdout]   40:     0x5589b9472fb7 - std::panicking::try::h9a576f20ff81ac30
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:516:19
[INFO] [stdout]   41:     0x5589b9472fb7 - std::panic::catch_unwind::hbcb4e3f860ef9830
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panic.rs:142:14
[INFO] [stdout]   42:     0x5589b9472fb7 - std::thread::Builder::spawn_unchecked_::{{closure}}::h93c79a6be1505948
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/thread/mod.rs:528:30
[INFO] [stdout]   43:     0x5589b9472fb7 - core::ops::function::FnOnce::call_once{{vtable.shim}}::h426d96740c81bdaf
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   44:     0x5589b999bda5 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h12de4fc57affb195
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/alloc/src/boxed.rs:2015:9
[INFO] [stdout]   45:     0x5589b999bda5 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h3c619f45059d5cf1
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/alloc/src/boxed.rs:2015:9
[INFO] [stdout]   46:     0x5589b999bda5 - std::sys::unix::thread::Thread::new::thread_start::hbac657605e4b7389
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/sys/unix/thread.rs:108:17
[INFO] [stdout]   47:     0x7f8c0b060ac3 - <unknown>
[INFO] [stdout]   48:     0x7f8c0b0f1bf4 - __clone
[INFO] [stdout]   49:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] ---- rstrip_tokens stdout ----
[INFO] [stdout] thread 'rstrip_tokens' panicked at tests/common/mod.rs:19:10:
[INFO] [stdout] Files not found, run `make test` to download these files: Os { code: 2, kind: NotFound, message: "No such file or directory" }
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x5589b9995076 - std::backtrace_rs::backtrace::libunwind::trace::hbee8a7973eeb6c93
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/../../backtrace/src/backtrace/libunwind.rs:104:5
[INFO] [stdout]    1:     0x5589b9995076 - std::backtrace_rs::backtrace::trace_unsynchronized::hc8ac75eea3aa6899
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
[INFO] [stdout]    2:     0x5589b9995076 - std::sys_common::backtrace::_print_fmt::hc7f3e3b5298b1083
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/sys_common/backtrace.rs:68:5
[INFO] [stdout]    3:     0x5589b9995076 - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::hbb235daedd7c6190
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/sys_common/backtrace.rs:44:22
[INFO] [stdout]    4:     0x5589b99be690 - core::fmt::rt::Argument::fmt::h76c38a80d925a410
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/fmt/rt.rs:142:9
[INFO] [stdout]    5:     0x5589b99be690 - core::fmt::write::h3ed6aeaa977c8e45
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/fmt/mod.rs:1120:17
[INFO] [stdout]    6:     0x5589b9992a8f - std::io::Write::write_fmt::h1299aa7741865f2b
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/io/mod.rs:1810:15
[INFO] [stdout]    7:     0x5589b9994e54 - std::sys_common::backtrace::_print::h5d645a07e0fcfdbb
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/sys_common/backtrace.rs:47:5
[INFO] [stdout]    8:     0x5589b9994e54 - std::sys_common::backtrace::print::h85035a511aafe7a8
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/sys_common/backtrace.rs:34:9
[INFO] [stdout]    9:     0x5589b9996bc7 - std::panicking::default_hook::{{closure}}::hcce8cea212785a25
[INFO] [stdout]   10:     0x5589b99968ad - std::panicking::default_hook::hf5fcb0f213fe709a
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:289:9
[INFO] [stdout]   11:     0x5589b94a25c7 - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::h60265c2dfa87ee34
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/alloc/src/boxed.rs:2029:9
[INFO] [stdout]   12:     0x5589b94a25c7 - test::test_main::{{closure}}::h77865bd3127078c6
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/test/src/lib.rs:138:21
[INFO] [stdout]   13:     0x5589b99971e6 - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::hbc5ccf4eb663e1e5
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/alloc/src/boxed.rs:2029:9
[INFO] [stdout]   14:     0x5589b99971e6 - std::panicking::rust_panic_with_hook::h095fccf1dc9379ee
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:783:13
[INFO] [stdout]   15:     0x5589b9996f32 - std::panicking::begin_panic_handler::{{closure}}::h032ba12139b353db
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:657:13
[INFO] [stdout]   16:     0x5589b9995576 - std::sys_common::backtrace::__rust_end_short_backtrace::h9259bc2ff8fd0f76
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/sys_common/backtrace.rs:171:18
[INFO] [stdout]   17:     0x5589b9996c90 - rust_begin_unwind
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:645:5
[INFO] [stdout]   18:     0x5589b945d315 - core::panicking::panic_fmt::h784f20a50eaab275
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/panicking.rs:72:14
[INFO] [stdout]   19:     0x5589b945d8f3 - core::result::unwrap_failed::h03d8a5018196e1cd
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/result.rs:1649:5
[INFO] [stdout]   20:     0x5589b946be6a - core::result::Result<T,E>::expect::hecefcd02d3a92a82
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/result.rs:1030:23
[INFO] [stdout]   21:     0x5589b946d9ab - added_tokens::common::get_byte_level_bpe::h00f14f659390a841
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/common/mod.rs:17:5
[INFO] [stdout]   22:     0x5589b946da03 - added_tokens::common::get_byte_level::h0166bfb93e59bbc2
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/common/mod.rs:24:40
[INFO] [stdout]   23:     0x5589b9465cec - added_tokens::rstrip_tokens::h1bf6db8b9c9e4d1b
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/added_tokens.rs:51:25
[INFO] [stdout]   24:     0x5589b9465c87 - added_tokens::rstrip_tokens::{{closure}}::h4ffd8ea76f40066d
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/added_tokens.rs:50:19
[INFO] [stdout]   25:     0x5589b946a856 - core::ops::function::FnOnce::call_once::h6198aa96d9ab4153
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   26:     0x5589b94a7e9f - core::ops::function::FnOnce::call_once::h8dc6907944022cf6
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   27:     0x5589b94a7e9f - test::__rust_begin_short_backtrace::haae1a87433f1efb3
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/test/src/lib.rs:627:18
[INFO] [stdout]   28:     0x5589b94a6c21 - test::run_test_in_process::{{closure}}::h8c7decfa7c14e152
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/test/src/lib.rs:650:60
[INFO] [stdout]   29:     0x5589b94a6c21 - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::h19e6ff056d9d21e9
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/panic/unwind_safe.rs:272:9
[INFO] [stdout]   30:     0x5589b94a6c21 - std::panicking::try::do_call::h89c848fcaa37c035
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:552:40
[INFO] [stdout]   31:     0x5589b94a6c21 - std::panicking::try::h57ab3dc74e2839b8
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:516:19
[INFO] [stdout]   32:     0x5589b94a6c21 - std::panic::catch_unwind::hfb6a1b1abc120fb9
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panic.rs:142:14
[INFO] [stdout]   33:     0x5589b94a6c21 - test::run_test_in_process::h5ae2f9875edd562d
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/test/src/lib.rs:650:27
[INFO] [stdout]   34:     0x5589b94a6c21 - test::run_test::{{closure}}::h35d7300d8928a067
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/test/src/lib.rs:573:43
[INFO] [stdout]   35:     0x5589b946df56 - test::run_test::{{closure}}::h7525ced405d23d1b
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/test/src/lib.rs:601:41
[INFO] [stdout]   36:     0x5589b946df56 - std::sys_common::backtrace::__rust_begin_short_backtrace::h4e7db78ce05afad8
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/sys_common/backtrace.rs:155:18
[INFO] [stdout]   37:     0x5589b9472fb7 - std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}}::hcfbcb64f1a1b3482
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/thread/mod.rs:529:17
[INFO] [stdout]   38:     0x5589b9472fb7 - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::h9d89c5c4108bd689
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/panic/unwind_safe.rs:272:9
[INFO] [stdout]   39:     0x5589b9472fb7 - std::panicking::try::do_call::h8a4869bc94ec50c9
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:552:40
[INFO] [stdout]   40:     0x5589b9472fb7 - std::panicking::try::h9a576f20ff81ac30
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:516:19
[INFO] [stdout]   41:     0x5589b9472fb7 - std::panic::catch_unwind::hbcb4e3f860ef9830
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panic.rs:142:14
[INFO] [stdout]   42:     0x5589b9472fb7 - std::thread::Builder::spawn_unchecked_::{{closure}}::h93c79a6be1505948
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/thread/mod.rs:528:30
[INFO] [stdout]   43:     0x5589b9472fb7 - core::ops::function::FnOnce::call_once{{vtable.shim}}::h426d96740c81bdaf
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   44:     0x5589b999bda5 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h12de4fc57affb195
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/alloc/src/boxed.rs:2015:9
[INFO] [stdout]   45:     0x5589b999bda5 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h3c619f45059d5cf1
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/alloc/src/boxed.rs:2015:9
[INFO] [stdout]   46:     0x5589b999bda5 - std::sys::unix::thread::Thread::new::thread_start::hbac657605e4b7389
[INFO] [stdout]                                at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/sys/unix/thread.rs:108:17
[INFO] [stdout]   47:     0x7f8c0b060ac3 - <unknown>
[INFO] [stdout]   48:     0x7f8c0b0f1bf4 - __clone
[INFO] [stdout]   49:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout]     lstrip_tokens
[INFO] [stdout]     overlapping_tokens
[INFO] [stdout]     rstrip_tokens
[INFO] [stdout]     single_word_tokens
[INFO] [stdout] 
[INFO] [stdout] test result: FAILED. 1 passed; 4 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.14s
[INFO] [stdout] 
[INFO] running `Command { std: "docker" "inspect" "b83480b98bc4c34a5f405715142ee6b25b26ddff401ea7e4918bf07a10bda62a", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "b83480b98bc4c34a5f405715142ee6b25b26ddff401ea7e4918bf07a10bda62a", kill_on_drop: false }`
[INFO] [stdout] b83480b98bc4c34a5f405715142ee6b25b26ddff401ea7e4918bf07a10bda62a
[INFO] testing tokenizers-0.15.0 against beta-2024-02-10 for beta-1.77-1
[INFO] extracting crate tokenizers 0.15.0 into /workspace/builds/worker-7-tc2/source
[INFO] validating manifest of crates.io crate tokenizers 0.15.0 on toolchain beta-2024-02-10
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+beta-2024-02-10" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] started tweaking crates.io crate tokenizers 0.15.0
[INFO] finished tweaking crates.io crate tokenizers 0.15.0
[INFO] tweaked toml for crates.io crate tokenizers 0.15.0 written to /workspace/builds/worker-7-tc2/source/Cargo.toml
[INFO] crate crates.io crate tokenizers 0.15.0 already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+beta-2024-02-10" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:2788e3201cd34a07e3172128adcd8b3090168a8e3bcc40d7c032b9dda1df7d1c" "/opt/rustwide/cargo-home/bin/cargo" "+beta-2024-02-10" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] [stdout] 3edfda6c55bd940b25e32e4b1b05f37d83e6dfffc942f5cd96e4a43aa2183820
[INFO] running `Command { std: "docker" "start" "-a" "3edfda6c55bd940b25e32e4b1b05f37d83e6dfffc942f5cd96e4a43aa2183820", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "3edfda6c55bd940b25e32e4b1b05f37d83e6dfffc942f5cd96e4a43aa2183820", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "3edfda6c55bd940b25e32e4b1b05f37d83e6dfffc942f5cd96e4a43aa2183820", kill_on_drop: false }`
[INFO] [stdout] 3edfda6c55bd940b25e32e4b1b05f37d83e6dfffc942f5cd96e4a43aa2183820
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:2788e3201cd34a07e3172128adcd8b3090168a8e3bcc40d7c032b9dda1df7d1c" "/opt/rustwide/cargo-home/bin/cargo" "+beta-2024-02-10" "build" "--frozen" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] d449849dec6e02799a1195ba22c41376ff26047da93ebba2bf84cd3ae1d80e25
[INFO] running `Command { std: "docker" "start" "-a" "d449849dec6e02799a1195ba22c41376ff26047da93ebba2bf84cd3ae1d80e25", kill_on_drop: false }`
[INFO] [stderr]    Compiling proc-macro2 v1.0.69
[INFO] [stderr]    Compiling libc v0.2.150
[INFO] [stderr]    Compiling strsim v0.10.0
[INFO] [stderr]    Compiling syn v1.0.109
[INFO] [stderr]    Compiling crossbeam-utils v0.8.16
[INFO] [stderr]    Compiling memoffset v0.9.0
[INFO] [stderr]    Compiling crossbeam-epoch v0.9.15
[INFO] [stderr]    Compiling ident_case v1.0.1
[INFO] [stderr]    Compiling fnv v1.0.7
[INFO] [stderr]    Compiling memchr v2.6.4
[INFO] [stderr]    Compiling serde v1.0.192
[INFO] [stderr]    Compiling utf8parse v0.2.1
[INFO] [stderr]    Compiling rayon-core v1.12.0
[INFO] [stderr]    Compiling pkg-config v0.3.27
[INFO] [stderr]    Compiling anstyle-parse v0.2.2
[INFO] [stderr]    Compiling anstyle-query v1.0.0
[INFO] [stderr]    Compiling colorchoice v1.0.0
[INFO] [stderr]    Compiling either v1.9.0
[INFO] [stderr]    Compiling quote v1.0.33
[INFO] [stderr]    Compiling crossbeam-deque v0.8.3
[INFO] [stderr]    Compiling paste v1.0.14
[INFO] [stderr]    Compiling anstyle v1.0.4
[INFO] [stderr]    Compiling syn v2.0.39
[INFO] [stderr]    Compiling portable-atomic v1.5.1
[INFO] [stderr]    Compiling anstream v0.6.4
[INFO] [stderr]    Compiling aho-corasick v1.1.2
[INFO] [stderr]    Compiling regex-syntax v0.8.2
[INFO] [stderr]    Compiling thiserror v1.0.50
[INFO] [stderr]    Compiling serde_json v1.0.108
[INFO] [stderr]    Compiling cc v1.0.83
[INFO] [stderr]    Compiling getrandom v0.2.11
[INFO] [stderr]    Compiling clap_lex v0.6.0
[INFO] [stderr]    Compiling rand_core v0.6.4
[INFO] [stderr]    Compiling unicode-width v0.1.11
[INFO] [stderr]    Compiling minimal-lexical v0.2.1
[INFO] [stderr]    Compiling heck v0.4.1
[INFO] [stderr]    Compiling rand_chacha v0.3.1
[INFO] [stderr]    Compiling nom v7.1.3
[INFO] [stderr]    Compiling console v0.15.7
[INFO] [stderr]    Compiling regex-automata v0.4.3
[INFO] [stderr]    Compiling onig_sys v69.8.1
[INFO] [stderr]    Compiling esaxx-rs v0.1.10
[INFO] [stderr]    Compiling darling_core v0.14.4
[INFO] [stderr]    Compiling clap_builder v4.4.8
[INFO] [stderr]    Compiling rayon v1.8.0
[INFO] [stderr]    Compiling serde_derive v1.0.192
[INFO] [stderr]    Compiling clap_derive v4.4.7
[INFO] [stderr]    Compiling thiserror-impl v1.0.50
[INFO] [stderr]    Compiling darling_macro v0.14.4
[INFO] [stderr]    Compiling monostate-impl v0.1.9
[INFO] [stderr]    Compiling darling v0.14.4
[INFO] [stderr]    Compiling derive_builder_core v0.12.0
[INFO] [stderr]    Compiling itertools v0.11.0
[INFO] [stderr]    Compiling unicode-segmentation v1.10.1
[INFO] [stderr]    Compiling number_prefix v0.4.0
[INFO] [stderr]    Compiling ryu v1.0.15
[INFO] [stderr]    Compiling macro_rules_attribute-proc_macro v0.2.0
[INFO] [stderr]    Compiling bitflags v1.3.2
[INFO] [stderr]    Compiling once_cell v1.18.0
[INFO] [stderr]    Compiling itoa v1.0.9
[INFO] [stderr]    Compiling smallvec v1.11.2
[INFO] [stderr]    Compiling derive_builder_macro v0.12.0
[INFO] [stderr]    Compiling onig v6.4.0
[INFO] [stderr]    Compiling indicatif v0.17.7
[INFO] [stderr]    Compiling unicode-normalization-alignments v0.1.12
[INFO] [stderr]    Compiling rayon-cond v0.3.0
[INFO] [stderr]    Compiling macro_rules_attribute v0.2.0
[INFO] [stderr]    Compiling clap v4.4.8
[INFO] [stderr]    Compiling regex v1.10.2
[INFO] [stderr]    Compiling rand v0.8.5
[INFO] [stderr]    Compiling derive_builder v0.12.0
[INFO] [stderr]    Compiling regex-syntax v0.7.5
[INFO] [stderr]    Compiling unicode_categories v0.1.1
[INFO] [stderr]    Compiling monostate v0.1.9
[INFO] [stderr]    Compiling spm_precompiled v0.1.4
[INFO] [stderr]    Compiling tokenizers v0.15.0 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished dev [unoptimized + debuginfo] target(s) in 35.28s
[INFO] running `Command { std: "docker" "inspect" "d449849dec6e02799a1195ba22c41376ff26047da93ebba2bf84cd3ae1d80e25", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "d449849dec6e02799a1195ba22c41376ff26047da93ebba2bf84cd3ae1d80e25", kill_on_drop: false }`
[INFO] [stdout] d449849dec6e02799a1195ba22c41376ff26047da93ebba2bf84cd3ae1d80e25
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:2788e3201cd34a07e3172128adcd8b3090168a8e3bcc40d7c032b9dda1df7d1c" "/opt/rustwide/cargo-home/bin/cargo" "+beta-2024-02-10" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] e6624c7eca3f9f4c3e89fa261244e4682afd63399d2e62977bf926bdcd3fd5c8
[INFO] running `Command { std: "docker" "start" "-a" "e6624c7eca3f9f4c3e89fa261244e4682afd63399d2e62977bf926bdcd3fd5c8", kill_on_drop: false }`
[INFO] [stderr]    Compiling rustix v0.38.23
[INFO] [stderr]    Compiling num-traits v0.2.17
[INFO] [stderr]    Compiling linux-raw-sys v0.4.11
[INFO] [stderr]    Compiling bitflags v2.4.1
[INFO] [stderr]    Compiling ciborium-io v0.2.1
[INFO] [stderr]    Compiling plotters-backend v0.3.5
[INFO] [stderr]    Compiling half v1.8.2
[INFO] [stderr]    Compiling itertools v0.10.5
[INFO] [stderr]    Compiling same-file v1.0.6
[INFO] [stderr]    Compiling cast v0.3.0
[INFO] [stderr]    Compiling walkdir v2.4.0
[INFO] [stderr]    Compiling plotters-svg v0.3.5
[INFO] [stderr]    Compiling ciborium-ll v0.2.1
[INFO] [stderr]    Compiling tinytemplate v1.2.1
[INFO] [stderr]    Compiling fastrand v2.0.1
[INFO] [stderr]    Compiling ciborium v0.2.1
[INFO] [stderr]    Compiling anes v0.1.6
[INFO] [stderr]    Compiling oorandom v11.1.3
[INFO] [stderr]    Compiling assert_approx_eq v1.1.0
[INFO] [stderr]    Compiling criterion-plot v0.5.0
[INFO] [stderr]    Compiling plotters v0.3.5
[INFO] [stderr]    Compiling is-terminal v0.4.9
[INFO] [stderr]    Compiling tempfile v3.8.1
[INFO] [stderr]    Compiling criterion v0.5.1
[INFO] [stderr]    Compiling tokenizers v0.15.0 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished test [unoptimized + debuginfo] target(s) in 25.45s
[INFO] running `Command { std: "docker" "inspect" "e6624c7eca3f9f4c3e89fa261244e4682afd63399d2e62977bf926bdcd3fd5c8", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "e6624c7eca3f9f4c3e89fa261244e4682afd63399d2e62977bf926bdcd3fd5c8", kill_on_drop: false }`
[INFO] [stdout] e6624c7eca3f9f4c3e89fa261244e4682afd63399d2e62977bf926bdcd3fd5c8
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:2788e3201cd34a07e3172128adcd8b3090168a8e3bcc40d7c032b9dda1df7d1c" "/opt/rustwide/cargo-home/bin/cargo" "+beta-2024-02-10" "test" "--frozen", kill_on_drop: false }`
[INFO] [stdout] 02bc2d20f3b97495c63daa4699fca137daad94baeb72cfa49c28899c4fa8bfbe
[INFO] running `Command { std: "docker" "start" "-a" "02bc2d20f3b97495c63daa4699fca137daad94baeb72cfa49c28899c4fa8bfbe", kill_on_drop: false }`
[INFO] [stderr]     Finished test [unoptimized + debuginfo] target(s) in 0.16s
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/tokenizers-50fd28f7c40d5a43)
[INFO] [stdout] 
[INFO] [stdout] running 174 tests
[INFO] [stdout] test decoders::fuse::tests::decode ... ok
[INFO] [stdout] test decoders::byte_fallback::tests::decode ... ok
[INFO] [stdout] test decoders::strip::tests::decode ... ok
[INFO] [stdout] test decoders::ctc::tests::handmade_with_delimiter_sample ... ok
[INFO] [stdout] test decoders::ctc::tests::handmade_sample ... ok
[INFO] [stdout] test decoders::sequence::tests::sequence_basic ... ok
[INFO] [stdout] test decoders::ctc::tests::librispeech_sample ... ok
[INFO] [stdout] test decoders::ctc::tests::another_librispeech_sample ... ok
[INFO] [stdout] test decoders::wordpiece::tests::wordpiece_decoder ... ok
[INFO] [stdout] test decoders::tests::decoder_serialization_no_decode ... ok
[INFO] [stdout] test decoders::tests::decoder_serialization ... ok
[INFO] [stdout] test decoders::tests::decoder_serialization_other_no_arg ... ok
[INFO] [stdout] test models::bpe::model::tests::test_bpe_byte_fallback ... ok
[INFO] [stdout] test models::bpe::model::tests::test_ordered_vocab_iter ... ok
[INFO] [stdout] test models::bpe::model::tests::test_bpe_from_file_bad_merges ... ok
[INFO] [stdout] test models::bpe::model::tests::test_bpe_from_file ... ok
[INFO] [stdout] test models::bpe::model::tests::test_bpe_from_file_merge_token_oov ... ok
[INFO] [stdout] test models::bpe::model::tests::test_bpe_with_continuing_subword_prefix ... ok
[INFO] [stdout] test models::bpe::model::tests::test_unk_get_fused ... ok
[INFO] [stdout] test models::bpe::model::tests::test_bpe_byte_fallback_newline ... ok
[INFO] [stdout] test models::bpe::model::tests::test_unk_not_fused ... ok
[INFO] [stdout] test models::bpe::word::tests::test_merge_max_length ... ok
[INFO] [stdout] test models::tests::incomplete_ordered_vocab ... ok
[INFO] [stdout] test models::bpe::model::tests::test_tokenize_with_and_without_dropout ... ok
[INFO] [stdout] test models::bpe::word::tests::test_merge ... ok
[INFO] [stdout] test models::unigram::lattice::tests::set_sentence ... ok
[INFO] [stdout] test models::tests::trainer_wrapper_train_model_wrapper ... ok
[INFO] [stdout] test models::unigram::lattice::tests::insert_test ... ok
[INFO] [stdout] test models::unigram::lattice::tests::test_nbest ... ok
[INFO] [stdout] test models::unigram::lattice::tests::test_viterbi2 ... ok
[INFO] [stdout] test models::unigram::lattice::tests::test_viterbi ... ok
[INFO] [stdout] test models::unigram::model::tests::test_encode ... ok
[INFO] [stdout] test models::unigram::model::tests::test_populate_nodes ... ok
[INFO] [stdout] test models::unigram::lattice::tests::test_populate ... ok
[INFO] [stdout] test models::unigram::lattice::tests::test_log_sum_exp ... ok
[INFO] [stdout] test models::unigram::model::tests::test_populate_nodes_unk ... ok
[INFO] [stdout] test models::unigram::model::tests::test_unigram_bytefallback ... ok
[INFO] [stdout] test models::unigram::trainer::tests::test_initial_alphabet ... ok
[INFO] [stdout] test models::unigram::serialization::test::test_serialization ... ok
[INFO] [stdout] test models::unigram::trainer::tests::test_to_log_prob ... ok
[INFO] [stdout] test models::unigram::serialization::test::test_serialization_unk_id_not_zero ... ok
[INFO] [stdout] test models::unigram::serialization::test::test_serialization_no_unk_id ... ok
[INFO] [stdout] test models::wordlevel::serialization::tests::deserialization_should_fail ... ok
[INFO] [stdout] test models::unigram::model::tests::test_encode2 ... ok
[INFO] [stdout] test models::wordlevel::serialization::tests::incomplete_vocab ... ok
[INFO] [stdout] test models::wordlevel::tests::test_tokenize_missing_unk_token ... ok
[INFO] [stdout] test models::wordlevel::serialization::tests::serde ... ok
[INFO] [stdout] test models::bpe::trainer::tests::test_train ... ok
[INFO] [stdout] test models::wordlevel::trainer::tests::test_train ... ok
[INFO] [stdout] test models::wordpiece::serialization::tests::deserialization_should_fail ... ok
[INFO] [stdout] test models::wordpiece::tests::test_error_display ... ok
[INFO] [stdout] test models::wordlevel::tests::test_tokenize_unk ... ok
[INFO] [stdout] test models::wordpiece::serialization::tests::serde ... ok
[INFO] [stdout] test normalizers::replace::tests::serialization ... ok
[INFO] [stdout] test normalizers::prepend::tests::test_prepend ... ok
[INFO] [stdout] test normalizers::precompiled::tests::expansion_followed_by_removal ... ok
[INFO] [stdout] test normalizers::replace::tests::test_replace ... ok
[INFO] [stdout] test models::bpe::trainer::tests::bpe_test_max_token_length_direct_assert ... ok
[INFO] [stdout] test normalizers::replace::tests::test_replace_decode ... ok
[INFO] [stdout] test normalizers::replace::tests::test_replace_regex ... ok
[INFO] [stdout] test normalizers::strip::tests::test_strip_accents ... ok
[INFO] [stdout] test normalizers::strip::tests::test_strip_accents_multiple ... ok
[INFO] [stdout] test normalizers::strip::tests::test_thai_bug ... ok
[INFO] [stdout] test pre_tokenizers::bert::tests::basic ... ok
[INFO] [stdout] test pre_tokenizers::bert::tests::chinese_chars ... ok
[INFO] [stdout] test normalizers::strip::tests::test_vietnamese_bug ... ok
[INFO] [stdout] test normalizers::unicode::tests::test_nfkc ... ok
[INFO] [stdout] test pre_tokenizers::byte_level::tests::add_prefix_space ... ok
[INFO] [stdout] test models::bpe::trainer::tests::bpe_test_max_token_length_16 ... ok
[INFO] [stdout] test pre_tokenizers::byte_level::tests::decode_unknown_characters ... ok
[INFO] [stdout] test pre_tokenizers::byte_level::tests::decoding ... ok
[INFO] [stdout] test pre_tokenizers::byte_level::tests::deserialization ... ok
[INFO] [stdout] test pre_tokenizers::byte_level::tests::handling_of_multiple_whitespaces ... ok
[INFO] [stdout] test pre_tokenizers::byte_level::tests::handling_of_newlines ... ok
[INFO] [stdout] test pre_tokenizers::byte_level::tests::pre_tokenization ... ok
[INFO] [stdout] test pre_tokenizers::byte_level::tests::decode_works_on_separated_tokens ... ok
[INFO] [stdout] test pre_tokenizers::byte_level::tests::processor_trims_offsets ... ok
[INFO] [stdout] test pre_tokenizers::byte_level::tests::pre_tokenization_no_regex ... ok
[INFO] [stdout] test pre_tokenizers::byte_level::tests::offsets_when_char_split_up ... ok
[INFO] [stdout] test pre_tokenizers::digits::tests::individual_digits ... ok
[INFO] [stdout] test pre_tokenizers::metaspace::tests::basic ... ok
[INFO] [stdout] test pre_tokenizers::digits::tests::numbers ... ok
[INFO] [stdout] test pre_tokenizers::byte_level::tests::processor_trims_offsets_pre_tokenized ... ok
[INFO] [stdout] test pre_tokenizers::metaspace::tests::multiple_spaces ... ok
[INFO] [stdout] test pre_tokenizers::metaspace::tests::serialization ... ok
[INFO] [stdout] test pre_tokenizers::punctuation::tests::punctuation_basic ... ok
[INFO] [stdout] test pre_tokenizers::metaspace::tests::non_legacy_meta_space ... ok
[INFO] [stdout] test pre_tokenizers::sequence::tests::sequence_basic ... ok
[INFO] [stdout] test pre_tokenizers::metaspace::tests::decode ... ok
[INFO] [stdout] test pre_tokenizers::split::tests::basic ... ok
[INFO] [stdout] test pre_tokenizers::split::tests::invert ... ok
[INFO] [stdout] test pre_tokenizers::punctuation::tests::deserialization ... ok
[INFO] [stdout] test pre_tokenizers::split::tests::serialization ... ok
[INFO] [stdout] test pre_tokenizers::split::tests::regex_string ... ok
[INFO] [stdout] test pre_tokenizers::tests::test_deserialize ... ok
[INFO] [stdout] test pre_tokenizers::unicode_scripts::pre_tokenizer::tests::basic ... ok
[INFO] [stdout] test pre_tokenizers::unicode_scripts::pre_tokenizer::tests::spaces_are_included_in_every_script ... ok
[INFO] [stdout] test pre_tokenizers::tests::test_deserialize_whitespace_split ... ok
[INFO] [stdout] test pre_tokenizers::unicode_scripts::scripts::tests::test_unicode_script ... ok
[INFO] [stdout] test pre_tokenizers::unicode_scripts::pre_tokenizer::tests::test_unicode_script ... ok
[INFO] [stdout] test processors::bert::tests::serde ... ok
[INFO] [stdout] test processors::bert::tests::bert_processing ... ok
[INFO] [stdout] test processors::roberta::tests::roberta_processing ... ok
[INFO] [stdout] test pre_tokenizers::whitespace::tests::whitespace_split ... ok
[INFO] [stdout] test processors::sequence::tests::process_chain ... ok
[INFO] [stdout] test processors::roberta::tests::serde ... ok
[INFO] [stdout] test processors::template::tests::expect_wrong_error_message ... ok
[INFO] [stdout] test processors::template::tests::pair_must_use_both_sequences ... ok
[INFO] [stdout] test processors::template::tests::missing_special_tokens ... ok
[INFO] [stdout] test processors::template::tests::piece_serde ... ok
[INFO] [stdout] test processors::template::tests::piece ... ok
[INFO] [stdout] test processors::template::tests::template_processing_overflowing ... ok
[INFO] [stdout] test processors::template::tests::template_processing ... ok
[INFO] [stdout] test processors::template::tests::special_token_serde ... ok
[INFO] [stdout] test processors::template::tests::template_serde ... ok
[INFO] [stdout] test processors::tests::deserialize_bert_roberta_correctly ... ok
[INFO] [stdout] test processors::template::tests::tokens_serde ... ok
[INFO] [stdout] test processors::template::tests::template_processing_serde ... ok
[INFO] [stdout] test tokenizer::added_vocabulary::tests::can_extract_added_tokens ... ok
[INFO] [stdout] test tokenizer::added_vocabulary::tests::empty_matches ... ok
[INFO] [stdout] test tokenizer::added_vocabulary::tests::can_add_special_tokens ... ok
[INFO] [stdout] test tokenizer::added_vocabulary::tests::can_add_tokens ... ok
[INFO] [stdout] test pre_tokenizers::whitespace::tests::basic ... ok
[INFO] [stdout] test models::unigram::trainer::tests::test_special_tokens ... ok
[INFO] [stdout] test tokenizer::encoding::tests::mappings ... ok
[INFO] [stdout] test tokenizer::encoding::tests::merge_encodings ... ok
[INFO] [stdout] test tokenizer::encoding::tests::padding ... ok
[INFO] [stdout] test tokenizer::encoding::tests::truncate ... ok
[INFO] [stdout] test tokenizer::encoding::tests::truncate_left ... ok
[INFO] [stdout] test tokenizer::encoding::tests::truncate_overflow_with_stride ... ok
[INFO] [stdout] test tokenizer::encoding::tests::truncate_to_empty ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::added_around_edges ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::added_characters_alignment ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::append ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::get_range ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::lstrip ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::mixed_addition_and_removal ... ok
[INFO] [stdout] test models::unigram::trainer::tests::test_unigram_chars ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::nfd_adds_new_chars ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::original_range ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::prepend ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::range_conversion ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::remove_at_beginning ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::remove_chars ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::remove_chars_added_by_nfd ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::removed_around_both_edges ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::remove_at_end ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::rstrip ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::slice ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::split ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::replace ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::strip ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::strip_unicode ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::transform_check ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::transform_range_multiple_bytes ... ok
[INFO] [stdout] test tokenizer::pattern::tests::char ... ok
[INFO] [stdout] test tokenizer::pattern::tests::functions ... ok
[INFO] [stdout] test tokenizer::normalizer::tests::transform_range_single_bytes ... ok
[INFO] [stdout] test tokenizer::added_vocabulary::tests::options_use_cases ... ok
[INFO] [stdout] test tokenizer::added_vocabulary::tests::test_lstrip_unicode_space ... ok
[INFO] [stdout] test tokenizer::added_vocabulary::tests::test_single_word_is_correct ... ok
[INFO] [stdout] test tokenizer::pattern::tests::sys_regex ... ok
[INFO] [stdout] test tokenizer::pattern::tests::regex ... ok
[INFO] [stdout] test tokenizer::pattern::tests::str ... ok
[INFO] [stdout] test utils::parallelism::tests::test_maybe_parallel_iterator ... ok
[INFO] [stdout] test utils::padding::tests::pad_to_multiple ... ok
[INFO] [stdout] test utils::truncation::tests::test_deserialize_defaults ... ok
[INFO] [stdout] test tokenizer::added_vocabulary::tests::test_single_word_is_unicode_correct ... ok
[INFO] [stdout] test utils::truncation::tests::truncate_encodings_longest_first ... ok
[INFO] [stdout] test utils::truncation::tests::truncate_encodings_empty ... ok
[INFO] [stdout] test tokenizer::serialization::tests::test_deserialization_serialization_invariant ... ok
[INFO] [stdout] test utils::parallelism::tests::test_maybe_parallel_slice ... ok
[INFO] [stdout] test pre_tokenizers::punctuation::tests::deserialization_erroneous - should panic ... ok
[INFO] [stdout] test models::unigram::trainer::tests::test_unk_token ... ok
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 174 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.11s
[INFO] [stdout] 
[INFO] [stderr]      Running unittests src/cli.rs (/opt/rustwide/target/debug/deps/cli-7287fa002842d317)
[INFO] [stdout] 
[INFO] [stdout] running 0 tests
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
[INFO] [stdout] 
[INFO] [stderr]      Running tests/added_tokens.rs (/opt/rustwide/target/debug/deps/added_tokens-2acad62c1e7c2d4a)
[INFO] [stdout] 
[INFO] [stdout] running 5 tests
[INFO] [stdout] test add_tokens ... ok
[INFO] [stdout] test overlapping_tokens ... FAILED
[INFO] [stdout] test lstrip_tokens ... FAILED
[INFO] [stdout] test rstrip_tokens ... FAILED
[INFO] [stdout] test single_word_tokens ... FAILED
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout] 
[INFO] [stdout] ---- overlapping_tokens stdout ----
[INFO] [stdout] thread 'overlapping_tokens' panicked at tests/common/mod.rs:19:10:
[INFO] [stdout] Files not found, run `make test` to download these files: Os { code: 2, kind: NotFound, message: "No such file or directory" }
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x55a031d4e0f6 - std::backtrace_rs::backtrace::libunwind::trace::h140b6deb6a45c671
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/../../backtrace/src/backtrace/libunwind.rs:104:5
[INFO] [stdout]    1:     0x55a031d4e0f6 - std::backtrace_rs::backtrace::trace_unsynchronized::h8450d7e4e9219aed
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
[INFO] [stdout]    2:     0x55a031d4e0f6 - std::sys_common::backtrace::_print_fmt::hbd28e5e6c6fc3a3f
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/sys_common/backtrace.rs:68:5
[INFO] [stdout]    3:     0x55a031d4e0f6 - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::hb058f285768cf98e
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/sys_common/backtrace.rs:44:22
[INFO] [stdout]    4:     0x55a031d77540 - core::fmt::rt::Argument::fmt::h87dec7a95127da24
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/fmt/rt.rs:142:9
[INFO] [stdout]    5:     0x55a031d77540 - core::fmt::write::h873f89a91a4832db
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/fmt/mod.rs:1120:17
[INFO] [stdout]    6:     0x55a031d4b8ff - std::io::Write::write_fmt::h90f651e9e694a4bb
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/io/mod.rs:1846:15
[INFO] [stdout]    7:     0x55a031d4ded4 - std::sys_common::backtrace::_print::h7719d1529d9a9e13
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/sys_common/backtrace.rs:47:5
[INFO] [stdout]    8:     0x55a031d4ded4 - std::sys_common::backtrace::print::haa3afbd0e7947108
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/sys_common/backtrace.rs:34:9
[INFO] [stdout]    9:     0x55a031d4fc47 - std::panicking::default_hook::{{closure}}::h10e3de2ec0eaff22
[INFO] [stdout]   10:     0x55a031d4f92d - std::panicking::default_hook::hbdc1b1b7fe073dab
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panicking.rs:289:9
[INFO] [stdout]   11:     0x55a03185b5d7 - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::h20f7887d7cd0a330
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/alloc/src/boxed.rs:2029:9
[INFO] [stdout]   12:     0x55a03185b5d7 - test::test_main::{{closure}}::hc125a615957b5cb1
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/test/src/lib.rs:138:21
[INFO] [stdout]   13:     0x55a031d50266 - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::h8c19e0590f8443c4
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/alloc/src/boxed.rs:2029:9
[INFO] [stdout]   14:     0x55a031d50266 - std::panicking::rust_panic_with_hook::hb81692602460473d
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panicking.rs:785:13
[INFO] [stdout]   15:     0x55a031d4ffb2 - std::panicking::begin_panic_handler::{{closure}}::h2470593aa2678e9c
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panicking.rs:659:13
[INFO] [stdout]   16:     0x55a031d4e5f6 - std::sys_common::backtrace::__rust_end_short_backtrace::h560bb50225b0562b
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/sys_common/backtrace.rs:171:18
[INFO] [stdout]   17:     0x55a031d4fd04 - rust_begin_unwind
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panicking.rs:647:5
[INFO] [stdout]   18:     0x55a031816da5 - core::panicking::panic_fmt::h29b6f262f6458dc3
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/panicking.rs:72:14
[INFO] [stdout]   19:     0x55a031817383 - core::result::unwrap_failed::h12bc80647957bcdb
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/result.rs:1649:5
[INFO] [stdout]   20:     0x55a0318260fa - core::result::Result<T,E>::expect::h89373a933f6f68a4
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/result.rs:1030:23
[INFO] [stdout]   21:     0x55a031826eab - added_tokens::common::get_byte_level_bpe::h02ff2b21ec36f683
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/common/mod.rs:17:5
[INFO] [stdout]   22:     0x55a031826f03 - added_tokens::common::get_byte_level::h6f06cb15f0681f58
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/common/mod.rs:24:40
[INFO] [stdout]   23:     0x55a03181ea9b - added_tokens::overlapping_tokens::h11cfa775c833e0f5
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/added_tokens.rs:99:25
[INFO] [stdout]   24:     0x55a03181ea47 - added_tokens::overlapping_tokens::{{closure}}::h53d76ad656e5b76e
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/added_tokens.rs:98:24
[INFO] [stdout]   25:     0x55a031825116 - core::ops::function::FnOnce::call_once::h477bc4c4e54749d2
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   26:     0x55a0318611cf - core::ops::function::FnOnce::call_once::h692fe6f34484199f
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   27:     0x55a0318611cf - test::__rust_begin_short_backtrace::h48b62e76bd60e2de
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/test/src/lib.rs:621:18
[INFO] [stdout]   28:     0x55a03185fff1 - test::run_test_in_process::{{closure}}::h1c68597526ef43db
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/test/src/lib.rs:644:60
[INFO] [stdout]   29:     0x55a03185fff1 - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::hcae98092997f976b
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/panic/unwind_safe.rs:272:9
[INFO] [stdout]   30:     0x55a03185fff1 - std::panicking::try::do_call::h8d1548c2f5bb535a
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panicking.rs:554:40
[INFO] [stdout]   31:     0x55a03185fff1 - std::panicking::try::hbb7a2054f484688e
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panicking.rs:518:19
[INFO] [stdout]   32:     0x55a03185fff1 - std::panic::catch_unwind::h696d12d9d80497c2
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panic.rs:142:14
[INFO] [stdout]   33:     0x55a03185fff1 - test::run_test_in_process::h053367a7217c825b
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/test/src/lib.rs:644:27
[INFO] [stdout]   34:     0x55a03185fff1 - test::run_test::{{closure}}::hfa524e9fabcba78e
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/test/src/lib.rs:567:43
[INFO] [stdout]   35:     0x55a031827456 - test::run_test::{{closure}}::h2c4d0bb741ef7f9f
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/test/src/lib.rs:595:41
[INFO] [stdout]   36:     0x55a031827456 - std::sys_common::backtrace::__rust_begin_short_backtrace::h0d2c708415550075
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/sys_common/backtrace.rs:155:18
[INFO] [stdout]   37:     0x55a03182c417 - std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}}::h76e2635840d7293f
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/thread/mod.rs:529:17
[INFO] [stdout]   38:     0x55a03182c417 - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::haa640b67a810a214
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/panic/unwind_safe.rs:272:9
[INFO] [stdout]   39:     0x55a03182c417 - std::panicking::try::do_call::h41892e3bc2807ab5
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panicking.rs:554:40
[INFO] [stdout]   40:     0x55a03182c417 - std::panicking::try::h861a16d180681c80
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panicking.rs:518:19
[INFO] [stdout]   41:     0x55a03182c417 - std::panic::catch_unwind::h8195f9064b1509fa
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panic.rs:142:14
[INFO] [stdout]   42:     0x55a03182c417 - std::thread::Builder::spawn_unchecked_::{{closure}}::h73cc419da1217371
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/thread/mod.rs:528:30
[INFO] [stdout]   43:     0x55a03182c417 - core::ops::function::FnOnce::call_once{{vtable.shim}}::h79dc6499ff073b09
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   44:     0x55a031d54715 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::ha718e8cdc51a5182
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/alloc/src/boxed.rs:2015:9
[INFO] [stdout]   45:     0x55a031d54715 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h86072abc877c5474
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/alloc/src/boxed.rs:2015:9
[INFO] [stdout]   46:     0x55a031d54715 - std::sys::pal::unix::thread::Thread::new::thread_start::hac4056197c365894
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/sys/pal/unix/thread.rs:108:17
[INFO] [stdout]   47:     0x7f52ccfb5ac3 - <unknown>
[INFO] [stdout]   48:     0x7f52cd046bf4 - __clone
[INFO] [stdout]   49:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] ---- lstrip_tokens stdout ----
[INFO] [stdout] thread 'lstrip_tokens' panicked at tests/common/mod.rs:19:10:
[INFO] [stdout] Files not found, run `make test` to download these files: Os { code: 2, kind: NotFound, message: "No such file or directory" }
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x55a031d4e0f6 - std::backtrace_rs::backtrace::libunwind::trace::h140b6deb6a45c671
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/../../backtrace/src/backtrace/libunwind.rs:104:5
[INFO] [stdout]    1:     0x55a031d4e0f6 - std::backtrace_rs::backtrace::trace_unsynchronized::h8450d7e4e9219aed
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
[INFO] [stdout]    2:     0x55a031d4e0f6 - std::sys_common::backtrace::_print_fmt::hbd28e5e6c6fc3a3f
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/sys_common/backtrace.rs:68:5
[INFO] [stdout]    3:     0x55a031d4e0f6 - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::hb058f285768cf98e
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/sys_common/backtrace.rs:44:22
[INFO] [stdout]    4:     0x55a031d77540 - core::fmt::rt::Argument::fmt::h87dec7a95127da24
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/fmt/rt.rs:142:9
[INFO] [stdout]    5:     0x55a031d77540 - core::fmt::write::h873f89a91a4832db
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/fmt/mod.rs:1120:17
[INFO] [stdout]    6:     0x55a031d4b8ff - std::io::Write::write_fmt::h90f651e9e694a4bb
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/io/mod.rs:1846:15
[INFO] [stdout]    7:     0x55a031d4ded4 - std::sys_common::backtrace::_print::h7719d1529d9a9e13
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/sys_common/backtrace.rs:47:5
[INFO] [stdout]    8:     0x55a031d4ded4 - std::sys_common::backtrace::print::haa3afbd0e7947108
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/sys_common/backtrace.rs:34:9
[INFO] [stdout]    9:     0x55a031d4fc47 - std::panicking::default_hook::{{closure}}::h10e3de2ec0eaff22
[INFO] [stdout]   10:     0x55a031d4f92d - std::panicking::default_hook::hbdc1b1b7fe073dab
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panicking.rs:289:9
[INFO] [stdout]   11:     0x55a03185b5d7 - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::h20f7887d7cd0a330
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/alloc/src/boxed.rs:2029:9
[INFO] [stdout]   12:     0x55a03185b5d7 - test::test_main::{{closure}}::hc125a615957b5cb1
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/test/src/lib.rs:138:21
[INFO] [stdout]   13:     0x55a031d50266 - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::h8c19e0590f8443c4
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/alloc/src/boxed.rs:2029:9
[INFO] [stdout]   14:     0x55a031d50266 - std::panicking::rust_panic_with_hook::hb81692602460473d
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panicking.rs:785:13
[INFO] [stdout]   15:     0x55a031d4ffb2 - std::panicking::begin_panic_handler::{{closure}}::h2470593aa2678e9c
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panicking.rs:659:13
[INFO] [stdout]   16:     0x55a031d4e5f6 - std::sys_common::backtrace::__rust_end_short_backtrace::h560bb50225b0562b
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/sys_common/backtrace.rs:171:18
[INFO] [stdout]   17:     0x55a031d4fd04 - rust_begin_unwind
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panicking.rs:647:5
[INFO] [stdout]   18:     0x55a031816da5 - core::panicking::panic_fmt::h29b6f262f6458dc3
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/panicking.rs:72:14
[INFO] [stdout]   19:     0x55a031817383 - core::result::unwrap_failed::h12bc80647957bcdb
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/result.rs:1649:5
[INFO] [stdout]   20:     0x55a0318260fa - core::result::Result<T,E>::expect::h89373a933f6f68a4
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/result.rs:1030:23
[INFO] [stdout]   21:     0x55a031826eab - added_tokens::common::get_byte_level_bpe::h02ff2b21ec36f683
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/common/mod.rs:17:5
[INFO] [stdout]   22:     0x55a031826f03 - added_tokens::common::get_byte_level::h6f06cb15f0681f58
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/common/mod.rs:24:40
[INFO] [stdout]   23:     0x55a03181d74b - added_tokens::lstrip_tokens::h063844ac60389969
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/added_tokens.rs:33:25
[INFO] [stdout]   24:     0x55a03181d6f7 - added_tokens::lstrip_tokens::{{closure}}::hd192bdcea248345a
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/added_tokens.rs:32:19
[INFO] [stdout]   25:     0x55a0318250d6 - core::ops::function::FnOnce::call_once::h1f5b898218c2fae0
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   26:     0x55a0318611cf - core::ops::function::FnOnce::call_once::h692fe6f34484199f
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   27:     0x55a0318611cf - test::__rust_begin_short_backtrace::h48b62e76bd60e2de
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/test/src/lib.rs:621:18
[INFO] [stdout]   28:     0x55a03185fff1 - test::run_test_in_process::{{closure}}::h1c68597526ef43db
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/test/src/lib.rs:644:60
[INFO] [stdout]   29:     0x55a03185fff1 - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::hcae98092997f976b
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/panic/unwind_safe.rs:272:9
[INFO] [stdout]   30:     0x55a03185fff1 - std::panicking::try::do_call::h8d1548c2f5bb535a
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panicking.rs:554:40
[INFO] [stdout]   31:     0x55a03185fff1 - std::panicking::try::hbb7a2054f484688e
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panicking.rs:518:19
[INFO] [stdout]   32:     0x55a03185fff1 - std::panic::catch_unwind::h696d12d9d80497c2
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panic.rs:142:14
[INFO] [stdout]   33:     0x55a03185fff1 - test::run_test_in_process::h053367a7217c825b
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/test/src/lib.rs:644:27
[INFO] [stdout]   34:     0x55a03185fff1 - test::run_test::{{closure}}::hfa524e9fabcba78e
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/test/src/lib.rs:567:43
[INFO] [stdout]   35:     0x55a031827456 - test::run_test::{{closure}}::h2c4d0bb741ef7f9f
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/test/src/lib.rs:595:41
[INFO] [stdout]   36:     0x55a031827456 - std::sys_common::backtrace::__rust_begin_short_backtrace::h0d2c708415550075
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/sys_common/backtrace.rs:155:18
[INFO] [stdout]   37:     0x55a03182c417 - std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}}::h76e2635840d7293f
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/thread/mod.rs:529:17
[INFO] [stdout]   38:     0x55a03182c417 - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::haa640b67a810a214
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/panic/unwind_safe.rs:272:9
[INFO] [stdout]   39:     0x55a03182c417 - std::panicking::try::do_call::h41892e3bc2807ab5
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panicking.rs:554:40
[INFO] [stdout]   40:     0x55a03182c417 - std::panicking::try::h861a16d180681c80
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panicking.rs:518:19
[INFO] [stdout]   41:     0x55a03182c417 - std::panic::catch_unwind::h8195f9064b1509fa
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panic.rs:142:14
[INFO] [stdout]   42:     0x55a03182c417 - std::thread::Builder::spawn_unchecked_::{{closure}}::h73cc419da1217371
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/thread/mod.rs:528:30
[INFO] [stdout]   43:     0x55a03182c417 - core::ops::function::FnOnce::call_once{{vtable.shim}}::h79dc6499ff073b09
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   44:     0x55a031d54715 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::ha718e8cdc51a5182
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/alloc/src/boxed.rs:2015:9
[INFO] [stdout]   45:     0x55a031d54715 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h86072abc877c5474
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/alloc/src/boxed.rs:2015:9
[INFO] [stdout]   46:     0x55a031d54715 - std::sys::pal::unix::thread::Thread::new::thread_start::hac4056197c365894
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/sys/pal/unix/thread.rs:108:17
[INFO] [stdout]   47:     0x7f52ccfb5ac3 - <unknown>
[INFO] [stdout]   48:     0x7f52cd046bf4 - __clone
[INFO] [stdout]   49:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] ---- rstrip_tokens stdout ----
[INFO] [stdout] thread 'rstrip_tokens' panicked at tests/common/mod.rs:19:10:
[INFO] [stdout] Files not found, run `make test` to download these files: Os { code: 2, kind: NotFound, message: "No such file or directory" }
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x55a031d4e0f6 - std::backtrace_rs::backtrace::libunwind::trace::h140b6deb6a45c671
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/../../backtrace/src/backtrace/libunwind.rs:104:5
[INFO] [stdout]    1:     0x55a031d4e0f6 - std::backtrace_rs::backtrace::trace_unsynchronized::h8450d7e4e9219aed
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
[INFO] [stdout]    2:     0x55a031d4e0f6 - std::sys_common::backtrace::_print_fmt::hbd28e5e6c6fc3a3f
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/sys_common/backtrace.rs:68:5
[INFO] [stdout]    3:     0x55a031d4e0f6 - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::hb058f285768cf98e
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/sys_common/backtrace.rs:44:22
[INFO] [stdout]    4:     0x55a031d77540 - core::fmt::rt::Argument::fmt::h87dec7a95127da24
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/fmt/rt.rs:142:9
[INFO] [stdout]    5:     0x55a031d77540 - core::fmt::write::h873f89a91a4832db
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/fmt/mod.rs:1120:17
[INFO] [stdout]    6:     0x55a031d4b8ff - std::io::Write::write_fmt::h90f651e9e694a4bb
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/io/mod.rs:1846:15
[INFO] [stdout]    7:     0x55a031d4ded4 - std::sys_common::backtrace::_print::h7719d1529d9a9e13
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/sys_common/backtrace.rs:47:5
[INFO] [stdout]    8:     0x55a031d4ded4 - std::sys_common::backtrace::print::haa3afbd0e7947108
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/sys_common/backtrace.rs:34:9
[INFO] [stdout]    9:     0x55a031d4fc47 - std::panicking::default_hook::{{closure}}::h10e3de2ec0eaff22
[INFO] [stdout]   10:     0x55a031d4f92d - std::panicking::default_hook::hbdc1b1b7fe073dab
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panicking.rs:289:9
[INFO] [stdout]   11:     0x55a03185b5d7 - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::h20f7887d7cd0a330
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/alloc/src/boxed.rs:2029:9
[INFO] [stdout]   12:     0x55a03185b5d7 - test::test_main::{{closure}}::hc125a615957b5cb1
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/test/src/lib.rs:138:21
[INFO] [stdout]   13:     0x55a031d50266 - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::h8c19e0590f8443c4
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/alloc/src/boxed.rs:2029:9
[INFO] [stdout]   14:     0x55a031d50266 - std::panicking::rust_panic_with_hook::hb81692602460473d
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panicking.rs:785:13
[INFO] [stdout]   15:     0x55a031d4ffb2 - std::panicking::begin_panic_handler::{{closure}}::h2470593aa2678e9c
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panicking.rs:659:13
[INFO] [stdout]   16:     0x55a031d4e5f6 - std::sys_common::backtrace::__rust_end_short_backtrace::h560bb50225b0562b
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/sys_common/backtrace.rs:171:18
[INFO] [stdout]   17:     0x55a031d4fd04 - rust_begin_unwind
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panicking.rs:647:5
[INFO] [stdout]   18:     0x55a031816da5 - core::panicking::panic_fmt::h29b6f262f6458dc3
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/panicking.rs:72:14
[INFO] [stdout]   19:     0x55a031817383 - core::result::unwrap_failed::h12bc80647957bcdb
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/result.rs:1649:5
[INFO] [stdout]   20:     0x55a0318260fa - core::result::Result<T,E>::expect::h89373a933f6f68a4
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/result.rs:1030:23
[INFO] [stdout]   21:     0x55a031826eab - added_tokens::common::get_byte_level_bpe::h02ff2b21ec36f683
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/common/mod.rs:17:5
[INFO] [stdout]   22:     0x55a031826f03 - added_tokens::common::get_byte_level::h6f06cb15f0681f58
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/common/mod.rs:24:40
[INFO] [stdout]   23:     0x55a03181dbff - added_tokens::rstrip_tokens::h0ddcd54b4daa9b21
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/added_tokens.rs:51:25
[INFO] [stdout]   24:     0x55a03181db97 - added_tokens::rstrip_tokens::{{closure}}::h4eafe4d326817742
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/added_tokens.rs:50:19
[INFO] [stdout]   25:     0x55a0318251e6 - core::ops::function::FnOnce::call_once::ha1186de9a2471d15
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   26:     0x55a0318611cf - core::ops::function::FnOnce::call_once::h692fe6f34484199f
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   27:     0x55a0318611cf - test::__rust_begin_short_backtrace::h48b62e76bd60e2de
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/test/src/lib.rs:621:18
[INFO] [stdout]   28:     0x55a03185fff1 - test::run_test_in_process::{{closure}}::h1c68597526ef43db
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/test/src/lib.rs:644:60
[INFO] [stdout]   29:     0x55a03185fff1 - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::hcae98092997f976b
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/panic/unwind_safe.rs:272:9
[INFO] [stdout]   30:     0x55a03185fff1 - std::panicking::try::do_call::h8d1548c2f5bb535a
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panicking.rs:554:40
[INFO] [stdout]   31:     0x55a03185fff1 - std::panicking::try::hbb7a2054f484688e
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panicking.rs:518:19
[INFO] [stdout]   32:     0x55a03185fff1 - std::panic::catch_unwind::h696d12d9d80497c2
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panic.rs:142:14
[INFO] [stdout]   33:     0x55a03185fff1 - test::run_test_in_process::h053367a7217c825b
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/test/src/lib.rs:644:27
[INFO] [stdout]   34:     0x55a03185fff1 - test::run_test::{{closure}}::hfa524e9fabcba78e
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/test/src/lib.rs:567:43
[INFO] [stdout]   35:     0x55a031827456 - test::run_test::{{closure}}::h2c4d0bb741ef7f9f
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/test/src/lib.rs:595:41
[INFO] [stdout]   36:     0x55a031827456 - std::sys_common::backtrace::__rust_begin_short_backtrace::h0d2c708415550075
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/sys_common/backtrace.rs:155:18
[INFO] [stdout]   37:     0x55a03182c417 - std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}}::h76e2635840d7293f
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/thread/mod.rs:529:17
[INFO] [stdout]   38:     0x55a03182c417 - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::haa640b67a810a214
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/panic/unwind_safe.rs:272:9
[INFO] [stdout]   39:     0x55a03182c417 - std::panicking::try::do_call::h41892e3bc2807ab5
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panicking.rs:554:40
[INFO] [stdout]   40:     0x55a03182c417 - std::panicking::try::h861a16d180681c80
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panicking.rs:518:19
[INFO] [stdout]   41:     0x55a03182c417 - std::panic::catch_unwind::h8195f9064b1509fa
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panic.rs:142:14
[INFO] [stdout]   42:     0x55a03182c417 - std::thread::Builder::spawn_unchecked_::{{closure}}::h73cc419da1217371
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/thread/mod.rs:528:30
[INFO] [stdout]   43:     0x55a03182c417 - core::ops::function::FnOnce::call_once{{vtable.shim}}::h79dc6499ff073b09
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   44:     0x55a031d54715 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::ha718e8cdc51a5182
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/alloc/src/boxed.rs:2015:9
[INFO] [stdout]   45:     0x55a031d54715 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h86072abc877c5474
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/alloc/src/boxed.rs:2015:9
[INFO] [stdout]   46:     0x55a031d54715 - std::sys::pal::unix::thread::Thread::new::thread_start::hac4056197c365894
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/sys/pal/unix/thread.rs:108:17
[INFO] [stdout]   47:     0x7f52ccfb5ac3 - <unknown>
[INFO] [stdout]   48:     0x7f52cd046bf4 - __clone
[INFO] [stdout]   49:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] ---- single_word_tokens stdout ----
[INFO] [stdout] thread 'single_word_tokens' panicked at tests/common/mod.rs:19:10:
[INFO] [stdout] Files not found, run `make test` to download these files: Os { code: 2, kind: NotFound, message: "No such file or directory" }
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x55a031d4e0f6 - std::backtrace_rs::backtrace::libunwind::trace::h140b6deb6a45c671
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/../../backtrace/src/backtrace/libunwind.rs:104:5
[INFO] [stdout]    1:     0x55a031d4e0f6 - std::backtrace_rs::backtrace::trace_unsynchronized::h8450d7e4e9219aed
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
[INFO] [stdout]    2:     0x55a031d4e0f6 - std::sys_common::backtrace::_print_fmt::hbd28e5e6c6fc3a3f
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/sys_common/backtrace.rs:68:5
[INFO] [stdout]    3:     0x55a031d4e0f6 - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::hb058f285768cf98e
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/sys_common/backtrace.rs:44:22
[INFO] [stdout]    4:     0x55a031d77540 - core::fmt::rt::Argument::fmt::h87dec7a95127da24
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/fmt/rt.rs:142:9
[INFO] [stdout]    5:     0x55a031d77540 - core::fmt::write::h873f89a91a4832db
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/fmt/mod.rs:1120:17
[INFO] [stdout]    6:     0x55a031d4b8ff - std::io::Write::write_fmt::h90f651e9e694a4bb
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/io/mod.rs:1846:15
[INFO] [stdout]    7:     0x55a031d4ded4 - std::sys_common::backtrace::_print::h7719d1529d9a9e13
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/sys_common/backtrace.rs:47:5
[INFO] [stdout]    8:     0x55a031d4ded4 - std::sys_common::backtrace::print::haa3afbd0e7947108
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/sys_common/backtrace.rs:34:9
[INFO] [stdout]    9:     0x55a031d4fc47 - std::panicking::default_hook::{{closure}}::h10e3de2ec0eaff22
[INFO] [stdout]   10:     0x55a031d4f92d - std::panicking::default_hook::hbdc1b1b7fe073dab
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panicking.rs:289:9
[INFO] [stdout]   11:     0x55a03185b5d7 - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::h20f7887d7cd0a330
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/alloc/src/boxed.rs:2029:9
[INFO] [stdout]   12:     0x55a03185b5d7 - test::test_main::{{closure}}::hc125a615957b5cb1
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/test/src/lib.rs:138:21
[INFO] [stdout]   13:     0x55a031d50266 - <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call::h8c19e0590f8443c4
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/alloc/src/boxed.rs:2029:9
[INFO] [stdout]   14:     0x55a031d50266 - std::panicking::rust_panic_with_hook::hb81692602460473d
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panicking.rs:785:13
[INFO] [stdout]   15:     0x55a031d4ffb2 - std::panicking::begin_panic_handler::{{closure}}::h2470593aa2678e9c
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panicking.rs:659:13
[INFO] [stdout]   16:     0x55a031d4e5f6 - std::sys_common::backtrace::__rust_end_short_backtrace::h560bb50225b0562b
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/sys_common/backtrace.rs:171:18
[INFO] [stdout]   17:     0x55a031d4fd04 - rust_begin_unwind
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panicking.rs:647:5
[INFO] [stdout]   18:     0x55a031816da5 - core::panicking::panic_fmt::h29b6f262f6458dc3
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/panicking.rs:72:14
[INFO] [stdout]   19:     0x55a031817383 - core::result::unwrap_failed::h12bc80647957bcdb
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/result.rs:1649:5
[INFO] [stdout]   20:     0x55a0318260fa - core::result::Result<T,E>::expect::h89373a933f6f68a4
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/result.rs:1030:23
[INFO] [stdout]   21:     0x55a031826eab - added_tokens::common::get_byte_level_bpe::h02ff2b21ec36f683
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/common/mod.rs:17:5
[INFO] [stdout]   22:     0x55a031826f03 - added_tokens::common::get_byte_level::h6f06cb15f0681f58
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/common/mod.rs:24:40
[INFO] [stdout]   23:     0x55a03181e35f - added_tokens::single_word_tokens::h96231b526d3b4480
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/added_tokens.rs:79:25
[INFO] [stdout]   24:     0x55a03181e2f7 - added_tokens::single_word_tokens::{{closure}}::hded5efa23bd47940
[INFO] [stdout]                                at /opt/rustwide/workdir/tests/added_tokens.rs:77:24
[INFO] [stdout]   25:     0x55a031825156 - core::ops::function::FnOnce::call_once::h5959169a0be81ff0
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   26:     0x55a0318611cf - core::ops::function::FnOnce::call_once::h692fe6f34484199f
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   27:     0x55a0318611cf - test::__rust_begin_short_backtrace::h48b62e76bd60e2de
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/test/src/lib.rs:621:18
[INFO] [stdout]   28:     0x55a03185fff1 - test::run_test_in_process::{{closure}}::h1c68597526ef43db
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/test/src/lib.rs:644:60
[INFO] [stdout]   29:     0x55a03185fff1 - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::hcae98092997f976b
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/panic/unwind_safe.rs:272:9
[INFO] [stdout]   30:     0x55a03185fff1 - std::panicking::try::do_call::h8d1548c2f5bb535a
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panicking.rs:554:40
[INFO] [stdout]   31:     0x55a03185fff1 - std::panicking::try::hbb7a2054f484688e
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panicking.rs:518:19
[INFO] [stdout]   32:     0x55a03185fff1 - std::panic::catch_unwind::h696d12d9d80497c2
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panic.rs:142:14
[INFO] [stdout]   33:     0x55a03185fff1 - test::run_test_in_process::h053367a7217c825b
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/test/src/lib.rs:644:27
[INFO] [stdout]   34:     0x55a03185fff1 - test::run_test::{{closure}}::hfa524e9fabcba78e
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/test/src/lib.rs:567:43
[INFO] [stdout]   35:     0x55a031827456 - test::run_test::{{closure}}::h2c4d0bb741ef7f9f
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/test/src/lib.rs:595:41
[INFO] [stdout]   36:     0x55a031827456 - std::sys_common::backtrace::__rust_begin_short_backtrace::h0d2c708415550075
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/sys_common/backtrace.rs:155:18
[INFO] [stdout]   37:     0x55a03182c417 - std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}}::h76e2635840d7293f
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/thread/mod.rs:529:17
[INFO] [stdout]   38:     0x55a03182c417 - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::haa640b67a810a214
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/panic/unwind_safe.rs:272:9
[INFO] [stdout]   39:     0x55a03182c417 - std::panicking::try::do_call::h41892e3bc2807ab5
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panicking.rs:554:40
[INFO] [stdout]   40:     0x55a03182c417 - std::panicking::try::h861a16d180681c80
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panicking.rs:518:19
[INFO] [stdout]   41:     0x55a03182c417 - std::panic::catch_unwind::h8195f9064b1509fa
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/panic.rs:142:14
[INFO] [stdout]   42:     0x55a03182c417 - std::thread::Builder::spawn_unchecked_::{{closure}}::h73cc419da1217371
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/thread/mod.rs:528:30
[INFO] [stdout]   43:     0x55a03182c417 - core::ops::function::FnOnce::call_once{{vtable.shim}}::h79dc6499ff073b09
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   44:     0x55a031d54715 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::ha718e8cdc51a5182
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/alloc/src/boxed.rs:2015:9
[INFO] [stdout]   45:     0x55a031d54715 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::h86072abc877c5474
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/alloc/src/boxed.rs:2015:9
[INFO] [stdout]   46:     0x55a031d54715 - std::sys::pal::unix::thread::Thread::new::thread_start::hac4056197c365894
[INFO] [stdout]                                at /rustc/f2048098a1ca42a520e7bed68e321a66edc0a1b1/library/std/src/sys/pal/unix/thread.rs:108:17
[INFO] [stdout]   47:     0x7f52ccfb5ac3 - <unknown>
[INFO] [stdout]   48:     0x7f52cd046bf4 - __clone
[INFO] [stdout]   49:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout]     lstrip_tokens
[INFO] [stdout]     overlapping_tokens
[INFO] [stdout]     rstrip_tokens
[INFO] [stdout]     single_word_tokens
[INFO] [stdout] 
[INFO] [stdout] test result: FAILED. 1 passed; 4 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.06s
[INFO] [stdout] 
[INFO] [stderr] error: test failed, to rerun pass `--test added_tokens`
[INFO] running `Command { std: "docker" "inspect" "02bc2d20f3b97495c63daa4699fca137daad94baeb72cfa49c28899c4fa8bfbe", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "02bc2d20f3b97495c63daa4699fca137daad94baeb72cfa49c28899c4fa8bfbe", kill_on_drop: false }`
[INFO] [stdout] 02bc2d20f3b97495c63daa4699fca137daad94baeb72cfa49c28899c4fa8bfbe
