[INFO] fetching crate tokenizers 0.15.0... [INFO] checking tokenizers-0.15.0 against master#385fa9d845dd326c6bbfd58c22244215e431948a for absurd-question-mark-desugar [INFO] extracting crate tokenizers 0.15.0 into /workspace/builds/worker-5-tc1/source [INFO] validating manifest of crates.io crate tokenizers 0.15.0 on toolchain 385fa9d845dd326c6bbfd58c22244215e431948a [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+385fa9d845dd326c6bbfd58c22244215e431948a" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }` [INFO] started tweaking crates.io crate tokenizers 0.15.0 [INFO] finished tweaking crates.io crate tokenizers 0.15.0 [INFO] tweaked toml for crates.io crate tokenizers 0.15.0 written to /workspace/builds/worker-5-tc1/source/Cargo.toml [INFO] crate crates.io crate tokenizers 0.15.0 already has a lockfile, it will not be regenerated [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+385fa9d845dd326c6bbfd58c22244215e431948a" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] [stderr] Updating crates.io index [INFO] [stderr] Downloading crates ... [INFO] [stderr] Downloaded monostate-impl v0.1.9 [INFO] [stderr] Downloaded libredox v0.0.1 [INFO] [stderr] Downloaded rayon-cond v0.3.0 [INFO] [stderr] Downloaded macro_rules_attribute-proc_macro v0.2.0 [INFO] [stderr] Downloaded redox_users v0.4.4 [INFO] [stderr] Downloaded macro_rules_attribute v0.2.0 [INFO] [stderr] Downloaded monostate v0.1.9 [INFO] [stderr] Downloaded hf-hub v0.3.2 [INFO] [stderr] Downloaded esaxx-rs v0.1.10 [INFO] [stderr] Downloaded rustix v0.38.23 [INFO] [stderr] Downloaded unicode-normalization-alignments v0.1.12 [INFO] [stderr] Downloaded spm_precompiled v0.1.4 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:2788e3201cd34a07e3172128adcd8b3090168a8e3bcc40d7c032b9dda1df7d1c" "/opt/rustwide/cargo-home/bin/cargo" "+385fa9d845dd326c6bbfd58c22244215e431948a" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }` [INFO] [stdout] 00b5d6c820d000347f15a59d62df2a7ceca88a9468730554287be9a2c4af33cd [INFO] running `Command { std: "docker" "start" "-a" "00b5d6c820d000347f15a59d62df2a7ceca88a9468730554287be9a2c4af33cd", kill_on_drop: false }` [INFO] running `Command { std: "docker" "inspect" "00b5d6c820d000347f15a59d62df2a7ceca88a9468730554287be9a2c4af33cd", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "00b5d6c820d000347f15a59d62df2a7ceca88a9468730554287be9a2c4af33cd", kill_on_drop: false }` [INFO] [stdout] 00b5d6c820d000347f15a59d62df2a7ceca88a9468730554287be9a2c4af33cd [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:2788e3201cd34a07e3172128adcd8b3090168a8e3bcc40d7c032b9dda1df7d1c" "/opt/rustwide/cargo-home/bin/cargo" "+385fa9d845dd326c6bbfd58c22244215e431948a" "check" "--frozen" "--all" "--all-targets" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] c279314f57c2a637e9bf51be0e09a3c767fe599d7efdad78e784b231e6a1146f [INFO] running `Command { std: "docker" "start" "-a" "c279314f57c2a637e9bf51be0e09a3c767fe599d7efdad78e784b231e6a1146f", kill_on_drop: false }` [INFO] [stderr] Compiling proc-macro2 v1.0.69 [INFO] [stderr] Compiling libc v0.2.150 [INFO] [stderr] Compiling serde v1.0.192 [INFO] [stderr] Compiling syn v1.0.109 [INFO] [stderr] Checking either v1.9.0 [INFO] [stderr] Compiling ident_case v1.0.1 [INFO] [stderr] Compiling strsim v0.10.0 [INFO] [stderr] Checking memchr v2.6.4 [INFO] [stderr] Compiling fnv v1.0.7 [INFO] [stderr] Compiling rayon-core v1.12.0 [INFO] [stderr] Checking anstyle-parse v0.2.2 [INFO] [stderr] Compiling serde_json v1.0.108 [INFO] [stderr] Checking anstyle v1.0.4 [INFO] [stderr] Checking ryu v1.0.15 [INFO] [stderr] Checking crossbeam-epoch v0.9.15 [INFO] [stderr] Compiling portable-atomic v1.5.1 [INFO] [stderr] Checking itoa v1.0.9 [INFO] [stderr] Checking regex-syntax v0.8.2 [INFO] [stderr] Checking clap_lex v0.6.0 [INFO] [stderr] Compiling rustix v0.38.23 [INFO] [stderr] Checking anstream v0.6.4 [INFO] [stderr] Compiling num-traits v0.2.17 [INFO] [stderr] Checking linux-raw-sys v0.4.11 [INFO] [stderr] Compiling thiserror v1.0.50 [INFO] [stderr] Checking crossbeam-deque v0.8.3 [INFO] [stderr] Checking bitflags v2.4.1 [INFO] [stderr] Checking itertools v0.11.0 [INFO] [stderr] Checking clap_builder v4.4.8 [INFO] [stderr] Checking unicode-segmentation v1.10.1 [INFO] [stderr] Checking smallvec v1.11.2 [INFO] [stderr] Compiling macro_rules_attribute-proc_macro v0.2.0 [INFO] [stderr] Checking itertools v0.10.5 [INFO] [stderr] Checking aho-corasick v1.1.2 [INFO] [stderr] Checking nom v7.1.3 [INFO] [stderr] Checking unicode-normalization-alignments v0.1.12 [INFO] [stderr] Checking rayon v1.8.0 [INFO] [stderr] Checking log v0.4.20 [INFO] [stderr] Checking macro_rules_attribute v0.2.0 [INFO] [stderr] Checking unicode_categories v0.1.1 [INFO] [stderr] Checking regex-syntax v0.7.5 [INFO] [stderr] Checking walkdir v2.4.0 [INFO] [stderr] Compiling quote v1.0.33 [INFO] [stderr] Compiling syn v2.0.39 [INFO] [stderr] Checking fastrand v2.0.1 [INFO] [stderr] Checking assert_approx_eq v1.1.0 [INFO] [stderr] Checking getrandom v0.2.11 [INFO] [stderr] Checking console v0.15.7 [INFO] [stderr] Checking regex-automata v0.4.3 [INFO] [stderr] Checking rand_core v0.6.4 [INFO] [stderr] Checking indicatif v0.17.7 [INFO] [stderr] Checking criterion-plot v0.5.0 [INFO] [stderr] Checking rand_chacha v0.3.1 [INFO] [stderr] Checking plotters v0.3.5 [INFO] [stderr] Checking rand v0.8.5 [INFO] [stderr] Compiling cc v1.0.83 [INFO] [stderr] Checking rayon-cond v0.3.0 [INFO] [stderr] Compiling onig_sys v69.8.1 [INFO] [stderr] Compiling esaxx-rs v0.1.10 [INFO] [stderr] Checking regex v1.10.2 [INFO] [stderr] Checking is-terminal v0.4.9 [INFO] [stderr] Checking tempfile v3.8.1 [INFO] [stderr] Compiling serde_derive v1.0.192 [INFO] [stderr] Compiling clap_derive v4.4.7 [INFO] [stderr] Compiling monostate-impl v0.1.9 [INFO] [stderr] Compiling thiserror-impl v1.0.50 [INFO] [stderr] Compiling darling_core v0.14.4 [INFO] [stderr] Checking clap v4.4.8 [INFO] [stderr] Compiling darling_macro v0.14.4 [INFO] [stderr] Compiling darling v0.14.4 [INFO] [stderr] Compiling derive_builder_core v0.12.0 [INFO] [stderr] Checking onig v6.4.0 [INFO] [stderr] Compiling derive_builder_macro v0.12.0 [INFO] [stderr] Checking derive_builder v0.12.0 [INFO] [stderr] Checking monostate v0.1.9 [INFO] [stderr] Checking spm_precompiled v0.1.4 [INFO] [stderr] Checking ciborium v0.2.1 [INFO] [stderr] Checking tinytemplate v1.2.1 [INFO] [stderr] Checking tokenizers v0.15.0 (/opt/rustwide/workdir) [INFO] [stderr] Checking criterion v0.5.1 [INFO] [stdout] warning: the item `BufRead` is imported redundantly [INFO] [stdout] --> src/models/bpe/model.rs:11:10 [INFO] [stdout] | [INFO] [stdout] 10 | io::prelude::*, [INFO] [stdout] | -------------- the item `BufRead` is already imported here [INFO] [stdout] 11 | io::{BufRead, BufReader}, [INFO] [stdout] | ^^^^^^^ [INFO] [stdout] | [INFO] [stdout] = note: `#[warn(unused_imports)]` on by default [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: the item `BufRead` is imported redundantly [INFO] [stdout] --> src/models/wordpiece/mod.rs:11:10 [INFO] [stdout] | [INFO] [stdout] 10 | io::prelude::*, [INFO] [stdout] | -------------- the item `BufRead` is already imported here [INFO] [stdout] 11 | io::{BufRead, BufReader}, [INFO] [stdout] | ^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: the item `serde` is imported redundantly [INFO] [stdout] --> src/tokenizer/serialization.rs:4:5 [INFO] [stdout] | [INFO] [stdout] 4 | self, [INFO] [stdout] | ^^^^ the item `serde` is already defined by prelude [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: the item `Encoding` is imported redundantly [INFO] [stdout] --> src/utils/padding.rs:86:9 [INFO] [stdout] | [INFO] [stdout] 85 | use super::*; [INFO] [stdout] | -------- the item `Encoding` is already imported here [INFO] [stdout] 86 | use crate::tokenizer::Encoding; [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^^^^^^^^^ [INFO] [stdout] | [INFO] [stdout] = note: `#[warn(unused_imports)]` on by default [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: the item `Encoding` is imported redundantly [INFO] [stdout] --> src/utils/truncation.rs:172:9 [INFO] [stdout] | [INFO] [stdout] 171 | use super::*; [INFO] [stdout] | -------- the item `Encoding` is already imported here [INFO] [stdout] 172 | use crate::tokenizer::Encoding; [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: the item `BufRead` is imported redundantly [INFO] [stdout] --> src/models/bpe/model.rs:11:10 [INFO] [stdout] | [INFO] [stdout] 10 | io::prelude::*, [INFO] [stdout] | -------------- the item `BufRead` is already imported here [INFO] [stdout] 11 | io::{BufRead, BufReader}, [INFO] [stdout] | ^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: the item `BufRead` is imported redundantly [INFO] [stdout] --> src/models/wordpiece/mod.rs:11:10 [INFO] [stdout] | [INFO] [stdout] 10 | io::prelude::*, [INFO] [stdout] | -------------- the item `BufRead` is already imported here [INFO] [stdout] 11 | io::{BufRead, BufReader}, [INFO] [stdout] | ^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: the item `NormalizedString` is imported redundantly [INFO] [stdout] --> src/normalizers/strip.rs:61:9 [INFO] [stdout] | [INFO] [stdout] 60 | use super::*; [INFO] [stdout] | -------- the item `NormalizedString` is already imported here [INFO] [stdout] 61 | use crate::normalizer::NormalizedString; [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: the item `Decoder` is imported redundantly [INFO] [stdout] --> src/pre_tokenizers/byte_level.rs:237:9 [INFO] [stdout] | [INFO] [stdout] 235 | use super::*; [INFO] [stdout] | -------- the item `Decoder` is already imported here [INFO] [stdout] 236 | use crate::tokenizer::{ [INFO] [stdout] 237 | Decoder, Encoding, OffsetReferential, OffsetType, PostProcessor, PreTokenizedString, [INFO] [stdout] | ^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: the item `Encoding` is imported redundantly [INFO] [stdout] --> src/pre_tokenizers/byte_level.rs:237:18 [INFO] [stdout] | [INFO] [stdout] 235 | use super::*; [INFO] [stdout] | -------- the item `Encoding` is already imported here [INFO] [stdout] 236 | use crate::tokenizer::{ [INFO] [stdout] 237 | Decoder, Encoding, OffsetReferential, OffsetType, PostProcessor, PreTokenizedString, [INFO] [stdout] | ^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: the item `PostProcessor` is imported redundantly [INFO] [stdout] --> src/pre_tokenizers/byte_level.rs:237:59 [INFO] [stdout] | [INFO] [stdout] 235 | use super::*; [INFO] [stdout] | -------- the item `PostProcessor` is already imported here [INFO] [stdout] 236 | use crate::tokenizer::{ [INFO] [stdout] 237 | Decoder, Encoding, OffsetReferential, OffsetType, PostProcessor, PreTokenizedString, [INFO] [stdout] | ^^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: the item `PreTokenizedString` is imported redundantly [INFO] [stdout] --> src/pre_tokenizers/byte_level.rs:237:74 [INFO] [stdout] | [INFO] [stdout] 235 | use super::*; [INFO] [stdout] | -------- the item `PreTokenizedString` is already imported here [INFO] [stdout] 236 | use crate::tokenizer::{ [INFO] [stdout] 237 | Decoder, Encoding, OffsetReferential, OffsetType, PostProcessor, PreTokenizedString, [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: the item `PreTokenizer` is imported redundantly [INFO] [stdout] --> src/pre_tokenizers/byte_level.rs:238:9 [INFO] [stdout] | [INFO] [stdout] 235 | use super::*; [INFO] [stdout] | -------- the item `PreTokenizer` is already imported here [INFO] [stdout] ... [INFO] [stdout] 238 | PreTokenizer, [INFO] [stdout] | ^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: the item `PreTokenizer` is imported redundantly [INFO] [stdout] --> src/pre_tokenizers/split.rs:109:48 [INFO] [stdout] | [INFO] [stdout] 108 | use super::*; [INFO] [stdout] | -------- the item `PreTokenizer` is already imported here [INFO] [stdout] 109 | use crate::{OffsetReferential, OffsetType, PreTokenizer}; [INFO] [stdout] | ^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: the item `PreTokenizer` is imported redundantly [INFO] [stdout] --> src/pre_tokenizers/whitespace.rs:46:48 [INFO] [stdout] | [INFO] [stdout] 45 | use super::*; [INFO] [stdout] | -------- the item `PreTokenizer` is already imported here [INFO] [stdout] 46 | use crate::{OffsetReferential, OffsetType, PreTokenizer}; [INFO] [stdout] | ^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: the item `PostProcessorWrapper` is imported redundantly [INFO] [stdout] --> src/processors/sequence.rs:41:40 [INFO] [stdout] | [INFO] [stdout] 40 | use super::*; [INFO] [stdout] | -------- the item `PostProcessorWrapper` is already imported here [INFO] [stdout] 41 | use crate::processors::{ByteLevel, PostProcessorWrapper}; [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: the item `Encoding` is imported redundantly [INFO] [stdout] --> src/processors/sequence.rs:42:28 [INFO] [stdout] | [INFO] [stdout] 40 | use super::*; [INFO] [stdout] | -------- the item `Encoding` is already imported here [INFO] [stdout] 41 | use crate::processors::{ByteLevel, PostProcessorWrapper}; [INFO] [stdout] 42 | use crate::tokenizer::{Encoding, PostProcessor}; [INFO] [stdout] | ^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: the item `PostProcessor` is imported redundantly [INFO] [stdout] --> src/processors/sequence.rs:42:38 [INFO] [stdout] | [INFO] [stdout] 40 | use super::*; [INFO] [stdout] | -------- the item `PostProcessor` is already imported here [INFO] [stdout] 41 | use crate::processors::{ByteLevel, PostProcessorWrapper}; [INFO] [stdout] 42 | use crate::tokenizer::{Encoding, PostProcessor}; [INFO] [stdout] | ^^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: the item `TryInto` is imported redundantly [INFO] [stdout] --> src/processors/template.rs:638:9 [INFO] [stdout] | [INFO] [stdout] 637 | use super::*; [INFO] [stdout] | -------- the item `TryInto` is already imported here [INFO] [stdout] 638 | use std::convert::TryInto; [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: the item `Token` is imported redundantly [INFO] [stdout] --> src/tokenizer/added_vocabulary.rs:490:56 [INFO] [stdout] | [INFO] [stdout] 487 | use super::*; [INFO] [stdout] | -------- the item `Token` is already imported here [INFO] [stdout] ... [INFO] [stdout] 490 | use crate::{OffsetReferential, OffsetType, Result, Token, Trainer}; [INFO] [stdout] | ^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: the item `Regex` is imported redundantly [INFO] [stdout] --> src/tokenizer/pattern.rs:143:9 [INFO] [stdout] | [INFO] [stdout] 142 | use super::*; [INFO] [stdout] | -------- the item `Regex` is already imported here [INFO] [stdout] 143 | use regex::Regex; [INFO] [stdout] | ^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: the item `serde` is imported redundantly [INFO] [stdout] --> src/tokenizer/serialization.rs:4:5 [INFO] [stdout] | [INFO] [stdout] 4 | self, [INFO] [stdout] | ^^^^ the item `serde` is already defined by prelude [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: 3 warnings emitted [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: 19 warnings emitted [INFO] [stdout] [INFO] [stdout] [INFO] [stderr] Finished `dev` profile [unoptimized + debuginfo] target(s) in 29.80s [INFO] running `Command { std: "docker" "inspect" "c279314f57c2a637e9bf51be0e09a3c767fe599d7efdad78e784b231e6a1146f", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "c279314f57c2a637e9bf51be0e09a3c767fe599d7efdad78e784b231e6a1146f", kill_on_drop: false }` [INFO] [stdout] c279314f57c2a637e9bf51be0e09a3c767fe599d7efdad78e784b231e6a1146f