[INFO] fetching crate tiktoken 1.0.1... [INFO] testing tiktoken-1.0.1 against 1.91.0 for beta-1.92-2 [INFO] extracting crate tiktoken 1.0.1 into /workspace/builds/worker-0-tc1/source [INFO] started tweaking crates.io crate tiktoken 1.0.1 [INFO] finished tweaking crates.io crate tiktoken 1.0.1 [INFO] tweaked toml for crates.io crate tiktoken 1.0.1 written to /workspace/builds/worker-0-tc1/source/Cargo.toml [INFO] validating manifest of crates.io crate tiktoken 1.0.1 on toolchain 1.91.0 [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.91.0" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }` [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.91.0" "generate-lockfile" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] [stderr] Updating crates.io index [INFO] [stderr] Locking 83 packages to latest compatible versions [INFO] [stderr] Adding base64 v0.21.7 (available: v0.22.1) [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.91.0" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] [stderr] Downloading crates ... [INFO] [stderr] Downloaded pcre2 v0.2.11 [INFO] [stderr] Downloaded pcre2-sys v0.2.10 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:4848fb76d95f26979359cc7e45710b1dbc8f3acb7aeedee7c460d7702230f228" "/opt/rustwide/cargo-home/bin/cargo" "+1.91.0" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }` [INFO] [stdout] cb9ba339a139e07e267abad8beb063ea507e0dce8a416e2979a0503fe8d37598 [INFO] running `Command { std: "docker" "start" "-a" "cb9ba339a139e07e267abad8beb063ea507e0dce8a416e2979a0503fe8d37598", kill_on_drop: false }` [INFO] running `Command { std: "docker" "inspect" "cb9ba339a139e07e267abad8beb063ea507e0dce8a416e2979a0503fe8d37598", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "cb9ba339a139e07e267abad8beb063ea507e0dce8a416e2979a0503fe8d37598", kill_on_drop: false }` [INFO] [stdout] cb9ba339a139e07e267abad8beb063ea507e0dce8a416e2979a0503fe8d37598 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:4848fb76d95f26979359cc7e45710b1dbc8f3acb7aeedee7c460d7702230f228" "/opt/rustwide/cargo-home/bin/cargo" "+1.91.0" "build" "--frozen" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] 4e2584dc830d527e2c00981001bf65b454a0112c1dc3c56f2161e5bef9d832e5 [INFO] running `Command { std: "docker" "start" "-a" "4e2584dc830d527e2c00981001bf65b454a0112c1dc3c56f2161e5bef9d832e5", kill_on_drop: false }` [INFO] [stderr] Compiling proc-macro2 v1.0.103 [INFO] [stderr] Compiling serde v1.0.228 [INFO] [stderr] Compiling rust_decimal v1.39.0 [INFO] [stderr] Compiling arrayvec v0.7.6 [INFO] [stderr] Compiling num-traits v0.2.19 [INFO] [stderr] Compiling base64 v0.21.7 [INFO] [stderr] Compiling jobserver v0.1.34 [INFO] [stderr] Compiling cc v1.2.44 [INFO] [stderr] Compiling quote v1.0.41 [INFO] [stderr] Compiling syn v2.0.108 [INFO] [stderr] Compiling pcre2-sys v0.2.10 [INFO] [stderr] Compiling pcre2 v0.2.11 [INFO] [stderr] Compiling rust_decimal_macros v1.39.0 [INFO] [stderr] Compiling tiktoken v1.0.1 (/opt/rustwide/workdir) [INFO] [stdout] warning: value assigned to `next_special` is never read [INFO] [stdout] --> src/bpe.rs:70:21 [INFO] [stdout] | [INFO] [stdout] 70 | let mut next_special = None; [INFO] [stdout] | ^^^^^^^^^^^^ [INFO] [stdout] | [INFO] [stdout] = help: maybe it is overwritten before being read? [INFO] [stdout] = note: `#[warn(unused_assignments)]` (part of `#[warn(unused)]`) on by default [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: fields `decoder`, `special_tokens_decoder`, and `sorted_token_bytes` are never read [INFO] [stdout] --> src/bpe.rs:7:5 [INFO] [stdout] | [INFO] [stdout] 5 | pub struct CoreBpe { [INFO] [stdout] | ------- fields in this struct [INFO] [stdout] 6 | encoder: HashMap, [INFO] [stdout] 7 | decoder: HashMap, [INFO] [stdout] | ^^^^^^^ [INFO] [stdout] 8 | special_tokens_encoder: HashMap, [INFO] [stdout] 9 | special_tokens_decoder: HashMap, [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^^^^^ [INFO] [stdout] ... [INFO] [stdout] 12 | sorted_token_bytes: Vec>, [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^ [INFO] [stdout] | [INFO] [stdout] = note: `#[warn(dead_code)]` (part of `#[warn(unused)]`) on by default [INFO] [stdout] [INFO] [stdout] [INFO] [stderr] Finished `dev` profile [unoptimized + debuginfo] target(s) in 8.80s [INFO] running `Command { std: "docker" "inspect" "4e2584dc830d527e2c00981001bf65b454a0112c1dc3c56f2161e5bef9d832e5", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "4e2584dc830d527e2c00981001bf65b454a0112c1dc3c56f2161e5bef9d832e5", kill_on_drop: false }` [INFO] [stdout] 4e2584dc830d527e2c00981001bf65b454a0112c1dc3c56f2161e5bef9d832e5 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:4848fb76d95f26979359cc7e45710b1dbc8f3acb7aeedee7c460d7702230f228" "/opt/rustwide/cargo-home/bin/cargo" "+1.91.0" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] 02fc0543725b199e528b1df30841527205036bee50eddcc7ac02a9c8c8791d8b [INFO] running `Command { std: "docker" "start" "-a" "02fc0543725b199e528b1df30841527205036bee50eddcc7ac02a9c8c8791d8b", kill_on_drop: false }` [INFO] [stderr] Compiling tiktoken v1.0.1 (/opt/rustwide/workdir) [INFO] [stdout] warning: value assigned to `next_special` is never read [INFO] [stdout] --> src/bpe.rs:70:21 [INFO] [stdout] | [INFO] [stdout] 70 | let mut next_special = None; [INFO] [stdout] | ^^^^^^^^^^^^ [INFO] [stdout] | [INFO] [stdout] = help: maybe it is overwritten before being read? [INFO] [stdout] = note: `#[warn(unused_assignments)]` (part of `#[warn(unused)]`) on by default [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: fields `decoder`, `special_tokens_decoder`, and `sorted_token_bytes` are never read [INFO] [stdout] --> src/bpe.rs:7:5 [INFO] [stdout] | [INFO] [stdout] 5 | pub struct CoreBpe { [INFO] [stdout] | ------- fields in this struct [INFO] [stdout] 6 | encoder: HashMap, [INFO] [stdout] 7 | decoder: HashMap, [INFO] [stdout] | ^^^^^^^ [INFO] [stdout] 8 | special_tokens_encoder: HashMap, [INFO] [stdout] 9 | special_tokens_decoder: HashMap, [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^^^^^ [INFO] [stdout] ... [INFO] [stdout] 12 | sorted_token_bytes: Vec>, [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^ [INFO] [stdout] | [INFO] [stdout] = note: `#[warn(dead_code)]` (part of `#[warn(unused)]`) on by default [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: value assigned to `next_special` is never read [INFO] [stdout] --> src/bpe.rs:70:21 [INFO] [stdout] | [INFO] [stdout] 70 | let mut next_special = None; [INFO] [stdout] | ^^^^^^^^^^^^ [INFO] [stdout] | [INFO] [stdout] = help: maybe it is overwritten before being read? [INFO] [stdout] = note: `#[warn(unused_assignments)]` (part of `#[warn(unused)]`) on by default [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: fields `decoder`, `special_tokens_decoder`, and `sorted_token_bytes` are never read [INFO] [stdout] --> src/bpe.rs:7:5 [INFO] [stdout] | [INFO] [stdout] 5 | pub struct CoreBpe { [INFO] [stdout] | ------- fields in this struct [INFO] [stdout] 6 | encoder: HashMap, [INFO] [stdout] 7 | decoder: HashMap, [INFO] [stdout] | ^^^^^^^ [INFO] [stdout] 8 | special_tokens_encoder: HashMap, [INFO] [stdout] 9 | special_tokens_decoder: HashMap, [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^^^^^ [INFO] [stdout] ... [INFO] [stdout] 12 | sorted_token_bytes: Vec>, [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^ [INFO] [stdout] | [INFO] [stdout] = note: `#[warn(dead_code)]` (part of `#[warn(unused)]`) on by default [INFO] [stdout] [INFO] [stdout] [INFO] [stderr] Finished `test` profile [unoptimized + debuginfo] target(s) in 0.95s [INFO] running `Command { std: "docker" "inspect" "02fc0543725b199e528b1df30841527205036bee50eddcc7ac02a9c8c8791d8b", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "02fc0543725b199e528b1df30841527205036bee50eddcc7ac02a9c8c8791d8b", kill_on_drop: false }` [INFO] [stdout] 02fc0543725b199e528b1df30841527205036bee50eddcc7ac02a9c8c8791d8b [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:4848fb76d95f26979359cc7e45710b1dbc8f3acb7aeedee7c460d7702230f228" "/opt/rustwide/cargo-home/bin/cargo" "+1.91.0" "test" "--frozen", kill_on_drop: false }` [INFO] [stdout] 54841fb8a1ce7d6d2c223a7181f06af90f3a8ecfaefbdc55ce6e0a39ad3cad3f [INFO] running `Command { std: "docker" "start" "-a" "54841fb8a1ce7d6d2c223a7181f06af90f3a8ecfaefbdc55ce6e0a39ad3cad3f", kill_on_drop: false }` [INFO] [stderr] warning: value assigned to `next_special` is never read [INFO] [stderr] --> src/bpe.rs:70:21 [INFO] [stderr] | [INFO] [stderr] 70 | let mut next_special = None; [INFO] [stderr] | ^^^^^^^^^^^^ [INFO] [stderr] | [INFO] [stderr] = help: maybe it is overwritten before being read? [INFO] [stderr] = note: `#[warn(unused_assignments)]` (part of `#[warn(unused)]`) on by default [INFO] [stderr] [INFO] [stderr] warning: fields `decoder`, `special_tokens_decoder`, and `sorted_token_bytes` are never read [INFO] [stderr] --> src/bpe.rs:7:5 [INFO] [stderr] | [INFO] [stderr] 5 | pub struct CoreBpe { [INFO] [stderr] | ------- fields in this struct [INFO] [stderr] 6 | encoder: HashMap, [INFO] [stderr] 7 | decoder: HashMap, [INFO] [stderr] | ^^^^^^^ [INFO] [stderr] 8 | special_tokens_encoder: HashMap, [INFO] [stderr] 9 | special_tokens_decoder: HashMap, [INFO] [stderr] | ^^^^^^^^^^^^^^^^^^^^^^ [INFO] [stderr] ... [INFO] [stderr] 12 | sorted_token_bytes: Vec>, [INFO] [stderr] | ^^^^^^^^^^^^^^^^^^ [INFO] [stderr] | [INFO] [stderr] = note: `#[warn(dead_code)]` (part of `#[warn(unused)]`) on by default [INFO] [stderr] [INFO] [stderr] warning: `tiktoken` (lib) generated 2 warnings [INFO] [stderr] warning: `tiktoken` (lib test) generated 2 warnings (2 duplicates) [INFO] [stderr] Finished `test` profile [unoptimized + debuginfo] target(s) in 0.11s [INFO] [stderr] Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/tiktoken-04bd2881a3860ff7) [INFO] [stdout] [INFO] [stdout] running 1 test [INFO] [stdout] test tests::it_works ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.93s [INFO] [stdout] [INFO] [stderr] Doc-tests tiktoken [INFO] [stdout] [INFO] [stdout] running 0 tests [INFO] [stdout] [INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s [INFO] [stdout] [INFO] running `Command { std: "docker" "inspect" "54841fb8a1ce7d6d2c223a7181f06af90f3a8ecfaefbdc55ce6e0a39ad3cad3f", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "54841fb8a1ce7d6d2c223a7181f06af90f3a8ecfaefbdc55ce6e0a39ad3cad3f", kill_on_drop: false }` [INFO] [stdout] 54841fb8a1ce7d6d2c223a7181f06af90f3a8ecfaefbdc55ce6e0a39ad3cad3f