[INFO] cloning repository https://github.com/19h/claude_tokenizer
[INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/19h/claude_tokenizer" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2F19h%2Fclaude_tokenizer", kill_on_drop: false }`
[INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2F19h%2Fclaude_tokenizer'...
[INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }`
[INFO] [stdout] 811f400df824611b4d59db677001947634aa1bf8
[INFO] documenting 19h/claude_tokenizer against 1.90.0 for beta-rustdoc-1.91-2
[INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2F19h%2Fclaude_tokenizer" "/workspace/builds/worker-2-tc1/source", kill_on_drop: false }`
[INFO] [stderr] Cloning into '/workspace/builds/worker-2-tc1/source'...
[INFO] [stderr] done.
[INFO] started tweaking git repo https://github.com/19h/claude_tokenizer
[INFO] removed 0 missing examples
[INFO] finished tweaking git repo https://github.com/19h/claude_tokenizer
[INFO] tweaked toml for git repo https://github.com/19h/claude_tokenizer written to /workspace/builds/worker-2-tc1/source/Cargo.toml
[INFO] validating manifest of git repo https://github.com/19h/claude_tokenizer on toolchain 1.90.0
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.90.0" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] crate git repo https://github.com/19h/claude_tokenizer already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.90.0" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] [stderr]     Updating crates.io index
[INFO] [stderr]     Blocking waiting for file lock on package cache
[INFO] [stderr]  Downloading crates ...
[INFO] [stderr]   Downloaded unicode-ident v1.0.8
[INFO] [stderr]   Downloaded quote v1.0.27
[INFO] [stderr]   Downloaded serde_derive v1.0.162
[INFO] [stderr]   Downloaded tar v0.4.38
[INFO] [stderr]   Downloaded wasm-bindgen-macro-support v0.2.85
[INFO] [stderr]   Downloaded proc-macro2 v1.0.56
[INFO] [stderr]   Downloaded sha2 v0.10.6
[INFO] [stderr]   Downloaded digest v0.10.6
[INFO] [stderr]   Downloaded filetime v0.2.21
[INFO] [stderr]   Downloaded clap_lex v0.4.1
[INFO] [stderr]   Downloaded xattr v0.2.3
[INFO] [stderr]   Downloaded clap_builder v4.2.7
[INFO] [stderr]   Downloaded aho-corasick v0.7.20
[INFO] [stderr]   Downloaded regex v1.8.1
[INFO] [stderr]   Downloaded openssl v0.10.52
[INFO] [stderr]   Downloaded base64 v0.21.0
[INFO] [stderr]   Downloaded spm_precompiled v0.1.4
[INFO] [stderr]   Downloaded esaxx-rs v0.1.8
[INFO] [stderr]   Downloaded cached-path v0.6.1
[INFO] [stderr]   Downloaded js-sys v0.3.62
[INFO] [stderr]   Downloaded web-sys v0.3.62
[INFO] [stderr]   Downloaded zip v0.6.5
[INFO] [stderr]   Downloaded wasm-bindgen v0.2.85
[INFO] [stderr]   Downloaded h2 v0.3.18
[INFO] [stderr]   Downloaded hyper v0.14.26
[INFO] [stderr]   Downloaded reqwest v0.11.17
[INFO] [stderr]   Downloaded tokio v1.28.1
[INFO] [stderr]   Downloaded url v2.3.1
[INFO] [stderr]   Downloaded bumpalo v3.12.2
[INFO] [stderr]   Downloaded openssl-sys v0.9.87
[INFO] [stderr]   Downloaded security-framework v2.8.2
[INFO] [stderr]   Downloaded regex-syntax v0.7.1
[INFO] [stderr]   Downloaded serde_json v1.0.96
[INFO] [stderr]   Downloaded darling_core v0.14.4
[INFO] [stderr]   Downloaded itertools v0.8.2
[INFO] [stderr]   Downloaded schannel v0.1.21
[INFO] [stderr]   Downloaded mio v0.8.6
[INFO] [stderr]   Downloaded tokenizers v0.13.3
[INFO] [stderr]   Downloaded clap_derive v4.2.0
[INFO] [stderr]   Downloaded derive_builder v0.12.0
[INFO] [stderr]   Downloaded console v0.15.5
[INFO] [stderr]   Downloaded onig v6.4.0
[INFO] [stderr]   Downloaded paste v1.0.12
[INFO] [stderr]   Downloaded rayon-cond v0.1.0
[INFO] [stderr]   Downloaded wasm-bindgen-backend v0.2.85
[INFO] [stderr]   Downloaded clap v4.2.7
[INFO] [stderr]   Downloaded onig_sys v69.8.1
[INFO] [stderr]   Downloaded darling v0.14.4
[INFO] [stderr]   Downloaded derive_builder_core v0.12.0
[INFO] [stderr]   Downloaded macro_rules_attribute v0.1.3
[INFO] [stderr]   Downloaded monostate-impl v0.1.6
[INFO] [stderr]   Downloaded ipnet v2.7.2
[INFO] [stderr]   Downloaded security-framework-sys v2.8.0
[INFO] [stderr]   Downloaded io-lifetimes v1.0.10
[INFO] [stderr]   Downloaded wasm-bindgen-futures v0.4.35
[INFO] [stderr]   Downloaded itoa v1.0.6
[INFO] [stderr]   Downloaded syn v2.0.15
[INFO] [stderr]   Downloaded unicode-normalization-alignments v0.1.12
[INFO] [stderr]   Downloaded darling_macro v0.14.4
[INFO] [stderr]   Downloaded derive_builder_macro v0.12.0
[INFO] [stderr]   Downloaded monostate v0.1.6
[INFO] [stderr]   Downloaded wasm-bindgen-shared v0.2.85
[INFO] [stderr]   Downloaded wasm-bindgen-macro v0.2.85
[INFO] [stderr]   Downloaded macro_rules_attribute-proc_macro v0.1.3
[INFO] [stderr]   Downloaded form_urlencoded v1.1.0
[INFO] [stderr]   Downloaded percent-encoding v2.2.0
[INFO] [stderr]   Downloaded serde v1.0.162
[INFO] [stderr]   Downloaded ryu v1.0.13
[INFO] [stderr]   Downloaded linux-raw-sys v0.3.7
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:e90291280db7d1fac5b66fc6dad9f9662629e7365a55743daf9bdf73ebc4ea79" "/opt/rustwide/cargo-home/bin/cargo" "+1.90.0" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] [stdout] f89fff7e839d428c4ebd29e237c78abaab47fb3428bd9fe80493fe775137ef17
[INFO] running `Command { std: "docker" "start" "-a" "f89fff7e839d428c4ebd29e237c78abaab47fb3428bd9fe80493fe775137ef17", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "f89fff7e839d428c4ebd29e237c78abaab47fb3428bd9fe80493fe775137ef17", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "f89fff7e839d428c4ebd29e237c78abaab47fb3428bd9fe80493fe775137ef17", kill_on_drop: false }`
[INFO] [stdout] f89fff7e839d428c4ebd29e237c78abaab47fb3428bd9fe80493fe775137ef17
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:e90291280db7d1fac5b66fc6dad9f9662629e7365a55743daf9bdf73ebc4ea79" "/opt/rustwide/cargo-home/bin/cargo" "+1.90.0" "doc" "--frozen" "--no-deps" "--document-private-items" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] 1ae1468f776c5e4027ac0d81e0b9894befab0f8d986fc4427fd21d9578058d31
[INFO] running `Command { std: "docker" "start" "-a" "1ae1468f776c5e4027ac0d81e0b9894befab0f8d986fc4427fd21d9578058d31", kill_on_drop: false }`
[INFO] [stderr]    Compiling libc v0.2.144
[INFO] [stderr]    Compiling proc-macro2 v1.0.56
[INFO] [stderr]    Compiling quote v1.0.27
[INFO] [stderr]    Compiling unicode-ident v1.0.8
[INFO] [stderr]    Compiling memchr v2.5.0
[INFO] [stderr]     Checking once_cell v1.17.1
[INFO] [stderr]    Compiling log v0.4.17
[INFO] [stderr]     Checking pin-project-lite v0.2.9
[INFO] [stderr]    Compiling tokio v1.28.1
[INFO] [stderr]    Compiling io-lifetimes v1.0.10
[INFO] [stderr]     Checking itoa v1.0.6
[INFO] [stderr]    Compiling serde_derive v1.0.162
[INFO] [stderr]    Compiling serde v1.0.162
[INFO] [stderr]    Compiling syn v1.0.109
[INFO] [stderr]    Compiling crossbeam-utils v0.8.15
[INFO] [stderr]     Checking subtle v2.4.1
[INFO] [stderr]    Compiling rustix v0.37.19
[INFO] [stderr]     Checking tracing-core v0.1.30
[INFO] [stderr]    Compiling memoffset v0.8.0
[INFO] [stderr]    Compiling futures-util v0.3.28
[INFO] [stderr]    Compiling openssl v0.10.52
[INFO] [stderr]     Checking linux-raw-sys v0.3.7
[INFO] [stderr]     Checking http v0.2.9
[INFO] [stderr]     Checking digest v0.10.6
[INFO] [stderr]    Compiling crossbeam-epoch v0.9.14
[INFO] [stderr]    Compiling jobserver v0.1.26
[INFO] [stderr]    Compiling syn v2.0.15
[INFO] [stderr]     Checking tracing v0.1.37
[INFO] [stderr]     Checking cpufeatures v0.2.7
[INFO] [stderr]     Checking futures-io v0.3.28
[INFO] [stderr]    Compiling cc v1.0.79
[INFO] [stderr]     Checking scopeguard v1.1.0
[INFO] [stderr]    Compiling zstd-safe v5.0.2+zstd.1.5.2
[INFO] [stderr]     Checking percent-encoding v2.2.0
[INFO] [stderr]     Checking want v0.3.0
[INFO] [stderr]     Checking form_urlencoded v1.1.0
[INFO] [stderr]     Checking num_cpus v1.15.0
[INFO] [stderr]     Checking mio v0.8.6
[INFO] [stderr]     Checking socket2 v0.4.9
[INFO] [stderr]     Checking getrandom v0.2.9
[INFO] [stderr]     Checking http-body v0.4.5
[INFO] [stderr]     Checking rand_core v0.6.4
[INFO] [stderr]     Checking unicode-normalization v0.1.22
[INFO] [stderr]     Checking aho-corasick v1.0.1
[INFO] [stderr]    Compiling openssl-sys v0.9.87
[INFO] [stderr]    Compiling zstd-sys v2.0.8+zstd.1.5.5
[INFO] [stderr]    Compiling native-tls v0.2.11
[INFO] [stderr]    Compiling bzip2-sys v0.1.11+1.0.8
[INFO] [stderr]    Compiling rayon-core v1.11.0
[INFO] [stderr]     Checking regex-syntax v0.7.1
[INFO] [stderr]     Checking ryu v1.0.13
[INFO] [stderr]     Checking base64ct v1.6.0
[INFO] [stderr]     Checking unicode-bidi v0.3.13
[INFO] [stderr]     Checking either v1.8.1
[INFO] [stderr]     Checking utf8parse v0.2.1
[INFO] [stderr]     Checking anstyle-parse v0.2.0
[INFO] [stderr]     Checking password-hash v0.4.2
[INFO] [stderr]     Checking idna v0.3.0
[INFO] [stderr]     Checking is-terminal v0.4.7
[INFO] [stderr]     Checking console v0.15.5
[INFO] [stderr]    Compiling onig_sys v69.8.1
[INFO] [stderr]     Checking crossbeam-deque v0.8.3
[INFO] [stderr]     Checking sha2 v0.10.6
[INFO] [stderr]     Checking crossbeam-channel v0.5.8
[INFO] [stderr]     Checking hmac v0.12.1
[INFO] [stderr]     Checking cipher v0.3.0
[INFO] [stderr]    Compiling serde_json v1.0.96
[INFO] [stderr]    Compiling thiserror v1.0.40
[INFO] [stderr]     Checking colorchoice v1.0.0
[INFO] [stderr]    Compiling paste v1.0.12
[INFO] [stderr]     Checking opaque-debug v0.3.0
[INFO] [stderr]     Checking anstyle v1.0.0
[INFO] [stderr]     Checking anstyle-query v1.0.0
[INFO] [stderr]     Checking time-core v0.1.1
[INFO] [stderr]     Checking time v0.3.21
[INFO] [stderr]     Checking aes v0.7.5
[INFO] [stderr]    Compiling darling_core v0.14.4
[INFO] [stderr]     Checking anstream v0.3.2
[INFO] [stderr]     Checking regex v1.8.1
[INFO] [stderr]     Checking rand_chacha v0.3.1
[INFO] [stderr]     Checking pbkdf2 v0.11.0
[INFO] [stderr]     Checking url v2.3.1
[INFO] [stderr]    Compiling esaxx-rs v0.1.8
[INFO] [stderr]     Checking filetime v0.2.21
[INFO] [stderr]     Checking xattr v0.2.3
[INFO] [stderr]     Checking sha1 v0.10.5
[INFO] [stderr]     Checking number_prefix v0.4.0
[INFO] [stderr]     Checking byteorder v1.4.3
[INFO] [stderr]     Checking base64 v0.21.0
[INFO] [stderr]    Compiling openssl-macros v0.1.1
[INFO] [stderr]    Compiling thiserror-impl v1.0.40
[INFO] [stderr]     Checking ipnet v2.7.2
[INFO] [stderr]     Checking tokio-util v0.7.8
[INFO] [stderr]    Compiling heck v0.4.1
[INFO] [stderr]     Checking clap_lex v0.4.1
[INFO] [stderr]     Checking strsim v0.10.0
[INFO] [stderr]     Checking fastrand v1.9.0
[INFO] [stderr]     Checking constant_time_eq v0.1.5
[INFO] [stderr]     Checking minimal-lexical v0.2.1
[INFO] [stderr]     Checking clap_builder v4.2.7
[INFO] [stderr]     Checking h2 v0.3.18
[INFO] [stderr]     Checking nom v7.1.3
[INFO] [stderr]     Checking tempfile v3.5.0
[INFO] [stderr]    Compiling clap_derive v4.2.0
[INFO] [stderr]     Checking indicatif v0.16.2
[INFO] [stderr]    Compiling monostate-impl v0.1.6
[INFO] [stderr]    Compiling darling_macro v0.14.4
[INFO] [stderr]     Checking tar v0.4.38
[INFO] [stderr]    Compiling darling v0.14.4
[INFO] [stderr]    Compiling derive_builder_core v0.12.0
[INFO] [stderr]     Checking rand v0.8.5
[INFO] [stderr]     Checking rayon v1.7.0
[INFO] [stderr]    Compiling derive_builder_macro v0.12.0
[INFO] [stderr]     Checking itertools v0.8.2
[INFO] [stderr]     Checking fs2 v0.4.3
[INFO] [stderr]     Checking tokio-native-tls v0.3.1
[INFO] [stderr]     Checking dirs-sys v0.3.7
[INFO] [stderr]     Checking smallvec v1.10.0
[INFO] [stderr]     Checking base64 v0.13.1
[INFO] [stderr]     Checking number_prefix v0.3.0
[INFO] [stderr]    Compiling macro_rules_attribute-proc_macro v0.1.3
[INFO] [stderr]    Compiling anyhow v1.0.71
[INFO] [stderr]     Checking hyper v0.14.26
[INFO] [stderr]     Checking glob v0.3.1
[INFO] [stderr]     Checking unicode-segmentation v1.10.1
[INFO] [stderr]     Checking clap v4.2.7
[INFO] [stderr]     Checking indicatif v0.15.0
[INFO] [stderr]     Checking dirs v4.0.0
[INFO] [stderr]     Checking macro_rules_attribute v0.1.3
[INFO] [stderr]     Checking unicode-normalization-alignments v0.1.12
[INFO] [stderr]     Checking derive_builder v0.12.0
[INFO] [stderr]     Checking itertools v0.9.0
[INFO] [stderr]     Checking aho-corasick v0.7.20
[INFO] [stderr]     Checking regex-syntax v0.6.29
[INFO] [stderr]     Checking unicode_categories v0.1.1
[INFO] [stderr]     Checking rayon-cond v0.1.0
[INFO] [stderr]     Checking bzip2 v0.4.4
[INFO] [stderr]     Checking hyper-tls v0.5.0
[INFO] [stderr]     Checking serde_urlencoded v0.7.1
[INFO] [stderr]     Checking spm_precompiled v0.1.4
[INFO] [stderr]     Checking monostate v0.1.6
[INFO] [stderr]     Checking reqwest v0.11.17
[INFO] [stderr]     Checking onig v6.4.0
[INFO] [stderr]     Checking zstd v0.11.2+zstd.1.5.2
[INFO] [stderr]     Checking zip v0.6.5
[INFO] [stderr]     Checking cached-path v0.6.1
[INFO] [stderr]     Checking tokenizers v0.13.3
[INFO] [stderr]  Documenting claude_tokenizer v0.1.0 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `dev` profile [unoptimized + debuginfo] target(s) in 1m 37s
[INFO] [stderr]    Generated /opt/rustwide/target/doc/claude_tokenizer/index.html
[INFO] running `Command { std: "docker" "inspect" "1ae1468f776c5e4027ac0d81e0b9894befab0f8d986fc4427fd21d9578058d31", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "1ae1468f776c5e4027ac0d81e0b9894befab0f8d986fc4427fd21d9578058d31", kill_on_drop: false }`
[INFO] [stdout] 1ae1468f776c5e4027ac0d81e0b9894befab0f8d986fc4427fd21d9578058d31
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "DOCS_RS=1" "-e" "RUSTC_BOOTSTRAP=1" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:e90291280db7d1fac5b66fc6dad9f9662629e7365a55743daf9bdf73ebc4ea79" "/opt/rustwide/cargo-home/bin/cargo" "+1.90.0" "rustdoc" "--lib" "-Zrustdoc-map" "--config" "build.rustdocflags=[\"--cfg\", \"docsrs\", \"-Z\", \"unstable-options\", \"--document-private-items\"]" "--frozen" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] 56f34cd282d3a7ef13bb652171176f9eb7622f0e4ac2ec1f8cc3c56b48253489
[INFO] running `Command { std: "docker" "start" "-a" "56f34cd282d3a7ef13bb652171176f9eb7622f0e4ac2ec1f8cc3c56b48253489", kill_on_drop: false }`
[INFO] [stderr]  Documenting claude_tokenizer v0.1.0 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `dev` profile [unoptimized + debuginfo] target(s) in 1.62s
[INFO] [stderr]    Generated /opt/rustwide/target/doc/claude_tokenizer/index.html
[INFO] running `Command { std: "docker" "inspect" "56f34cd282d3a7ef13bb652171176f9eb7622f0e4ac2ec1f8cc3c56b48253489", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "56f34cd282d3a7ef13bb652171176f9eb7622f0e4ac2ec1f8cc3c56b48253489", kill_on_drop: false }`
[INFO] [stdout] 56f34cd282d3a7ef13bb652171176f9eb7622f0e4ac2ec1f8cc3c56b48253489
