[INFO] cloning repository https://github.com/drozdziak1/ocl-test [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/drozdziak1/ocl-test" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fdrozdziak1%2Focl-test", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fdrozdziak1%2Focl-test'... [INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }` [INFO] [stdout] c89d8e311d764e1d40734d4412c8228a781dd462 [INFO] checking drozdziak1/ocl-test against try#a4980311fb7bb9e7893708e6bd3fbbfb2819fd3d for pr-145342-1 [INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fdrozdziak1%2Focl-test" "/workspace/builds/worker-4-tc2/source", kill_on_drop: false }` [INFO] [stderr] Cloning into '/workspace/builds/worker-4-tc2/source'... [INFO] [stderr] done. [INFO] started tweaking git repo https://github.com/drozdziak1/ocl-test [INFO] finished tweaking git repo https://github.com/drozdziak1/ocl-test [INFO] tweaked toml for git repo https://github.com/drozdziak1/ocl-test written to /workspace/builds/worker-4-tc2/source/Cargo.toml [INFO] validating manifest of git repo https://github.com/drozdziak1/ocl-test on toolchain a4980311fb7bb9e7893708e6bd3fbbfb2819fd3d [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+a4980311fb7bb9e7893708e6bd3fbbfb2819fd3d" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }` [INFO] crate git repo https://github.com/drozdziak1/ocl-test already has a lockfile, it will not be regenerated [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+a4980311fb7bb9e7893708e6bd3fbbfb2819fd3d" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-4-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-4-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:7ad1b28ee6f5f7f699f6cf7015098d6ccdd96d6f2d78dd06228f5b4c9faf309c" "/opt/rustwide/cargo-home/bin/cargo" "+a4980311fb7bb9e7893708e6bd3fbbfb2819fd3d" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }` [INFO] [stdout] a3e6bfb5f1fe36981de5d06b10c27aab0501021e0049dba03c3d4af0d91e352a [INFO] running `Command { std: "docker" "start" "-a" "a3e6bfb5f1fe36981de5d06b10c27aab0501021e0049dba03c3d4af0d91e352a", kill_on_drop: false }` [INFO] running `Command { std: "docker" "inspect" "a3e6bfb5f1fe36981de5d06b10c27aab0501021e0049dba03c3d4af0d91e352a", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "a3e6bfb5f1fe36981de5d06b10c27aab0501021e0049dba03c3d4af0d91e352a", kill_on_drop: false }` [INFO] [stdout] a3e6bfb5f1fe36981de5d06b10c27aab0501021e0049dba03c3d4af0d91e352a [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-4-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-4-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:7ad1b28ee6f5f7f699f6cf7015098d6ccdd96d6f2d78dd06228f5b4c9faf309c" "/opt/rustwide/cargo-home/bin/cargo" "+a4980311fb7bb9e7893708e6bd3fbbfb2819fd3d" "check" "--frozen" "--all" "--all-targets" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] 2d05b91573cda34d7a67a4dc2c9669a43e1765dc8fd97380b95ce6a8de3bf1a3 [INFO] running `Command { std: "docker" "start" "-a" "2d05b91573cda34d7a67a4dc2c9669a43e1765dc8fd97380b95ce6a8de3bf1a3", kill_on_drop: false }` [INFO] [stderr] Compiling proc-macro2 v1.0.93 [INFO] [stderr] Compiling unicode-ident v1.0.17 [INFO] [stderr] Compiling libc v0.2.170 [INFO] [stderr] Compiling shlex v1.3.0 [INFO] [stderr] Compiling autocfg v1.4.0 [INFO] [stderr] Checking cfg-if v1.0.0 [INFO] [stderr] Compiling version_check v0.9.5 [INFO] [stderr] Compiling crossbeam-utils v0.8.21 [INFO] [stderr] Compiling libm v0.2.11 [INFO] [stderr] Compiling serde v1.0.218 [INFO] [stderr] Compiling rayon-core v1.12.1 [INFO] [stderr] Checking either v1.14.0 [INFO] [stderr] Checking memchr v2.7.4 [INFO] [stderr] Checking byteorder v1.5.0 [INFO] [stderr] Checking once_cell v1.20.3 [INFO] [stderr] Checking smallvec v1.14.0 [INFO] [stderr] Checking bitflags v2.9.0 [INFO] [stderr] Checking regex-syntax v0.8.5 [INFO] [stderr] Checking itoa v1.0.14 [INFO] [stderr] Compiling siphasher v1.0.1 [INFO] [stderr] Compiling rand_core v0.6.4 [INFO] [stderr] Compiling rustversion v1.0.19 [INFO] [stderr] Compiling thiserror v2.0.12 [INFO] [stderr] Checking ryu v1.0.19 [INFO] [stderr] Compiling pkg-config v0.3.32 [INFO] [stderr] Compiling rand v0.8.5 [INFO] [stderr] Checking allocator-api2 v0.2.21 [INFO] [stderr] Compiling ahash v0.8.11 [INFO] [stderr] Compiling phf_shared v0.11.3 [INFO] [stderr] Compiling parking_lot_core v0.9.10 [INFO] [stderr] Checking array-init-cursor v0.2.0 [INFO] [stderr] Compiling num-traits v0.2.19 [INFO] [stderr] Compiling lock_api v0.4.12 [INFO] [stderr] Checking planus v0.3.1 [INFO] [stderr] Checking crossbeam-epoch v0.9.18 [INFO] [stderr] Checking scopeguard v1.2.0 [INFO] [stderr] Checking equivalent v1.0.2 [INFO] [stderr] Checking aho-corasick v1.1.3 [INFO] [stderr] Checking foldhash v0.1.4 [INFO] [stderr] Compiling polars-utils v0.46.0 [INFO] [stderr] Compiling quote v1.0.38 [INFO] [stderr] Checking iana-time-zone v0.1.61 [INFO] [stderr] Compiling syn v2.0.98 [INFO] [stderr] Compiling phf_generator v0.11.3 [INFO] [stderr] Compiling heck v0.5.0 [INFO] [stderr] Checking simdutf8 v0.1.5 [INFO] [stderr] Checking static_assertions v1.1.0 [INFO] [stderr] Compiling polars-schema v0.46.0 [INFO] [stderr] Compiling phf_codegen v0.11.3 [INFO] [stderr] Checking raw-cpuid v11.4.0 [INFO] [stderr] Checking stable_deref_trait v1.2.0 [INFO] [stderr] Checking unicode-width v0.2.0 [INFO] [stderr] Checking phf v0.11.3 [INFO] [stderr] Compiling polars-arrow v0.46.0 [INFO] [stderr] Compiling polars-compute v0.46.0 [INFO] [stderr] Checking crossbeam-deque v0.8.6 [INFO] [stderr] Compiling rustix v0.38.44 [INFO] [stderr] Checking ethnum v1.5.0 [INFO] [stderr] Checking dyn-clone v1.0.18 [INFO] [stderr] Checking streaming-iterator v0.1.9 [INFO] [stderr] Compiling jobserver v0.1.32 [INFO] [stderr] Checking strength_reduce v0.2.4 [INFO] [stderr] Checking unicode-segmentation v1.12.0 [INFO] [stderr] Checking fast-float2 v0.2.3 [INFO] [stderr] Checking getrandom v0.2.15 [INFO] [stderr] Compiling cc v1.2.16 [INFO] [stderr] Checking memmap2 v0.9.5 [INFO] [stderr] Compiling regex-automata v0.4.9 [INFO] [stderr] Checking linux-raw-sys v0.4.15 [INFO] [stderr] Checking parking_lot v0.12.3 [INFO] [stderr] Checking atoi_simd v0.16.0 [INFO] [stderr] Checking adler2 v2.0.0 [INFO] [stderr] Checking castaway v0.2.3 [INFO] [stderr] Checking rayon v1.10.0 [INFO] [stderr] Checking zlib-rs v0.4.2 [INFO] [stderr] Checking crc32fast v1.4.2 [INFO] [stderr] Checking writeable v0.5.5 [INFO] [stderr] Checking litemap v0.7.4 [INFO] [stderr] Checking miniz_oxide v0.8.5 [INFO] [stderr] Checking percent-encoding v2.3.1 [INFO] [stderr] Checking chrono v0.4.40 [INFO] [stderr] Compiling polars-core v0.46.0 [INFO] [stderr] Checking base64 v0.22.1 [INFO] [stderr] Compiling zstd-safe v7.2.3 [INFO] [stderr] Checking alloc-no-stdlib v2.0.4 [INFO] [stderr] Compiling polars-ops v0.46.0 [INFO] [stderr] Checking alloc-stdlib v0.2.2 [INFO] [stderr] Checking icu_locid_transform_data v1.5.0 [INFO] [stderr] Checking xxhash-rust v0.8.15 [INFO] [stderr] Compiling snap v1.1.1 [INFO] [stderr] Checking argminmax v0.6.2 [INFO] [stderr] Checking brotli-decompressor v4.0.2 [INFO] [stderr] Checking fallible-streaming-iterator v0.1.9 [INFO] [stderr] Checking icu_properties_data v1.5.0 [INFO] [stderr] Checking streaming-decompression v0.1.2 [INFO] [stderr] Checking utf16_iter v1.0.5 [INFO] [stderr] Compiling fnv v1.0.7 [INFO] [stderr] Compiling ident_case v1.0.1 [INFO] [stderr] Checking icu_normalizer_data v1.5.0 [INFO] [stderr] Compiling semver v1.0.25 [INFO] [stderr] Checking polars-parquet-format v0.1.0 [INFO] [stderr] Checking write16 v1.0.0 [INFO] [stderr] Checking utf8_iter v1.0.4 [INFO] [stderr] Compiling strsim v0.11.1 [INFO] [stderr] Compiling polars-plan v0.46.0 [INFO] [stderr] Checking log v0.4.26 [INFO] [stderr] Checking rustls-pki-types v1.11.0 [INFO] [stderr] Checking untrusted v0.9.0 [INFO] [stderr] Checking glob v0.3.2 [INFO] [stderr] Checking home v0.5.11 [INFO] [stderr] Checking brotli v7.0.0 [INFO] [stderr] Checking crossterm v0.28.1 [INFO] [stderr] Compiling serde_json v1.0.140 [INFO] [stderr] Compiling portable-atomic v1.11.0 [INFO] [stderr] Compiling thiserror v1.0.69 [INFO] [stderr] Checking zeroize v1.8.1 [INFO] [stderr] Checking utf8parse v0.2.2 [INFO] [stderr] Compiling rustls v0.23.23 [INFO] [stderr] Checking comfy-table v7.1.4 [INFO] [stderr] Checking libz-rs-sys v0.4.2 [INFO] [stderr] Compiling rustc_version v0.4.1 [INFO] [stderr] Compiling regex v1.11.1 [INFO] [stderr] Checking anstyle-parse v0.2.6 [INFO] [stderr] Checking flate2 v1.0.35 [INFO] [stderr] Checking form_urlencoded v1.2.1 [INFO] [stderr] Checking num-complex v0.4.6 [INFO] [stderr] Checking console v0.15.11 [INFO] [stderr] Compiling matrixmultiply v0.3.9 [INFO] [stderr] Checking is_terminal_polyfill v1.70.1 [INFO] [stderr] Checking option-ext v0.2.0 [INFO] [stderr] Compiling parse-zoneinfo v0.3.1 [INFO] [stderr] Compiling rustix v1.0.2 [INFO] [stderr] Compiling cl-sys v0.4.3 [INFO] [stderr] Compiling paste v1.0.15 [INFO] [stderr] Checking now v0.1.3 [INFO] [stderr] Checking colorchoice v1.0.3 [INFO] [stderr] Compiling getrandom v0.3.1 [INFO] [stderr] Checking anstyle v1.0.10 [INFO] [stderr] Checking bitflags v1.3.2 [INFO] [stderr] Checking subtle v2.6.1 [INFO] [stderr] Checking anstyle-query v1.1.2 [INFO] [stderr] Checking dirs-sys v0.4.1 [INFO] [stderr] Compiling ocl-core v0.11.5 [INFO] [stderr] Checking webpki-roots v0.26.8 [INFO] [stderr] Checking anstream v0.6.18 [INFO] [stderr] Checking num-traits v0.1.43 [INFO] [stderr] Checking socks v0.3.4 [INFO] [stderr] Checking crossbeam-channel v0.5.14 [INFO] [stderr] Checking crossbeam-queue v0.3.12 [INFO] [stderr] Compiling polars-lazy v0.46.0 [INFO] [stderr] Checking linux-raw-sys v0.9.2 [INFO] [stderr] Checking rawpointer v0.2.1 [INFO] [stderr] Compiling psm v0.1.25 [INFO] [stderr] Compiling stacker v0.1.19 [INFO] [stderr] Compiling chrono-tz-build v0.4.0 [INFO] [stderr] Compiling zstd-sys v2.0.14+zstd.1.5.7 [INFO] [stderr] Compiling lz4-sys v1.11.1+lz4-1.10.0 [INFO] [stderr] Compiling ring v0.17.9 [INFO] [stderr] Compiling onig_sys v69.8.1 [INFO] [stderr] Compiling esaxx-rs v0.1.10 [INFO] [stderr] Checking number_prefix v0.4.0 [INFO] [stderr] Checking minimal-lexical v0.2.1 [INFO] [stderr] Checking indicatif v0.17.11 [INFO] [stderr] Checking nom v7.1.3 [INFO] [stderr] Checking dirs v5.0.1 [INFO] [stderr] Checking enum_primitive v0.1.1 [INFO] [stderr] Checking crossbeam v0.8.4 [INFO] [stderr] Compiling chrono-tz v0.10.1 [INFO] [stderr] Checking num-integer v0.1.46 [INFO] [stderr] Checking ocl-core-vector v0.1.1 [INFO] [stderr] Compiling polars v0.46.0 [INFO] [stderr] Checking itertools v0.11.0 [INFO] [stderr] Checking futures v0.1.31 [INFO] [stderr] Checking clap_lex v0.7.4 [INFO] [stderr] Checking fastrand v2.3.0 [INFO] [stderr] Compiling macro_rules_attribute-proc_macro v0.2.0 [INFO] [stderr] Checking base64 v0.13.1 [INFO] [stderr] Checking clap_builder v4.5.31 [INFO] [stderr] Checking ndarray v0.16.1 [INFO] [stderr] Compiling synstructure v0.13.1 [INFO] [stderr] Compiling darling_core v0.20.11 [INFO] [stderr] Checking tempfile v3.18.0 [INFO] [stderr] Checking qutex v0.2.6 [INFO] [stderr] Checking macro_rules_attribute v0.2.0 [INFO] [stderr] Checking env_filter v0.1.3 [INFO] [stderr] Checking itertools v0.13.0 [INFO] [stderr] Checking rayon-cond v0.3.0 [INFO] [stderr] Checking unicode-normalization-alignments v0.1.12 [INFO] [stderr] Checking humantime v2.1.0 [INFO] [stderr] Checking lazy_static v1.5.0 [INFO] [stderr] Checking unicode_categories v0.1.1 [INFO] [stderr] Checking nodrop v0.1.14 [INFO] [stderr] Checking shell-words v1.1.0 [INFO] [stderr] Checking env_logger v0.11.6 [INFO] [stderr] Checking fastapprox v0.3.1 [INFO] [stderr] Compiling serde_derive v1.0.218 [INFO] [stderr] Compiling zerocopy-derive v0.7.35 [INFO] [stderr] Compiling thiserror-impl v2.0.12 [INFO] [stderr] Compiling bytemuck_derive v1.8.1 [INFO] [stderr] Compiling zerofrom-derive v0.1.5 [INFO] [stderr] Compiling yoke-derive v0.7.5 [INFO] [stderr] Compiling zerovec-derive v0.10.3 [INFO] [stderr] Compiling displaydoc v0.2.5 [INFO] [stderr] Compiling strum_macros v0.26.4 [INFO] [stderr] Compiling icu_provider_macros v1.5.0 [INFO] [stderr] Checking zerocopy v0.7.35 [INFO] [stderr] Compiling recursive-proc-macro-impl v0.1.1 [INFO] [stderr] Compiling thiserror-impl v1.0.69 [INFO] [stderr] Checking recursive v0.1.1 [INFO] [stderr] Compiling monostate-impl v0.1.14 [INFO] [stderr] Checking bytemuck v1.22.0 [INFO] [stderr] Compiling clap_derive v4.5.28 [INFO] [stderr] Checking onig v6.4.0 [INFO] [stderr] Checking ppv-lite86 v0.2.20 [INFO] [stderr] Checking zerofrom v0.1.5 [INFO] [stderr] Checking yoke v0.7.5 [INFO] [stderr] Checking zerovec v0.10.4 [INFO] [stderr] Compiling darling_macro v0.20.11 [INFO] [stderr] Checking rand_chacha v0.3.1 [INFO] [stderr] Compiling darling v0.20.11 [INFO] [stderr] Compiling derive_builder_core v0.20.2 [INFO] [stderr] Checking dialoguer v0.11.0 [INFO] [stderr] Checking rand_distr v0.4.3 [INFO] [stderr] Checking rustls-webpki v0.102.8 [INFO] [stderr] Compiling derive_builder_macro v0.20.2 [INFO] [stderr] Checking tinystr v0.7.6 [INFO] [stderr] Checking icu_collections v1.5.0 [INFO] [stderr] Checking derive_builder v0.20.2 [INFO] [stderr] Checking icu_locid v1.5.0 [INFO] [stderr] Checking ndarray-rand v0.15.0 [INFO] [stderr] Checking ocl v0.19.7 [INFO] [stderr] Checking clap v4.5.31 [INFO] [stderr] Checking icu_provider v1.5.0 [INFO] [stderr] Checking icu_locid_transform v1.5.0 [INFO] [stderr] Checking icu_properties v1.5.1 [INFO] [stderr] Checking zstd v0.13.3 [INFO] [stderr] Checking bytes v1.10.0 [INFO] [stderr] Checking polars-arrow-format v0.1.0 [INFO] [stderr] Checking hashbrown v0.15.2 [INFO] [stderr] Checking compact_str v0.8.1 [INFO] [stderr] Checking hashbrown v0.14.5 [INFO] [stderr] Checking monostate v0.1.14 [INFO] [stderr] Checking spm_precompiled v0.1.4 [INFO] [stderr] Checking icu_normalizer v1.5.0 [INFO] [stderr] Checking http v1.2.0 [INFO] [stderr] Checking idna_adapter v1.2.0 [INFO] [stderr] Checking idna v1.0.3 [INFO] [stderr] Checking indexmap v2.7.1 [INFO] [stderr] Checking url v2.5.4 [INFO] [stderr] Checking ureq v2.12.1 [INFO] [stderr] Checking hf-hub v0.4.2 [INFO] [stderr] Checking tokenizers v0.21.1 [INFO] [stderr] Checking polars-error v0.46.0 [INFO] [stderr] Checking lz4 v1.28.1 [INFO] [stderr] Checking polars-row v0.46.0 [INFO] [stderr] Checking polars-parquet v0.46.0 [INFO] [stderr] Checking polars-time v0.46.0 [INFO] [stderr] Checking polars-io v0.46.0 [INFO] [stderr] Checking polars-expr v0.46.0 [INFO] [stderr] Checking polars-mem-engine v0.46.0 [INFO] [stderr] Checking ocl-test v0.1.0 (/opt/rustwide/workdir) [INFO] [stdout] warning: unused import: `log::error` [INFO] [stdout] --> src/transformer.rs:3:5 [INFO] [stdout] | [INFO] [stdout] 3 | use log::error; [INFO] [stdout] | ^^^^^^^^^^ [INFO] [stdout] | [INFO] [stdout] = note: `#[warn(unused_imports)]` on by default [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `std::cmp::PartialOrd` [INFO] [stdout] --> src/transformer.rs:15:5 [INFO] [stdout] | [INFO] [stdout] 15 | use std::cmp::PartialOrd; [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused macro definition: `check_floats_not_inf` [INFO] [stdout] --> src/transformer.rs:53:14 [INFO] [stdout] | [INFO] [stdout] 53 | macro_rules! check_floats_not_inf { [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^^^ [INFO] [stdout] | [INFO] [stdout] = note: `#[warn(unused_macros)]` on by default [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `trace` [INFO] [stdout] --> src/train_llm.rs:6:24 [INFO] [stdout] | [INFO] [stdout] 6 | use log::{debug, info, trace, warn}; [INFO] [stdout] | ^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused imports: `NSeqTokenizer` and `TokenizerExport` [INFO] [stdout] --> src/train_llm.rs:8:22 [INFO] [stdout] | [INFO] [stdout] 8 | use nseq_tokenizer::{NSeqTokenizer, TokenizerExport}; [INFO] [stdout] | ^^^^^^^^^^^^^ ^^^^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `IntoParallelRefIterator` [INFO] [stdout] --> src/train_llm.rs:11:19 [INFO] [stdout] | [INFO] [stdout] 11 | use rayon::iter::{IntoParallelRefIterator, ParallelIterator}; [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `fs::File` [INFO] [stdout] --> src/train_llm.rs:14:11 [INFO] [stdout] | [INFO] [stdout] 14 | use std::{fs::File, path::PathBuf}; [INFO] [stdout] | ^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `LevelFilter` [INFO] [stdout] --> src/train_nseq_tokenizer.rs:7:17 [INFO] [stdout] | [INFO] [stdout] 7 | use log::{info, LevelFilter}; [INFO] [stdout] | ^^^^^^^^^^^ [INFO] [stdout] | [INFO] [stdout] = note: `#[warn(unused_imports)]` on by default [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `env` [INFO] [stdout] --> src/train_nseq_tokenizer.rs:12:5 [INFO] [stdout] | [INFO] [stdout] 12 | env, [INFO] [stdout] | ^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `LevelFilter` [INFO] [stdout] --> src/train_nseq_tokenizer.rs:7:17 [INFO] [stdout] | [INFO] [stdout] 7 | use log::{info, LevelFilter}; [INFO] [stdout] | ^^^^^^^^^^^ [INFO] [stdout] | [INFO] [stdout] = note: `#[warn(unused_imports)]` on by default [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `env` [INFO] [stdout] --> src/train_nseq_tokenizer.rs:12:5 [INFO] [stdout] | [INFO] [stdout] 12 | env, [INFO] [stdout] | ^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `log::error` [INFO] [stdout] --> src/transformer.rs:3:5 [INFO] [stdout] | [INFO] [stdout] 3 | use log::error; [INFO] [stdout] | ^^^^^^^^^^ [INFO] [stdout] | [INFO] [stdout] = note: `#[warn(unused_imports)]` on by default [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `std::cmp::PartialOrd` [INFO] [stdout] --> src/transformer.rs:15:5 [INFO] [stdout] | [INFO] [stdout] 15 | use std::cmp::PartialOrd; [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused macro definition: `check_floats_not_inf` [INFO] [stdout] --> src/transformer.rs:53:14 [INFO] [stdout] | [INFO] [stdout] 53 | macro_rules! check_floats_not_inf { [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^^^ [INFO] [stdout] | [INFO] [stdout] = note: `#[warn(unused_macros)]` on by default [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `trace` [INFO] [stdout] --> src/train_llm.rs:6:24 [INFO] [stdout] | [INFO] [stdout] 6 | use log::{debug, info, trace, warn}; [INFO] [stdout] | ^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused imports: `NSeqTokenizer` and `TokenizerExport` [INFO] [stdout] --> src/train_llm.rs:8:22 [INFO] [stdout] | [INFO] [stdout] 8 | use nseq_tokenizer::{NSeqTokenizer, TokenizerExport}; [INFO] [stdout] | ^^^^^^^^^^^^^ ^^^^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `IntoParallelRefIterator` [INFO] [stdout] --> src/train_llm.rs:11:19 [INFO] [stdout] | [INFO] [stdout] 11 | use rayon::iter::{IntoParallelRefIterator, ParallelIterator}; [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `fs::File` [INFO] [stdout] --> src/train_llm.rs:14:11 [INFO] [stdout] | [INFO] [stdout] 14 | use std::{fs::File, path::PathBuf}; [INFO] [stdout] | ^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `IntoParallelRefIterator` [INFO] [stdout] --> src/train_nseq_tokenizer.rs:9:19 [INFO] [stdout] | [INFO] [stdout] 9 | use rayon::iter::{IntoParallelRefIterator, ParallelIterator}; [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `IntoParallelRefIterator` [INFO] [stdout] --> src/train_nseq_tokenizer.rs:9:19 [INFO] [stdout] | [INFO] [stdout] 9 | use rayon::iter::{IntoParallelRefIterator, ParallelIterator}; [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: associated function `import` is never used [INFO] [stdout] --> src/nseq_tokenizer.rs:171:12 [INFO] [stdout] | [INFO] [stdout] 161 | impl NSeqTokenizer { [INFO] [stdout] | ------------------------------------- associated function in this implementation [INFO] [stdout] ... [INFO] [stdout] 171 | pub fn import(export: &TokenizerExport) -> Result { [INFO] [stdout] | ^^^^^^ [INFO] [stdout] | [INFO] [stdout] = note: `#[warn(dead_code)]` on by default [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] error[E0061]: this function takes 4 arguments but 3 arguments were supplied [INFO] [stdout] --> src/transformer.rs:1210:18 [INFO] [stdout] | [INFO] [stdout] 1210 | let tb = TransformerBlock::new(embed_dim, 2, 15); [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^^^^------------------ argument #4 of type `&mut _` is missing [INFO] [stdout] | [INFO] [stdout] note: associated function defined here [INFO] [stdout] --> src/transformer.rs:581:12 [INFO] [stdout] | [INFO] [stdout] 581 | pub fn new( [INFO] [stdout] | ^^^ [INFO] [stdout] ... [INFO] [stdout] 585 | rng: &mut R, [INFO] [stdout] | ----------- [INFO] [stdout] help: provide the argument [INFO] [stdout] | [INFO] [stdout] 1210 | let tb = TransformerBlock::new(embed_dim, 2, 15, /* rng */); [INFO] [stdout] | +++++++++++ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] error[E0061]: this function takes 7 arguments but 6 arguments were supplied [INFO] [stdout] --> src/transformer.rs:1239:21 [INFO] [stdout] | [INFO] [stdout] 1239 | let mut t = Transformer::new( [INFO] [stdout] | _____________________^^^^^^^^^^^^^^^^- [INFO] [stdout] 1240 | | ctx_size, vocab_size, embed_dim, num_layers, num_heads, ff_dim, [INFO] [stdout] 1241 | | )?; [INFO] [stdout] | |_________- argument #7 of type `&mut _` is missing [INFO] [stdout] | [INFO] [stdout] note: associated function defined here [INFO] [stdout] --> src/transformer.rs:234:12 [INFO] [stdout] | [INFO] [stdout] 234 | pub fn new( [INFO] [stdout] | ^^^ [INFO] [stdout] ... [INFO] [stdout] 241 | rng: &mut R, [INFO] [stdout] | ----------- [INFO] [stdout] help: provide the argument [INFO] [stdout] | [INFO] [stdout] 1239 - let mut t = Transformer::new( [INFO] [stdout] 1240 - ctx_size, vocab_size, embed_dim, num_layers, num_heads, ff_dim, [INFO] [stdout] 1241 - )?; [INFO] [stdout] 1239 + let mut t = Transformer::new(ctx_size, vocab_size, embed_dim, num_layers, num_heads, ff_dim, /* rng */)?; [INFO] [stdout] | [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `ParallelIterator` [INFO] [stdout] --> src/train_llm.rs:11:44 [INFO] [stdout] | [INFO] [stdout] 11 | use rayon::iter::{IntoParallelRefIterator, ParallelIterator}; [INFO] [stdout] | ^^^^^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] error[E0061]: this method takes 2 arguments but 3 arguments were supplied [INFO] [stdout] --> src/transformer.rs:1263:30 [INFO] [stdout] | [INFO] [stdout] 1263 | let new_loss = t.naive_bwd(lr, &train_data, &y_gt)?; [INFO] [stdout] | ^^^^^^^^^ -- unexpected argument #1 of type `{float}` [INFO] [stdout] | [INFO] [stdout] note: method defined here [INFO] [stdout] --> src/transformer.rs:339:12 [INFO] [stdout] | [INFO] [stdout] 339 | pub fn naive_bwd( [INFO] [stdout] | ^^^^^^^^^ [INFO] [stdout] help: remove the extra argument [INFO] [stdout] | [INFO] [stdout] 1263 - let new_loss = t.naive_bwd(lr, &train_data, &y_gt)?; [INFO] [stdout] 1263 + let new_loss = t.naive_bwd(&train_data, &y_gt)?; [INFO] [stdout] | [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] error[E0369]: binary operation `<` cannot be applied to type `TransformerGradients` [INFO] [stdout] --> src/transformer.rs:1265:36 [INFO] [stdout] | [INFO] [stdout] 1265 | assert!(dbg!(new_loss) < dbg!(loss)); [INFO] [stdout] | -------------- ^ ---------- f32 [INFO] [stdout] | | [INFO] [stdout] | TransformerGradients [INFO] [stdout] | [INFO] [stdout] note: an implementation of `PartialOrd` might be missing for `TransformerGradients` [INFO] [stdout] --> src/transformer.rs:181:1 [INFO] [stdout] | [INFO] [stdout] 181 | pub struct TransformerGradients { [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ must implement `PartialOrd` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] error[E0277]: `TransformerGradients` doesn't implement `std::fmt::Debug` [INFO] [stdout] --> src/transformer.rs:1265:21 [INFO] [stdout] | [INFO] [stdout] 1265 | assert!(dbg!(new_loss) < dbg!(loss)); [INFO] [stdout] | ^^^^^^^^^^^^^^ the trait `std::fmt::Debug` is not implemented for `TransformerGradients` [INFO] [stdout] | [INFO] [stdout] = note: add `#[derive(Debug)]` to `TransformerGradients` or manually `impl std::fmt::Debug for TransformerGradients` [INFO] [stdout] = note: this error originates in the macro `dbg` (in Nightly builds, run with -Z macro-backtrace for more info) [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `ctx_width` [INFO] [stdout] --> src/transformer.rs:235:9 [INFO] [stdout] | [INFO] [stdout] 235 | ctx_width: usize, [INFO] [stdout] | ^^^^^^^^^ help: if this is intentional, prefix it with an underscore: `_ctx_width` [INFO] [stdout] | [INFO] [stdout] = note: `#[warn(unused_variables)]` on by default [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `z` [INFO] [stdout] --> src/transformer.rs:352:13 [INFO] [stdout] | [INFO] [stdout] 352 | let z = &train_data.predictions_raw; [INFO] [stdout] | ^ help: if this is intentional, prefix it with an underscore: `_z` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `ParallelIterator` [INFO] [stdout] --> src/train_llm.rs:11:44 [INFO] [stdout] | [INFO] [stdout] 11 | use rayon::iter::{IntoParallelRefIterator, ParallelIterator}; [INFO] [stdout] | ^^^^^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `idx` [INFO] [stdout] --> src/transformer.rs:869:9 [INFO] [stdout] | [INFO] [stdout] 869 | idx: usize, [INFO] [stdout] | ^^^ help: if this is intentional, prefix it with an underscore: `_idx` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `ctx_width` [INFO] [stdout] --> src/transformer.rs:235:9 [INFO] [stdout] | [INFO] [stdout] 235 | ctx_width: usize, [INFO] [stdout] | ^^^^^^^^^ help: if this is intentional, prefix it with an underscore: `_ctx_width` [INFO] [stdout] | [INFO] [stdout] = note: `#[warn(unused_variables)]` on by default [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `z` [INFO] [stdout] --> src/transformer.rs:352:13 [INFO] [stdout] | [INFO] [stdout] 352 | let z = &train_data.predictions_raw; [INFO] [stdout] | ^ help: if this is intentional, prefix it with an underscore: `_z` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: constant `TOK_ID_OFFSET` is never used [INFO] [stdout] --> src/nseq_tokenizer.rs:16:11 [INFO] [stdout] | [INFO] [stdout] 16 | pub const TOK_ID_OFFSET: u32 = 1_114_112; [INFO] [stdout] | ^^^^^^^^^^^^^ [INFO] [stdout] | [INFO] [stdout] = note: `#[warn(dead_code)]` on by default [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: enum `TokenComponent` is never used [INFO] [stdout] --> src/nseq_tokenizer.rs:26:10 [INFO] [stdout] | [INFO] [stdout] 26 | pub enum TokenComponent { [INFO] [stdout] | ^^^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: methods `unroll` and `as_u32` are never used [INFO] [stdout] --> src/nseq_tokenizer.rs:42:12 [INFO] [stdout] | [INFO] [stdout] 41 | impl TokenComponent { [INFO] [stdout] | -------------------------------------- methods in this implementation [INFO] [stdout] 42 | pub fn unroll(&self) -> String { [INFO] [stdout] | ^^^^^^ [INFO] [stdout] ... [INFO] [stdout] 49 | pub fn as_u32(&self) -> u32 { [INFO] [stdout] | ^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: struct `Token` is never constructed [INFO] [stdout] --> src/nseq_tokenizer.rs:60:12 [INFO] [stdout] | [INFO] [stdout] 60 | pub struct Token { [INFO] [stdout] | ^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: methods `unroll`, `as_u32`, and `as_u32s` are never used [INFO] [stdout] --> src/nseq_tokenizer.rs:66:12 [INFO] [stdout] | [INFO] [stdout] 65 | impl Token { [INFO] [stdout] | ----------------------------- methods in this implementation [INFO] [stdout] 66 | pub fn unroll(&self) -> String { [INFO] [stdout] | ^^^^^^ [INFO] [stdout] ... [INFO] [stdout] 76 | pub fn as_u32(&self) -> u32 { [INFO] [stdout] | ^^^^^^ [INFO] [stdout] ... [INFO] [stdout] 81 | pub fn as_u32s(&self) -> Vec { [INFO] [stdout] | ^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: function `most_common_nsequences` is never used [INFO] [stdout] --> src/nseq_tokenizer.rs:114:8 [INFO] [stdout] | [INFO] [stdout] 114 | pub fn most_common_nsequences( [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: struct `NSeqTokenizer` is never constructed [INFO] [stdout] --> src/nseq_tokenizer.rs:152:12 [INFO] [stdout] | [INFO] [stdout] 152 | pub struct NSeqTokenizer { [INFO] [stdout] | ^^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: multiple associated items are never used [INFO] [stdout] --> src/nseq_tokenizer.rs:162:12 [INFO] [stdout] | [INFO] [stdout] 161 | impl NSeqTokenizer { [INFO] [stdout] | ------------------------------------- associated items in this implementation [INFO] [stdout] 162 | pub fn new(vocab_size: u32) -> Self { [INFO] [stdout] | ^^^ [INFO] [stdout] ... [INFO] [stdout] 171 | pub fn import(export: &TokenizerExport) -> Result { [INFO] [stdout] | ^^^^^^ [INFO] [stdout] ... [INFO] [stdout] 252 | pub fn export(&self) -> TokenizerExport { [INFO] [stdout] | ^^^^^^ [INFO] [stdout] ... [INFO] [stdout] 267 | pub fn is_full(&self) -> bool { [INFO] [stdout] | ^^^^^^^ [INFO] [stdout] ... [INFO] [stdout] 271 | pub fn tokenize_str(&self, s: &str) -> Vec> { [INFO] [stdout] | ^^^^^^^^^^^^ [INFO] [stdout] ... [INFO] [stdout] 278 | pub fn tokenize(&self, tok_comps: Vec>) -> Vec> { [INFO] [stdout] | ^^^^^^^^ [INFO] [stdout] ... [INFO] [stdout] 312 | pub fn untokenize(&self, tok_comps: &[TokenComponent]) -> String { [INFO] [stdout] | ^^^^^^^^^^ [INFO] [stdout] ... [INFO] [stdout] 324 | pub fn ingest(&self, s: &str) -> (usize, bool) { [INFO] [stdout] | ^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: struct `TokenizerExport` is never constructed [INFO] [stdout] --> src/nseq_tokenizer.rs:387:12 [INFO] [stdout] | [INFO] [stdout] 387 | pub struct TokenizerExport { [INFO] [stdout] | ^^^^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: field `ff_dim` is never read [INFO] [stdout] --> src/transformer.rs:435:5 [INFO] [stdout] | [INFO] [stdout] 432 | pub struct TransformerBlock { [INFO] [stdout] | ---------------- field in this struct [INFO] [stdout] ... [INFO] [stdout] 435 | ff_dim: usize, [INFO] [stdout] | ^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: fields `x_ln`, `atn_scores_atn_out`, `x_ff1`, `x_ff2`, `x_ff2_b`, and `x_with_ff` are never read [INFO] [stdout] --> src/transformer.rs:461:5 [INFO] [stdout] | [INFO] [stdout] 451 | pub struct TBTrainData { [INFO] [stdout] | ----------- fields in this struct [INFO] [stdout] ... [INFO] [stdout] 461 | x_ln: Array2, [INFO] [stdout] | ^^^^ [INFO] [stdout] ... [INFO] [stdout] 475 | atn_scores_atn_out: Array2, [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^ [INFO] [stdout] ... [INFO] [stdout] 479 | x_ff1: Array2, [INFO] [stdout] | ^^^^^ [INFO] [stdout] ... [INFO] [stdout] 485 | x_ff2: Array2, [INFO] [stdout] | ^^^^^ [INFO] [stdout] 486 | /// Xff2 + ff2_b [INFO] [stdout] 487 | x_ff2_b: Array2, [INFO] [stdout] | ^^^^^^^ [INFO] [stdout] 488 | /// X + atn_out_reshape + X_ff2_b [INFO] [stdout] 489 | x_with_ff: Array2, [INFO] [stdout] | ^^^^^^^^^ [INFO] [stdout] | [INFO] [stdout] = note: `TBTrainData` has a derived impl for the trait `Clone`, but this is intentionally ignored during dead code analysis [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `idx` [INFO] [stdout] --> src/transformer.rs:869:9 [INFO] [stdout] | [INFO] [stdout] 869 | idx: usize, [INFO] [stdout] | ^^^ help: if this is intentional, prefix it with an underscore: `_idx` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] Some errors have detailed explanations: E0061, E0277, E0369. [INFO] [stdout] [INFO] [stdout] For more information about an error, try `rustc --explain E0061`. [INFO] [stdout] [INFO] [stderr] error: could not compile `ocl-test` (bin "train-llm" test) due to 5 previous errors; 11 warnings emitted [INFO] running `Command { std: "docker" "inspect" "2d05b91573cda34d7a67a4dc2c9669a43e1765dc8fd97380b95ce6a8de3bf1a3", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "2d05b91573cda34d7a67a4dc2c9669a43e1765dc8fd97380b95ce6a8de3bf1a3", kill_on_drop: false }` [INFO] [stdout] 2d05b91573cda34d7a67a4dc2c9669a43e1765dc8fd97380b95ce6a8de3bf1a3