[INFO] cloning repository https://github.com/lucienhuangfu/eLLM [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/lucienhuangfu/eLLM" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Flucienhuangfu%2FeLLM", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Flucienhuangfu%2FeLLM'... [INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }` [INFO] [stdout] 139479cf8259c82cf8ce2e172493acc22c6e8f02 [INFO] testing lucienhuangfu/eLLM against master#cdb45c87e2cd43495379f7e867e3cc15dcee9f93 for pr-145838-1 [INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Flucienhuangfu%2FeLLM" "/workspace/builds/worker-7-tc1/source", kill_on_drop: false }` [INFO] [stderr] Cloning into '/workspace/builds/worker-7-tc1/source'... [INFO] [stderr] done. [INFO] removed /workspace/builds/worker-7-tc1/source/.cargo/config.toml [INFO] started tweaking git repo https://github.com/lucienhuangfu/eLLM [INFO] finished tweaking git repo https://github.com/lucienhuangfu/eLLM [INFO] tweaked toml for git repo https://github.com/lucienhuangfu/eLLM written to /workspace/builds/worker-7-tc1/source/Cargo.toml [INFO] validating manifest of git repo https://github.com/lucienhuangfu/eLLM on toolchain cdb45c87e2cd43495379f7e867e3cc15dcee9f93 [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+cdb45c87e2cd43495379f7e867e3cc15dcee9f93" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }` [INFO] crate git repo https://github.com/lucienhuangfu/eLLM already has a lockfile, it will not be regenerated [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+cdb45c87e2cd43495379f7e867e3cc15dcee9f93" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] [stderr] warning: unused manifest key: toolchain [INFO] [stderr] Updating crates.io index [INFO] [stderr] Blocking waiting for file lock on package cache [INFO] [stderr] Downloading crates ... [INFO] [stderr] Downloaded macro_rules_attribute-proc_macro v0.2.2 [INFO] [stderr] Downloaded monostate-impl v0.1.14 [INFO] [stderr] Downloaded macro_rules_attribute v0.2.2 [INFO] [stderr] Downloaded rayon-cond v0.3.0 [INFO] [stderr] Downloaded core_affinity v0.8.3 [INFO] [stderr] Downloaded monostate v0.1.14 [INFO] [stderr] Downloaded pyo3-macros v0.20.3 [INFO] [stderr] Downloaded cache-padded v1.3.0 [INFO] [stderr] Downloaded repugnant-pickle v0.0.1 [INFO] [stderr] Downloaded iter-read v1.1.0 [INFO] [stderr] Downloaded rtrb v0.2.3 [INFO] [stderr] Downloaded pyo3-ffi v0.20.3 [INFO] [stderr] Downloaded pyo3-build-config v0.20.3 [INFO] [stderr] Downloaded pyo3-macros-backend v0.20.3 [INFO] [stderr] Downloaded numpy v0.20.0 [INFO] [stderr] Downloaded hyper-util v0.1.15 [INFO] [stderr] Downloaded tokenizers v0.20.4 [INFO] [stderr] Downloaded raw-cpuid v11.5.0 [INFO] [stderr] Downloaded io-uring v0.7.8 [INFO] [stderr] Downloaded esaxx-rs v0.1.10 [INFO] [stderr] Downloaded serde-pickle v1.2.0 [INFO] [stderr] Downloaded pyo3 v0.20.3 [INFO] [stderr] Downloaded spm_precompiled v0.1.4 [INFO] [stderr] Downloaded bzip2-sys v0.1.13+1.0.8 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:7ad1b28ee6f5f7f699f6cf7015098d6ccdd96d6f2d78dd06228f5b4c9faf309c" "/opt/rustwide/cargo-home/bin/cargo" "+cdb45c87e2cd43495379f7e867e3cc15dcee9f93" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }` [INFO] [stdout] a4eb768f46d882a2715caa8f28ee51c4a397dcda7a1599c8de84476b314f1ec0 [INFO] running `Command { std: "docker" "start" "-a" "a4eb768f46d882a2715caa8f28ee51c4a397dcda7a1599c8de84476b314f1ec0", kill_on_drop: false }` [INFO] running `Command { std: "docker" "inspect" "a4eb768f46d882a2715caa8f28ee51c4a397dcda7a1599c8de84476b314f1ec0", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "a4eb768f46d882a2715caa8f28ee51c4a397dcda7a1599c8de84476b314f1ec0", kill_on_drop: false }` [INFO] [stdout] a4eb768f46d882a2715caa8f28ee51c4a397dcda7a1599c8de84476b314f1ec0 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:7ad1b28ee6f5f7f699f6cf7015098d6ccdd96d6f2d78dd06228f5b4c9faf309c" "/opt/rustwide/cargo-home/bin/cargo" "+cdb45c87e2cd43495379f7e867e3cc15dcee9f93" "build" "--frozen" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] 54518d92bd27cf62cf09402bad8dc546d4256bfceb31c4bf999d2263f52df489 [INFO] running `Command { std: "docker" "start" "-a" "54518d92bd27cf62cf09402bad8dc546d4256bfceb31c4bf999d2263f52df489", kill_on_drop: false }` [INFO] [stderr] warning: unused manifest key: toolchain [INFO] [stderr] Compiling libc v0.2.174 [INFO] [stderr] Compiling cfg-if v1.0.1 [INFO] [stderr] Compiling libm v0.2.15 [INFO] [stderr] Compiling num-traits v0.2.19 [INFO] [stderr] Compiling futures-sink v0.3.31 [INFO] [stderr] Compiling subtle v2.6.1 [INFO] [stderr] Compiling syn v2.0.104 [INFO] [stderr] Compiling slab v0.4.10 [INFO] [stderr] Compiling either v1.15.0 [INFO] [stderr] Compiling zstd-safe v5.0.2+zstd.1.5.2 [INFO] [stderr] Compiling inout v0.1.4 [INFO] [stderr] Compiling futures-channel v0.3.31 [INFO] [stderr] Compiling serde_json v1.0.140 [INFO] [stderr] Compiling tracing-core v0.1.34 [INFO] [stderr] Compiling portable-atomic v1.11.1 [INFO] [stderr] Compiling base64ct v1.8.0 [INFO] [stderr] Compiling minimal-lexical v0.2.1 [INFO] [stderr] Compiling miniz_oxide v0.8.9 [INFO] [stderr] Compiling crc32fast v1.4.2 [INFO] [stderr] Compiling cipher v0.4.4 [INFO] [stderr] Compiling digest v0.10.7 [INFO] [stderr] Compiling nom v7.1.3 [INFO] [stderr] Compiling aho-corasick v1.1.3 [INFO] [stderr] Compiling sync_wrapper v1.0.2 [INFO] [stderr] Compiling unicode-width v0.2.1 [INFO] [stderr] Compiling time v0.3.41 [INFO] [stderr] Compiling unicode-segmentation v1.12.0 [INFO] [stderr] Compiling clap_lex v0.7.5 [INFO] [stderr] Compiling macro_rules_attribute-proc_macro v0.2.2 [INFO] [stderr] Compiling hmac v0.12.1 [INFO] [stderr] Compiling sha2 v0.10.9 [INFO] [stderr] Compiling itertools v0.11.0 [INFO] [stderr] Compiling rayon v1.10.0 [INFO] [stderr] Compiling tracing v0.1.41 [INFO] [stderr] Compiling aes v0.8.4 [INFO] [stderr] Compiling sha1 v0.10.6 [INFO] [stderr] Compiling base64 v0.13.1 [INFO] [stderr] Compiling axum-core v0.5.2 [INFO] [stderr] Compiling macro_rules_attribute v0.2.2 [INFO] [stderr] Compiling clap_builder v4.5.40 [INFO] [stderr] Compiling itertools v0.12.1 [INFO] [stderr] Compiling crossbeam-channel v0.5.15 [INFO] [stderr] Compiling crossbeam-queue v0.3.12 [INFO] [stderr] Compiling jobserver v0.1.33 [INFO] [stderr] Compiling getrandom v0.2.16 [INFO] [stderr] Compiling parking_lot_core v0.9.11 [INFO] [stderr] Compiling cc v1.2.27 [INFO] [stderr] Compiling parking_lot v0.12.4 [INFO] [stderr] Compiling mio v1.0.4 [INFO] [stderr] Compiling rand_core v0.6.4 [INFO] [stderr] Compiling socket2 v0.5.10 [INFO] [stderr] Compiling signal-hook-registry v1.4.5 [INFO] [stderr] Compiling password-hash v0.4.2 [INFO] [stderr] Compiling rand_chacha v0.3.1 [INFO] [stderr] Compiling flate2 v1.1.2 [INFO] [stderr] Compiling regex-automata v0.4.9 [INFO] [stderr] Compiling pbkdf2 v0.11.0 [INFO] [stderr] Compiling console v0.15.11 [INFO] [stderr] Compiling rand v0.8.5 [INFO] [stderr] Compiling num_cpus v1.17.0 [INFO] [stderr] Compiling num-integer v0.1.46 [INFO] [stderr] Compiling num-complex v0.4.6 [INFO] [stderr] Compiling unicode-normalization-alignments v0.1.12 [INFO] [stderr] Compiling matchit v0.8.4 [INFO] [stderr] Compiling unicode_categories v0.1.1 [INFO] [stderr] Compiling num-bigint v0.4.6 [INFO] [stderr] Compiling rayon-cond v0.3.0 [INFO] [stderr] Compiling num-iter v0.1.45 [INFO] [stderr] Compiling indicatif v0.17.11 [INFO] [stderr] Compiling cache-padded v1.3.0 [INFO] [stderr] Compiling iter-read v1.1.0 [INFO] [stderr] Compiling rtrb v0.2.3 [INFO] [stderr] Compiling half v2.6.0 [INFO] [stderr] Compiling core_affinity v0.8.3 [INFO] [stderr] Compiling crossbeam v0.8.4 [INFO] [stderr] Compiling memmap2 v0.9.5 [INFO] [stderr] Compiling itertools v0.14.0 [INFO] [stderr] Compiling zstd-sys v2.0.15+zstd.1.5.7 [INFO] [stderr] Compiling bzip2-sys v0.1.13+1.0.8 [INFO] [stderr] Compiling onig_sys v69.9.1 [INFO] [stderr] Compiling esaxx-rs v0.1.10 [INFO] [stderr] Compiling num-rational v0.4.2 [INFO] [stderr] Compiling darling_core v0.20.11 [INFO] [stderr] Compiling clap v4.5.40 [INFO] [stderr] Compiling num v0.4.3 [INFO] [stderr] Compiling bzip2 v0.4.4 [INFO] [stderr] Compiling serde_derive v1.0.219 [INFO] [stderr] Compiling futures-macro v0.3.31 [INFO] [stderr] Compiling tokio-macros v2.5.0 [INFO] [stderr] Compiling monostate-impl v0.1.14 [INFO] [stderr] Compiling thiserror-impl v1.0.69 [INFO] [stderr] Compiling regex v1.11.1 [INFO] [stderr] Compiling async-stream-impl v0.3.6 [INFO] [stderr] Compiling tokio v1.46.1 [INFO] [stderr] Compiling futures-util v0.3.31 [INFO] [stderr] Compiling async-stream v0.3.6 [INFO] [stderr] Compiling darling_macro v0.20.11 [INFO] [stderr] Compiling onig v6.5.1 [INFO] [stderr] Compiling darling v0.20.11 [INFO] [stderr] Compiling derive_builder_core v0.20.2 [INFO] [stderr] Compiling thiserror v1.0.69 [INFO] [stderr] Compiling serde v1.0.219 [INFO] [stderr] Compiling derive_builder_macro v0.20.2 [INFO] [stderr] Compiling derive_builder v0.20.2 [INFO] [stderr] Compiling zstd v0.11.2+zstd.1.5.2 [INFO] [stderr] Compiling zip v0.6.6 [INFO] [stderr] Compiling repugnant-pickle v0.0.1 [INFO] [stderr] Compiling futures-executor v0.3.31 [INFO] [stderr] Compiling futures v0.3.31 [INFO] [stderr] Compiling spm_precompiled v0.1.4 [INFO] [stderr] Compiling serde_path_to_error v0.1.17 [INFO] [stderr] Compiling serde_urlencoded v0.7.1 [INFO] [stderr] Compiling monostate v0.1.14 [INFO] [stderr] Compiling serde-pickle v1.2.0 [INFO] [stderr] Compiling hyper v1.6.0 [INFO] [stderr] Compiling tower v0.5.2 [INFO] [stderr] Compiling tokenizers v0.20.4 [INFO] [stderr] Compiling safetensors v0.4.5 [INFO] [stderr] Compiling hyper-util v0.1.15 [INFO] [stderr] Compiling axum v0.8.4 [INFO] [stderr] Compiling eLLM v0.1.0 (/opt/rustwide/workdir) [INFO] [stdout] warning: unused import: `crate::kernel::generic::from_f32::FromF32` [INFO] [stdout] --> src/init/config.rs:5:5 [INFO] [stdout] | [INFO] [stdout] 5 | use crate::kernel::generic::from_f32::FromF32; [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [INFO] [stdout] | [INFO] [stdout] = note: `#[warn(unused_imports)]` (part of `#[warn(unused)]`) on by default [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused imports: `Deserializer`, `Visitor`, and `self` [INFO] [stdout] --> src/init/config.rs:7:17 [INFO] [stdout] | [INFO] [stdout] 7 | use serde::de::{self, Deserializer, Visitor}; [INFO] [stdout] | ^^^^ ^^^^^^^^^^^^ ^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `std::f16` [INFO] [stdout] --> src/init/config.rs:8:5 [INFO] [stdout] | [INFO] [stdout] 8 | use std::f16; [INFO] [stdout] | ^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `std::ptr` [INFO] [stdout] --> src/kernel/generic/complex_mul.rs:1:5 [INFO] [stdout] | [INFO] [stdout] 1 | use std::ptr; [INFO] [stdout] | ^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `std::ptr` [INFO] [stdout] --> src/kernel/generic/silu.rs:1:5 [INFO] [stdout] | [INFO] [stdout] 1 | use std::ptr; [INFO] [stdout] | ^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `self` [INFO] [stdout] --> src/kernel/generic/silu.rs:4:22 [INFO] [stdout] | [INFO] [stdout] 4 | use super::sigmoid::{self, Sigmoid}; [INFO] [stdout] | ^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused imports: `Div` and `Mul` [INFO] [stdout] --> src/kernel/generic/rms_norm.rs:3:21 [INFO] [stdout] | [INFO] [stdout] 3 | use std::ops::{Add, Div, Mul}; [INFO] [stdout] | ^^^ ^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `_mm512_storeu_ph` [INFO] [stdout] --> src/kernel/x86_64/f16_512/argmax.rs:2:82 [INFO] [stdout] | [INFO] [stdout] 2 | __m512h, _mm512_cmp_ph_mask, _mm512_loadu_ph, _mm512_max_ph, _mm512_set1_ph, _mm512_storeu_ph, [INFO] [stdout] | ^^^^^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused imports: `_MM_HINT_T1`, `_mm512_add_ph`, and `_mm512_reduce_add_ph` [INFO] [stdout] --> src/kernel/x86_64/f16_512/flash_attention.rs:4:14 [INFO] [stdout] | [INFO] [stdout] 4 | __m512h, _mm512_add_ph, _mm512_fmadd_ph, _mm512_load_ph, _mm512_mul_ph, _mm512_reduce_add_ph, [INFO] [stdout] | ^^^^^^^^^^^^^ ^^^^^^^^^^^^^^^^^^^^ [INFO] [stdout] 5 | _mm512_set1_ph, _mm512_setzero_ph, _mm512_store_ph, _mm_prefetch, _MM_HINT_T1, _MM_HINT_T2, [INFO] [stdout] | ^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `crate::kernel::generic::from_usize::FromUsize` [INFO] [stdout] --> src/compiler/map/rms_map.rs:4:5 [INFO] [stdout] | [INFO] [stdout] 4 | use crate::kernel::generic::from_usize::FromUsize; [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused imports: `AddAssign`, `Add`, `Div`, and `Mul` [INFO] [stdout] --> src/compiler/operator.rs:3:16 [INFO] [stdout] | [INFO] [stdout] 3 | use std::ops::{Add, Sub, Div, Mul, AddAssign, Neg }; [INFO] [stdout] | ^^^ ^^^ ^^^ ^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `crate::init::matmul_params::MatMulParams` [INFO] [stdout] --> src/compiler/operator.rs:8:5 [INFO] [stdout] | [INFO] [stdout] 8 | use crate::init::matmul_params::MatMulParams; [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `std::iter::zip` [INFO] [stdout] --> src/ptensor/tensor.rs:2:5 [INFO] [stdout] | [INFO] [stdout] 2 | use std::iter::zip; [INFO] [stdout] | ^^^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused imports: `AddAssign`, `Div`, and `Mul` [INFO] [stdout] --> src/ptensor/tensor.rs:4:26 [INFO] [stdout] | [INFO] [stdout] 4 | use std::ops::{Add, Sub, Div, Mul, AddAssign, Neg }; [INFO] [stdout] | ^^^ ^^^ ^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused imports: `AddAssign`, `Add`, `Div`, and `Mul` [INFO] [stdout] --> src/ptensor/linear.rs:5:16 [INFO] [stdout] | [INFO] [stdout] 5 | use std::ops::{Add, Sub, Div, Mul, AddAssign, Neg}; [INFO] [stdout] | ^^^ ^^^ ^^^ ^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused imports: `BufReader` and `Read` [INFO] [stdout] --> src/llama/model_loader.rs:6:15 [INFO] [stdout] | [INFO] [stdout] 6 | use std::io::{BufReader, Read}; [INFO] [stdout] | ^^^^^^^^^ ^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `serde_json` [INFO] [stdout] --> src/llama/model_loader.rs:12:5 [INFO] [stdout] | [INFO] [stdout] 12 | use serde_json; [INFO] [stdout] | ^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused imports: `AddAssign`, `Add`, `Div`, and `Mul` [INFO] [stdout] --> src/llama/attention.rs:5:16 [INFO] [stdout] | [INFO] [stdout] 5 | use std::ops::{Add, AddAssign, Div, Mul, Neg, Sub}; [INFO] [stdout] | ^^^ ^^^^^^^^^ ^^^ ^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused imports: `AddAssign`, `Add`, `Div`, and `Mul` [INFO] [stdout] --> src/llama/feedforward.rs:3:16 [INFO] [stdout] | [INFO] [stdout] 3 | use std::ops::{Add, Sub, Div, Mul, AddAssign, Neg}; [INFO] [stdout] | ^^^ ^^^ ^^^ ^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused imports: `AddAssign`, `Add`, `Div`, and `Mul` [INFO] [stdout] --> src/llama/transformer_block.rs:4:16 [INFO] [stdout] | [INFO] [stdout] 4 | use std::ops::{Add, Sub, Div, Mul, AddAssign, Neg }; [INFO] [stdout] | ^^^ ^^^ ^^^ ^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused imports: `AddAssign`, `Add`, `Div`, and `Mul` [INFO] [stdout] --> src/llama/transformer.rs:2:16 [INFO] [stdout] | [INFO] [stdout] 2 | use std::ops::{Add, AddAssign, Div, Mul, Neg, Sub}; [INFO] [stdout] | ^^^ ^^^^^^^^^ ^^^ ^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `RwLock` [INFO] [stdout] --> src/llama/transformer.rs:4:22 [INFO] [stdout] | [INFO] [stdout] 4 | use std::sync::{Arc, RwLock}; [INFO] [stdout] | ^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `std::time::Instant` [INFO] [stdout] --> src/llama/transformer.rs:6:5 [INFO] [stdout] | [INFO] [stdout] 6 | use std::time::Instant; [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `std::cell::SyncUnsafeCell` [INFO] [stdout] --> src/llama/transformer.rs:9:5 [INFO] [stdout] | [INFO] [stdout] 9 | use std::cell::SyncUnsafeCell; [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `crate::memory::cache` [INFO] [stdout] --> src/llama/transformer.rs:21:5 [INFO] [stdout] | [INFO] [stdout] 21 | use crate::memory::cache; [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `super::model_loader::SafeTensorsLoader` [INFO] [stdout] --> src/llama/transformer.rs:27:5 [INFO] [stdout] | [INFO] [stdout] 27 | use super::model_loader::SafeTensorsLoader; [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: the feature `avx512_target_feature` has been stable since 1.89.0 and no longer requires an attribute to enable [INFO] [stdout] --> src/lib.rs:8:12 [INFO] [stdout] | [INFO] [stdout] 8 | #![feature(avx512_target_feature)] [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^^^^ [INFO] [stdout] | [INFO] [stdout] = note: `#[warn(stable_features)]` on by default [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: the feature `stdarch_x86_avx512` has been stable since 1.89.0 and no longer requires an attribute to enable [INFO] [stdout] --> src/lib.rs:5:12 [INFO] [stdout] | [INFO] [stdout] 5 | #![feature(stdarch_x86_avx512)] [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `Add` [INFO] [stdout] --> src/ptensor/tensor.rs:4:16 [INFO] [stdout] | [INFO] [stdout] 4 | use std::ops::{Add, Sub, Div, Mul, AddAssign, Neg }; [INFO] [stdout] | ^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `Add` [INFO] [stdout] --> src/kernel/generic/rms_norm.rs:3:16 [INFO] [stdout] | [INFO] [stdout] 3 | use std::ops::{Add, Div, Mul}; [INFO] [stdout] | ^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: variable does not need to be mutable [INFO] [stdout] --> src/memory/allocator.rs:9:13 [INFO] [stdout] | [INFO] [stdout] 9 | let mut data_ptr: *mut T = alloc::alloc(layout) as *mut T; [INFO] [stdout] | ----^^^^^^^^ [INFO] [stdout] | | [INFO] [stdout] | help: remove this `mut` [INFO] [stdout] | [INFO] [stdout] = note: `#[warn(unused_mut)]` (part of `#[warn(unused)]`) on by default [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `i` [INFO] [stdout] --> src/kernel/generic/flash_attention.rs:68:9 [INFO] [stdout] | [INFO] [stdout] 68 | for i in 0..=position { [INFO] [stdout] | ^ help: if this is intentional, prefix it with an underscore: `_i` [INFO] [stdout] | [INFO] [stdout] = note: `#[warn(unused_variables)]` (part of `#[warn(unused)]`) on by default [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `k` [INFO] [stdout] --> src/kernel/x86_64/f16_512/matmul_block.rs:26:9 [INFO] [stdout] | [INFO] [stdout] 26 | for k in (0..param.column_step_macro).step_by(64) { [INFO] [stdout] | ^ help: if this is intentional, prefix it with an underscore: `_k` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: value assigned to `chunks_sum` is never read [INFO] [stdout] --> src/kernel/x86_64/f16_512/rms_norm.rs:9:17 [INFO] [stdout] | [INFO] [stdout] 9 | let mut chunks_sum = 0.0; [INFO] [stdout] | ^^^^^^^^^^ [INFO] [stdout] | [INFO] [stdout] = help: maybe it is overwritten before being read? [INFO] [stdout] = note: `#[warn(unused_assignments)]` (part of `#[warn(unused)]`) on by default [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `position_index` [INFO] [stdout] --> src/compiler/map/rms_map.rs:34:42 [INFO] [stdout] | [INFO] [stdout] 34 | pub fn run(&self, batch_size: usize, position_index: usize, thread_id: usize) { [INFO] [stdout] | ^^^^^^^^^^^^^^ help: if this is intentional, prefix it with an underscore: `_position_index` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `position` [INFO] [stdout] --> src/compiler/zip_map/add_zip.rs:42:13 [INFO] [stdout] | [INFO] [stdout] 42 | position: usize, [INFO] [stdout] | ^^^^^^^^ help: if this is intentional, prefix it with an underscore: `_position` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `input_ptr1` [INFO] [stdout] --> src/compiler/zip_map/add_zip.rs:96:24 [INFO] [stdout] | [INFO] [stdout] 96 | fn compute (&self, input_ptr1: *const f64, input_ptr2: *const f64, output_ptr: *mut f64) { [INFO] [stdout] | ^^^^^^^^^^ help: if this is intentional, prefix it with an underscore: `_input_ptr1` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `input_ptr2` [INFO] [stdout] --> src/compiler/zip_map/add_zip.rs:96:48 [INFO] [stdout] | [INFO] [stdout] 96 | fn compute (&self, input_ptr1: *const f64, input_ptr2: *const f64, output_ptr: *mut f64) { [INFO] [stdout] | ^^^^^^^^^^ help: if this is intentional, prefix it with an underscore: `_input_ptr2` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `output_ptr` [INFO] [stdout] --> src/compiler/zip_map/add_zip.rs:96:72 [INFO] [stdout] | [INFO] [stdout] 96 | fn compute (&self, input_ptr1: *const f64, input_ptr2: *const f64, output_ptr: *mut f64) { [INFO] [stdout] | ^^^^^^^^^^ help: if this is intentional, prefix it with an underscore: `_output_ptr` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `input_ptr1` [INFO] [stdout] --> src/compiler/zip_map/add_rms_zip.rs:102:23 [INFO] [stdout] | [INFO] [stdout] 102 | fn compute(&self, input_ptr1: *const f64, input_ptr2: *const f64, output_ptr: *mut f64) { [INFO] [stdout] | ^^^^^^^^^^ help: if this is intentional, prefix it with an underscore: `_input_ptr1` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `input_ptr2` [INFO] [stdout] --> src/compiler/zip_map/add_rms_zip.rs:102:47 [INFO] [stdout] | [INFO] [stdout] 102 | fn compute(&self, input_ptr1: *const f64, input_ptr2: *const f64, output_ptr: *mut f64) { [INFO] [stdout] | ^^^^^^^^^^ help: if this is intentional, prefix it with an underscore: `_input_ptr2` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `output_ptr` [INFO] [stdout] --> src/compiler/zip_map/add_rms_zip.rs:102:71 [INFO] [stdout] | [INFO] [stdout] 102 | fn compute(&self, input_ptr1: *const f64, input_ptr2: *const f64, output_ptr: *mut f64) { [INFO] [stdout] | ^^^^^^^^^^ help: if this is intentional, prefix it with an underscore: `_output_ptr` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `input_ptr1` [INFO] [stdout] --> src/compiler/zip_map/complex_zip.rs:121:23 [INFO] [stdout] | [INFO] [stdout] 121 | fn compute(&self, input_ptr1: *const f64, input_ptr2: *const f64, output_ptr: *mut f64) { [INFO] [stdout] | ^^^^^^^^^^ help: if this is intentional, prefix it with an underscore: `_input_ptr1` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `input_ptr2` [INFO] [stdout] --> src/compiler/zip_map/complex_zip.rs:121:47 [INFO] [stdout] | [INFO] [stdout] 121 | fn compute(&self, input_ptr1: *const f64, input_ptr2: *const f64, output_ptr: *mut f64) { [INFO] [stdout] | ^^^^^^^^^^ help: if this is intentional, prefix it with an underscore: `_input_ptr2` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `output_ptr` [INFO] [stdout] --> src/compiler/zip_map/complex_zip.rs:121:71 [INFO] [stdout] | [INFO] [stdout] 121 | fn compute(&self, input_ptr1: *const f64, input_ptr2: *const f64, output_ptr: *mut f64) { [INFO] [stdout] | ^^^^^^^^^^ help: if this is intentional, prefix it with an underscore: `_output_ptr` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `input_ptr` [INFO] [stdout] --> src/compiler/reduce/argmax_reduce.rs:78:23 [INFO] [stdout] | [INFO] [stdout] 78 | fn compute(&self, input_ptr: *const f32, output_ptr: *mut usize, length: usize) { [INFO] [stdout] | ^^^^^^^^^ help: if this is intentional, prefix it with an underscore: `_input_ptr` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `output_ptr` [INFO] [stdout] --> src/compiler/reduce/argmax_reduce.rs:78:46 [INFO] [stdout] | [INFO] [stdout] 78 | fn compute(&self, input_ptr: *const f32, output_ptr: *mut usize, length: usize) { [INFO] [stdout] | ^^^^^^^^^^ help: if this is intentional, prefix it with an underscore: `_output_ptr` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `length` [INFO] [stdout] --> src/compiler/reduce/argmax_reduce.rs:78:70 [INFO] [stdout] | [INFO] [stdout] 78 | fn compute(&self, input_ptr: *const f32, output_ptr: *mut usize, length: usize) { [INFO] [stdout] | ^^^^^^ help: if this is intentional, prefix it with an underscore: `_length` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `input_ptr` [INFO] [stdout] --> src/compiler/reduce/argmax_reduce.rs:91:23 [INFO] [stdout] | [INFO] [stdout] 91 | fn compute(&self, input_ptr: *const f64, output_ptr: *mut usize, length: usize) { [INFO] [stdout] | ^^^^^^^^^ help: if this is intentional, prefix it with an underscore: `_input_ptr` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `output_ptr` [INFO] [stdout] --> src/compiler/reduce/argmax_reduce.rs:91:46 [INFO] [stdout] | [INFO] [stdout] 91 | fn compute(&self, input_ptr: *const f64, output_ptr: *mut usize, length: usize) { [INFO] [stdout] | ^^^^^^^^^^ help: if this is intentional, prefix it with an underscore: `_output_ptr` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `length` [INFO] [stdout] --> src/compiler/reduce/argmax_reduce.rs:91:70 [INFO] [stdout] | [INFO] [stdout] 91 | fn compute(&self, input_ptr: *const f64, output_ptr: *mut usize, length: usize) { [INFO] [stdout] | ^^^^^^ help: if this is intentional, prefix it with an underscore: `_length` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `m` [INFO] [stdout] --> src/compiler/mul/chunk_matmul.rs:38:13 [INFO] [stdout] | [INFO] [stdout] 38 | let m = std::cmp::min(params.a_row_step_macro, m_total - i); [INFO] [stdout] | ^ help: if this is intentional, prefix it with an underscore: `_m` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `n` [INFO] [stdout] --> src/compiler/mul/chunk_matmul.rs:40:17 [INFO] [stdout] | [INFO] [stdout] 40 | let n = std::cmp::min(params.b_row_step_macro, n_total - j); [INFO] [stdout] | ^ help: if this is intentional, prefix it with an underscore: `_n` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `num_tasks` [INFO] [stdout] --> src/compiler/mul/mat_mul.rs:126:13 [INFO] [stdout] | [INFO] [stdout] 126 | let num_tasks = self.chunks.len(); [INFO] [stdout] | ^^^^^^^^^ help: if this is intentional, prefix it with an underscore: `_num_tasks` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unnecessary `unsafe` block [INFO] [stdout] --> src/compiler/mul/mat_mul.rs:171:29 [INFO] [stdout] | [INFO] [stdout] 171 | let a_ptr = unsafe { task.0.ptr }; [INFO] [stdout] | ^^^^^^ unnecessary `unsafe` block [INFO] [stdout] | [INFO] [stdout] = note: `#[warn(unused_unsafe)]` (part of `#[warn(unused)]`) on by default [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unnecessary `unsafe` block [INFO] [stdout] --> src/compiler/mul/mat_mul.rs:172:29 [INFO] [stdout] | [INFO] [stdout] 172 | let b_ptr = unsafe { task.1.ptr }; [INFO] [stdout] | ^^^^^^ unnecessary `unsafe` block [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unnecessary `unsafe` block [INFO] [stdout] --> src/compiler/mul/mat_mul.rs:173:29 [INFO] [stdout] | [INFO] [stdout] 173 | let c_ptr = unsafe { task.2.ptr }; [INFO] [stdout] | ^^^^^^ unnecessary `unsafe` block [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unnecessary `unsafe` block [INFO] [stdout] --> src/compiler/mul/mat_mul.rs:201:29 [INFO] [stdout] | [INFO] [stdout] 201 | let a_ptr = unsafe { task.0.ptr }; [INFO] [stdout] | ^^^^^^ unnecessary `unsafe` block [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unnecessary `unsafe` block [INFO] [stdout] --> src/compiler/mul/mat_mul.rs:202:29 [INFO] [stdout] | [INFO] [stdout] 202 | let b_ptr = unsafe { task.1.ptr }; [INFO] [stdout] | ^^^^^^ unnecessary `unsafe` block [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unnecessary `unsafe` block [INFO] [stdout] --> src/compiler/mul/mat_mul.rs:203:29 [INFO] [stdout] | [INFO] [stdout] 203 | let c_ptr = unsafe { task.2.ptr }; [INFO] [stdout] | ^^^^^^ unnecessary `unsafe` block [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `input_ptr1` [INFO] [stdout] --> src/compiler/mul/mat_mul.rs:272:23 [INFO] [stdout] | [INFO] [stdout] 272 | fn compute(&self, input_ptr1: *const f32, input_ptr2: *const f32, output_ptr: *mut f32) { [INFO] [stdout] | ^^^^^^^^^^ help: if this is intentional, prefix it with an underscore: `_input_ptr1` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `input_ptr2` [INFO] [stdout] --> src/compiler/mul/mat_mul.rs:272:47 [INFO] [stdout] | [INFO] [stdout] 272 | fn compute(&self, input_ptr1: *const f32, input_ptr2: *const f32, output_ptr: *mut f32) { [INFO] [stdout] | ^^^^^^^^^^ help: if this is intentional, prefix it with an underscore: `_input_ptr2` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `output_ptr` [INFO] [stdout] --> src/compiler/mul/mat_mul.rs:272:71 [INFO] [stdout] | [INFO] [stdout] 272 | fn compute(&self, input_ptr1: *const f32, input_ptr2: *const f32, output_ptr: *mut f32) { [INFO] [stdout] | ^^^^^^^^^^ help: if this is intentional, prefix it with an underscore: `_output_ptr` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `shape4` [INFO] [stdout] --> src/compiler/mul/chunk_attention.rs:16:5 [INFO] [stdout] | [INFO] [stdout] 16 | shape4: Vec, [INFO] [stdout] | ^^^^^^ help: if this is intentional, prefix it with an underscore: `_shape4` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unreachable pattern [INFO] [stdout] --> src/compiler/operator.rs:92:13 [INFO] [stdout] | [INFO] [stdout] 92 | _ => panic!(), [INFO] [stdout] | ^ no value can reach this [INFO] [stdout] | [INFO] [stdout] note: multiple earlier patterns match some of the same values [INFO] [stdout] --> src/compiler/operator.rs:92:13 [INFO] [stdout] | [INFO] [stdout] 52 | Self::AddRMSZipMap(operator) => { [INFO] [stdout] | ---------------------------- matches some of the same values [INFO] [stdout] ... [INFO] [stdout] 55 | Self::AddZipMap(operator) => { [INFO] [stdout] | ------------------------- matches some of the same values [INFO] [stdout] ... [INFO] [stdout] 58 | Self::ArgmaxReduce(operator) => { [INFO] [stdout] | ---------------------------- matches some of the same values [INFO] [stdout] ... [INFO] [stdout] 61 | Self::AttentionMul(operator) => { [INFO] [stdout] | ---------------------------- matches some of the same values [INFO] [stdout] ... [INFO] [stdout] 92 | _ => panic!(), [INFO] [stdout] | ^ ...and 5 other patterns collectively make this unreachable [INFO] [stdout] = note: `#[warn(unreachable_patterns)]` (part of `#[warn(unused)]`) on by default [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `tensor_name` [INFO] [stdout] --> src/ptensor/tensor.rs:245:9 [INFO] [stdout] | [INFO] [stdout] 245 | tensor_name: String, [INFO] [stdout] | ^^^^^^^^^^^ help: if this is intentional, prefix it with an underscore: `_tensor_name` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unnecessary `unsafe` block [INFO] [stdout] --> src/llama/attention.rs:114:9 [INFO] [stdout] | [INFO] [stdout] 114 | unsafe { [INFO] [stdout] | ^^^^^^ unnecessary `unsafe` block [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: variable does not need to be mutable [INFO] [stdout] --> src/llama/attention.rs:169:17 [INFO] [stdout] | [INFO] [stdout] 169 | let mut view_key_position_tensor = key_position_tensor.permute(vec![1, 2, 0, 3]); [INFO] [stdout] | ----^^^^^^^^^^^^^^^^^^^^^^^^ [INFO] [stdout] | | [INFO] [stdout] | help: remove this `mut` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: variable does not need to be mutable [INFO] [stdout] --> src/llama/attention.rs:171:17 [INFO] [stdout] | [INFO] [stdout] 171 | let mut view_value_tensor = value_tensor.view(vec![ [INFO] [stdout] | ----^^^^^^^^^^^^^^^^^ [INFO] [stdout] | | [INFO] [stdout] | help: remove this `mut` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: variable does not need to be mutable [INFO] [stdout] --> src/llama/attention.rs:177:17 [INFO] [stdout] | [INFO] [stdout] 177 | let mut view_value_tensor2 = view_value_tensor.permute(vec![1, 2, 0, 3]); [INFO] [stdout] | ----^^^^^^^^^^^^^^^^^^ [INFO] [stdout] | | [INFO] [stdout] | help: remove this `mut` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: variable does not need to be mutable [INFO] [stdout] --> src/llama/attention.rs:193:17 [INFO] [stdout] | [INFO] [stdout] 193 | let mut view_context_tensor = [INFO] [stdout] | ----^^^^^^^^^^^^^^^^^^^ [INFO] [stdout] | | [INFO] [stdout] | help: remove this `mut` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `tensor_name` [INFO] [stdout] --> src/llama/transformer_block.rs:118:9 [INFO] [stdout] | [INFO] [stdout] 118 | tensor_name: String, [INFO] [stdout] | ^^^^^^^^^^^ help: if this is intentional, prefix it with an underscore: `_tensor_name` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `module_vec` [INFO] [stdout] --> src/llama/transformer.rs:111:13 [INFO] [stdout] | [INFO] [stdout] 111 | let module_vec: Vec> = Vec::new(); [INFO] [stdout] | ^^^^^^^^^^ help: if this is intentional, prefix it with an underscore: `_module_vec` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `logits` [INFO] [stdout] --> src/llama/transformer.rs:176:13 [INFO] [stdout] | [INFO] [stdout] 176 | let logits = self [INFO] [stdout] | ^^^^^^ help: if this is intentional, prefix it with an underscore: `_logits` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `b` [INFO] [stdout] --> src/llama/transformer.rs:219:17 [INFO] [stdout] | [INFO] [stdout] 219 | let b = Arc::clone(&barrier); [INFO] [stdout] | ^ help: if this is intentional, prefix it with an underscore: `_b` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `queue` [INFO] [stdout] --> src/llama/transformer.rs:221:17 [INFO] [stdout] | [INFO] [stdout] 221 | let queue = Arc::clone(&sync_operator_queue); [INFO] [stdout] | ^^^^^ help: if this is intentional, prefix it with an underscore: `_queue` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused variable: `start_pos` [INFO] [stdout] --> src/llama/transformer.rs:223:17 [INFO] [stdout] | [INFO] [stdout] 223 | let start_pos = self.start_pos; // 显式捕获当前值 [INFO] [stdout] | ^^^^^^^^^ help: if this is intentional, prefix it with an underscore: `_start_pos` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unnecessary `unsafe` block [INFO] [stdout] --> src/llama/transformer.rs:232:21 [INFO] [stdout] | [INFO] [stdout] 232 | unsafe { [INFO] [stdout] | ^^^^^^ unnecessary `unsafe` block [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: field `parameters` is never read [INFO] [stdout] --> src/memory/cache.rs:10:5 [INFO] [stdout] | [INFO] [stdout] 6 | pub struct Cache { [INFO] [stdout] | ----- field in this struct [INFO] [stdout] ... [INFO] [stdout] 10 | parameters: HashMap>, [INFO] [stdout] | ^^^^^^^^^^ [INFO] [stdout] | [INFO] [stdout] = note: `Cache` has derived impls for the traits `Clone` and `Debug`, but these are intentionally ignored during dead code analysis [INFO] [stdout] = note: `#[warn(dead_code)]` (part of `#[warn(unused)]`) on by default [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: function `sigmoid` is never used [INFO] [stdout] --> src/kernel/x86_64/f16_512/activation.rs:14:4 [INFO] [stdout] | [INFO] [stdout] 14 | fn sigmoid(x: f16) -> f16 { [INFO] [stdout] | ^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: field `scope_name` is never read [INFO] [stdout] --> src/ptensor/linear.rs:21:5 [INFO] [stdout] | [INFO] [stdout] 17 | pub struct Linear { [INFO] [stdout] | ------ field in this struct [INFO] [stdout] ... [INFO] [stdout] 21 | scope_name: String, [INFO] [stdout] | ^^^^^^^^^^ [INFO] [stdout] | [INFO] [stdout] = note: `Linear` has a derived impl for the trait `Clone`, but this is intentionally ignored during dead code analysis [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: function `find_safetensors_file` is never used [INFO] [stdout] --> src/llama/model_loader.rs:19:4 [INFO] [stdout] | [INFO] [stdout] 19 | fn find_safetensors_file>(model_dir: P) -> Result { [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: fields `all_head_size`, `cache`, and `operator_queue` are never read [INFO] [stdout] --> src/llama/attention.rs:25:5 [INFO] [stdout] | [INFO] [stdout] 19 | pub struct Attention { [INFO] [stdout] | --------- fields in this struct [INFO] [stdout] ... [INFO] [stdout] 25 | all_head_size: usize, [INFO] [stdout] | ^^^^^^^^^^^^^ [INFO] [stdout] ... [INFO] [stdout] 35 | cache: Rc>>, [INFO] [stdout] | ^^^^^ [INFO] [stdout] 36 | operator_queue: Rc>>>, [INFO] [stdout] | ^^^^^^^^^^^^^^ [INFO] [stdout] | [INFO] [stdout] = note: `Attention` has a derived impl for the trait `Clone`, but this is intentionally ignored during dead code analysis [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: fields `cache` and `operator_queue` are never read [INFO] [stdout] --> src/llama/feedforward.rs:21:5 [INFO] [stdout] | [INFO] [stdout] 15 | pub struct FeedForward { [INFO] [stdout] | ----------- fields in this struct [INFO] [stdout] ... [INFO] [stdout] 21 | cache: Rc>>, [INFO] [stdout] | ^^^^^ [INFO] [stdout] 22 | operator_queue: Rc>>>, [INFO] [stdout] | ^^^^^^^^^^^^^^ [INFO] [stdout] | [INFO] [stdout] = note: `FeedForward` has a derived impl for the trait `Clone`, but this is intentionally ignored during dead code analysis [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: fields `cache` and `operator_queue` are never read [INFO] [stdout] --> src/llama/transformer_block.rs:38:5 [INFO] [stdout] | [INFO] [stdout] 24 | pub struct TransformerBlock<'a, T> { [INFO] [stdout] | ---------------- fields in this struct [INFO] [stdout] ... [INFO] [stdout] 38 | cache: Rc>>, [INFO] [stdout] | ^^^^^ [INFO] [stdout] 39 | operator_queue: Rc>>>, [INFO] [stdout] | ^^^^^^^^^^^^^^ [INFO] [stdout] | [INFO] [stdout] = note: `TransformerBlock` has a derived impl for the trait `Clone`, but this is intentionally ignored during dead code analysis [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: variable `K` should have a snake case name [INFO] [stdout] --> src/kernel/generic/flash_attention.rs:61:18 [INFO] [stdout] | [INFO] [stdout] 61 | q: *const T, K: *const T, V: *const T, o: *mut T, inverse_sqrt_head: T, length: usize, stride: usize, position: usize [INFO] [stdout] | ^ help: convert the identifier to snake case (notice the capitalization): `k` [INFO] [stdout] | [INFO] [stdout] = note: `#[warn(non_snake_case)]` (part of `#[warn(nonstandard_style)]`) on by default [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: variable `V` should have a snake case name [INFO] [stdout] --> src/kernel/generic/flash_attention.rs:61:31 [INFO] [stdout] | [INFO] [stdout] 61 | q: *const T, K: *const T, V: *const T, o: *mut T, inverse_sqrt_head: T, length: usize, stride: usize, position: usize [INFO] [stdout] | ^ help: convert the identifier to snake case (notice the capitalization): `v` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: variable `cephes_LOG2EF` should have a snake case name [INFO] [stdout] --> src/kernel/x86_64/f16_512/activation.rs:24:9 [INFO] [stdout] | [INFO] [stdout] 24 | let cephes_LOG2EF = _mm512_set1_ph(1.44269504088896341); [INFO] [stdout] | ^^^^^^^^^^^^^ help: convert the identifier to snake case: `cephes_log2_ef` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: variable `inv_LOG2EF` should have a snake case name [INFO] [stdout] --> src/kernel/x86_64/f16_512/activation.rs:25:9 [INFO] [stdout] | [INFO] [stdout] 25 | let inv_LOG2EF = _mm512_set1_ph(0.693147180559945); [INFO] [stdout] | ^^^^^^^^^^ help: convert the identifier to snake case: `inv_log2_ef` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: variable `K` should have a snake case name [INFO] [stdout] --> src/kernel/x86_64/f16_512/flash_attention.rs:32:5 [INFO] [stdout] | [INFO] [stdout] 32 | K: *const f16, [INFO] [stdout] | ^ help: convert the identifier to snake case (notice the capitalization): `k` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: variable `V` should have a snake case name [INFO] [stdout] --> src/kernel/x86_64/f16_512/flash_attention.rs:33:5 [INFO] [stdout] | [INFO] [stdout] 33 | V: *const f16, [INFO] [stdout] | ^ help: convert the identifier to snake case (notice the capitalization): `v` [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] error: couldn't read `src/serving/enhanced_server.rs`: No such file or directory (os error 2) [INFO] [stdout] [INFO] [stdout] [INFO] [stderr] error: could not compile `eLLM` (bin "enhanced-server") due to 1 previous error [INFO] [stderr] warning: build failed, waiting for other jobs to finish... [INFO] [stdout] error[E0433]: failed to resolve: use of unresolved module or unlinked crate `eLLM` [INFO] [stdout] --> src/bin/main.rs:10:5 [INFO] [stdout] | [INFO] [stdout] 10 | use eLLM::compiler::operator::Operator; [INFO] [stdout] | ^^^^ use of unresolved module or unlinked crate `eLLM` [INFO] [stdout] | [INFO] [stdout] help: there is a crate or module with a similar name [INFO] [stdout] | [INFO] [stdout] 10 - use eLLM::compiler::operator::Operator; [INFO] [stdout] 10 + use ellm::compiler::operator::Operator; [INFO] [stdout] | [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] error[E0433]: failed to resolve: use of unresolved module or unlinked crate `eLLM` [INFO] [stdout] --> src/bin/main.rs:11:5 [INFO] [stdout] | [INFO] [stdout] 11 | use eLLM::init::config::Config; [INFO] [stdout] | ^^^^ use of unresolved module or unlinked crate `eLLM` [INFO] [stdout] | [INFO] [stdout] help: there is a crate or module with a similar name [INFO] [stdout] | [INFO] [stdout] 11 - use eLLM::init::config::Config; [INFO] [stdout] 11 + use ellm::init::config::Config; [INFO] [stdout] | [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] error[E0433]: failed to resolve: use of unresolved module or unlinked crate `eLLM` [INFO] [stdout] --> src/bin/main.rs:12:5 [INFO] [stdout] | [INFO] [stdout] 12 | use eLLM::memory::cache::Cache; [INFO] [stdout] | ^^^^ use of unresolved module or unlinked crate `eLLM` [INFO] [stdout] | [INFO] [stdout] help: there is a crate or module with a similar name [INFO] [stdout] | [INFO] [stdout] 12 - use eLLM::memory::cache::Cache; [INFO] [stdout] 12 + use ellm::memory::cache::Cache; [INFO] [stdout] | [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] error[E0433]: failed to resolve: use of unresolved module or unlinked crate `eLLM` [INFO] [stdout] --> src/bin/main.rs:13:5 [INFO] [stdout] | [INFO] [stdout] 13 | use eLLM::ptensor::tensor::Tensor; [INFO] [stdout] | ^^^^ use of unresolved module or unlinked crate `eLLM` [INFO] [stdout] | [INFO] [stdout] help: there is a crate or module with a similar name [INFO] [stdout] | [INFO] [stdout] 13 - use eLLM::ptensor::tensor::Tensor; [INFO] [stdout] 13 + use ellm::ptensor::tensor::Tensor; [INFO] [stdout] | [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] error[E0433]: failed to resolve: use of unresolved module or unlinked crate `eLLM` [INFO] [stdout] --> src/bin/main.rs:14:5 [INFO] [stdout] | [INFO] [stdout] 14 | use eLLM::llama::model::Model; [INFO] [stdout] | ^^^^ use of unresolved module or unlinked crate `eLLM` [INFO] [stdout] | [INFO] [stdout] help: there is a crate or module with a similar name [INFO] [stdout] | [INFO] [stdout] 14 - use eLLM::llama::model::Model; [INFO] [stdout] 14 + use ellm::llama::model::Model; [INFO] [stdout] | [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] error[E0433]: failed to resolve: use of unresolved module or unlinked crate `eLLM` [INFO] [stdout] --> src/bin/main.rs:15:5 [INFO] [stdout] | [INFO] [stdout] 15 | use eLLM::runtime::start::start; [INFO] [stdout] | ^^^^ use of unresolved module or unlinked crate `eLLM` [INFO] [stdout] | [INFO] [stdout] help: there is a crate or module with a similar name [INFO] [stdout] | [INFO] [stdout] 15 - use eLLM::runtime::start::start; [INFO] [stdout] 15 + use ellm::runtime::start::start; [INFO] [stdout] | [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] error[E0433]: failed to resolve: use of unresolved module or unlinked crate `eLLM` [INFO] [stdout] --> src/bin/main.rs:17:5 [INFO] [stdout] | [INFO] [stdout] 17 | use eLLM::ptensor::linear::Linear; [INFO] [stdout] | ^^^^ use of unresolved module or unlinked crate `eLLM` [INFO] [stdout] | [INFO] [stdout] help: there is a crate or module with a similar name [INFO] [stdout] | [INFO] [stdout] 17 - use eLLM::ptensor::linear::Linear; [INFO] [stdout] 17 + use ellm::ptensor::linear::Linear; [INFO] [stdout] | [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] error[E0433]: failed to resolve: use of unresolved module or unlinked crate `eLLM` [INFO] [stdout] --> src/bin/main.rs:18:5 [INFO] [stdout] | [INFO] [stdout] 18 | use eLLM::llama::rope::precompute_freqs_cis; [INFO] [stdout] | ^^^^ use of unresolved module or unlinked crate `eLLM` [INFO] [stdout] | [INFO] [stdout] help: there is a crate or module with a similar name [INFO] [stdout] | [INFO] [stdout] 18 - use eLLM::llama::rope::precompute_freqs_cis; [INFO] [stdout] 18 + use ellm::llama::rope::precompute_freqs_cis; [INFO] [stdout] | [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] error: couldn't read `src/serving/batch_server.rs`: No such file or directory (os error 2) [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: unused import: `std::time::Instant` [INFO] [stdout] --> src/bin/main.rs:4:5 [INFO] [stdout] | [INFO] [stdout] 4 | use std::time::Instant; [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^ [INFO] [stdout] | [INFO] [stdout] = note: `#[warn(unused_imports)]` (part of `#[warn(unused)]`) on by default [INFO] [stdout] [INFO] [stdout] [INFO] [stderr] error: could not compile `eLLM` (bin "batch-server") due to 1 previous error [INFO] [stdout] warning: variants `GetStatus` and `Shutdown` are never constructed [INFO] [stdout] --> src/serving/server.rs:31:5 [INFO] [stdout] | [INFO] [stdout] 29 | enum LLMTask { [INFO] [stdout] | ------- variants in this enum [INFO] [stdout] 30 | ProcessBatch(Vec), [INFO] [stdout] 31 | GetStatus, [INFO] [stdout] | ^^^^^^^^^ [INFO] [stdout] 32 | Shutdown, [INFO] [stdout] | ^^^^^^^^ [INFO] [stdout] | [INFO] [stdout] = note: `LLMTask` has a derived impl for the trait `Debug`, but this is intentionally ignored during dead code analysis [INFO] [stdout] = note: `#[warn(dead_code)]` (part of `#[warn(unused)]`) on by default [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: field `start_time` is never read [INFO] [stdout] --> src/serving/server.rs:151:5 [INFO] [stdout] | [INFO] [stdout] 146 | struct LLMWorker { [INFO] [stdout] | --------- field in this struct [INFO] [stdout] ... [INFO] [stdout] 151 | start_time: Instant, [INFO] [stdout] | ^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: fields `temperature`, `max_tokens`, and `top_p` are never read [INFO] [stdout] --> src/serving/server.rs:290:5 [INFO] [stdout] | [INFO] [stdout] 286 | pub struct ChatCompletionRequest { [INFO] [stdout] | --------------------- fields in this struct [INFO] [stdout] ... [INFO] [stdout] 290 | temperature: Option, [INFO] [stdout] | ^^^^^^^^^^^ [INFO] [stdout] 291 | max_tokens: Option, [INFO] [stdout] | ^^^^^^^^^^ [INFO] [stdout] 292 | top_p: Option, [INFO] [stdout] | ^^^^^ [INFO] [stdout] | [INFO] [stdout] = note: `ChatCompletionRequest` has a derived impl for the trait `Debug`, but this is intentionally ignored during dead code analysis [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] error[E0425]: cannot find function `build_graph` in this scope [INFO] [stdout] --> src/bin/main.rs:89:5 [INFO] [stdout] | [INFO] [stdout] 89 | build_graph(&config, sequences.as_mut_ptr(), cache.clone(), operator_queue.clone()); [INFO] [stdout] | ^^^^^^^^^^^ not found in this scope [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] Some errors have detailed explanations: E0425, E0433. [INFO] [stdout] [INFO] [stdout] For more information about an error, try `rustc --explain E0425`. [INFO] [stdout] [INFO] [stderr] error: could not compile `eLLM` (bin "main") due to 9 previous errors; 1 warning emitted [INFO] running `Command { std: "docker" "inspect" "54518d92bd27cf62cf09402bad8dc546d4256bfceb31c4bf999d2263f52df489", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "54518d92bd27cf62cf09402bad8dc546d4256bfceb31c4bf999d2263f52df489", kill_on_drop: false }` [INFO] [stdout] 54518d92bd27cf62cf09402bad8dc546d4256bfceb31c4bf999d2263f52df489