[INFO] cloning repository https://github.com/puranikyashaswin/rusty
[INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/puranikyashaswin/rusty" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fpuranikyashaswin%2Frusty", kill_on_drop: false }`
[INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fpuranikyashaswin%2Frusty'...
[INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }`
[INFO] [stdout] 3aee502ce1809ed8e238b89f5616ade5bda3acbb
[INFO] testing puranikyashaswin/rusty against try#33835004928d3bf65db4d4712e1330766263b0bd for pr-155739
[INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fpuranikyashaswin%2Frusty" "/workspace/builds/worker-6-tc2/source", kill_on_drop: false }`
[INFO] [stderr] Cloning into '/workspace/builds/worker-6-tc2/source'...
[INFO] [stderr] done.
[INFO] started tweaking git repo https://github.com/puranikyashaswin/rusty
[INFO] finished tweaking git repo https://github.com/puranikyashaswin/rusty
[INFO] tweaked toml for git repo https://github.com/puranikyashaswin/rusty written to /workspace/builds/worker-6-tc2/source/Cargo.toml
[INFO] validating manifest of git repo https://github.com/puranikyashaswin/rusty on toolchain 33835004928d3bf65db4d4712e1330766263b0bd
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+33835004928d3bf65db4d4712e1330766263b0bd" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] crate git repo https://github.com/puranikyashaswin/rusty already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+33835004928d3bf65db4d4712e1330766263b0bd" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] [stderr]     Blocking waiting for file lock on package cache
[INFO] [stderr]     Blocking waiting for file lock on package cache
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+33835004928d3bf65db4d4712e1330766263b0bd" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] [stdout] 17fb1017b9fca4d1815018260a478189cf93b282fd9f179ab5ee905bd79af646
[INFO] running `Command { std: "docker" "start" "-a" "17fb1017b9fca4d1815018260a478189cf93b282fd9f179ab5ee905bd79af646", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "17fb1017b9fca4d1815018260a478189cf93b282fd9f179ab5ee905bd79af646", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "17fb1017b9fca4d1815018260a478189cf93b282fd9f179ab5ee905bd79af646", kill_on_drop: false }`
[INFO] [stdout] 17fb1017b9fca4d1815018260a478189cf93b282fd9f179ab5ee905bd79af646
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+33835004928d3bf65db4d4712e1330766263b0bd" "build" "--frozen" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] ce6a5e01fab7740a399a6c2d8b296982abcc41e069f689034f8877f144164d11
[INFO] running `Command { std: "docker" "start" "-a" "ce6a5e01fab7740a399a6c2d8b296982abcc41e069f689034f8877f144164d11", kill_on_drop: false }`
[INFO] [stderr]    Compiling libc v0.2.184
[INFO] [stderr]    Compiling bitflags v2.10.0
[INFO] [stderr]    Compiling zerocopy v0.8.36
[INFO] [stderr]    Compiling smallvec v1.15.1
[INFO] [stderr]    Compiling cfg_aliases v0.1.1
[INFO] [stderr]    Compiling syn v2.0.114
[INFO] [stderr]    Compiling ahash v0.8.12
[INFO] [stderr]    Compiling khronos-egl v6.0.0
[INFO] [stderr]    Compiling termcolor v1.4.1
[INFO] [stderr]    Compiling ash v0.37.3+1.3.251
[INFO] [stderr]    Compiling bit-vec v0.6.3
[INFO] [stderr]    Compiling gpu-descriptor-types v0.1.2
[INFO] [stderr]    Compiling gpu-alloc-types v0.3.0
[INFO] [stderr]    Compiling codespan-reporting v0.11.1
[INFO] [stderr]    Compiling bit-set v0.5.3
[INFO] [stderr]    Compiling spirv v0.3.0+sdk-1.3.268.0
[INFO] [stderr]    Compiling wgpu-hal v0.19.5
[INFO] [stderr]    Compiling aho-corasick v1.1.4
[INFO] [stderr]    Compiling libloading v0.7.4
[INFO] [stderr]    Compiling hexf-parse v0.2.1
[INFO] [stderr]    Compiling gpu-alloc v0.6.0
[INFO] [stderr]    Compiling wgpu-types v0.19.2
[INFO] [stderr]    Compiling wgpu-core v0.19.4
[INFO] [stderr]    Compiling parking_lot_core v0.9.12
[INFO] [stderr]    Compiling parking_lot v0.12.5
[INFO] [stderr]    Compiling regex-automata v0.4.13
[INFO] [stderr]    Compiling utf8parse v0.2.2
[INFO] [stderr]    Compiling glow v0.13.1
[INFO] [stderr]    Compiling renderdoc-sys v1.1.0
[INFO] [stderr]    Compiling arrayvec v0.7.6
[INFO] [stderr]    Compiling profiling v1.0.17
[INFO] [stderr]    Compiling anstyle-parse v0.2.7
[INFO] [stderr]    Compiling wgpu v0.19.4
[INFO] [stderr]    Compiling anstyle-query v1.1.5
[INFO] [stderr]    Compiling is_terminal_polyfill v1.70.2
[INFO] [stderr]    Compiling colorchoice v1.0.4
[INFO] [stderr]    Compiling getrandom v0.2.17
[INFO] [stderr]    Compiling anstream v0.6.21
[INFO] [stderr]    Compiling futures-core v0.3.31
[INFO] [stderr]    Compiling jiff v0.2.18
[INFO] [stderr]    Compiling futures-intrusive v0.5.0
[INFO] [stderr]    Compiling rand_core v0.6.4
[INFO] [stderr]    Compiling pollster v0.3.0
[INFO] [stderr]    Compiling serde_json v1.0.149
[INFO] [stderr]    Compiling errno v0.3.14
[INFO] [stderr]    Compiling signal-hook-registry v1.4.8
[INFO] [stderr]    Compiling regex v1.12.2
[INFO] [stderr]    Compiling memmap2 v0.9.9
[INFO] [stderr]    Compiling getrandom v0.3.4
[INFO] [stderr]    Compiling env_filter v0.1.4
[INFO] [stderr]    Compiling darling_core v0.23.0
[INFO] [stderr]    Compiling hashbrown v0.14.5
[INFO] [stderr]    Compiling ppv-lite86 v0.2.21
[INFO] [stderr]    Compiling mio v1.2.0
[INFO] [stderr]    Compiling rand_chacha v0.3.1
[INFO] [stderr]    Compiling gpu-descriptor v0.2.4
[INFO] [stderr]    Compiling rand v0.8.5
[INFO] [stderr]    Compiling thiserror-impl v1.0.69
[INFO] [stderr]    Compiling bytemuck_derive v1.10.2
[INFO] [stderr]    Compiling serde_derive v1.0.228
[INFO] [stderr]    Compiling signal-hook v0.3.18
[INFO] [stderr]    Compiling rustix v0.38.44
[INFO] [stderr]    Compiling rand_core v0.9.5
[INFO] [stderr]    Compiling thiserror v1.0.69
[INFO] [stderr]    Compiling env_logger v0.11.8
[INFO] [stderr]    Compiling naga v0.19.2
[INFO] [stderr]    Compiling bytemuck v1.24.0
[INFO] [stderr]    Compiling strum_macros v0.26.4
[INFO] [stderr]    Compiling signal-hook-mio v0.2.5
[INFO] [stderr]    Compiling compact_str v0.8.1
[INFO] [stderr]    Compiling crossterm v0.28.1
[INFO] [stderr]    Compiling darling_macro v0.23.0
[INFO] [stderr]    Compiling darling v0.23.0
[INFO] [stderr]    Compiling instability v0.3.12
[INFO] [stderr]    Compiling rand_chacha v0.9.0
[INFO] [stderr]    Compiling tokio-macros v2.7.0
[INFO] [stderr]    Compiling socket2 v0.6.3
[INFO] [stderr]    Compiling chrono v0.4.44
[INFO] [stderr]    Compiling strum v0.26.3
[INFO] [stderr]    Compiling ratatui v0.29.0
[INFO] [stderr]    Compiling tokio v1.51.0
[INFO] [stderr]    Compiling serde v1.0.228
[INFO] [stderr]    Compiling rand v0.9.2
[INFO] [stderr]    Compiling sysinfo v0.33.1
[INFO] [stderr]    Compiling safetensors v0.4.5
[INFO] [stderr]    Compiling thiserror-impl v2.0.18
[INFO] [stderr]    Compiling thiserror v2.0.18
[INFO] [stderr]    Compiling rusty-monitor v0.1.0 (/opt/rustwide/workdir/rusty-monitor)
[INFO] [stderr]    Compiling rusty-backend v0.1.0 (/opt/rustwide/workdir/rusty-backend)
[INFO] [stderr]    Compiling rusty-loader v0.1.0 (/opt/rustwide/workdir/rusty-loader)
[INFO] [stderr]    Compiling rusty-autograd v0.1.0 (/opt/rustwide/workdir/rusty-autograd)
[INFO] [stderr]    Compiling rusty-graph v0.1.0 (/opt/rustwide/workdir/rusty-graph)
[INFO] [stderr]    Compiling rusty-trainer v0.1.0 (/opt/rustwide/workdir/rusty-trainer)
[INFO] [stderr]    Compiling rusty-hub v0.1.0 (/opt/rustwide/workdir/rusty-hub)
[INFO] [stderr]    Compiling rusty v0.1.0 (/opt/rustwide/workdir/rusty)
[INFO] [stdout] warning: unused variable: `mask`
[INFO] [stdout]    --> rusty/src/functional.rs:146:9
[INFO] [stdout]     |
[INFO] [stdout] 146 |     let mask = abs_diff.less_than(&beta_tensor);
[INFO] [stdout]     |         ^^^^ help: if this is intentional, prefix it with an underscore: `_mask`
[INFO] [stdout]     |
[INFO] [stdout]     = note: `#[warn(unused_variables)]` (part of `#[warn(unused)]`) on by default
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused variable: `sq_term`
[INFO] [stdout]    --> rusty/src/functional.rs:148:9
[INFO] [stdout]     |
[INFO] [stdout] 148 |     let sq_term = diff.mul(&diff).mul_scalar(0.5 / beta);
[INFO] [stdout]     |         ^^^^^^^ help: if this is intentional, prefix it with an underscore: `_sq_term`
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused variable: `linear_term`
[INFO] [stdout]    --> rusty/src/functional.rs:149:9
[INFO] [stdout]     |
[INFO] [stdout] 149 |     let linear_term = abs_diff.sub(&beta_tensor.mul_scalar(0.5));
[INFO] [stdout]     |         ^^^^^^^^^^^ help: if this is intentional, prefix it with an underscore: `_linear_term`
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused variable: `scale`
[INFO] [stdout]    --> rusty/src/optim/adam.rs:130:21
[INFO] [stdout]     |
[INFO] [stdout] 130 |                 let scale = max_norm / global_norm;
[INFO] [stdout]     |                     ^^^^^ help: if this is intentional, prefix it with an underscore: `_scale`
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: missing documentation for a struct field
[INFO] [stdout]   --> rusty/src/nn/activation.rs:81:5
[INFO] [stdout]    |
[INFO] [stdout] 81 |     pub dim: i32,
[INFO] [stdout]    |     ^^^^^^^^^^^^
[INFO] [stdout]    |
[INFO] [stdout] note: the lint level is defined here
[INFO] [stdout]   --> rusty/src/lib.rs:41:9
[INFO] [stdout]    |
[INFO] [stdout] 41 | #![warn(missing_docs)]
[INFO] [stdout]    |         ^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: missing documentation for an associated function
[INFO] [stdout]   --> rusty/src/nn/activation.rs:85:5
[INFO] [stdout]    |
[INFO] [stdout] 85 |     pub fn new(dim: i32) -> Self {
[INFO] [stdout]    |     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: missing documentation for a variant
[INFO] [stdout]   --> rusty/src/serialize.rs:17:5
[INFO] [stdout]    |
[INFO] [stdout] 17 |     Io(#[from] std::io::Error),
[INFO] [stdout]    |     ^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: missing documentation for a variant
[INFO] [stdout]   --> rusty/src/serialize.rs:19:5
[INFO] [stdout]    |
[INFO] [stdout] 19 |     Json(#[from] serde_json::Error),
[INFO] [stdout]    |     ^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: missing documentation for a variant
[INFO] [stdout]   --> rusty/src/serialize.rs:21:5
[INFO] [stdout]    |
[INFO] [stdout] 21 |     TensorNotFound(String),
[INFO] [stdout]    |     ^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stderr]    Compiling rusty-benchmarks v0.1.0 (/opt/rustwide/workdir/benchmarks)
[INFO] [stderr]    Compiling rusty-cli v0.1.0 (/opt/rustwide/workdir/rusty-cli)
[INFO] [stderr]     Finished `dev` profile [unoptimized + debuginfo] target(s) in 2m 46s
[INFO] running `Command { std: "docker" "inspect" "ce6a5e01fab7740a399a6c2d8b296982abcc41e069f689034f8877f144164d11", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "ce6a5e01fab7740a399a6c2d8b296982abcc41e069f689034f8877f144164d11", kill_on_drop: false }`
[INFO] [stdout] ce6a5e01fab7740a399a6c2d8b296982abcc41e069f689034f8877f144164d11
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+33835004928d3bf65db4d4712e1330766263b0bd" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] 1846c2850e7dc6cda820bdf21992487a906a71d3bf38b518fab9d50e675f8c02
[INFO] running `Command { std: "docker" "start" "-a" "1846c2850e7dc6cda820bdf21992487a906a71d3bf38b518fab9d50e675f8c02", kill_on_drop: false }`
[INFO] [stderr]    Compiling zerocopy v0.8.36
[INFO] [stderr]    Compiling zerocopy-derive v0.8.36
[INFO] [stderr]    Compiling serde v1.0.228
[INFO] [stderr]    Compiling serde_json v1.0.149
[INFO] [stderr]    Compiling clap_lex v0.7.7
[INFO] [stderr]    Compiling itertools v0.10.5
[INFO] [stderr]    Compiling is-terminal v0.4.17
[INFO] [stderr]    Compiling clap_builder v4.5.56
[INFO] [stderr]    Compiling safetensors v0.4.5
[INFO] [stderr]    Compiling tinytemplate v1.2.1
[INFO] [stderr]    Compiling criterion-plot v0.5.0
[INFO] [stderr]    Compiling clap v4.5.56
[INFO] [stderr]    Compiling ahash v0.8.12
[INFO] [stderr]    Compiling ppv-lite86 v0.2.21
[INFO] [stderr]    Compiling half v2.7.1
[INFO] [stderr]    Compiling hashbrown v0.14.5
[INFO] [stderr]    Compiling rand_chacha v0.3.1
[INFO] [stderr]    Compiling rand_chacha v0.9.0
[INFO] [stderr]    Compiling ciborium-ll v0.2.2
[INFO] [stderr]    Compiling rand v0.9.2
[INFO] [stderr]    Compiling ciborium v0.2.2
[INFO] [stderr]    Compiling rand v0.8.5
[INFO] [stderr]    Compiling gpu-descriptor v0.2.4
[INFO] [stderr]    Compiling wgpu-hal v0.19.5
[INFO] [stderr]    Compiling rusty-monitor v0.1.0 (/opt/rustwide/workdir/rusty-monitor)
[INFO] [stderr]    Compiling criterion v0.5.1
[INFO] [stderr]    Compiling wgpu-core v0.19.4
[INFO] [stderr]    Compiling wgpu v0.19.4
[INFO] [stderr]    Compiling rusty-backend v0.1.0 (/opt/rustwide/workdir/rusty-backend)
[INFO] [stderr]    Compiling rusty-loader v0.1.0 (/opt/rustwide/workdir/rusty-loader)
[INFO] [stderr]    Compiling rusty-autograd v0.1.0 (/opt/rustwide/workdir/rusty-autograd)
[INFO] [stderr]    Compiling rusty-graph v0.1.0 (/opt/rustwide/workdir/rusty-graph)
[INFO] [stderr]    Compiling rusty-trainer v0.1.0 (/opt/rustwide/workdir/rusty-trainer)
[INFO] [stderr]    Compiling rusty-hub v0.1.0 (/opt/rustwide/workdir/rusty-hub)
[INFO] [stderr]    Compiling rusty v0.1.0 (/opt/rustwide/workdir/rusty)
[INFO] [stdout] warning: unused variable: `mask`
[INFO] [stdout]    --> rusty/src/functional.rs:146:9
[INFO] [stdout]     |
[INFO] [stdout] 146 |     let mask = abs_diff.less_than(&beta_tensor);
[INFO] [stdout]     |         ^^^^ help: if this is intentional, prefix it with an underscore: `_mask`
[INFO] [stdout]     |
[INFO] [stdout]     = note: `#[warn(unused_variables)]` (part of `#[warn(unused)]`) on by default
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused variable: `sq_term`
[INFO] [stdout]    --> rusty/src/functional.rs:148:9
[INFO] [stdout]     |
[INFO] [stdout] 148 |     let sq_term = diff.mul(&diff).mul_scalar(0.5 / beta);
[INFO] [stdout]     |         ^^^^^^^ help: if this is intentional, prefix it with an underscore: `_sq_term`
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused variable: `linear_term`
[INFO] [stdout]    --> rusty/src/functional.rs:149:9
[INFO] [stdout]     |
[INFO] [stdout] 149 |     let linear_term = abs_diff.sub(&beta_tensor.mul_scalar(0.5));
[INFO] [stdout]     |         ^^^^^^^^^^^ help: if this is intentional, prefix it with an underscore: `_linear_term`
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused variable: `scale`
[INFO] [stdout]    --> rusty/src/optim/adam.rs:130:21
[INFO] [stdout]     |
[INFO] [stdout] 130 |                 let scale = max_norm / global_norm;
[INFO] [stdout]     |                     ^^^^^ help: if this is intentional, prefix it with an underscore: `_scale`
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: missing documentation for a struct field
[INFO] [stdout]   --> rusty/src/nn/activation.rs:81:5
[INFO] [stdout]    |
[INFO] [stdout] 81 |     pub dim: i32,
[INFO] [stdout]    |     ^^^^^^^^^^^^
[INFO] [stdout]    |
[INFO] [stdout] note: the lint level is defined here
[INFO] [stdout]   --> rusty/src/lib.rs:41:9
[INFO] [stdout]    |
[INFO] [stdout] 41 | #![warn(missing_docs)]
[INFO] [stdout]    |         ^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: missing documentation for an associated function
[INFO] [stdout]   --> rusty/src/nn/activation.rs:85:5
[INFO] [stdout]    |
[INFO] [stdout] 85 |     pub fn new(dim: i32) -> Self {
[INFO] [stdout]    |     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: missing documentation for a variant
[INFO] [stdout]   --> rusty/src/serialize.rs:17:5
[INFO] [stdout]    |
[INFO] [stdout] 17 |     Io(#[from] std::io::Error),
[INFO] [stdout]    |     ^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: missing documentation for a variant
[INFO] [stdout]   --> rusty/src/serialize.rs:19:5
[INFO] [stdout]    |
[INFO] [stdout] 19 |     Json(#[from] serde_json::Error),
[INFO] [stdout]    |     ^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: missing documentation for a variant
[INFO] [stdout]   --> rusty/src/serialize.rs:21:5
[INFO] [stdout]    |
[INFO] [stdout] 21 |     TensorNotFound(String),
[INFO] [stdout]    |     ^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stderr]    Compiling rusty-cli v0.1.0 (/opt/rustwide/workdir/rusty-cli)
[INFO] [stdout] warning: unused import: `DemoConfig`
[INFO] [stdout]  --> rusty/examples/lora_finetune.rs:8:21
[INFO] [stdout]   |
[INFO] [stdout] 8 | use rusty_trainer::{DemoConfig, GradScaler};
[INFO] [stdout]   |                     ^^^^^^^^^^
[INFO] [stdout]   |
[INFO] [stdout]   = note: `#[warn(unused_imports)]` (part of `#[warn(unused)]`) on by default
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused variable: `engine`
[INFO] [stdout]   --> rusty/examples/lora_finetune.rs:16:9
[INFO] [stdout]    |
[INFO] [stdout] 16 |     let engine = ComputeEngine::new(&ctx);
[INFO] [stdout]    |         ^^^^^^ help: if this is intentional, prefix it with an underscore: `_engine`
[INFO] [stdout]    |
[INFO] [stdout]    = note: `#[warn(unused_variables)]` (part of `#[warn(unused)]`) on by default
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stderr]    Compiling rusty-benchmarks v0.1.0 (/opt/rustwide/workdir/benchmarks)
[INFO] [stdout] warning: unused variable: `mask`
[INFO] [stdout]    --> rusty/src/functional.rs:146:9
[INFO] [stdout]     |
[INFO] [stdout] 146 |     let mask = abs_diff.less_than(&beta_tensor);
[INFO] [stdout]     |         ^^^^ help: if this is intentional, prefix it with an underscore: `_mask`
[INFO] [stdout]     |
[INFO] [stdout]     = note: `#[warn(unused_variables)]` (part of `#[warn(unused)]`) on by default
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused variable: `sq_term`
[INFO] [stdout]    --> rusty/src/functional.rs:148:9
[INFO] [stdout]     |
[INFO] [stdout] 148 |     let sq_term = diff.mul(&diff).mul_scalar(0.5 / beta);
[INFO] [stdout]     |         ^^^^^^^ help: if this is intentional, prefix it with an underscore: `_sq_term`
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused variable: `linear_term`
[INFO] [stdout]    --> rusty/src/functional.rs:149:9
[INFO] [stdout]     |
[INFO] [stdout] 149 |     let linear_term = abs_diff.sub(&beta_tensor.mul_scalar(0.5));
[INFO] [stdout]     |         ^^^^^^^^^^^ help: if this is intentional, prefix it with an underscore: `_linear_term`
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused variable: `scale`
[INFO] [stdout]    --> rusty/src/optim/adam.rs:130:21
[INFO] [stdout]     |
[INFO] [stdout] 130 |                 let scale = max_norm / global_norm;
[INFO] [stdout]     |                     ^^^^^ help: if this is intentional, prefix it with an underscore: `_scale`
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: missing documentation for a struct field
[INFO] [stdout]   --> rusty/src/nn/activation.rs:81:5
[INFO] [stdout]    |
[INFO] [stdout] 81 |     pub dim: i32,
[INFO] [stdout]    |     ^^^^^^^^^^^^
[INFO] [stdout]    |
[INFO] [stdout] note: the lint level is defined here
[INFO] [stdout]   --> rusty/src/lib.rs:41:9
[INFO] [stdout]    |
[INFO] [stdout] 41 | #![warn(missing_docs)]
[INFO] [stdout]    |         ^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: missing documentation for an associated function
[INFO] [stdout]   --> rusty/src/nn/activation.rs:85:5
[INFO] [stdout]    |
[INFO] [stdout] 85 |     pub fn new(dim: i32) -> Self {
[INFO] [stdout]    |     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: missing documentation for a variant
[INFO] [stdout]   --> rusty/src/serialize.rs:17:5
[INFO] [stdout]    |
[INFO] [stdout] 17 |     Io(#[from] std::io::Error),
[INFO] [stdout]    |     ^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: missing documentation for a variant
[INFO] [stdout]   --> rusty/src/serialize.rs:19:5
[INFO] [stdout]    |
[INFO] [stdout] 19 |     Json(#[from] serde_json::Error),
[INFO] [stdout]    |     ^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: missing documentation for a variant
[INFO] [stdout]   --> rusty/src/serialize.rs:21:5
[INFO] [stdout]    |
[INFO] [stdout] 21 |     TensorNotFound(String),
[INFO] [stdout]    |     ^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused variable: `ctx`
[INFO] [stdout]    --> rusty/examples/flash_attention_advanced.rs:115:27
[INFO] [stdout]     |
[INFO] [stdout] 115 | fn demo_memory_efficiency(ctx: &WgpuContext, engine: &ComputeEngine) {
[INFO] [stdout]     |                           ^^^ help: if this is intentional, prefix it with an underscore: `_ctx`
[INFO] [stdout]     |
[INFO] [stdout]     = note: `#[warn(unused_variables)]` (part of `#[warn(unused)]`) on by default
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused variable: `engine`
[INFO] [stdout]    --> rusty/examples/flash_attention_advanced.rs:115:46
[INFO] [stdout]     |
[INFO] [stdout] 115 | fn demo_memory_efficiency(ctx: &WgpuContext, engine: &ComputeEngine) {
[INFO] [stdout]     |                                              ^^^^^^ help: if this is intentional, prefix it with an underscore: `_engine`
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: unused variable: `flash_attn`
[INFO] [stdout]    --> rusty/examples/flash_attention_advanced.rs:121:9
[INFO] [stdout]     |
[INFO] [stdout] 121 |     let flash_attn = FlashAttention::new(hidden_dim, num_heads, true);
[INFO] [stdout]     |         ^^^^^^^^^^ help: if this is intentional, prefix it with an underscore: `_flash_attn`
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 1m 36s
[INFO] running `Command { std: "docker" "inspect" "1846c2850e7dc6cda820bdf21992487a906a71d3bf38b518fab9d50e675f8c02", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "1846c2850e7dc6cda820bdf21992487a906a71d3bf38b518fab9d50e675f8c02", kill_on_drop: false }`
[INFO] [stdout] 1846c2850e7dc6cda820bdf21992487a906a71d3bf38b518fab9d50e675f8c02
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+33835004928d3bf65db4d4712e1330766263b0bd" "test" "--frozen", kill_on_drop: false }`
[INFO] [stdout] ef88a7a5bbb2931d4cea68ad601b9ae2331528351cdbd3e7799d25c96411ee50
[INFO] running `Command { std: "docker" "start" "-a" "ef88a7a5bbb2931d4cea68ad601b9ae2331528351cdbd3e7799d25c96411ee50", kill_on_drop: false }`
[INFO] [stderr] warning: unused variable: `mask`
[INFO] [stderr]    --> rusty/src/functional.rs:146:9
[INFO] [stderr]     |
[INFO] [stderr] 146 |     let mask = abs_diff.less_than(&beta_tensor);
[INFO] [stderr]     |         ^^^^ help: if this is intentional, prefix it with an underscore: `_mask`
[INFO] [stderr]     |
[INFO] [stderr]     = note: `#[warn(unused_variables)]` (part of `#[warn(unused)]`) on by default
[INFO] [stderr] 
[INFO] [stderr] warning: unused variable: `sq_term`
[INFO] [stderr]    --> rusty/src/functional.rs:148:9
[INFO] [stderr]     |
[INFO] [stderr] 148 |     let sq_term = diff.mul(&diff).mul_scalar(0.5 / beta);
[INFO] [stderr]     |         ^^^^^^^ help: if this is intentional, prefix it with an underscore: `_sq_term`
[INFO] [stderr] 
[INFO] [stderr] warning: unused variable: `linear_term`
[INFO] [stderr]    --> rusty/src/functional.rs:149:9
[INFO] [stderr]     |
[INFO] [stderr] 149 |     let linear_term = abs_diff.sub(&beta_tensor.mul_scalar(0.5));
[INFO] [stderr]     |         ^^^^^^^^^^^ help: if this is intentional, prefix it with an underscore: `_linear_term`
[INFO] [stderr] 
[INFO] [stderr] warning: unused variable: `scale`
[INFO] [stderr]    --> rusty/src/optim/adam.rs:130:21
[INFO] [stderr]     |
[INFO] [stderr] 130 |                 let scale = max_norm / global_norm;
[INFO] [stderr]     |                     ^^^^^ help: if this is intentional, prefix it with an underscore: `_scale`
[INFO] [stderr] 
[INFO] [stderr] warning: missing documentation for a struct field
[INFO] [stderr]   --> rusty/src/nn/activation.rs:81:5
[INFO] [stderr]    |
[INFO] [stderr] 81 |     pub dim: i32,
[INFO] [stderr]    |     ^^^^^^^^^^^^
[INFO] [stderr]    |
[INFO] [stderr] note: the lint level is defined here
[INFO] [stderr]   --> rusty/src/lib.rs:41:9
[INFO] [stderr]    |
[INFO] [stderr] 41 | #![warn(missing_docs)]
[INFO] [stderr]    |         ^^^^^^^^^^^^
[INFO] [stderr] 
[INFO] [stderr] warning: missing documentation for an associated function
[INFO] [stderr]   --> rusty/src/nn/activation.rs:85:5
[INFO] [stderr]    |
[INFO] [stderr] 85 |     pub fn new(dim: i32) -> Self {
[INFO] [stderr]    |     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stderr] 
[INFO] [stderr] warning: missing documentation for a variant
[INFO] [stderr]   --> rusty/src/serialize.rs:17:5
[INFO] [stderr]    |
[INFO] [stderr] 17 |     Io(#[from] std::io::Error),
[INFO] [stderr]    |     ^^
[INFO] [stderr] 
[INFO] [stderr] warning: missing documentation for a variant
[INFO] [stderr]   --> rusty/src/serialize.rs:19:5
[INFO] [stderr]    |
[INFO] [stderr] 19 |     Json(#[from] serde_json::Error),
[INFO] [stderr]    |     ^^^^
[INFO] [stderr] 
[INFO] [stderr] warning: missing documentation for a variant
[INFO] [stderr]   --> rusty/src/serialize.rs:21:5
[INFO] [stderr]    |
[INFO] [stderr] 21 |     TensorNotFound(String),
[INFO] [stderr]    |     ^^^^^^^^^^^^^^
[INFO] [stderr] 
[INFO] [stderr] warning: `rusty` (lib) generated 9 warnings (run `cargo fix --lib -p rusty` to apply 4 suggestions)
[INFO] [stderr] warning: `rusty` (lib test) generated 9 warnings (9 duplicates)
[INFO] [stderr] warning: unused variable: `ctx`
[INFO] [stderr]    --> rusty/examples/flash_attention_advanced.rs:115:27
[INFO] [stderr]     |
[INFO] [stderr] 115 | fn demo_memory_efficiency(ctx: &WgpuContext, engine: &ComputeEngine) {
[INFO] [stderr]     |                           ^^^ help: if this is intentional, prefix it with an underscore: `_ctx`
[INFO] [stderr]     |
[INFO] [stderr]     = note: `#[warn(unused_variables)]` (part of `#[warn(unused)]`) on by default
[INFO] [stderr] 
[INFO] [stderr] warning: unused variable: `engine`
[INFO] [stderr]    --> rusty/examples/flash_attention_advanced.rs:115:46
[INFO] [stderr]     |
[INFO] [stderr] 115 | fn demo_memory_efficiency(ctx: &WgpuContext, engine: &ComputeEngine) {
[INFO] [stderr]     |                                              ^^^^^^ help: if this is intentional, prefix it with an underscore: `_engine`
[INFO] [stderr] 
[INFO] [stderr] warning: unused variable: `flash_attn`
[INFO] [stderr]    --> rusty/examples/flash_attention_advanced.rs:121:9
[INFO] [stderr]     |
[INFO] [stderr] 121 |     let flash_attn = FlashAttention::new(hidden_dim, num_heads, true);
[INFO] [stderr]     |         ^^^^^^^^^^ help: if this is intentional, prefix it with an underscore: `_flash_attn`
[INFO] [stderr] 
[INFO] [stderr] warning: unused import: `DemoConfig`
[INFO] [stderr]  --> rusty/examples/lora_finetune.rs:8:21
[INFO] [stderr]   |
[INFO] [stderr] 8 | use rusty_trainer::{DemoConfig, GradScaler};
[INFO] [stderr]   |                     ^^^^^^^^^^
[INFO] [stderr]   |
[INFO] [stderr]   = note: `#[warn(unused_imports)]` (part of `#[warn(unused)]`) on by default
[INFO] [stderr] 
[INFO] [stderr] warning: unused variable: `engine`
[INFO] [stderr]   --> rusty/examples/lora_finetune.rs:16:9
[INFO] [stderr]    |
[INFO] [stderr] 16 |     let engine = ComputeEngine::new(&ctx);
[INFO] [stderr]    |         ^^^^^^ help: if this is intentional, prefix it with an underscore: `_engine`
[INFO] [stderr]    |
[INFO] [stderr]    = note: `#[warn(unused_variables)]` (part of `#[warn(unused)]`) on by default
[INFO] [stderr] 
[INFO] [stderr] warning: `rusty` (example "flash_attention_advanced") generated 3 warnings (run `cargo fix --example "flash_attention_advanced" -p rusty` to apply 3 suggestions)
[INFO] [stderr] warning: `rusty` (example "lora_finetune") generated 2 warnings (run `cargo fix --example "lora_finetune" -p rusty` to apply 2 suggestions)
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 0.38s
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/rusty-e51365842974e5db)
[INFO] [stdout] 
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/rusty_autograd-cb4344a758190157)
[INFO] [stdout] running 0 tests
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] running 0 tests
[INFO] [stdout] 
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/rusty_backend-c2426dc10a280255)
[INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
[INFO] [stdout] 
[INFO] [stderr]      Running unittests src/main.rs (/opt/rustwide/target/debug/deps/bench-d53dd60a30bc739a)
[INFO] [stdout] 
[INFO] [stdout] running 0 tests
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stderr]      Running unittests src/main.rs (/opt/rustwide/target/debug/deps/rusty_cli-d0e0e522a85b4c56)
[INFO] [stdout] running 0 tests
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] running 0 tests
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
[INFO] [stdout] 
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/rusty_graph-60fe94a1156988df)
[INFO] [stdout] 
[INFO] [stdout] running 2 tests
[INFO] [stderr]      Running tests/flash_attention_correctness.rs (/opt/rustwide/target/debug/deps/flash_attention_correctness-bb723c2470d1a271)
[INFO] [stdout] test flash_attention::tests::test_creation ... ok
[INFO] [stdout] test flash_attention::tests::test_memory_savings ... ok
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] running 7 tests
[INFO] [stdout] test tests::test_multi_head_creation ... ok
[INFO] [stdout] test tests::test_memory_savings ... ok
[INFO] [stderr] error: XDG_RUNTIME_DIR is invalid or not set in the environment.
[INFO] [stderr] error: XDG_RUNTIME_DIR is invalid or not set in the environment.
[INFO] [stderr] error: XDG_RUNTIME_DIR is invalid or not set in the environment.
[INFO] [stderr] error: XDG_RUNTIME_DIR is invalid or not set in the environment.
[INFO] [stderr] error: XDG_RUNTIME_DIR is invalid or not set in the environment.
[INFO] [stdout] test tests::test_backward_pass_shapes ... FAILED
[INFO] [stdout] test tests::test_attention_normalization ... FAILED
[INFO] [stdout] test tests::test_causal_masking ... FAILED
[INFO] [stdout] test tests::test_flash_attention_shape ... FAILED
[INFO] [stdout] test tests::test_different_sequence_lengths ... FAILED
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout] 
[INFO] [stdout] ---- tests::test_backward_pass_shapes stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'tests::test_backward_pass_shapes' (26) panicked at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/backend/wgpu_core.rs:3006:5:
[INFO] [stdout] wgpu error: Validation Error
[INFO] [stdout] 
[INFO] [stdout] Caused by:
[INFO] [stdout]     In Device::create_shader_module
[INFO] [stdout]       note: label = `Kernels`
[INFO] [stdout]     
[INFO] [stdout] Shader 'Kernels' parsing error: no definition in scope for identifier: 'delta'
[INFO] [stdout]      ┌─ wgsl:1382:5
[INFO] [stdout]      │
[INFO] [stdout] 1382 │     delta[write_idx] = d_val;
[INFO] [stdout]      │     ^^^^^ unknown identifier
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout]     no definition in scope for identifier: 'delta'
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x63396d54464a - std[ec419fa8110287d5]::backtrace_rs::backtrace::libunwind::trace
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9
[INFO] [stdout]    1:     0x63396d54464a - std[ec419fa8110287d5]::backtrace_rs::backtrace::trace_unsynchronized::<std[ec419fa8110287d5]::sys::backtrace::_print_fmt::{closure#1}>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14
[INFO] [stdout]    2:     0x63396d54464a - std[ec419fa8110287d5]::sys::backtrace::_print_fmt
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/sys/backtrace.rs:74:9
[INFO] [stdout]    3:     0x63396d54464a - <<std[ec419fa8110287d5]::sys::backtrace::BacktraceLock>::print::DisplayBacktrace as core[35159d6ffb30e017]::fmt::Display>::fmt
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/sys/backtrace.rs:44:26
[INFO] [stdout]    4:     0x63396d55b74a - <core[35159d6ffb30e017]::fmt::rt::Argument>::fmt
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/fmt/rt.rs:152:76
[INFO] [stdout]    5:     0x63396d55b74a - core[35159d6ffb30e017]::fmt::write
[INFO] [stdout]    6:     0x63396d548fb2 - std[ec419fa8110287d5]::io::default_write_fmt::<alloc[a8a7aba520129d98]::vec::Vec<u8>>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/io/mod.rs:621:11
[INFO] [stdout]    7:     0x63396d548fb2 - <alloc[a8a7aba520129d98]::vec::Vec<u8> as std[ec419fa8110287d5]::io::Write>::write_fmt
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/io/mod.rs:1976:13
[INFO] [stdout]    8:     0x63396d5233cf - <std[ec419fa8110287d5]::sys::backtrace::BacktraceLock>::print
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/sys/backtrace.rs:47:9
[INFO] [stdout]    9:     0x63396d5233cf - std[ec419fa8110287d5]::panicking::default_hook::{closure#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:292:27
[INFO] [stdout]   10:     0x63396d53c979 - std[ec419fa8110287d5]::panicking::default_hook
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:316:9
[INFO] [stdout]   11:     0x63396cc2a9bc - <alloc[a8a7aba520129d98]::boxed::Box<dyn for<'a, 'b> core[35159d6ffb30e017]::ops::function::Fn<(&'a std[ec419fa8110287d5]::panic::PanicHookInfo<'b>,), Output = ()> + core[35159d6ffb30e017]::marker::Sync + core[35159d6ffb30e017]::marker::Send> as core[35159d6ffb30e017]::ops::function::Fn<(&std[ec419fa8110287d5]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/alloc/src/boxed.rs:2285:9
[INFO] [stdout]   12:     0x63396cc2a9bc - test[a8007afcd3effadc]::test_main_inner::<test[a8007afcd3effadc]::test_main_static::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/test/src/lib.rs:155:21
[INFO] [stdout]   13:     0x63396d53cb32 - <alloc[a8a7aba520129d98]::boxed::Box<dyn for<'a, 'b> core[35159d6ffb30e017]::ops::function::Fn<(&'a std[ec419fa8110287d5]::panic::PanicHookInfo<'b>,), Output = ()> + core[35159d6ffb30e017]::marker::Sync + core[35159d6ffb30e017]::marker::Send> as core[35159d6ffb30e017]::ops::function::Fn<(&std[ec419fa8110287d5]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/alloc/src/boxed.rs:2285:9
[INFO] [stdout]   14:     0x63396d53cb32 - std[ec419fa8110287d5]::panicking::panic_with_hook
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:833:13
[INFO] [stdout]   15:     0x63396d523488 - std[ec419fa8110287d5]::panicking::panic_handler::{closure#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:698:13
[INFO] [stdout]   16:     0x63396d51adf9 - std[ec419fa8110287d5]::sys::backtrace::__rust_end_short_backtrace::<std[ec419fa8110287d5]::panicking::panic_handler::{closure#0}, !>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/sys/backtrace.rs:182:18
[INFO] [stdout]   17:     0x63396d52419d - __rustc[cfb3622dd870db93]::rust_begin_unwind
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:689:5
[INFO] [stdout]   18:     0x63396d55bf0c - core[35159d6ffb30e017]::panicking::panic_fmt
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/panicking.rs:80:14
[INFO] [stdout]   19:     0x63396cdba0f4 - wgpu[ccc4085f254c30c6]::backend::wgpu_core::default_error_handler
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/backend/wgpu_core.rs:3006:5
[INFO] [stdout]   20:     0x63396cf0ce4a - <wgpu[ccc4085f254c30c6]::backend::wgpu_core::default_error_handler as core[35159d6ffb30e017]::ops::function::Fn<(wgpu[ccc4085f254c30c6]::Error,)>>::call
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/ops/function.rs:79:5
[INFO] [stdout]   21:     0x63396cf4475f - <alloc[a8a7aba520129d98]::boxed::Box<dyn wgpu[ccc4085f254c30c6]::UncapturedErrorHandler<Output = ()>> as core[35159d6ffb30e017]::ops::function::Fn<(wgpu[ccc4085f254c30c6]::Error,)>>::call
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/alloc/src/boxed.rs:2285:9
[INFO] [stdout]   22:     0x63396cdb7c28 - <wgpu[ccc4085f254c30c6]::backend::wgpu_core::ErrorSinkRaw>::handle_error
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/backend/wgpu_core.rs:2992:17
[INFO] [stdout]   23:     0x63396cda3adf - <wgpu[ccc4085f254c30c6]::backend::wgpu_core::ContextWgpuCore>::handle_error::<wgpu_core[1485c20d5417a3cb]::pipeline::CreateShaderModuleError>
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/backend/wgpu_core.rs:262:14
[INFO] [stdout]   24:     0x63396cdd1e7e - <wgpu[ccc4085f254c30c6]::backend::wgpu_core::ContextWgpuCore as wgpu[ccc4085f254c30c6]::context::Context>::device_create_shader_module
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/backend/wgpu_core.rs:874:18
[INFO] [stdout]   25:     0x63396cdc02f5 - <wgpu[ccc4085f254c30c6]::backend::wgpu_core::ContextWgpuCore as wgpu[ccc4085f254c30c6]::context::DynContext>::device_create_shader_module
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/context.rs:2191:37
[INFO] [stdout]   26:     0x63396cfe3c32 - <wgpu[ccc4085f254c30c6]::Device>::create_shader_module
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/lib.rs:2325:26
[INFO] [stdout]   27:     0x63396cc67ff6 - <rusty_backend[2d1285208260fdc1]::ComputeEngine>::new
[INFO] [stdout]                                at /opt/rustwide/workdir/rusty-backend/src/lib.rs:352:14
[INFO] [stdout]   28:     0x63396cc19acc - flash_attention_correctness[33a0a5a98cb1a929]::tests::setup
[INFO] [stdout]                                at /opt/rustwide/workdir/rusty-graph/tests/flash_attention_correctness.rs:14:22
[INFO] [stdout]   29:     0x63396cc1a473 - flash_attention_correctness[33a0a5a98cb1a929]::tests::test_backward_pass_shapes
[INFO] [stdout]                                at /opt/rustwide/workdir/rusty-graph/tests/flash_attention_correctness.rs:100:29
[INFO] [stdout]   30:     0x63396cc18d57 - flash_attention_correctness[33a0a5a98cb1a929]::tests::test_backward_pass_shapes::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/workdir/rusty-graph/tests/flash_attention_correctness.rs:99:35
[INFO] [stdout]   31:     0x63396cc1db36 - <flash_attention_correctness[33a0a5a98cb1a929]::tests::test_backward_pass_shapes::{closure#0} as core[35159d6ffb30e017]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   32:     0x63396cc1dc9b - <fn() -> core[35159d6ffb30e017]::result::Result<(), alloc[a8a7aba520129d98]::string::String> as core[35159d6ffb30e017]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   33:     0x63396cc1dc9b - test[a8007afcd3effadc]::__rust_begin_short_backtrace::<core[35159d6ffb30e017]::result::Result<(), alloc[a8a7aba520129d98]::string::String>, fn() -> core[35159d6ffb30e017]::result::Result<(), alloc[a8a7aba520129d98]::string::String>>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/test/src/lib.rs:724:18
[INFO] [stdout]   34:     0x63396cc2b48b - test[a8007afcd3effadc]::run_test_in_process::{closure#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/test/src/lib.rs:747:74
[INFO] [stdout]   35:     0x63396cc2b48b - <core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<test[a8007afcd3effadc]::run_test_in_process::{closure#0}> as core[35159d6ffb30e017]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   36:     0x63396cc2b48b - std[ec419fa8110287d5]::panicking::catch_unwind::do_call::<core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<test[a8007afcd3effadc]::run_test_in_process::{closure#0}>, core[35159d6ffb30e017]::result::Result<(), alloc[a8a7aba520129d98]::string::String>>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:581:40
[INFO] [stdout]   37:     0x63396cc2b48b - std[ec419fa8110287d5]::panicking::catch_unwind::<core[35159d6ffb30e017]::result::Result<(), alloc[a8a7aba520129d98]::string::String>, core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<test[a8007afcd3effadc]::run_test_in_process::{closure#0}>>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:544:19
[INFO] [stdout]   38:     0x63396cc2b48b - std[ec419fa8110287d5]::panic::catch_unwind::<core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<test[a8007afcd3effadc]::run_test_in_process::{closure#0}>, core[35159d6ffb30e017]::result::Result<(), alloc[a8a7aba520129d98]::string::String>>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panic.rs:359:14
[INFO] [stdout]   39:     0x63396cc2b48b - test[a8007afcd3effadc]::run_test_in_process
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/test/src/lib.rs:747:27
[INFO] [stdout]   40:     0x63396cc2b48b - test[a8007afcd3effadc]::run_test::{closure#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/test/src/lib.rs:668:43
[INFO] [stdout]   41:     0x63396cc25e64 - test[a8007afcd3effadc]::run_test::{closure#1}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/test/src/lib.rs:698:41
[INFO] [stdout]   42:     0x63396cc25e64 - std[ec419fa8110287d5]::sys::backtrace::__rust_begin_short_backtrace::<test[a8007afcd3effadc]::run_test::{closure#1}, ()>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/sys/backtrace.rs:166:18
[INFO] [stdout]   43:     0x63396cc2e092 - std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked::<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/thread/lifecycle.rs:70:13
[INFO] [stdout]   44:     0x63396cc2e092 - <core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}> as core[35159d6ffb30e017]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   45:     0x63396cc2e092 - std[ec419fa8110287d5]::panicking::catch_unwind::do_call::<core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:581:40
[INFO] [stdout]   46:     0x63396cc2e092 - std[ec419fa8110287d5]::panicking::catch_unwind::<(), core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:544:19
[INFO] [stdout]   47:     0x63396cc2e092 - std[ec419fa8110287d5]::panic::catch_unwind::<core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panic.rs:359:14
[INFO] [stdout]   48:     0x63396cc2e092 - std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked::<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/thread/lifecycle.rs:68:26
[INFO] [stdout]   49:     0x63396cc2e092 - <std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1} as core[35159d6ffb30e017]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   50:     0x63396d543f2f - <alloc[a8a7aba520129d98]::boxed::Box<dyn core[35159d6ffb30e017]::ops::function::FnOnce<(), Output = ()> + core[35159d6ffb30e017]::marker::Send> as core[35159d6ffb30e017]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/alloc/src/boxed.rs:2271:9
[INFO] [stdout]   51:     0x63396d543f2f - <std[ec419fa8110287d5]::sys::thread::unix::Thread>::new::thread_start
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/sys/thread/unix.rs:118:17
[INFO] [stdout]   52:     0x720ce4c3daa4 - <unknown>
[INFO] [stdout]   53:     0x720ce4ccaa64 - clone
[INFO] [stdout]   54:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] ---- tests::test_attention_normalization stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'tests::test_attention_normalization' (25) panicked at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/backend/wgpu_core.rs:3006:5:
[INFO] [stdout] wgpu error: Validation Error
[INFO] [stdout] 
[INFO] [stdout] Caused by:
[INFO] [stdout]     In Device::create_shader_module
[INFO] [stdout]       note: label = `Kernels`
[INFO] [stdout]     
[INFO] [stdout] Shader 'Kernels' parsing error: no definition in scope for identifier: 'delta'
[INFO] [stdout]      ┌─ wgsl:1382:5
[INFO] [stdout]      │
[INFO] [stdout] 1382 │     delta[write_idx] = d_val;
[INFO] [stdout]      │     ^^^^^ unknown identifier
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout]     no definition in scope for identifier: 'delta'
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x63396d54464a - std[ec419fa8110287d5]::backtrace_rs::backtrace::libunwind::trace
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9
[INFO] [stdout]    1:     0x63396d54464a - std[ec419fa8110287d5]::backtrace_rs::backtrace::trace_unsynchronized::<std[ec419fa8110287d5]::sys::backtrace::_print_fmt::{closure#1}>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14
[INFO] [stdout]    2:     0x63396d54464a - std[ec419fa8110287d5]::sys::backtrace::_print_fmt
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/sys/backtrace.rs:74:9
[INFO] [stdout]    3:     0x63396d54464a - <<std[ec419fa8110287d5]::sys::backtrace::BacktraceLock>::print::DisplayBacktrace as core[35159d6ffb30e017]::fmt::Display>::fmt
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/sys/backtrace.rs:44:26
[INFO] [stdout]    4:     0x63396d55b74a - <core[35159d6ffb30e017]::fmt::rt::Argument>::fmt
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/fmt/rt.rs:152:76
[INFO] [stdout]    5:     0x63396d55b74a - core[35159d6ffb30e017]::fmt::write
[INFO] [stdout]    6:     0x63396d548fb2 - std[ec419fa8110287d5]::io::default_write_fmt::<alloc[a8a7aba520129d98]::vec::Vec<u8>>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/io/mod.rs:621:11
[INFO] [stdout]    7:     0x63396d548fb2 - <alloc[a8a7aba520129d98]::vec::Vec<u8> as std[ec419fa8110287d5]::io::Write>::write_fmt
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/io/mod.rs:1976:13
[INFO] [stdout]    8:     0x63396d5233cf - <std[ec419fa8110287d5]::sys::backtrace::BacktraceLock>::print
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/sys/backtrace.rs:47:9
[INFO] [stdout]    9:     0x63396d5233cf - std[ec419fa8110287d5]::panicking::default_hook::{closure#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:292:27
[INFO] [stdout]   10:     0x63396d53c979 - std[ec419fa8110287d5]::panicking::default_hook
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:316:9
[INFO] [stdout]   11:     0x63396cc2a9bc - <alloc[a8a7aba520129d98]::boxed::Box<dyn for<'a, 'b> core[35159d6ffb30e017]::ops::function::Fn<(&'a std[ec419fa8110287d5]::panic::PanicHookInfo<'b>,), Output = ()> + core[35159d6ffb30e017]::marker::Sync + core[35159d6ffb30e017]::marker::Send> as core[35159d6ffb30e017]::ops::function::Fn<(&std[ec419fa8110287d5]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/alloc/src/boxed.rs:2285:9
[INFO] [stdout]   12:     0x63396cc2a9bc - test[a8007afcd3effadc]::test_main_inner::<test[a8007afcd3effadc]::test_main_static::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/test/src/lib.rs:155:21
[INFO] [stdout]   13:     0x63396d53cb32 - <alloc[a8a7aba520129d98]::boxed::Box<dyn for<'a, 'b> core[35159d6ffb30e017]::ops::function::Fn<(&'a std[ec419fa8110287d5]::panic::PanicHookInfo<'b>,), Output = ()> + core[35159d6ffb30e017]::marker::Sync + core[35159d6ffb30e017]::marker::Send> as core[35159d6ffb30e017]::ops::function::Fn<(&std[ec419fa8110287d5]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/alloc/src/boxed.rs:2285:9
[INFO] [stdout]   14:     0x63396d53cb32 - std[ec419fa8110287d5]::panicking::panic_with_hook
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:833:13
[INFO] [stdout]   15:     0x63396d523488 - std[ec419fa8110287d5]::panicking::panic_handler::{closure#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:698:13
[INFO] [stdout]   16:     0x63396d51adf9 - std[ec419fa8110287d5]::sys::backtrace::__rust_end_short_backtrace::<std[ec419fa8110287d5]::panicking::panic_handler::{closure#0}, !>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/sys/backtrace.rs:182:18
[INFO] [stdout]   17:     0x63396d52419d - __rustc[cfb3622dd870db93]::rust_begin_unwind
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:689:5
[INFO] [stdout]   18:     0x63396d55bf0c - core[35159d6ffb30e017]::panicking::panic_fmt
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/panicking.rs:80:14
[INFO] [stdout]   19:     0x63396cdba0f4 - wgpu[ccc4085f254c30c6]::backend::wgpu_core::default_error_handler
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/backend/wgpu_core.rs:3006:5
[INFO] [stdout]   20:     0x63396cf0ce4a - <wgpu[ccc4085f254c30c6]::backend::wgpu_core::default_error_handler as core[35159d6ffb30e017]::ops::function::Fn<(wgpu[ccc4085f254c30c6]::Error,)>>::call
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/ops/function.rs:79:5
[INFO] [stdout]   21:     0x63396cf4475f - <alloc[a8a7aba520129d98]::boxed::Box<dyn wgpu[ccc4085f254c30c6]::UncapturedErrorHandler<Output = ()>> as core[35159d6ffb30e017]::ops::function::Fn<(wgpu[ccc4085f254c30c6]::Error,)>>::call
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/alloc/src/boxed.rs:2285:9
[INFO] [stdout]   22:     0x63396cdb7c28 - <wgpu[ccc4085f254c30c6]::backend::wgpu_core::ErrorSinkRaw>::handle_error
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/backend/wgpu_core.rs:2992:17
[INFO] [stdout]   23:     0x63396cda3adf - <wgpu[ccc4085f254c30c6]::backend::wgpu_core::ContextWgpuCore>::handle_error::<wgpu_core[1485c20d5417a3cb]::pipeline::CreateShaderModuleError>
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/backend/wgpu_core.rs:262:14
[INFO] [stdout]   24:     0x63396cdd1e7e - <wgpu[ccc4085f254c30c6]::backend::wgpu_core::ContextWgpuCore as wgpu[ccc4085f254c30c6]::context::Context>::device_create_shader_module
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/backend/wgpu_core.rs:874:18
[INFO] [stdout]   25:     0x63396cdc02f5 - <wgpu[ccc4085f254c30c6]::backend::wgpu_core::ContextWgpuCore as wgpu[ccc4085f254c30c6]::context::DynContext>::device_create_shader_module
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/context.rs:2191:37
[INFO] [stdout]   26:     0x63396cfe3c32 - <wgpu[ccc4085f254c30c6]::Device>::create_shader_module
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/lib.rs:2325:26
[INFO] [stdout]   27:     0x63396cc67ff6 - <rusty_backend[2d1285208260fdc1]::ComputeEngine>::new
[INFO] [stdout]                                at /opt/rustwide/workdir/rusty-backend/src/lib.rs:352:14
[INFO] [stdout]   28:     0x63396cc19acc - flash_attention_correctness[33a0a5a98cb1a929]::tests::setup
[INFO] [stdout]                                at /opt/rustwide/workdir/rusty-graph/tests/flash_attention_correctness.rs:14:22
[INFO] [stdout]   29:     0x63396cc1b26f - flash_attention_correctness[33a0a5a98cb1a929]::tests::test_attention_normalization
[INFO] [stdout]                                at /opt/rustwide/workdir/rusty-graph/tests/flash_attention_correctness.rs:71:29
[INFO] [stdout]   30:     0x63396cc18db7 - flash_attention_correctness[33a0a5a98cb1a929]::tests::test_attention_normalization::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/workdir/rusty-graph/tests/flash_attention_correctness.rs:70:38
[INFO] [stdout]   31:     0x63396cc1dbb6 - <flash_attention_correctness[33a0a5a98cb1a929]::tests::test_attention_normalization::{closure#0} as core[35159d6ffb30e017]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   32:     0x63396cc1dc9b - <fn() -> core[35159d6ffb30e017]::result::Result<(), alloc[a8a7aba520129d98]::string::String> as core[35159d6ffb30e017]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   33:     0x63396cc1dc9b - test[a8007afcd3effadc]::__rust_begin_short_backtrace::<core[35159d6ffb30e017]::result::Result<(), alloc[a8a7aba520129d98]::string::String>, fn() -> core[35159d6ffb30e017]::result::Result<(), alloc[a8a7aba520129d98]::string::String>>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/test/src/lib.rs:724:18
[INFO] [stdout]   34:     0x63396cc2b48b - test[a8007afcd3effadc]::run_test_in_process::{closure#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/test/src/lib.rs:747:74
[INFO] [stdout]   35:     0x63396cc2b48b - <core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<test[a8007afcd3effadc]::run_test_in_process::{closure#0}> as core[35159d6ffb30e017]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   36:     0x63396cc2b48b - std[ec419fa8110287d5]::panicking::catch_unwind::do_call::<core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<test[a8007afcd3effadc]::run_test_in_process::{closure#0}>, core[35159d6ffb30e017]::result::Result<(), alloc[a8a7aba520129d98]::string::String>>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:581:40
[INFO] [stdout]   37:     0x63396cc2b48b - std[ec419fa8110287d5]::panicking::catch_unwind::<core[35159d6ffb30e017]::result::Result<(), alloc[a8a7aba520129d98]::string::String>, core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<test[a8007afcd3effadc]::run_test_in_process::{closure#0}>>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:544:19
[INFO] [stdout]   38:     0x63396cc2b48b - std[ec419fa8110287d5]::panic::catch_unwind::<core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<test[a8007afcd3effadc]::run_test_in_process::{closure#0}>, core[35159d6ffb30e017]::result::Result<(), alloc[a8a7aba520129d98]::string::String>>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panic.rs:359:14
[INFO] [stdout]   39:     0x63396cc2b48b - test[a8007afcd3effadc]::run_test_in_process
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/test/src/lib.rs:747:27
[INFO] [stdout]   40:     0x63396cc2b48b - test[a8007afcd3effadc]::run_test::{closure#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/test/src/lib.rs:668:43
[INFO] [stdout]   41:     0x63396cc25e64 - test[a8007afcd3effadc]::run_test::{closure#1}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/test/src/lib.rs:698:41
[INFO] [stdout]   42:     0x63396cc25e64 - std[ec419fa8110287d5]::sys::backtrace::__rust_begin_short_backtrace::<test[a8007afcd3effadc]::run_test::{closure#1}, ()>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/sys/backtrace.rs:166:18
[INFO] [stdout]   43:     0x63396cc2e092 - std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked::<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/thread/lifecycle.rs:70:13
[INFO] [stdout]   44:     0x63396cc2e092 - <core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}> as core[35159d6ffb30e017]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   45:     0x63396cc2e092 - std[ec419fa8110287d5]::panicking::catch_unwind::do_call::<core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:581:40
[INFO] [stdout]   46:     0x63396cc2e092 - std[ec419fa8110287d5]::panicking::catch_unwind::<(), core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:544:19
[INFO] [stdout]   47:     0x63396cc2e092 - std[ec419fa8110287d5]::panic::catch_unwind::<core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panic.rs:359:14
[INFO] [stdout]   48:     0x63396cc2e092 - std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked::<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/thread/lifecycle.rs:68:26
[INFO] [stdout]   49:     0x63396cc2e092 - <std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1} as core[35159d6ffb30e017]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   50:     0x63396d543f2f - <alloc[a8a7aba520129d98]::boxed::Box<dyn core[35159d6ffb30e017]::ops::function::FnOnce<(), Output = ()> + core[35159d6ffb30e017]::marker::Send> as core[35159d6ffb30e017]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/alloc/src/boxed.rs:2271:9
[INFO] [stdout]   51:     0x63396d543f2f - <std[ec419fa8110287d5]::sys::thread::unix::Thread>::new::thread_start
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/sys/thread/unix.rs:118:17
[INFO] [stdout]   52:     0x720ce4c3daa4 - <unknown>
[INFO] [stdout]   53:     0x720ce4ccaa64 - clone
[INFO] [stdout]   54:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] ---- tests::test_causal_masking stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'tests::test_causal_masking' (27) panicked at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/backend/wgpu_core.rs:3006:5:
[INFO] [stdout] wgpu error: Validation Error
[INFO] [stdout] 
[INFO] [stdout] Caused by:
[INFO] [stdout]     In Device::create_shader_module
[INFO] [stdout]       note: label = `Kernels`
[INFO] [stdout]     
[INFO] [stdout] Shader 'Kernels' parsing error: no definition in scope for identifier: 'delta'
[INFO] [stdout]      ┌─ wgsl:1382:5
[INFO] [stdout]      │
[INFO] [stdout] 1382 │     delta[write_idx] = d_val;
[INFO] [stdout]      │     ^^^^^ unknown identifier
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout]     no definition in scope for identifier: 'delta'
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x63396d54464a - std[ec419fa8110287d5]::backtrace_rs::backtrace::libunwind::trace
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9
[INFO] [stdout]    1:     0x63396d54464a - std[ec419fa8110287d5]::backtrace_rs::backtrace::trace_unsynchronized::<std[ec419fa8110287d5]::sys::backtrace::_print_fmt::{closure#1}>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14
[INFO] [stdout]    2:     0x63396d54464a - std[ec419fa8110287d5]::sys::backtrace::_print_fmt
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/sys/backtrace.rs:74:9
[INFO] [stdout]    3:     0x63396d54464a - <<std[ec419fa8110287d5]::sys::backtrace::BacktraceLock>::print::DisplayBacktrace as core[35159d6ffb30e017]::fmt::Display>::fmt
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/sys/backtrace.rs:44:26
[INFO] [stdout]    4:     0x63396d55b74a - <core[35159d6ffb30e017]::fmt::rt::Argument>::fmt
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/fmt/rt.rs:152:76
[INFO] [stdout]    5:     0x63396d55b74a - core[35159d6ffb30e017]::fmt::write
[INFO] [stdout]    6:     0x63396d548fb2 - std[ec419fa8110287d5]::io::default_write_fmt::<alloc[a8a7aba520129d98]::vec::Vec<u8>>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/io/mod.rs:621:11
[INFO] [stdout]    7:     0x63396d548fb2 - <alloc[a8a7aba520129d98]::vec::Vec<u8> as std[ec419fa8110287d5]::io::Write>::write_fmt
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/io/mod.rs:1976:13
[INFO] [stdout]    8:     0x63396d5233cf - <std[ec419fa8110287d5]::sys::backtrace::BacktraceLock>::print
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/sys/backtrace.rs:47:9
[INFO] [stdout]    9:     0x63396d5233cf - std[ec419fa8110287d5]::panicking::default_hook::{closure#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:292:27
[INFO] [stdout]   10:     0x63396d53c979 - std[ec419fa8110287d5]::panicking::default_hook
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:316:9
[INFO] [stdout]   11:     0x63396cc2a9bc - <alloc[a8a7aba520129d98]::boxed::Box<dyn for<'a, 'b> core[35159d6ffb30e017]::ops::function::Fn<(&'a std[ec419fa8110287d5]::panic::PanicHookInfo<'b>,), Output = ()> + core[35159d6ffb30e017]::marker::Sync + core[35159d6ffb30e017]::marker::Send> as core[35159d6ffb30e017]::ops::function::Fn<(&std[ec419fa8110287d5]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/alloc/src/boxed.rs:2285:9
[INFO] [stdout]   12:     0x63396cc2a9bc - test[a8007afcd3effadc]::test_main_inner::<test[a8007afcd3effadc]::test_main_static::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/test/src/lib.rs:155:21
[INFO] [stdout]   13:     0x63396d53cb32 - <alloc[a8a7aba520129d98]::boxed::Box<dyn for<'a, 'b> core[35159d6ffb30e017]::ops::function::Fn<(&'a std[ec419fa8110287d5]::panic::PanicHookInfo<'b>,), Output = ()> + core[35159d6ffb30e017]::marker::Sync + core[35159d6ffb30e017]::marker::Send> as core[35159d6ffb30e017]::ops::function::Fn<(&std[ec419fa8110287d5]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/alloc/src/boxed.rs:2285:9
[INFO] [stdout]   14:     0x63396d53cb32 - std[ec419fa8110287d5]::panicking::panic_with_hook
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:833:13
[INFO] [stdout]   15:     0x63396d523488 - std[ec419fa8110287d5]::panicking::panic_handler::{closure#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:698:13
[INFO] [stdout]   16:     0x63396d51adf9 - std[ec419fa8110287d5]::sys::backtrace::__rust_end_short_backtrace::<std[ec419fa8110287d5]::panicking::panic_handler::{closure#0}, !>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/sys/backtrace.rs:182:18
[INFO] [stdout]   17:     0x63396d52419d - __rustc[cfb3622dd870db93]::rust_begin_unwind
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:689:5
[INFO] [stdout]   18:     0x63396d55bf0c - core[35159d6ffb30e017]::panicking::panic_fmt
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/panicking.rs:80:14
[INFO] [stdout]   19:     0x63396cdba0f4 - wgpu[ccc4085f254c30c6]::backend::wgpu_core::default_error_handler
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/backend/wgpu_core.rs:3006:5
[INFO] [stdout]   20:     0x63396cf0ce4a - <wgpu[ccc4085f254c30c6]::backend::wgpu_core::default_error_handler as core[35159d6ffb30e017]::ops::function::Fn<(wgpu[ccc4085f254c30c6]::Error,)>>::call
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/ops/function.rs:79:5
[INFO] [stdout]   21:     0x63396cf4475f - <alloc[a8a7aba520129d98]::boxed::Box<dyn wgpu[ccc4085f254c30c6]::UncapturedErrorHandler<Output = ()>> as core[35159d6ffb30e017]::ops::function::Fn<(wgpu[ccc4085f254c30c6]::Error,)>>::call
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/alloc/src/boxed.rs:2285:9
[INFO] [stdout]   22:     0x63396cdb7c28 - <wgpu[ccc4085f254c30c6]::backend::wgpu_core::ErrorSinkRaw>::handle_error
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/backend/wgpu_core.rs:2992:17
[INFO] [stdout]   23:     0x63396cda3adf - <wgpu[ccc4085f254c30c6]::backend::wgpu_core::ContextWgpuCore>::handle_error::<wgpu_core[1485c20d5417a3cb]::pipeline::CreateShaderModuleError>
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/backend/wgpu_core.rs:262:14
[INFO] [stdout]   24:     0x63396cdd1e7e - <wgpu[ccc4085f254c30c6]::backend::wgpu_core::ContextWgpuCore as wgpu[ccc4085f254c30c6]::context::Context>::device_create_shader_module
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/backend/wgpu_core.rs:874:18
[INFO] [stdout]   25:     0x63396cdc02f5 - <wgpu[ccc4085f254c30c6]::backend::wgpu_core::ContextWgpuCore as wgpu[ccc4085f254c30c6]::context::DynContext>::device_create_shader_module
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/context.rs:2191:37
[INFO] [stdout]   26:     0x63396cfe3c32 - <wgpu[ccc4085f254c30c6]::Device>::create_shader_module
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/lib.rs:2325:26
[INFO] [stdout]   27:     0x63396cc67ff6 - <rusty_backend[2d1285208260fdc1]::ComputeEngine>::new
[INFO] [stdout]                                at /opt/rustwide/workdir/rusty-backend/src/lib.rs:352:14
[INFO] [stdout]   28:     0x63396cc19acc - flash_attention_correctness[33a0a5a98cb1a929]::tests::setup
[INFO] [stdout]                                at /opt/rustwide/workdir/rusty-graph/tests/flash_attention_correctness.rs:14:22
[INFO] [stdout]   29:     0x63396cc19b4f - flash_attention_correctness[33a0a5a98cb1a929]::tests::test_causal_masking
[INFO] [stdout]                                at /opt/rustwide/workdir/rusty-graph/tests/flash_attention_correctness.rs:41:29
[INFO] [stdout]   30:     0x63396cc18cc7 - flash_attention_correctness[33a0a5a98cb1a929]::tests::test_causal_masking::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/workdir/rusty-graph/tests/flash_attention_correctness.rs:40:29
[INFO] [stdout]   31:     0x63396cc1da76 - <flash_attention_correctness[33a0a5a98cb1a929]::tests::test_causal_masking::{closure#0} as core[35159d6ffb30e017]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   32:     0x63396cc1dc9b - <fn() -> core[35159d6ffb30e017]::result::Result<(), alloc[a8a7aba520129d98]::string::String> as core[35159d6ffb30e017]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   33:     0x63396cc1dc9b - test[a8007afcd3effadc]::__rust_begin_short_backtrace::<core[35159d6ffb30e017]::result::Result<(), alloc[a8a7aba520129d98]::string::String>, fn() -> core[35159d6ffb30e017]::result::Result<(), alloc[a8a7aba520129d98]::string::String>>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/test/src/lib.rs:724:18
[INFO] [stdout]   34:     0x63396cc2b48b - test[a8007afcd3effadc]::run_test_in_process::{closure#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/test/src/lib.rs:747:74
[INFO] [stdout]   35:     0x63396cc2b48b - <core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<test[a8007afcd3effadc]::run_test_in_process::{closure#0}> as core[35159d6ffb30e017]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   36:     0x63396cc2b48b - std[ec419fa8110287d5]::panicking::catch_unwind::do_call::<core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<test[a8007afcd3effadc]::run_test_in_process::{closure#0}>, core[35159d6ffb30e017]::result::Result<(), alloc[a8a7aba520129d98]::string::String>>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:581:40
[INFO] [stdout]   37:     0x63396cc2b48b - std[ec419fa8110287d5]::panicking::catch_unwind::<core[35159d6ffb30e017]::result::Result<(), alloc[a8a7aba520129d98]::string::String>, core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<test[a8007afcd3effadc]::run_test_in_process::{closure#0}>>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:544:19
[INFO] [stdout]   38:     0x63396cc2b48b - std[ec419fa8110287d5]::panic::catch_unwind::<core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<test[a8007afcd3effadc]::run_test_in_process::{closure#0}>, core[35159d6ffb30e017]::result::Result<(), alloc[a8a7aba520129d98]::string::String>>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panic.rs:359:14
[INFO] [stdout]   39:     0x63396cc2b48b - test[a8007afcd3effadc]::run_test_in_process
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/test/src/lib.rs:747:27
[INFO] [stdout]   40:     0x63396cc2b48b - test[a8007afcd3effadc]::run_test::{closure#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/test/src/lib.rs:668:43
[INFO] [stdout]   41:     0x63396cc25e64 - test[a8007afcd3effadc]::run_test::{closure#1}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/test/src/lib.rs:698:41
[INFO] [stdout]   42:     0x63396cc25e64 - std[ec419fa8110287d5]::sys::backtrace::__rust_begin_short_backtrace::<test[a8007afcd3effadc]::run_test::{closure#1}, ()>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/sys/backtrace.rs:166:18
[INFO] [stdout]   43:     0x63396cc2e092 - std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked::<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/thread/lifecycle.rs:70:13
[INFO] [stdout]   44:     0x63396cc2e092 - <core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}> as core[35159d6ffb30e017]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   45:     0x63396cc2e092 - std[ec419fa8110287d5]::panicking::catch_unwind::do_call::<core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:581:40
[INFO] [stdout]   46:     0x63396cc2e092 - std[ec419fa8110287d5]::panicking::catch_unwind::<(), core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:544:19
[INFO] [stdout]   47:     0x63396cc2e092 - std[ec419fa8110287d5]::panic::catch_unwind::<core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panic.rs:359:14
[INFO] [stdout]   48:     0x63396cc2e092 - std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked::<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/thread/lifecycle.rs:68:26
[INFO] [stdout]   49:     0x63396cc2e092 - <std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1} as core[35159d6ffb30e017]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   50:     0x63396d543f2f - <alloc[a8a7aba520129d98]::boxed::Box<dyn core[35159d6ffb30e017]::ops::function::FnOnce<(), Output = ()> + core[35159d6ffb30e017]::marker::Send> as core[35159d6ffb30e017]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/alloc/src/boxed.rs:2271:9
[INFO] [stdout]   51:     0x63396d543f2f - <std[ec419fa8110287d5]::sys::thread::unix::Thread>::new::thread_start
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/sys/thread/unix.rs:118:17
[INFO] [stdout]   52:     0x720ce4c3daa4 - <unknown>
[INFO] [stdout]   53:     0x720ce4ccaa64 - clone
[INFO] [stdout]   54:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] ---- tests::test_flash_attention_shape stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'tests::test_flash_attention_shape' (29) panicked at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/backend/wgpu_core.rs:3006:5:
[INFO] [stdout] wgpu error: Validation Error
[INFO] [stdout] 
[INFO] [stdout] Caused by:
[INFO] [stdout]     In Device::create_shader_module
[INFO] [stdout]       note: label = `Kernels`
[INFO] [stdout]     
[INFO] [stdout] Shader 'Kernels' parsing error: no definition in scope for identifier: 'delta'
[INFO] [stdout]      ┌─ wgsl:1382:5
[INFO] [stdout]      │
[INFO] [stdout] 1382 │     delta[write_idx] = d_val;
[INFO] [stdout]      │     ^^^^^ unknown identifier
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout]     no definition in scope for identifier: 'delta'
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x63396d54464a - std[ec419fa8110287d5]::backtrace_rs::backtrace::libunwind::trace
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9
[INFO] [stdout]    1:     0x63396d54464a - std[ec419fa8110287d5]::backtrace_rs::backtrace::trace_unsynchronized::<std[ec419fa8110287d5]::sys::backtrace::_print_fmt::{closure#1}>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14
[INFO] [stdout]    2:     0x63396d54464a - std[ec419fa8110287d5]::sys::backtrace::_print_fmt
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/sys/backtrace.rs:74:9
[INFO] [stdout]    3:     0x63396d54464a - <<std[ec419fa8110287d5]::sys::backtrace::BacktraceLock>::print::DisplayBacktrace as core[35159d6ffb30e017]::fmt::Display>::fmt
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/sys/backtrace.rs:44:26
[INFO] [stdout]    4:     0x63396d55b74a - <core[35159d6ffb30e017]::fmt::rt::Argument>::fmt
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/fmt/rt.rs:152:76
[INFO] [stdout]    5:     0x63396d55b74a - core[35159d6ffb30e017]::fmt::write
[INFO] [stdout]    6:     0x63396d548fb2 - std[ec419fa8110287d5]::io::default_write_fmt::<alloc[a8a7aba520129d98]::vec::Vec<u8>>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/io/mod.rs:621:11
[INFO] [stdout]    7:     0x63396d548fb2 - <alloc[a8a7aba520129d98]::vec::Vec<u8> as std[ec419fa8110287d5]::io::Write>::write_fmt
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/io/mod.rs:1976:13
[INFO] [stdout]    8:     0x63396d5233cf - <std[ec419fa8110287d5]::sys::backtrace::BacktraceLock>::print
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/sys/backtrace.rs:47:9
[INFO] [stdout]    9:     0x63396d5233cf - std[ec419fa8110287d5]::panicking::default_hook::{closure#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:292:27
[INFO] [stdout]   10:     0x63396d53c979 - std[ec419fa8110287d5]::panicking::default_hook
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:316:9
[INFO] [stdout]   11:     0x63396cc2a9bc - <alloc[a8a7aba520129d98]::boxed::Box<dyn for<'a, 'b> core[35159d6ffb30e017]::ops::function::Fn<(&'a std[ec419fa8110287d5]::panic::PanicHookInfo<'b>,), Output = ()> + core[35159d6ffb30e017]::marker::Sync + core[35159d6ffb30e017]::marker::Send> as core[35159d6ffb30e017]::ops::function::Fn<(&std[ec419fa8110287d5]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/alloc/src/boxed.rs:2285:9
[INFO] [stdout]   12:     0x63396cc2a9bc - test[a8007afcd3effadc]::test_main_inner::<test[a8007afcd3effadc]::test_main_static::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/test/src/lib.rs:155:21
[INFO] [stdout]   13:     0x63396d53cb32 - <alloc[a8a7aba520129d98]::boxed::Box<dyn for<'a, 'b> core[35159d6ffb30e017]::ops::function::Fn<(&'a std[ec419fa8110287d5]::panic::PanicHookInfo<'b>,), Output = ()> + core[35159d6ffb30e017]::marker::Sync + core[35159d6ffb30e017]::marker::Send> as core[35159d6ffb30e017]::ops::function::Fn<(&std[ec419fa8110287d5]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/alloc/src/boxed.rs:2285:9
[INFO] [stdout]   14:     0x63396d53cb32 - std[ec419fa8110287d5]::panicking::panic_with_hook
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:833:13
[INFO] [stdout]   15:     0x63396d523488 - std[ec419fa8110287d5]::panicking::panic_handler::{closure#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:698:13
[INFO] [stdout]   16:     0x63396d51adf9 - std[ec419fa8110287d5]::sys::backtrace::__rust_end_short_backtrace::<std[ec419fa8110287d5]::panicking::panic_handler::{closure#0}, !>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/sys/backtrace.rs:182:18
[INFO] [stdout]   17:     0x63396d52419d - __rustc[cfb3622dd870db93]::rust_begin_unwind
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:689:5
[INFO] [stdout]   18:     0x63396d55bf0c - core[35159d6ffb30e017]::panicking::panic_fmt
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/panicking.rs:80:14
[INFO] [stdout]   19:     0x63396cdba0f4 - wgpu[ccc4085f254c30c6]::backend::wgpu_core::default_error_handler
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/backend/wgpu_core.rs:3006:5
[INFO] [stdout]   20:     0x63396cf0ce4a - <wgpu[ccc4085f254c30c6]::backend::wgpu_core::default_error_handler as core[35159d6ffb30e017]::ops::function::Fn<(wgpu[ccc4085f254c30c6]::Error,)>>::call
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/ops/function.rs:79:5
[INFO] [stdout]   21:     0x63396cf4475f - <alloc[a8a7aba520129d98]::boxed::Box<dyn wgpu[ccc4085f254c30c6]::UncapturedErrorHandler<Output = ()>> as core[35159d6ffb30e017]::ops::function::Fn<(wgpu[ccc4085f254c30c6]::Error,)>>::call
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/alloc/src/boxed.rs:2285:9
[INFO] [stdout]   22:     0x63396cdb7c28 - <wgpu[ccc4085f254c30c6]::backend::wgpu_core::ErrorSinkRaw>::handle_error
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/backend/wgpu_core.rs:2992:17
[INFO] [stdout]   23:     0x63396cda3adf - <wgpu[ccc4085f254c30c6]::backend::wgpu_core::ContextWgpuCore>::handle_error::<wgpu_core[1485c20d5417a3cb]::pipeline::CreateShaderModuleError>
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/backend/wgpu_core.rs:262:14
[INFO] [stdout]   24:     0x63396cdd1e7e - <wgpu[ccc4085f254c30c6]::backend::wgpu_core::ContextWgpuCore as wgpu[ccc4085f254c30c6]::context::Context>::device_create_shader_module
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/backend/wgpu_core.rs:874:18
[INFO] [stdout]   25:     0x63396cdc02f5 - <wgpu[ccc4085f254c30c6]::backend::wgpu_core::ContextWgpuCore as wgpu[ccc4085f254c30c6]::context::DynContext>::device_create_shader_module
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/context.rs:2191:37
[INFO] [stdout]   26:     0x63396cfe3c32 - <wgpu[ccc4085f254c30c6]::Device>::create_shader_module
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/lib.rs:2325:26
[INFO] [stdout]   27:     0x63396cc67ff6 - <rusty_backend[2d1285208260fdc1]::ComputeEngine>::new
[INFO] [stdout]                                at /opt/rustwide/workdir/rusty-backend/src/lib.rs:352:14
[INFO] [stdout]   28:     0x63396cc19acc - flash_attention_correctness[33a0a5a98cb1a929]::tests::setup
[INFO] [stdout]                                at /opt/rustwide/workdir/rusty-graph/tests/flash_attention_correctness.rs:14:22
[INFO] [stdout]   29:     0x63396cc1abd3 - flash_attention_correctness[33a0a5a98cb1a929]::tests::test_flash_attention_shape
[INFO] [stdout]                                at /opt/rustwide/workdir/rusty-graph/tests/flash_attention_correctness.rs:20:29
[INFO] [stdout]   30:     0x63396cc18d87 - flash_attention_correctness[33a0a5a98cb1a929]::tests::test_flash_attention_shape::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/workdir/rusty-graph/tests/flash_attention_correctness.rs:19:36
[INFO] [stdout]   31:     0x63396cc1db76 - <flash_attention_correctness[33a0a5a98cb1a929]::tests::test_flash_attention_shape::{closure#0} as core[35159d6ffb30e017]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   32:     0x63396cc1dc9b - <fn() -> core[35159d6ffb30e017]::result::Result<(), alloc[a8a7aba520129d98]::string::String> as core[35159d6ffb30e017]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   33:     0x63396cc1dc9b - test[a8007afcd3effadc]::__rust_begin_short_backtrace::<core[35159d6ffb30e017]::result::Result<(), alloc[a8a7aba520129d98]::string::String>, fn() -> core[35159d6ffb30e017]::result::Result<(), alloc[a8a7aba520129d98]::string::String>>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/test/src/lib.rs:724:18
[INFO] [stdout]   34:     0x63396cc2b48b - test[a8007afcd3effadc]::run_test_in_process::{closure#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/test/src/lib.rs:747:74
[INFO] [stdout]   35:     0x63396cc2b48b - <core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<test[a8007afcd3effadc]::run_test_in_process::{closure#0}> as core[35159d6ffb30e017]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   36:     0x63396cc2b48b - std[ec419fa8110287d5]::panicking::catch_unwind::do_call::<core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<test[a8007afcd3effadc]::run_test_in_process::{closure#0}>, core[35159d6ffb30e017]::result::Result<(), alloc[a8a7aba520129d98]::string::String>>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:581:40
[INFO] [stdout]   37:     0x63396cc2b48b - std[ec419fa8110287d5]::panicking::catch_unwind::<core[35159d6ffb30e017]::result::Result<(), alloc[a8a7aba520129d98]::string::String>, core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<test[a8007afcd3effadc]::run_test_in_process::{closure#0}>>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:544:19
[INFO] [stdout]   38:     0x63396cc2b48b - std[ec419fa8110287d5]::panic::catch_unwind::<core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<test[a8007afcd3effadc]::run_test_in_process::{closure#0}>, core[35159d6ffb30e017]::result::Result<(), alloc[a8a7aba520129d98]::string::String>>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panic.rs:359:14
[INFO] [stdout]   39:     0x63396cc2b48b - test[a8007afcd3effadc]::run_test_in_process
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/test/src/lib.rs:747:27
[INFO] [stdout]   40:     0x63396cc2b48b - test[a8007afcd3effadc]::run_test::{closure#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/test/src/lib.rs:668:43
[INFO] [stdout]   41:     0x63396cc25e64 - test[a8007afcd3effadc]::run_test::{closure#1}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/test/src/lib.rs:698:41
[INFO] [stdout]   42:     0x63396cc25e64 - std[ec419fa8110287d5]::sys::backtrace::__rust_begin_short_backtrace::<test[a8007afcd3effadc]::run_test::{closure#1}, ()>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/sys/backtrace.rs:166:18
[INFO] [stdout]   43:     0x63396cc2e092 - std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked::<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/thread/lifecycle.rs:70:13
[INFO] [stdout]   44:     0x63396cc2e092 - <core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}> as core[35159d6ffb30e017]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   45:     0x63396cc2e092 - std[ec419fa8110287d5]::panicking::catch_unwind::do_call::<core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:581:40
[INFO] [stdout]   46:     0x63396cc2e092 - std[ec419fa8110287d5]::panicking::catch_unwind::<(), core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:544:19
[INFO] [stdout]   47:     0x63396cc2e092 - std[ec419fa8110287d5]::panic::catch_unwind::<core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panic.rs:359:14
[INFO] [stdout]   48:     0x63396cc2e092 - std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked::<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/thread/lifecycle.rs:68:26
[INFO] [stdout]   49:     0x63396cc2e092 - <std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1} as core[35159d6ffb30e017]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   50:     0x63396d543f2f - <alloc[a8a7aba520129d98]::boxed::Box<dyn core[35159d6ffb30e017]::ops::function::FnOnce<(), Output = ()> + core[35159d6ffb30e017]::marker::Send> as core[35159d6ffb30e017]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/alloc/src/boxed.rs:2271:9
[INFO] [stdout]   51:     0x63396d543f2f - <std[ec419fa8110287d5]::sys::thread::unix::Thread>::new::thread_start
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/sys/thread/unix.rs:118:17
[INFO] [stdout]   52:     0x720ce4c3daa4 - <unknown>
[INFO] [stdout]   53:     0x720ce4ccaa64 - clone
[INFO] [stdout]   54:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] ---- tests::test_different_sequence_lengths stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'tests::test_different_sequence_lengths' (28) panicked at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/backend/wgpu_core.rs:3006:5:
[INFO] [stdout] wgpu error: Validation Error
[INFO] [stdout] 
[INFO] [stdout] Caused by:
[INFO] [stdout]     In Device::create_shader_module
[INFO] [stdout]       note: label = `Kernels`
[INFO] [stdout]     
[INFO] [stdout] Shader 'Kernels' parsing error: no definition in scope for identifier: 'delta'
[INFO] [stdout]      ┌─ wgsl:1382:5
[INFO] [stdout]      │
[INFO] [stdout] 1382 │     delta[write_idx] = d_val;
[INFO] [stdout]      │     ^^^^^ unknown identifier
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout]     no definition in scope for identifier: 'delta'
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x63396d54464a - std[ec419fa8110287d5]::backtrace_rs::backtrace::libunwind::trace
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9
[INFO] [stdout]    1:     0x63396d54464a - std[ec419fa8110287d5]::backtrace_rs::backtrace::trace_unsynchronized::<std[ec419fa8110287d5]::sys::backtrace::_print_fmt::{closure#1}>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14
[INFO] [stdout]    2:     0x63396d54464a - std[ec419fa8110287d5]::sys::backtrace::_print_fmt
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/sys/backtrace.rs:74:9
[INFO] [stdout]    3:     0x63396d54464a - <<std[ec419fa8110287d5]::sys::backtrace::BacktraceLock>::print::DisplayBacktrace as core[35159d6ffb30e017]::fmt::Display>::fmt
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/sys/backtrace.rs:44:26
[INFO] [stdout]    4:     0x63396d55b74a - <core[35159d6ffb30e017]::fmt::rt::Argument>::fmt
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/fmt/rt.rs:152:76
[INFO] [stdout]    5:     0x63396d55b74a - core[35159d6ffb30e017]::fmt::write
[INFO] [stdout]    6:     0x63396d548fb2 - std[ec419fa8110287d5]::io::default_write_fmt::<alloc[a8a7aba520129d98]::vec::Vec<u8>>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/io/mod.rs:621:11
[INFO] [stdout]    7:     0x63396d548fb2 - <alloc[a8a7aba520129d98]::vec::Vec<u8> as std[ec419fa8110287d5]::io::Write>::write_fmt
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/io/mod.rs:1976:13
[INFO] [stdout]    8:     0x63396d5233cf - <std[ec419fa8110287d5]::sys::backtrace::BacktraceLock>::print
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/sys/backtrace.rs:47:9
[INFO] [stdout]    9:     0x63396d5233cf - std[ec419fa8110287d5]::panicking::default_hook::{closure#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:292:27
[INFO] [stdout]   10:     0x63396d53c979 - std[ec419fa8110287d5]::panicking::default_hook
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:316:9
[INFO] [stdout]   11:     0x63396cc2a9bc - <alloc[a8a7aba520129d98]::boxed::Box<dyn for<'a, 'b> core[35159d6ffb30e017]::ops::function::Fn<(&'a std[ec419fa8110287d5]::panic::PanicHookInfo<'b>,), Output = ()> + core[35159d6ffb30e017]::marker::Sync + core[35159d6ffb30e017]::marker::Send> as core[35159d6ffb30e017]::ops::function::Fn<(&std[ec419fa8110287d5]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/alloc/src/boxed.rs:2285:9
[INFO] [stdout]   12:     0x63396cc2a9bc - test[a8007afcd3effadc]::test_main_inner::<test[a8007afcd3effadc]::test_main_static::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/test/src/lib.rs:155:21
[INFO] [stdout]   13:     0x63396d53cb32 - <alloc[a8a7aba520129d98]::boxed::Box<dyn for<'a, 'b> core[35159d6ffb30e017]::ops::function::Fn<(&'a std[ec419fa8110287d5]::panic::PanicHookInfo<'b>,), Output = ()> + core[35159d6ffb30e017]::marker::Sync + core[35159d6ffb30e017]::marker::Send> as core[35159d6ffb30e017]::ops::function::Fn<(&std[ec419fa8110287d5]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/alloc/src/boxed.rs:2285:9
[INFO] [stdout]   14:     0x63396d53cb32 - std[ec419fa8110287d5]::panicking::panic_with_hook
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:833:13
[INFO] [stdout]   15:     0x63396d523488 - std[ec419fa8110287d5]::panicking::panic_handler::{closure#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:698:13
[INFO] [stdout]   16:     0x63396d51adf9 - std[ec419fa8110287d5]::sys::backtrace::__rust_end_short_backtrace::<std[ec419fa8110287d5]::panicking::panic_handler::{closure#0}, !>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/sys/backtrace.rs:182:18
[INFO] [stdout]   17:     0x63396d52419d - __rustc[cfb3622dd870db93]::rust_begin_unwind
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:689:5
[INFO] [stdout]   18:     0x63396d55bf0c - core[35159d6ffb30e017]::panicking::panic_fmt
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/panicking.rs:80:14
[INFO] [stdout]   19:     0x63396cdba0f4 - wgpu[ccc4085f254c30c6]::backend::wgpu_core::default_error_handler
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/backend/wgpu_core.rs:3006:5
[INFO] [stdout]   20:     0x63396cf0ce4a - <wgpu[ccc4085f254c30c6]::backend::wgpu_core::default_error_handler as core[35159d6ffb30e017]::ops::function::Fn<(wgpu[ccc4085f254c30c6]::Error,)>>::call
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/ops/function.rs:79:5
[INFO] [stdout]   21:     0x63396cf4475f - <alloc[a8a7aba520129d98]::boxed::Box<dyn wgpu[ccc4085f254c30c6]::UncapturedErrorHandler<Output = ()>> as core[35159d6ffb30e017]::ops::function::Fn<(wgpu[ccc4085f254c30c6]::Error,)>>::call
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/alloc/src/boxed.rs:2285:9
[INFO] [stdout]   22:     0x63396cdb7c28 - <wgpu[ccc4085f254c30c6]::backend::wgpu_core::ErrorSinkRaw>::handle_error
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/backend/wgpu_core.rs:2992:17
[INFO] [stdout]   23:     0x63396cda3adf - <wgpu[ccc4085f254c30c6]::backend::wgpu_core::ContextWgpuCore>::handle_error::<wgpu_core[1485c20d5417a3cb]::pipeline::CreateShaderModuleError>
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/backend/wgpu_core.rs:262:14
[INFO] [stdout]   24:     0x63396cdd1e7e - <wgpu[ccc4085f254c30c6]::backend::wgpu_core::ContextWgpuCore as wgpu[ccc4085f254c30c6]::context::Context>::device_create_shader_module
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/backend/wgpu_core.rs:874:18
[INFO] [stdout]   25:     0x63396cdc02f5 - <wgpu[ccc4085f254c30c6]::backend::wgpu_core::ContextWgpuCore as wgpu[ccc4085f254c30c6]::context::DynContext>::device_create_shader_module
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/context.rs:2191:37
[INFO] [stdout]   26:     0x63396cfe3c32 - <wgpu[ccc4085f254c30c6]::Device>::create_shader_module
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/wgpu-0.19.4/src/lib.rs:2325:26
[INFO] [stdout]   27:     0x63396cc67ff6 - <rusty_backend[2d1285208260fdc1]::ComputeEngine>::new
[INFO] [stdout]                                at /opt/rustwide/workdir/rusty-backend/src/lib.rs:352:14
[INFO] [stdout]   28:     0x63396cc19acc - flash_attention_correctness[33a0a5a98cb1a929]::tests::setup
[INFO] [stdout]                                at /opt/rustwide/workdir/rusty-graph/tests/flash_attention_correctness.rs:14:22
[INFO] [stdout]   29:     0x63396cc1b992 - flash_attention_correctness[33a0a5a98cb1a929]::tests::test_different_sequence_lengths
[INFO] [stdout]                                at /opt/rustwide/workdir/rusty-graph/tests/flash_attention_correctness.rs:141:29
[INFO] [stdout]   30:     0x63396cc18de7 - flash_attention_correctness[33a0a5a98cb1a929]::tests::test_different_sequence_lengths::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/workdir/rusty-graph/tests/flash_attention_correctness.rs:140:41
[INFO] [stdout]   31:     0x63396cc1dbf6 - <flash_attention_correctness[33a0a5a98cb1a929]::tests::test_different_sequence_lengths::{closure#0} as core[35159d6ffb30e017]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   32:     0x63396cc1dc9b - <fn() -> core[35159d6ffb30e017]::result::Result<(), alloc[a8a7aba520129d98]::string::String> as core[35159d6ffb30e017]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   33:     0x63396cc1dc9b - test[a8007afcd3effadc]::__rust_begin_short_backtrace::<core[35159d6ffb30e017]::result::Result<(), alloc[a8a7aba520129d98]::string::String>, fn() -> core[35159d6ffb30e017]::result::Result<(), alloc[a8a7aba520129d98]::string::String>>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/test/src/lib.rs:724:18
[INFO] [stdout]   34:     0x63396cc2b48b - test[a8007afcd3effadc]::run_test_in_process::{closure#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/test/src/lib.rs:747:74
[INFO] [stdout]   35:     0x63396cc2b48b - <core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<test[a8007afcd3effadc]::run_test_in_process::{closure#0}> as core[35159d6ffb30e017]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   36:     0x63396cc2b48b - std[ec419fa8110287d5]::panicking::catch_unwind::do_call::<core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<test[a8007afcd3effadc]::run_test_in_process::{closure#0}>, core[35159d6ffb30e017]::result::Result<(), alloc[a8a7aba520129d98]::string::String>>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:581:40
[INFO] [stdout]   37:     0x63396cc2b48b - std[ec419fa8110287d5]::panicking::catch_unwind::<core[35159d6ffb30e017]::result::Result<(), alloc[a8a7aba520129d98]::string::String>, core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<test[a8007afcd3effadc]::run_test_in_process::{closure#0}>>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:544:19
[INFO] [stdout]   38:     0x63396cc2b48b - std[ec419fa8110287d5]::panic::catch_unwind::<core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<test[a8007afcd3effadc]::run_test_in_process::{closure#0}>, core[35159d6ffb30e017]::result::Result<(), alloc[a8a7aba520129d98]::string::String>>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panic.rs:359:14
[INFO] [stdout]   39:     0x63396cc2b48b - test[a8007afcd3effadc]::run_test_in_process
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/test/src/lib.rs:747:27
[INFO] [stdout]   40:     0x63396cc2b48b - test[a8007afcd3effadc]::run_test::{closure#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/test/src/lib.rs:668:43
[INFO] [stdout]   41:     0x63396cc25e64 - test[a8007afcd3effadc]::run_test::{closure#1}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/test/src/lib.rs:698:41
[INFO] [stdout]   42:     0x63396cc25e64 - std[ec419fa8110287d5]::sys::backtrace::__rust_begin_short_backtrace::<test[a8007afcd3effadc]::run_test::{closure#1}, ()>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/sys/backtrace.rs:166:18
[INFO] [stdout]   43:     0x63396cc2e092 - std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked::<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/thread/lifecycle.rs:70:13
[INFO] [stdout]   44:     0x63396cc2e092 - <core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}> as core[35159d6ffb30e017]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   45:     0x63396cc2e092 - std[ec419fa8110287d5]::panicking::catch_unwind::do_call::<core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:581:40
[INFO] [stdout]   46:     0x63396cc2e092 - std[ec419fa8110287d5]::panicking::catch_unwind::<(), core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panicking.rs:544:19
[INFO] [stdout]   47:     0x63396cc2e092 - std[ec419fa8110287d5]::panic::catch_unwind::<core[35159d6ffb30e017]::panic::unwind_safe::AssertUnwindSafe<std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/panic.rs:359:14
[INFO] [stdout]   48:     0x63396cc2e092 - std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked::<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/thread/lifecycle.rs:68:26
[INFO] [stdout]   49:     0x63396cc2e092 - <std[ec419fa8110287d5]::thread::lifecycle::spawn_unchecked<test[a8007afcd3effadc]::run_test::{closure#1}, ()>::{closure#1} as core[35159d6ffb30e017]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0}
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   50:     0x63396d543f2f - <alloc[a8a7aba520129d98]::boxed::Box<dyn core[35159d6ffb30e017]::ops::function::FnOnce<(), Output = ()> + core[35159d6ffb30e017]::marker::Send> as core[35159d6ffb30e017]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/alloc/src/boxed.rs:2271:9
[INFO] [stdout]   51:     0x63396d543f2f - <std[ec419fa8110287d5]::sys::thread::unix::Thread>::new::thread_start
[INFO] [stdout]                                at /rustc/33835004928d3bf65db4d4712e1330766263b0bd/library/std/src/sys/thread/unix.rs:118:17
[INFO] [stdout]   52:     0x720ce4c3daa4 - <unknown>
[INFO] [stdout]   53:     0x720ce4ccaa64 - clone
[INFO] [stdout]   54:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout]     tests::test_attention_normalization
[INFO] [stdout]     tests::test_backward_pass_shapes
[INFO] [stdout]     tests::test_causal_masking
[INFO] [stdout]     tests::test_different_sequence_lengths
[INFO] [stdout]     tests::test_flash_attention_shape
[INFO] [stdout] 
[INFO] [stdout] test result: FAILED. 2 passed; 5 failed; 0 ignored; 0 measured; 0 filtered out; finished in 1.94s
[INFO] [stdout] 
[INFO] [stderr] error: test failed, to rerun pass `-p rusty-graph --test flash_attention_correctness`
[INFO] running `Command { std: "docker" "inspect" "ef88a7a5bbb2931d4cea68ad601b9ae2331528351cdbd3e7799d25c96411ee50", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "ef88a7a5bbb2931d4cea68ad601b9ae2331528351cdbd3e7799d25c96411ee50", kill_on_drop: false }`
[INFO] [stdout] ef88a7a5bbb2931d4cea68ad601b9ae2331528351cdbd3e7799d25c96411ee50
