[INFO] cloning repository https://github.com/DeShuiYu/flash-attention-wrapper-rs
[INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/DeShuiYu/flash-attention-wrapper-rs" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FDeShuiYu%2Fflash-attention-wrapper-rs", kill_on_drop: false }`
[INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FDeShuiYu%2Fflash-attention-wrapper-rs'...
[INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }`
[INFO] [stdout] ffff9c79a7093eeab42121d546e4127c273242e0
[INFO] testing DeShuiYu/flash-attention-wrapper-rs against try#9f93af291970322f4f1c6315ccde4d7078201159 for pr-146098-6
[INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FDeShuiYu%2Fflash-attention-wrapper-rs" "/workspace/builds/worker-2-tc2/source", kill_on_drop: false }`
[INFO] [stderr] Cloning into '/workspace/builds/worker-2-tc2/source'...
[INFO] [stderr] done.
[INFO] removed /workspace/builds/worker-2-tc2/source/.cargo/config.toml
[INFO] started tweaking git repo https://github.com/DeShuiYu/flash-attention-wrapper-rs
[INFO] finished tweaking git repo https://github.com/DeShuiYu/flash-attention-wrapper-rs
[INFO] tweaked toml for git repo https://github.com/DeShuiYu/flash-attention-wrapper-rs written to /workspace/builds/worker-2-tc2/source/Cargo.toml
[INFO] validating manifest of git repo https://github.com/DeShuiYu/flash-attention-wrapper-rs on toolchain 9f93af291970322f4f1c6315ccde4d7078201159
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+9f93af291970322f4f1c6315ccde4d7078201159" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] crate git repo https://github.com/DeShuiYu/flash-attention-wrapper-rs already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+9f93af291970322f4f1c6315ccde4d7078201159" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:4848fb76d95f26979359cc7e45710b1dbc8f3acb7aeedee7c460d7702230f228" "/opt/rustwide/cargo-home/bin/cargo" "+9f93af291970322f4f1c6315ccde4d7078201159" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] [stdout] 50a774867772a15060c19cb471a5500760dd00e2b4a4678126d358e0459f96eb
[INFO] running `Command { std: "docker" "start" "-a" "50a774867772a15060c19cb471a5500760dd00e2b4a4678126d358e0459f96eb", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "50a774867772a15060c19cb471a5500760dd00e2b4a4678126d358e0459f96eb", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "50a774867772a15060c19cb471a5500760dd00e2b4a4678126d358e0459f96eb", kill_on_drop: false }`
[INFO] [stdout] 50a774867772a15060c19cb471a5500760dd00e2b4a4678126d358e0459f96eb
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:4848fb76d95f26979359cc7e45710b1dbc8f3acb7aeedee7c460d7702230f228" "/opt/rustwide/cargo-home/bin/cargo" "+9f93af291970322f4f1c6315ccde4d7078201159" "build" "--frozen" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] e8325ab5191b333afab751d8ebf288a78f737e2d6b7826e4452ad89e560a5d1e
[INFO] running `Command { std: "docker" "start" "-a" "e8325ab5191b333afab751d8ebf288a78f737e2d6b7826e4452ad89e560a5d1e", kill_on_drop: false }`
[INFO] [stderr]    Compiling crossbeam-utils v0.8.21
[INFO] [stderr]    Compiling libc v0.2.171
[INFO] [stderr]    Compiling object v0.36.7
[INFO] [stderr]    Compiling rayon-core v1.12.1
[INFO] [stderr]    Compiling adler2 v2.0.0
[INFO] [stderr]    Compiling gimli v0.31.1
[INFO] [stderr]    Compiling memchr v2.7.4
[INFO] [stderr]    Compiling anyhow v1.0.97
[INFO] [stderr]    Compiling miniz_oxide v0.8.5
[INFO] [stderr]    Compiling rustc-demangle v0.1.24
[INFO] [stderr]    Compiling either v1.15.0
[INFO] [stderr]    Compiling cfg-if v1.0.0
[INFO] [stderr]    Compiling glob v0.3.2
[INFO] [stderr]    Compiling crossbeam-epoch v0.9.18
[INFO] [stderr]    Compiling crossbeam-deque v0.8.6
[INFO] [stderr]    Compiling num_cpus v1.16.0
[INFO] [stderr]    Compiling rayon v1.10.0
[INFO] [stderr]    Compiling addr2line v0.24.2
[INFO] [stderr]    Compiling backtrace v0.3.74
[INFO] [stderr]    Compiling bindgen_cuda v0.1.5
[INFO] [stderr]    Compiling flash-attention-wrapper-rs v0.1.0 (/opt/rustwide/workdir)
[INFO] [stderr] error: failed to run custom build command for `flash-attention-wrapper-rs v0.1.0 (/opt/rustwide/workdir)`
[INFO] [stderr] note: To improve backtraces for build dependencies, set the CARGO_PROFILE_DEV_BUILD_OVERRIDE_DEBUG=true environment variable to enable debug information generation.
[INFO] [stderr] 
[INFO] [stderr] Caused by:
[INFO] [stderr]   process didn't exit successfully: `/opt/rustwide/target/debug/build/flash-attention-wrapper-rs-cae21b650dce4659/build-script-build` (exit status: 101)
[INFO] [stderr]   --- stdout
[INFO] [stderr]   cargo:rerun-if-changed=build.rs
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_api.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim128_fp16_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim160_fp16_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim192_fp16_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim224_fp16_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim256_fp16_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim32_fp16_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim64_fp16_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim96_fp16_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim128_bf16_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim160_bf16_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim192_bf16_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim224_bf16_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim256_bf16_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim32_bf16_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim64_bf16_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim96_bf16_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim128_fp16_causal_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim160_fp16_causal_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim192_fp16_causal_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim224_fp16_causal_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim256_fp16_causal_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim32_fp16_causal_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim64_fp16_causal_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim96_fp16_causal_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim128_bf16_causal_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim160_bf16_causal_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim192_bf16_causal_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim224_bf16_causal_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim256_bf16_causal_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim32_bf16_causal_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim64_bf16_causal_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim96_bf16_causal_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_kernel.h
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_launch_template.h
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash.h
[INFO] [stderr]   cargo:rerun-if-changed=kernels/philox.cuh
[INFO] [stderr]   cargo:rerun-if-changed=kernels/softmax.h
[INFO] [stderr]   cargo:rerun-if-changed=kernels/utils.h
[INFO] [stderr]   cargo:rerun-if-changed=kernels/kernel_traits.h
[INFO] [stderr]   cargo:rerun-if-changed=kernels/block_info.h
[INFO] [stderr]   cargo:rerun-if-changed=kernels/static_switch.h
[INFO] [stderr]   cargo:rerun-if-changed=kernels/hardware_info.h
[INFO] [stderr]   cargo:info=["/usr", "/usr/local/cuda", "/opt/cuda", "/usr/lib/cuda", "C:/Program Files/NVIDIA GPU Computing Toolkit", "C:/CUDA"]
[INFO] [stderr]   cargo:rerun-if-env-changed=CUDA_COMPUTE_CAP
[INFO] [stderr] 
[INFO] [stderr]   --- stderr
[INFO] [stderr] 
[INFO] [stderr]   thread 'main' (372) panicked at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/bindgen_cuda-0.1.5/src/lib.rs:489:18:
[INFO] [stderr]   `nvidia-smi` failed. Ensure that you have CUDA installed and that `nvidia-smi` is in your PATH.: Os { code: 2, kind: NotFound, message: "No such file or directory" }
[INFO] [stderr]   stack backtrace:
[INFO] [stderr]      0:     0x5a68e07c6812 - std::backtrace_rs::backtrace::libunwind::trace::h16affffe904e891e
[INFO] [stderr]                                  at /rustc/9f93af291970322f4f1c6315ccde4d7078201159/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9
[INFO] [stderr]      1:     0x5a68e07c6812 - std::backtrace_rs::backtrace::trace_unsynchronized::h5c14b13373ed4150
[INFO] [stderr]                                  at /rustc/9f93af291970322f4f1c6315ccde4d7078201159/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14
[INFO] [stderr]      2:     0x5a68e07c6812 - std::sys::backtrace::_print_fmt::hcbb507f162c816cc
[INFO] [stderr]                                  at /rustc/9f93af291970322f4f1c6315ccde4d7078201159/library/std/src/sys/backtrace.rs:66:9
[INFO] [stderr]      3:     0x5a68e07c6812 - <std::sys::backtrace::BacktraceLock::print::DisplayBacktrace as core::fmt::Display>::fmt::h8be9aa933f14675f
[INFO] [stderr]                                  at /rustc/9f93af291970322f4f1c6315ccde4d7078201159/library/std/src/sys/backtrace.rs:39:26
[INFO] [stderr]      4:     0x5a68e07d606f - core::fmt::rt::Argument::fmt::h30ed739d33467c3a
[INFO] [stderr]                                  at /rustc/9f93af291970322f4f1c6315ccde4d7078201159/library/core/src/fmt/rt.rs:173:76
[INFO] [stderr]      5:     0x5a68e07d606f - core::fmt::write::hfd0efbb002ac7eea
[INFO] [stderr]                                  at /rustc/9f93af291970322f4f1c6315ccde4d7078201159/library/core/src/fmt/mod.rs:1469:25
[INFO] [stderr]      6:     0x5a68e0793ae3 - std::io::default_write_fmt::hf7668c9f69c3a921
[INFO] [stderr]                                  at /rustc/9f93af291970322f4f1c6315ccde4d7078201159/library/std/src/io/mod.rs:639:11
[INFO] [stderr]      7:     0x5a68e0793ae3 - std::io::Write::write_fmt::ha6503cd07dd1d506
[INFO] [stderr]                                  at /rustc/9f93af291970322f4f1c6315ccde4d7078201159/library/std/src/io/mod.rs:1954:13
[INFO] [stderr]      8:     0x5a68e079f282 - std::sys::backtrace::BacktraceLock::print::hf2554f6030d393f7
[INFO] [stderr]                                  at /rustc/9f93af291970322f4f1c6315ccde4d7078201159/library/std/src/sys/backtrace.rs:42:9
[INFO] [stderr]      9:     0x5a68e07a488f - std::panicking::default_hook::{{closure}}::h8873121c56335b01
[INFO] [stderr]                                  at /rustc/9f93af291970322f4f1c6315ccde4d7078201159/library/std/src/panicking.rs:301:27
[INFO] [stderr]     10:     0x5a68e07a46e9 - std::panicking::default_hook::hbafefc2d196267a2
[INFO] [stderr]                                  at /rustc/9f93af291970322f4f1c6315ccde4d7078201159/library/std/src/panicking.rs:328:9
[INFO] [stderr]     11:     0x5a68e07a4f15 - std::panicking::panic_with_hook::h9f5b09d5adc1a745
[INFO] [stderr]                                  at /rustc/9f93af291970322f4f1c6315ccde4d7078201159/library/std/src/panicking.rs:834:13
[INFO] [stderr]     12:     0x5a68e07a4cfa - std::panicking::panic_handler::{{closure}}::h08111e483bdf6a89
[INFO] [stderr]                                  at /rustc/9f93af291970322f4f1c6315ccde4d7078201159/library/std/src/panicking.rs:707:13
[INFO] [stderr]     13:     0x5a68e079f3b9 - std::sys::backtrace::__rust_end_short_backtrace::h1b86e3414ecbbe8d
[INFO] [stderr]                                  at /rustc/9f93af291970322f4f1c6315ccde4d7078201159/library/std/src/sys/backtrace.rs:174:18
[INFO] [stderr]     14:     0x5a68e078807d - __rustc[b292c645e8102103]::rust_begin_unwind
[INFO] [stderr]                                  at /rustc/9f93af291970322f4f1c6315ccde4d7078201159/library/std/src/panicking.rs:698:5
[INFO] [stderr]     15:     0x5a68e07da050 - core::panicking::panic_fmt::h31cc490ecc8cc1fa
[INFO] [stderr]                                  at /rustc/9f93af291970322f4f1c6315ccde4d7078201159/library/core/src/panicking.rs:80:14
[INFO] [stderr]     16:     0x5a68e07d94f6 - core::result::unwrap_failed::he05762ef9e6bdf9c
[INFO] [stderr]                                  at /rustc/9f93af291970322f4f1c6315ccde4d7078201159/library/core/src/result.rs:1862:5
[INFO] [stderr]     17:     0x5a68e0733d12 - core::result::Result<T,E>::expect::h9535cbb091e361e7
[INFO] [stderr]     18:     0x5a68e0731813 - bindgen_cuda::compute_cap::hc2138ccbf35bbc94
[INFO] [stderr]     19:     0x5a68e07342f7 - <bindgen_cuda::Builder as core::default::Default>::default::he58ffd3a58454bbd
[INFO] [stderr]     20:     0x5a68e07269c0 - build_script_build::main::hd5a640ec4edca9bb
[INFO] [stderr]     21:     0x5a68e07186d3 - core::ops::function::FnOnce::call_once::h8e88f7c6bf15c4af
[INFO] [stderr]     22:     0x5a68e07183e6 - std::sys::backtrace::__rust_begin_short_backtrace::h20c094342d45b517
[INFO] [stderr]     23:     0x5a68e0727189 - std::rt::lang_start::{{closure}}::h8febf5da688d6807
[INFO] [stderr]     24:     0x5a68e0795330 - core::ops::function::impls::<impl core::ops::function::FnOnce<A> for &F>::call_once::hfe01ef9c04091e5f
[INFO] [stderr]                                  at /rustc/9f93af291970322f4f1c6315ccde4d7078201159/library/core/src/ops/function.rs:287:21
[INFO] [stderr]     25:     0x5a68e0795330 - std::panicking::catch_unwind::do_call::h3720541c1dc2745c
[INFO] [stderr]                                  at /rustc/9f93af291970322f4f1c6315ccde4d7078201159/library/std/src/panicking.rs:590:40
[INFO] [stderr]     26:     0x5a68e0795330 - std::panicking::catch_unwind::hf812e1c72a8544c2
[INFO] [stderr]                                  at /rustc/9f93af291970322f4f1c6315ccde4d7078201159/library/std/src/panicking.rs:553:19
[INFO] [stderr]     27:     0x5a68e0795330 - std::panic::catch_unwind::h9e80dffea8831154
[INFO] [stderr]                                  at /rustc/9f93af291970322f4f1c6315ccde4d7078201159/library/std/src/panic.rs:359:14
[INFO] [stderr]     28:     0x5a68e0795330 - std::rt::lang_start_internal::{{closure}}::h03410fa218b2c977
[INFO] [stderr]                                  at /rustc/9f93af291970322f4f1c6315ccde4d7078201159/library/std/src/rt.rs:175:24
[INFO] [stderr]     29:     0x5a68e0795330 - std::panicking::catch_unwind::do_call::hcc46efa18e4a9c15
[INFO] [stderr]                                  at /rustc/9f93af291970322f4f1c6315ccde4d7078201159/library/std/src/panicking.rs:590:40
[INFO] [stderr]     30:     0x5a68e0795330 - std::panicking::catch_unwind::hc0afbf6668eb863a
[INFO] [stderr]                                  at /rustc/9f93af291970322f4f1c6315ccde4d7078201159/library/std/src/panicking.rs:553:19
[INFO] [stderr]     31:     0x5a68e0795330 - std::panic::catch_unwind::h9640c0d1343096b8
[INFO] [stderr]                                  at /rustc/9f93af291970322f4f1c6315ccde4d7078201159/library/std/src/panic.rs:359:14
[INFO] [stderr]     32:     0x5a68e0795330 - std::rt::lang_start_internal::hea659f61d058debe
[INFO] [stderr]                                  at /rustc/9f93af291970322f4f1c6315ccde4d7078201159/library/std/src/rt.rs:171:5
[INFO] [stderr]     33:     0x5a68e0727171 - std::rt::lang_start::h33144e3915e39215
[INFO] [stderr]     34:     0x5a68e0729ff5 - main
[INFO] [stderr]     35:     0x747e9bcb61ca - <unknown>
[INFO] [stderr]     36:     0x747e9bcb628b - __libc_start_main
[INFO] [stderr]     37:     0x5a68e0717ab5 - _start
[INFO] [stderr]     38:                0x0 - <unknown>
[INFO] running `Command { std: "docker" "inspect" "e8325ab5191b333afab751d8ebf288a78f737e2d6b7826e4452ad89e560a5d1e", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "e8325ab5191b333afab751d8ebf288a78f737e2d6b7826e4452ad89e560a5d1e", kill_on_drop: false }`
[INFO] [stdout] e8325ab5191b333afab751d8ebf288a78f737e2d6b7826e4452ad89e560a5d1e
