[INFO] cloning repository https://github.com/DeShuiYu/flash-attention-wrapper-rs
[INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/DeShuiYu/flash-attention-wrapper-rs" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FDeShuiYu%2Fflash-attention-wrapper-rs", kill_on_drop: false }`
[INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FDeShuiYu%2Fflash-attention-wrapper-rs'...
[INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }`
[INFO] [stdout] ffff9c79a7093eeab42121d546e4127c273242e0
[INFO] checking DeShuiYu/flash-attention-wrapper-rs against master#04ff05c9c0cfbca33115c5f1b8bb20a66a54b799 for pr-147834
[INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FDeShuiYu%2Fflash-attention-wrapper-rs" "/workspace/builds/worker-2-tc1/source", kill_on_drop: false }`
[INFO] [stderr] Cloning into '/workspace/builds/worker-2-tc1/source'...
[INFO] [stderr] done.
[INFO] removed /workspace/builds/worker-2-tc1/source/.cargo/config.toml
[INFO] started tweaking git repo https://github.com/DeShuiYu/flash-attention-wrapper-rs
[INFO] finished tweaking git repo https://github.com/DeShuiYu/flash-attention-wrapper-rs
[INFO] tweaked toml for git repo https://github.com/DeShuiYu/flash-attention-wrapper-rs written to /workspace/builds/worker-2-tc1/source/Cargo.toml
[INFO] validating manifest of git repo https://github.com/DeShuiYu/flash-attention-wrapper-rs on toolchain 04ff05c9c0cfbca33115c5f1b8bb20a66a54b799
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+04ff05c9c0cfbca33115c5f1b8bb20a66a54b799" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] crate git repo https://github.com/DeShuiYu/flash-attention-wrapper-rs already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+04ff05c9c0cfbca33115c5f1b8bb20a66a54b799" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] [stderr]     Updating crates.io index
[INFO] [stderr]  Downloading crates ...
[INFO] [stderr]   Downloaded bindgen_cuda v0.1.5
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:e90291280db7d1fac5b66fc6dad9f9662629e7365a55743daf9bdf73ebc4ea79" "/opt/rustwide/cargo-home/bin/cargo" "+04ff05c9c0cfbca33115c5f1b8bb20a66a54b799" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] [stdout] e8a11155f158217989347f369f18b96bf41240808c43cadac6fe50c660e89aaa
[INFO] running `Command { std: "docker" "start" "-a" "e8a11155f158217989347f369f18b96bf41240808c43cadac6fe50c660e89aaa", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "e8a11155f158217989347f369f18b96bf41240808c43cadac6fe50c660e89aaa", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "e8a11155f158217989347f369f18b96bf41240808c43cadac6fe50c660e89aaa", kill_on_drop: false }`
[INFO] [stdout] e8a11155f158217989347f369f18b96bf41240808c43cadac6fe50c660e89aaa
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:e90291280db7d1fac5b66fc6dad9f9662629e7365a55743daf9bdf73ebc4ea79" "/opt/rustwide/cargo-home/bin/cargo" "+04ff05c9c0cfbca33115c5f1b8bb20a66a54b799" "check" "--frozen" "--all" "--all-targets" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] 1b59e44583ccac567838ea545f651a69095c0ec15b6636da7f5c28a951c46fd4
[INFO] running `Command { std: "docker" "start" "-a" "1b59e44583ccac567838ea545f651a69095c0ec15b6636da7f5c28a951c46fd4", kill_on_drop: false }`
[INFO] [stderr]    Compiling object v0.36.7
[INFO] [stderr]    Compiling anyhow v1.0.97
[INFO] [stderr]    Compiling memchr v2.7.4
[INFO] [stderr]    Compiling gimli v0.31.1
[INFO] [stderr]    Compiling adler2 v2.0.0
[INFO] [stderr]    Compiling rustc-demangle v0.1.24
[INFO] [stderr]    Compiling either v1.15.0
[INFO] [stderr]    Compiling libc v0.2.171
[INFO] [stderr]    Compiling crossbeam-utils v0.8.21
[INFO] [stderr]    Compiling rayon-core v1.12.1
[INFO] [stderr]     Checking miniz_oxide v0.8.5
[INFO] [stderr]    Compiling crossbeam-epoch v0.9.18
[INFO] [stderr]    Compiling num_cpus v1.16.0
[INFO] [stderr]    Compiling crossbeam-deque v0.8.6
[INFO] [stderr]    Compiling rayon v1.10.0
[INFO] [stderr]     Checking addr2line v0.24.2
[INFO] [stderr]    Compiling backtrace v0.3.74
[INFO] [stderr]    Compiling bindgen_cuda v0.1.5
[INFO] [stderr]    Compiling flash-attention-wrapper-rs v0.1.0 (/opt/rustwide/workdir)
[INFO] [stderr] error: failed to run custom build command for `flash-attention-wrapper-rs v0.1.0 (/opt/rustwide/workdir)`
[INFO] [stderr] note: To improve backtraces for build dependencies, set the CARGO_PROFILE_DEV_BUILD_OVERRIDE_DEBUG=true environment variable to enable debug information generation.
[INFO] [stderr] 
[INFO] [stderr] Caused by:
[INFO] [stderr]   process didn't exit successfully: `/opt/rustwide/target/debug/build/flash-attention-wrapper-rs-b269d5a786921ca0/build-script-build` (exit status: 101)
[INFO] [stderr]   --- stdout
[INFO] [stderr]   cargo:rerun-if-changed=build.rs
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_api.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim128_fp16_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim160_fp16_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim192_fp16_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim224_fp16_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim256_fp16_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim32_fp16_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim64_fp16_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim96_fp16_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim128_bf16_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim160_bf16_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim192_bf16_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim224_bf16_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim256_bf16_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim32_bf16_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim64_bf16_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim96_bf16_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim128_fp16_causal_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim160_fp16_causal_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim192_fp16_causal_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim224_fp16_causal_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim256_fp16_causal_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim32_fp16_causal_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim64_fp16_causal_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim96_fp16_causal_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim128_bf16_causal_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim160_bf16_causal_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim192_bf16_causal_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim224_bf16_causal_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim256_bf16_causal_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim32_bf16_causal_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim64_bf16_causal_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_hdim96_bf16_causal_sm80.cu
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_kernel.h
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash_fwd_launch_template.h
[INFO] [stderr]   cargo:rerun-if-changed=kernels/flash.h
[INFO] [stderr]   cargo:rerun-if-changed=kernels/philox.cuh
[INFO] [stderr]   cargo:rerun-if-changed=kernels/softmax.h
[INFO] [stderr]   cargo:rerun-if-changed=kernels/utils.h
[INFO] [stderr]   cargo:rerun-if-changed=kernels/kernel_traits.h
[INFO] [stderr]   cargo:rerun-if-changed=kernels/block_info.h
[INFO] [stderr]   cargo:rerun-if-changed=kernels/static_switch.h
[INFO] [stderr]   cargo:rerun-if-changed=kernels/hardware_info.h
[INFO] [stderr]   cargo:info=["/usr", "/usr/local/cuda", "/opt/cuda", "/usr/lib/cuda", "C:/Program Files/NVIDIA GPU Computing Toolkit", "C:/CUDA"]
[INFO] [stderr]   cargo:rerun-if-env-changed=CUDA_COMPUTE_CAP
[INFO] [stderr] 
[INFO] [stderr]   --- stderr
[INFO] [stderr] 
[INFO] [stderr]   thread 'main' (423) panicked at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/bindgen_cuda-0.1.5/src/lib.rs:489:18:
[INFO] [stderr]   `nvidia-smi` failed. Ensure that you have CUDA installed and that `nvidia-smi` is in your PATH.: Os { code: 2, kind: NotFound, message: "No such file or directory" }
[INFO] [stderr]   stack backtrace:
[INFO] [stderr]      0:     0x5683277e67f2 - std::backtrace_rs::backtrace::libunwind::trace::h5b10d8d38c4bcd99
[INFO] [stderr]                                  at /rustc/04ff05c9c0cfbca33115c5f1b8bb20a66a54b799/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9
[INFO] [stderr]      1:     0x5683277e67f2 - std::backtrace_rs::backtrace::trace_unsynchronized::h91ff6307cb600af0
[INFO] [stderr]                                  at /rustc/04ff05c9c0cfbca33115c5f1b8bb20a66a54b799/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14
[INFO] [stderr]      2:     0x5683277e67f2 - std::sys::backtrace::_print_fmt::h9aed4c565cef2a51
[INFO] [stderr]                                  at /rustc/04ff05c9c0cfbca33115c5f1b8bb20a66a54b799/library/std/src/sys/backtrace.rs:66:9
[INFO] [stderr]      3:     0x5683277e67f2 - <std::sys::backtrace::BacktraceLock::print::DisplayBacktrace as core::fmt::Display>::fmt::h6c686dc381194ca8
[INFO] [stderr]                                  at /rustc/04ff05c9c0cfbca33115c5f1b8bb20a66a54b799/library/std/src/sys/backtrace.rs:39:26
[INFO] [stderr]      4:     0x5683277f60af - core::fmt::rt::Argument::fmt::ha6ca7c473cfcc90b
[INFO] [stderr]                                  at /rustc/04ff05c9c0cfbca33115c5f1b8bb20a66a54b799/library/core/src/fmt/rt.rs:173:76
[INFO] [stderr]      5:     0x5683277f60af - core::fmt::write::h2b7e1e4441166417
[INFO] [stderr]                                  at /rustc/04ff05c9c0cfbca33115c5f1b8bb20a66a54b799/library/core/src/fmt/mod.rs:1469:25
[INFO] [stderr]      6:     0x5683277b39c3 - std::io::default_write_fmt::h8c98997065cfd9f0
[INFO] [stderr]                                  at /rustc/04ff05c9c0cfbca33115c5f1b8bb20a66a54b799/library/std/src/io/mod.rs:639:11
[INFO] [stderr]      7:     0x5683277b39c3 - std::io::Write::write_fmt::hdafd4114bd1f888e
[INFO] [stderr]                                  at /rustc/04ff05c9c0cfbca33115c5f1b8bb20a66a54b799/library/std/src/io/mod.rs:1954:13
[INFO] [stderr]      8:     0x5683277bf372 - std::sys::backtrace::BacktraceLock::print::h77ddc3fa97dc90a9
[INFO] [stderr]                                  at /rustc/04ff05c9c0cfbca33115c5f1b8bb20a66a54b799/library/std/src/sys/backtrace.rs:42:9
[INFO] [stderr]      9:     0x5683277c48cf - std::panicking::default_hook::{{closure}}::he8407a3a28791da3
[INFO] [stderr]                                  at /rustc/04ff05c9c0cfbca33115c5f1b8bb20a66a54b799/library/std/src/panicking.rs:301:27
[INFO] [stderr]     10:     0x5683277c4729 - std::panicking::default_hook::h13a7c8af3befd07d
[INFO] [stderr]                                  at /rustc/04ff05c9c0cfbca33115c5f1b8bb20a66a54b799/library/std/src/panicking.rs:328:9
[INFO] [stderr]     11:     0x5683277c4f55 - std::panicking::panic_with_hook::h2e9e4a8ab29bed1b
[INFO] [stderr]                                  at /rustc/04ff05c9c0cfbca33115c5f1b8bb20a66a54b799/library/std/src/panicking.rs:834:13
[INFO] [stderr]     12:     0x5683277c4d3a - std::panicking::panic_handler::{{closure}}::h532cbb6601506606
[INFO] [stderr]                                  at /rustc/04ff05c9c0cfbca33115c5f1b8bb20a66a54b799/library/std/src/panicking.rs:707:13
[INFO] [stderr]     13:     0x5683277bf4a9 - std::sys::backtrace::__rust_end_short_backtrace::hc53cbf87d4647961
[INFO] [stderr]                                  at /rustc/04ff05c9c0cfbca33115c5f1b8bb20a66a54b799/library/std/src/sys/backtrace.rs:174:18
[INFO] [stderr]     14:     0x5683277a7f3d - __rustc[8a6c2e5bab0fd969]::rust_begin_unwind
[INFO] [stderr]                                  at /rustc/04ff05c9c0cfbca33115c5f1b8bb20a66a54b799/library/std/src/panicking.rs:698:5
[INFO] [stderr]     15:     0x5683277fa070 - core::panicking::panic_fmt::h6f32932d33196761
[INFO] [stderr]                                  at /rustc/04ff05c9c0cfbca33115c5f1b8bb20a66a54b799/library/core/src/panicking.rs:80:14
[INFO] [stderr]     16:     0x5683277f9516 - core::result::unwrap_failed::h333e1e9d882a115c
[INFO] [stderr]                                  at /rustc/04ff05c9c0cfbca33115c5f1b8bb20a66a54b799/library/core/src/result.rs:1862:5
[INFO] [stderr]     17:     0x568327755132 - core::result::Result<T,E>::expect::h7315a9bc32220d26
[INFO] [stderr]     18:     0x568327752b73 - bindgen_cuda::compute_cap::hf3549f9a39c2b6eb
[INFO] [stderr]     19:     0x568327755957 - <bindgen_cuda::Builder as core::default::Default>::default::h543ce6eb29dddb14
[INFO] [stderr]     20:     0x568327746600 - build_script_build::main::h3471fd99ee14d95d
[INFO] [stderr]     21:     0x5683277387a3 - core::ops::function::FnOnce::call_once::h1904efe7a1480421
[INFO] [stderr]     22:     0x5683277382b6 - std::sys::backtrace::__rust_begin_short_backtrace::hfd9aa33f301bc6db
[INFO] [stderr]     23:     0x568327746dc9 - std::rt::lang_start::{{closure}}::h5372778396ffc23e
[INFO] [stderr]     24:     0x5683277b51e0 - core::ops::function::impls::<impl core::ops::function::FnOnce<A> for &F>::call_once::hc778f5eee8f06531
[INFO] [stderr]                                  at /rustc/04ff05c9c0cfbca33115c5f1b8bb20a66a54b799/library/core/src/ops/function.rs:287:21
[INFO] [stderr]     25:     0x5683277b51e0 - std::panicking::catch_unwind::do_call::h8642eb90ec4f284b
[INFO] [stderr]                                  at /rustc/04ff05c9c0cfbca33115c5f1b8bb20a66a54b799/library/std/src/panicking.rs:590:40
[INFO] [stderr]     26:     0x5683277b51e0 - std::panicking::catch_unwind::h632d5bee465d35bf
[INFO] [stderr]                                  at /rustc/04ff05c9c0cfbca33115c5f1b8bb20a66a54b799/library/std/src/panicking.rs:553:19
[INFO] [stderr]     27:     0x5683277b51e0 - std::panic::catch_unwind::h8614abbdec605ea5
[INFO] [stderr]                                  at /rustc/04ff05c9c0cfbca33115c5f1b8bb20a66a54b799/library/std/src/panic.rs:359:14
[INFO] [stderr]     28:     0x5683277b51e0 - std::rt::lang_start_internal::{{closure}}::he900e0ef1190ed68
[INFO] [stderr]                                  at /rustc/04ff05c9c0cfbca33115c5f1b8bb20a66a54b799/library/std/src/rt.rs:175:24
[INFO] [stderr]     29:     0x5683277b51e0 - std::panicking::catch_unwind::do_call::h802f9473e2c32f11
[INFO] [stderr]                                  at /rustc/04ff05c9c0cfbca33115c5f1b8bb20a66a54b799/library/std/src/panicking.rs:590:40
[INFO] [stderr]     30:     0x5683277b51e0 - std::panicking::catch_unwind::hf04979aa19129a2f
[INFO] [stderr]                                  at /rustc/04ff05c9c0cfbca33115c5f1b8bb20a66a54b799/library/std/src/panicking.rs:553:19
[INFO] [stderr]     31:     0x5683277b51e0 - std::panic::catch_unwind::hee09ad77e8325352
[INFO] [stderr]                                  at /rustc/04ff05c9c0cfbca33115c5f1b8bb20a66a54b799/library/std/src/panic.rs:359:14
[INFO] [stderr]     32:     0x5683277b51e0 - std::rt::lang_start_internal::hd9b9605d3f6093ca
[INFO] [stderr]                                  at /rustc/04ff05c9c0cfbca33115c5f1b8bb20a66a54b799/library/std/src/rt.rs:171:5
[INFO] [stderr]     33:     0x568327746db1 - std::rt::lang_start::hafe8ef7d635d6a83
[INFO] [stderr]     34:     0x568327749f05 - main
[INFO] [stderr]     35:     0x7139a8ae11ca - <unknown>
[INFO] [stderr]     36:     0x7139a8ae128b - __libc_start_main
[INFO] [stderr]     37:     0x5683277379c5 - _start
[INFO] [stderr]     38:                0x0 - <unknown>
[INFO] running `Command { std: "docker" "inspect" "1b59e44583ccac567838ea545f651a69095c0ec15b6636da7f5c28a951c46fd4", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "1b59e44583ccac567838ea545f651a69095c0ec15b6636da7f5c28a951c46fd4", kill_on_drop: false }`
[INFO] [stdout] 1b59e44583ccac567838ea545f651a69095c0ec15b6636da7f5c28a951c46fd4
