[INFO] cloning repository https://github.com/EndlessReform/candle-gqa
[INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/EndlessReform/candle-gqa" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FEndlessReform%2Fcandle-gqa", kill_on_drop: false }`
[INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FEndlessReform%2Fcandle-gqa'...
[INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }`
[INFO] [stdout] e2c802ca2e0fb3ed46be7df5d2bdbd389cee97ee
[INFO] building EndlessReform/candle-gqa against master#ad211ced81509462cdfe4c29ed10f97279a0acae for pr-135216
[INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FEndlessReform%2Fcandle-gqa" "/workspace/builds/worker-0-tc1/source", kill_on_drop: false }`
[INFO] [stderr] Cloning into '/workspace/builds/worker-0-tc1/source'...
[INFO] [stderr] done.
[INFO] validating manifest of git repo https://github.com/EndlessReform/candle-gqa on toolchain ad211ced81509462cdfe4c29ed10f97279a0acae
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+ad211ced81509462cdfe4c29ed10f97279a0acae" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] started tweaking git repo https://github.com/EndlessReform/candle-gqa
[INFO] finished tweaking git repo https://github.com/EndlessReform/candle-gqa
[INFO] tweaked toml for git repo https://github.com/EndlessReform/candle-gqa written to /workspace/builds/worker-0-tc1/source/Cargo.toml
[INFO] crate git repo https://github.com/EndlessReform/candle-gqa already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+ad211ced81509462cdfe4c29ed10f97279a0acae" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] [stderr]     Updating crates.io index
[INFO] [stderr]  Downloading crates ...
[INFO] [stderr]   Downloaded gemm-f64 v0.17.1
[INFO] [stderr]   Downloaded gemm-common v0.17.1
[INFO] [stderr]   Downloaded gemm-c64 v0.17.1
[INFO] [stderr]   Downloaded gemm-c32 v0.17.1
[INFO] [stderr]   Downloaded zip v1.1.4
[INFO] [stderr]   Downloaded gemm-f16 v0.17.1
[INFO] [stderr]   Downloaded safetensors v0.4.5
[INFO] [stderr]   Downloaded bindgen_cuda v0.1.5
[INFO] [stderr]   Downloaded dyn-stack v0.10.0
[INFO] [stderr]   Downloaded candle-kernels v0.7.2
[INFO] [stderr]   Downloaded reborrow v0.5.5
[INFO] [stderr]   Downloaded pulp v0.18.22
[INFO] [stderr]   Downloaded candle-core v0.7.2
[INFO] [stderr]   Downloaded enum-as-inner v0.6.1
[INFO] [stderr]   Downloaded gemm v0.17.1
[INFO] [stderr]   Downloaded gemm-f32 v0.17.1
[INFO] [stderr]   Downloaded sysctl v0.5.5
[INFO] [stderr]   Downloaded cudarc v0.12.1
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:f3a9d4ad9d972b27faf3965f35b62e55ba32bbce8f20bc8fe909558a86702fde" "/opt/rustwide/cargo-home/bin/cargo" "+ad211ced81509462cdfe4c29ed10f97279a0acae" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] [stdout] 172c35b975e01a0435ae640e339f5dcf22319d4e4a30f2abfcc329a42438f7cc
[INFO] running `Command { std: "docker" "start" "-a" "172c35b975e01a0435ae640e339f5dcf22319d4e4a30f2abfcc329a42438f7cc", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "172c35b975e01a0435ae640e339f5dcf22319d4e4a30f2abfcc329a42438f7cc", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "172c35b975e01a0435ae640e339f5dcf22319d4e4a30f2abfcc329a42438f7cc", kill_on_drop: false }`
[INFO] [stdout] 172c35b975e01a0435ae640e339f5dcf22319d4e4a30f2abfcc329a42438f7cc
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:f3a9d4ad9d972b27faf3965f35b62e55ba32bbce8f20bc8fe909558a86702fde" "/opt/rustwide/cargo-home/bin/cargo" "+ad211ced81509462cdfe4c29ed10f97279a0acae" "build" "--frozen" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] 2cdf8429f57a7fcfbc0e9a31dc69900eae4ee54aab23fd9755c34d05a6bd44ac
[INFO] running `Command { std: "docker" "start" "-a" "2cdf8429f57a7fcfbc0e9a31dc69900eae4ee54aab23fd9755c34d05a6bd44ac", kill_on_drop: false }`
[INFO] [stderr]    Compiling proc-macro2 v1.0.87
[INFO] [stderr]    Compiling libc v0.2.159
[INFO] [stderr]    Compiling crossbeam-utils v0.8.20
[INFO] [stderr]    Compiling rayon-core v1.12.1
[INFO] [stderr]    Compiling autocfg v1.4.0
[INFO] [stderr]    Compiling either v1.13.0
[INFO] [stderr]    Compiling libm v0.2.8
[INFO] [stderr]    Compiling byteorder v1.5.0
[INFO] [stderr]    Compiling paste v1.0.15
[INFO] [stderr]    Compiling reborrow v0.5.5
[INFO] [stderr]    Compiling bitflags v1.3.2
[INFO] [stderr]    Compiling once_cell v1.20.2
[INFO] [stderr]    Compiling seq-macro v0.3.5
[INFO] [stderr]    Compiling glob v0.3.1
[INFO] [stderr]    Compiling hashbrown v0.15.0
[INFO] [stderr]    Compiling equivalent v1.0.1
[INFO] [stderr]    Compiling raw-cpuid v10.7.0
[INFO] [stderr]    Compiling toml_datetime v0.6.8
[INFO] [stderr]    Compiling winnow v0.6.20
[INFO] [stderr]    Compiling serde_json v1.0.128
[INFO] [stderr]    Compiling thiserror v1.0.64
[INFO] [stderr]    Compiling cudarc v0.12.1
[INFO] [stderr]    Compiling stable_deref_trait v1.2.0
[INFO] [stderr]    Compiling zip v1.1.4
[INFO] [stderr]    Compiling ryu v1.0.18
[INFO] [stderr]    Compiling memchr v2.7.4
[INFO] [stderr]    Compiling itoa v1.0.11
[INFO] [stderr]    Compiling crc32fast v1.4.2
[INFO] [stderr]    Compiling libloading v0.8.5
[INFO] [stderr]    Compiling num-traits v0.2.19
[INFO] [stderr] error: failed to run custom build command for `cudarc v0.12.1`
[INFO] [stderr] note: To improve backtraces for build dependencies, set the CARGO_PROFILE_DEV_BUILD_OVERRIDE_DEBUG=true environment variable to enable debug information generation.
[INFO] [stderr] 
[INFO] [stderr] Caused by:
[INFO] [stderr]   process didn't exit successfully: `/opt/rustwide/target/debug/build/cudarc-ec32e410df717af5/build-script-build` (exit status: 101)
[INFO] [stderr]   --- stdout
[INFO] [stderr]   cargo:rerun-if-changed=build.rs
[INFO] [stderr]   cargo:rerun-if-env-changed=CUDA_ROOT
[INFO] [stderr]   cargo:rerun-if-env-changed=CUDA_PATH
[INFO] [stderr]   cargo:rerun-if-env-changed=CUDA_TOOLKIT_ROOT_DIR
[INFO] [stderr] 
[INFO] [stderr]   --- stderr
[INFO] [stderr] 
[INFO] [stderr]   thread 'main' panicked at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.12.1/build.rs:57:10:
[INFO] [stderr]   Failed to execute `nvcc`: Os { code: 2, kind: NotFound, message: "No such file or directory" }
[INFO] [stderr]   stack backtrace:
[INFO] [stderr]      0:     0x632afeeacbca - std::backtrace_rs::backtrace::libunwind::trace::h65cc9476dea42f04
[INFO] [stderr]                                  at /rustc/ad211ced81509462cdfe4c29ed10f97279a0acae/library/std/src/../../backtrace/src/backtrace/libunwind.rs:116:5
[INFO] [stderr]      1:     0x632afeeacbca - std::backtrace_rs::backtrace::trace_unsynchronized::h31307b22853da5cb
[INFO] [stderr]                                  at /rustc/ad211ced81509462cdfe4c29ed10f97279a0acae/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
[INFO] [stderr]      2:     0x632afeeacbca - std::sys::backtrace::_print_fmt::h1d1ec741e9afb97a
[INFO] [stderr]                                  at /rustc/ad211ced81509462cdfe4c29ed10f97279a0acae/library/std/src/sys/backtrace.rs:66:9
[INFO] [stderr]      3:     0x632afeeacbca - <std::sys::backtrace::BacktraceLock::print::DisplayBacktrace as core::fmt::Display>::fmt::he389a1126db3ba75
[INFO] [stderr]                                  at /rustc/ad211ced81509462cdfe4c29ed10f97279a0acae/library/std/src/sys/backtrace.rs:39:26
[INFO] [stderr]      4:     0x632afeecddb3 - core::fmt::rt::Argument::fmt::h0df11dc86b5adf75
[INFO] [stderr]                                  at /rustc/ad211ced81509462cdfe4c29ed10f97279a0acae/library/core/src/fmt/rt.rs:177:76
[INFO] [stderr]      5:     0x632afeecddb3 - core::fmt::write::hb735a44de60d4775
[INFO] [stderr]                                  at /rustc/ad211ced81509462cdfe4c29ed10f97279a0acae/library/core/src/fmt/mod.rs:1440:21
[INFO] [stderr]      6:     0x632afeea9d03 - std::io::Write::write_fmt::h7e55554e3b601464
[INFO] [stderr]                                  at /rustc/ad211ced81509462cdfe4c29ed10f97279a0acae/library/std/src/io/mod.rs:1887:15
[INFO] [stderr]      7:     0x632afeeaca12 - std::sys::backtrace::BacktraceLock::print::h1b2403acafb4a9ce
[INFO] [stderr]                                  at /rustc/ad211ced81509462cdfe4c29ed10f97279a0acae/library/std/src/sys/backtrace.rs:42:9
[INFO] [stderr]      8:     0x632afeeada70 - std::panicking::default_hook::{{closure}}::h1331b39f8c22272c
[INFO] [stderr]                                  at /rustc/ad211ced81509462cdfe4c29ed10f97279a0acae/library/std/src/panicking.rs:295:22
[INFO] [stderr]      9:     0x632afeead850 - std::panicking::default_hook::h412b1b8b79d13729
[INFO] [stderr]                                  at /rustc/ad211ced81509462cdfe4c29ed10f97279a0acae/library/std/src/panicking.rs:322:9
[INFO] [stderr]     10:     0x632afeeae102 - std::panicking::rust_panic_with_hook::he422ff96d7e46154
[INFO] [stderr]                                  at /rustc/ad211ced81509462cdfe4c29ed10f97279a0acae/library/std/src/panicking.rs:828:13
[INFO] [stderr]     11:     0x632afeeadf9a - std::panicking::begin_panic_handler::{{closure}}::h48ed6f472c90914b
[INFO] [stderr]                                  at /rustc/ad211ced81509462cdfe4c29ed10f97279a0acae/library/std/src/panicking.rs:701:13
[INFO] [stderr]     12:     0x632afeead0c9 - std::sys::backtrace::__rust_end_short_backtrace::hb3ec7f756cf60e78
[INFO] [stderr]                                  at /rustc/ad211ced81509462cdfe4c29ed10f97279a0acae/library/std/src/sys/backtrace.rs:168:18
[INFO] [stderr]     13:     0x632afeeadc2d - rust_begin_unwind
[INFO] [stderr]                                  at /rustc/ad211ced81509462cdfe4c29ed10f97279a0acae/library/std/src/panicking.rs:692:5
[INFO] [stderr]     14:     0x632afeeccfe0 - core::panicking::panic_fmt::h14762d721bf3d8f4
[INFO] [stderr]                                  at /rustc/ad211ced81509462cdfe4c29ed10f97279a0acae/library/core/src/panicking.rs:75:14
[INFO] [stderr]     15:     0x632afeecd386 - core::result::unwrap_failed::h920701fb7a43bb98
[INFO] [stderr]                                  at /rustc/ad211ced81509462cdfe4c29ed10f97279a0acae/library/core/src/result.rs:1704:5
[INFO] [stderr]     16:     0x632afee836ae - core::result::Result<T,E>::expect::h0030fffff15c4557
[INFO] [stderr]     17:     0x632afee841d6 - build_script_build::cuda_version_from_build_system::hf32e0f4ebe2f7327
[INFO] [stderr]     18:     0x632afee83f72 - build_script_build::main::h202da4d95f6b0e1a
[INFO] [stderr]     19:     0x632afee823c3 - core::ops::function::FnOnce::call_once::h5a919e8a3e93ef06
[INFO] [stderr]     20:     0x632afee86576 - std::sys::backtrace::__rust_begin_short_backtrace::h432afea3d74c8453
[INFO] [stderr]     21:     0x632afee7cbd9 - std::rt::lang_start::{{closure}}::h9e1014760f2361c7
[INFO] [stderr]     22:     0x632afeea6d07 - core::ops::function::impls::<impl core::ops::function::FnOnce<A> for &F>::call_once::he65d3dc22beac451
[INFO] [stderr]                                  at /rustc/ad211ced81509462cdfe4c29ed10f97279a0acae/library/core/src/ops/function.rs:284:13
[INFO] [stderr]     23:     0x632afeea6d07 - std::panicking::try::do_call::h06981c1fa5ca7e3e
[INFO] [stderr]                                  at /rustc/ad211ced81509462cdfe4c29ed10f97279a0acae/library/std/src/panicking.rs:584:40
[INFO] [stderr]     24:     0x632afeea6d07 - std::panicking::try::h69dc3282503f57f9
[INFO] [stderr]                                  at /rustc/ad211ced81509462cdfe4c29ed10f97279a0acae/library/std/src/panicking.rs:547:19
[INFO] [stderr]     25:     0x632afeea6d07 - std::panic::catch_unwind::h92970ef9ef5c92ae
[INFO] [stderr]                                  at /rustc/ad211ced81509462cdfe4c29ed10f97279a0acae/library/std/src/panic.rs:358:14
[INFO] [stderr]     26:     0x632afeea6d07 - std::rt::lang_start_internal::{{closure}}::h1b78dd850ae1293d
[INFO] [stderr]                                  at /rustc/ad211ced81509462cdfe4c29ed10f97279a0acae/library/std/src/rt.rs:174:48
[INFO] [stderr]     27:     0x632afeea6d07 - std::panicking::try::do_call::h027346d9b0cbd7c7
[INFO] [stderr]                                  at /rustc/ad211ced81509462cdfe4c29ed10f97279a0acae/library/std/src/panicking.rs:584:40
[INFO] [stderr]     28:     0x632afeea6d07 - std::panicking::try::h91dc055514206193
[INFO] [stderr]                                  at /rustc/ad211ced81509462cdfe4c29ed10f97279a0acae/library/std/src/panicking.rs:547:19
[INFO] [stderr]     29:     0x632afeea6d07 - std::panic::catch_unwind::ha551d86c182ebce0
[INFO] [stderr]                                  at /rustc/ad211ced81509462cdfe4c29ed10f97279a0acae/library/std/src/panic.rs:358:14
[INFO] [stderr]     30:     0x632afeea6d07 - std::rt::lang_start_internal::h19b9f2ab21592fb1
[INFO] [stderr]                                  at /rustc/ad211ced81509462cdfe4c29ed10f97279a0acae/library/std/src/rt.rs:174:20
[INFO] [stderr]     31:     0x632afee7cbb7 - std::rt::lang_start::h39531928b544cbdb
[INFO] [stderr]     32:     0x632afee859c5 - main
[INFO] [stderr]     33:     0x766ce50f5d90 - <unknown>
[INFO] [stderr]     34:     0x766ce50f5e40 - __libc_start_main
[INFO] [stderr]     35:     0x632afee7c2d5 - _start
[INFO] [stderr]     36:                0x0 - <unknown>
[INFO] [stderr] warning: build failed, waiting for other jobs to finish...
[INFO] running `Command { std: "docker" "inspect" "2cdf8429f57a7fcfbc0e9a31dc69900eae4ee54aab23fd9755c34d05a6bd44ac", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "2cdf8429f57a7fcfbc0e9a31dc69900eae4ee54aab23fd9755c34d05a6bd44ac", kill_on_drop: false }`
[INFO] [stdout] 2cdf8429f57a7fcfbc0e9a31dc69900eae4ee54aab23fd9755c34d05a6bd44ac
