[INFO] fetching crate candle-flash-attn 0.3.1...
[INFO] testing candle-flash-attn-0.3.1 against 1.75.0 for beta-1.76-1
[INFO] extracting crate candle-flash-attn 0.3.1 into /workspace/builds/worker-5-tc1/source
[INFO] validating manifest of crates.io crate candle-flash-attn 0.3.1 on toolchain 1.75.0
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.75.0" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] started tweaking crates.io crate candle-flash-attn 0.3.1
[INFO] finished tweaking crates.io crate candle-flash-attn 0.3.1
[INFO] tweaked toml for crates.io crate candle-flash-attn 0.3.1 written to /workspace/builds/worker-5-tc1/source/Cargo.toml
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.75.0" "generate-lockfile" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] [stderr]     Updating crates.io index
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.75.0" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] [stderr]  Downloading crates ...
[INFO] [stderr]   Downloaded zerofrom-derive v0.1.3
[INFO] [stderr]   Downloaded gemm-f16 v0.16.15
[INFO] [stderr]   Downloaded gemm-c64 v0.16.15
[INFO] [stderr]   Downloaded reborrow v0.5.5
[INFO] [stderr]   Downloaded cudarc v0.9.15
[INFO] [stderr]   Downloaded pulp v0.18.6
[INFO] [stderr]   Downloaded candle-core v0.3.2
[INFO] [stderr]   Downloaded gemm-f64 v0.16.15
[INFO] [stderr]   Downloaded zerofrom v0.1.3
[INFO] [stderr]   Downloaded gemm-common v0.16.15
[INFO] [stderr]   Downloaded yoke v0.7.3
[INFO] [stderr]   Downloaded yoke-derive v0.7.3
[INFO] [stderr]   Downloaded candle-nn v0.3.2
[INFO] [stderr]   Downloaded safetensors v0.3.3
[INFO] [stderr]   Downloaded gemm v0.16.15
[INFO] [stderr]   Downloaded candle-kernels v0.3.2
[INFO] [stderr]   Downloaded gemm-c32 v0.16.15
[INFO] [stderr]   Downloaded gemm-f32 v0.16.15
[INFO] [stderr]   Downloaded dyn-stack v0.10.0
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:2788e3201cd34a07e3172128adcd8b3090168a8e3bcc40d7c032b9dda1df7d1c" "/opt/rustwide/cargo-home/bin/cargo" "+1.75.0" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] [stdout] 7a4fb7d021cfd9e53b9e2b6fc523aabd4b94ac70efbc149933d138a976f7a380
[INFO] running `Command { std: "docker" "start" "-a" "7a4fb7d021cfd9e53b9e2b6fc523aabd4b94ac70efbc149933d138a976f7a380", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "7a4fb7d021cfd9e53b9e2b6fc523aabd4b94ac70efbc149933d138a976f7a380", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "7a4fb7d021cfd9e53b9e2b6fc523aabd4b94ac70efbc149933d138a976f7a380", kill_on_drop: false }`
[INFO] [stdout] 7a4fb7d021cfd9e53b9e2b6fc523aabd4b94ac70efbc149933d138a976f7a380
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:2788e3201cd34a07e3172128adcd8b3090168a8e3bcc40d7c032b9dda1df7d1c" "/opt/rustwide/cargo-home/bin/cargo" "+1.75.0" "build" "--frozen" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] d0f40d280608d8cfa423a33d9adc121dbb39d0b8bdd0975b280be6e0ac44188c
[INFO] running `Command { std: "docker" "start" "-a" "d0f40d280608d8cfa423a33d9adc121dbb39d0b8bdd0975b280be6e0ac44188c", kill_on_drop: false }`
[INFO] [stderr]    Compiling proc-macro2 v1.0.75
[INFO] [stderr]    Compiling crossbeam-utils v0.8.18
[INFO] [stderr]    Compiling libm v0.2.8
[INFO] [stderr]    Compiling rayon-core v1.12.0
[INFO] [stderr]    Compiling either v1.9.0
[INFO] [stderr]    Compiling ppv-lite86 v0.2.17
[INFO] [stderr]    Compiling reborrow v0.5.5
[INFO] [stderr]    Compiling paste v1.0.14
[INFO] [stderr]    Compiling memchr v2.7.1
[INFO] [stderr]    Compiling bitflags v1.3.2
[INFO] [stderr]    Compiling adler v1.0.2
[INFO] [stderr]    Compiling gimli v0.28.1
[INFO] [stderr]    Compiling num-traits v0.2.17
[INFO] [stderr]    Compiling anyhow v1.0.79
[INFO] [stderr]    Compiling seq-macro v0.3.5
[INFO] [stderr]    Compiling getrandom v0.2.11
[INFO] [stderr]    Compiling cc v1.0.83
[INFO] [stderr]    Compiling raw-cpuid v10.7.0
[INFO] [stderr]    Compiling miniz_oxide v0.7.1
[INFO] [stderr]    Compiling rand_core v0.6.4
[INFO] [stderr]    Compiling rustc-demangle v0.1.23
[INFO] [stderr]    Compiling once_cell v1.19.0
[INFO] [stderr]    Compiling rand_chacha v0.3.1
[INFO] [stderr]    Compiling unicode-xid v0.2.4
[INFO] [stderr]    Compiling crc32fast v1.3.2
[INFO] [stderr]    Compiling glob v0.3.1
[INFO] [stderr]    Compiling object v0.32.2
[INFO] [stderr]    Compiling rand v0.8.5
[INFO] [stderr]    Compiling quote v1.0.35
[INFO] [stderr]    Compiling num_cpus v1.16.0
[INFO] [stderr]    Compiling stable_deref_trait v1.2.0
[INFO] [stderr]    Compiling cudarc v0.9.15
[INFO] [stderr]    Compiling syn v2.0.48
[INFO] [stderr]    Compiling crossbeam-epoch v0.9.17
[INFO] [stderr]    Compiling byteorder v1.5.0
[INFO] [stderr]    Compiling memmap2 v0.7.1
[INFO] [stderr]    Compiling crossbeam-deque v0.8.4
[INFO] [stderr]    Compiling zip v0.6.6
[INFO] [stderr] error: failed to run custom build command for `cudarc v0.9.15`
[INFO] [stderr] note: To improve backtraces for build dependencies, set the CARGO_PROFILE_DEV_BUILD_OVERRIDE_DEBUG=true environment variable to enable debug information generation.
[INFO] [stderr] 
[INFO] [stderr] Caused by:
[INFO] [stderr]   process didn't exit successfully: `/opt/rustwide/target/debug/build/cudarc-05d6874d9215c7ef/build-script-build` (exit status: 101)
[INFO] [stderr]   --- stdout
[INFO] [stderr]   cargo:rerun-if-changed=build.rs
[INFO] [stderr]   cargo:rerun-if-env-changed=CUDA_ROOT
[INFO] [stderr]   cargo:rerun-if-env-changed=CUDA_PATH
[INFO] [stderr]   cargo:rerun-if-env-changed=CUDA_TOOLKIT_ROOT_DIR
[INFO] [stderr] 
[INFO] [stderr]   --- stderr
[INFO] [stderr]   thread 'main' panicked at /opt/rustwide/cargo-home/registry/src/index.crates.io-6f17d22bba15001f/cudarc-0.9.15/build.rs:21:13:
[INFO] [stderr]   Unable to find `include/cuda.h` under any of: ["/usr", "/usr/local/cuda", "/opt/cuda", "/usr/lib/cuda", "C:/Program Files/NVIDIA GPU Computing Toolkit", "C:/CUDA"]. Set the `CUDA_ROOT` environment variable to `$CUDA_ROOT/include/cuda.h` to override path.
[INFO] [stderr]   stack backtrace:
[INFO] [stderr]      0:     0x55d5fbfd458c - std::backtrace_rs::backtrace::libunwind::trace::ha637c64ce894333a
[INFO] [stderr]                                  at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/../../backtrace/src/backtrace/libunwind.rs:104:5
[INFO] [stderr]      1:     0x55d5fbfd458c - std::backtrace_rs::backtrace::trace_unsynchronized::h47f62dea28e0c88d
[INFO] [stderr]                                  at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
[INFO] [stderr]      2:     0x55d5fbfd458c - std::sys_common::backtrace::_print_fmt::h9eef0abe20ede486
[INFO] [stderr]                                  at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/sys_common/backtrace.rs:67:5
[INFO] [stderr]      3:     0x55d5fbfd458c - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::hed7f999df88cc644
[INFO] [stderr]                                  at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/sys_common/backtrace.rs:44:22
[INFO] [stderr]      4:     0x55d5fbff3e70 - core::fmt::rt::Argument::fmt::h1539a9308b8d058d
[INFO] [stderr]                                  at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/core/src/fmt/rt.rs:142:9
[INFO] [stderr]      5:     0x55d5fbff3e70 - core::fmt::write::h3a39390d8560d9c9
[INFO] [stderr]                                  at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/core/src/fmt/mod.rs:1120:17
[INFO] [stderr]      6:     0x55d5fbfd275f - std::io::Write::write_fmt::h5fc9997dfe05f882
[INFO] [stderr]                                  at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/io/mod.rs:1762:15
[INFO] [stderr]      7:     0x55d5fbfd4374 - std::sys_common::backtrace::_print::h894006fb5c6f3d45
[INFO] [stderr]                                  at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/sys_common/backtrace.rs:47:5
[INFO] [stderr]      8:     0x55d5fbfd4374 - std::sys_common::backtrace::print::h23a2d212c6fff936
[INFO] [stderr]                                  at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/sys_common/backtrace.rs:34:9
[INFO] [stderr]      9:     0x55d5fbfd5887 - std::panicking::default_hook::{{closure}}::h8a1d2ee00185001a
[INFO] [stderr]     10:     0x55d5fbfd55ef - std::panicking::default_hook::h6038f2eba384e475
[INFO] [stderr]                                  at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/panicking.rs:292:9
[INFO] [stderr]     11:     0x55d5fbfd5d08 - std::panicking::rust_panic_with_hook::h2b5517d590cab22e
[INFO] [stderr]                                  at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/panicking.rs:779:13
[INFO] [stderr]     12:     0x55d5fbfd5bee - std::panicking::begin_panic_handler::{{closure}}::h233112c06e0ef43e
[INFO] [stderr]                                  at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/panicking.rs:657:13
[INFO] [stderr]     13:     0x55d5fbfd4a56 - std::sys_common::backtrace::__rust_end_short_backtrace::h6e893f24d7ebbff8
[INFO] [stderr]                                  at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/sys_common/backtrace.rs:170:18
[INFO] [stderr]     14:     0x55d5fbfd5952 - rust_begin_unwind
[INFO] [stderr]                                  at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/panicking.rs:645:5
[INFO] [stderr]     15:     0x55d5fbfb21b5 - core::panicking::panic_fmt::hbf0e066aabfa482c
[INFO] [stderr]                                  at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/core/src/panicking.rs:72:14
[INFO] [stderr]     16:     0x55d5fbfb69de - build_script_build::link_cuda::{{closure}}::h8e77d5e8f20c0b60
[INFO] [stderr]     17:     0x55d5fbfb4bc9 - core::option::Option<T>::unwrap_or_else::hb75061c31f1e62e9
[INFO] [stderr]     18:     0x55d5fbfb64b9 - build_script_build::link_cuda::h12e09d1dd45376ad
[INFO] [stderr]     19:     0x55d5fbfb635a - build_script_build::main::hae2ea235ce0d7269
[INFO] [stderr]     20:     0x55d5fbfb3a73 - core::ops::function::FnOnce::call_once::hb9a86525011b48eb
[INFO] [stderr]     21:     0x55d5fbfb75a6 - std::sys_common::backtrace::__rust_begin_short_backtrace::h6b548231eda702bd
[INFO] [stderr]     22:     0x55d5fbfb34a9 - std::rt::lang_start::{{closure}}::h7af338db5ab3fc7a
[INFO] [stderr]     23:     0x55d5fbfcfef7 - core::ops::function::impls::<impl core::ops::function::FnOnce<A> for &F>::call_once::hd95060ecd5e1ca24
[INFO] [stderr]                                  at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/core/src/ops/function.rs:284:13
[INFO] [stderr]     24:     0x55d5fbfcfef7 - std::panicking::try::do_call::h6e8cf51db32a6e4b
[INFO] [stderr]                                  at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/panicking.rs:552:40
[INFO] [stderr]     25:     0x55d5fbfcfef7 - std::panicking::try::h3a52eefe24fe3c29
[INFO] [stderr]                                  at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/panicking.rs:516:19
[INFO] [stderr]     26:     0x55d5fbfcfef7 - std::panic::catch_unwind::h24c28c23c02c3841
[INFO] [stderr]                                  at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/panic.rs:142:14
[INFO] [stderr]     27:     0x55d5fbfcfef7 - std::rt::lang_start_internal::{{closure}}::h705d3c9cbc06ef47
[INFO] [stderr]                                  at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/rt.rs:148:48
[INFO] [stderr]     28:     0x55d5fbfcfef7 - std::panicking::try::do_call::ha21f52ba13158470
[INFO] [stderr]                                  at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/panicking.rs:552:40
[INFO] [stderr]     29:     0x55d5fbfcfef7 - std::panicking::try::h5581346bf6aeb1f8
[INFO] [stderr]                                  at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/panicking.rs:516:19
[INFO] [stderr]     30:     0x55d5fbfcfef7 - std::panic::catch_unwind::h7919645a6b72e25b
[INFO] [stderr]                                  at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/panic.rs:142:14
[INFO] [stderr]     31:     0x55d5fbfcfef7 - std::rt::lang_start_internal::h12de51168669836e
[INFO] [stderr]                                  at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/rt.rs:148:20
[INFO] [stderr]     32:     0x55d5fbfb3487 - std::rt::lang_start::h40f1f902eb1fb8ad
[INFO] [stderr]     33:     0x55d5fbfb6dd5 - main
[INFO] [stderr]     34:     0x7f4aef727d90 - <unknown>
[INFO] [stderr]     35:     0x7f4aef727e40 - __libc_start_main
[INFO] [stderr]     36:     0x55d5fbfb28d5 - _start
[INFO] [stderr]     37:                0x0 - <unknown>
[INFO] [stderr] warning: build failed, waiting for other jobs to finish...
[INFO] running `Command { std: "docker" "inspect" "d0f40d280608d8cfa423a33d9adc121dbb39d0b8bdd0975b280be6e0ac44188c", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "d0f40d280608d8cfa423a33d9adc121dbb39d0b8bdd0975b280be6e0ac44188c", kill_on_drop: false }`
[INFO] [stdout] d0f40d280608d8cfa423a33d9adc121dbb39d0b8bdd0975b280be6e0ac44188c
