[INFO] cloning repository https://github.com/EricLBuehler/candle_graphs [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/EricLBuehler/candle_graphs" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FEricLBuehler%2Fcandle_graphs", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FEricLBuehler%2Fcandle_graphs'... [INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }` [INFO] [stdout] 91bad9d7fb10728d7694570af15e12a389ace96f [INFO] testing EricLBuehler/candle_graphs/91bad9d7fb10728d7694570af15e12a389ace96f against master#b03b3a7ec92682be2917540b679478d41c95a30c for pr-137122-1 [INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FEricLBuehler%2Fcandle_graphs" "/workspace/builds/worker-3-tc1/source", kill_on_drop: false }` [INFO] [stderr] Cloning into '/workspace/builds/worker-3-tc1/source'... [INFO] [stderr] done. [INFO] started tweaking git repo https://github.com/EricLBuehler/candle_graphs [INFO] finished tweaking git repo https://github.com/EricLBuehler/candle_graphs [INFO] tweaked toml for git repo https://github.com/EricLBuehler/candle_graphs written to /workspace/builds/worker-3-tc1/source/Cargo.toml [INFO] validating manifest of git repo https://github.com/EricLBuehler/candle_graphs on toolchain b03b3a7ec92682be2917540b679478d41c95a30c [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+b03b3a7ec92682be2917540b679478d41c95a30c" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }` [INFO] crate git repo https://github.com/EricLBuehler/candle_graphs already has a lockfile, it will not be regenerated [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+b03b3a7ec92682be2917540b679478d41c95a30c" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] [stderr] Blocking waiting for file lock on package cache [INFO] [stderr] Updating git repository `https://github.com/huggingface/candle.git` [INFO] [stderr] Updating git submodule `https://github.com/NVIDIA/cutlass.git` [INFO] [stderr] Updating crates.io index [INFO] [stderr] Blocking waiting for file lock on package cache [INFO] [stderr] Downloading crates ... [INFO] [stderr] Downloaded quote_into_macro v0.2.0 [INFO] [stderr] Downloaded ug-cuda v0.0.2 [INFO] [stderr] Downloaded ug v0.0.2 [INFO] [stderr] Downloaded bindgen_cuda v0.1.5 [INFO] [stderr] Downloaded quote_into v0.2.0 [INFO] [stderr] Downloaded cudarc v0.12.1 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:90999bfc7ae267e83380e433d8e61a7c072ca6729e92edbae886d3423b3a6f4c" "/opt/rustwide/cargo-home/bin/cargo" "+b03b3a7ec92682be2917540b679478d41c95a30c" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }` [INFO] [stdout] 56c99e052e7bfd8b35bc594679b1a56b8377ef6ea6fec2e9570bf87eedce7fc6 [INFO] running `Command { std: "docker" "start" "-a" "56c99e052e7bfd8b35bc594679b1a56b8377ef6ea6fec2e9570bf87eedce7fc6", kill_on_drop: false }` [INFO] running `Command { std: "docker" "inspect" "56c99e052e7bfd8b35bc594679b1a56b8377ef6ea6fec2e9570bf87eedce7fc6", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "56c99e052e7bfd8b35bc594679b1a56b8377ef6ea6fec2e9570bf87eedce7fc6", kill_on_drop: false }` [INFO] [stdout] 56c99e052e7bfd8b35bc594679b1a56b8377ef6ea6fec2e9570bf87eedce7fc6 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:90999bfc7ae267e83380e433d8e61a7c072ca6729e92edbae886d3423b3a6f4c" "/opt/rustwide/cargo-home/bin/cargo" "+b03b3a7ec92682be2917540b679478d41c95a30c" "build" "--frozen" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] 153c717e8696e53a5a04b98c4f07ca8f3dfb466a31ed5ef4b0241cee1495dec3 [INFO] running `Command { std: "docker" "start" "-a" "153c717e8696e53a5a04b98c4f07ca8f3dfb466a31ed5ef4b0241cee1495dec3", kill_on_drop: false }` [INFO] [stderr] Compiling proc-macro2 v1.0.92 [INFO] [stderr] Compiling unicode-ident v1.0.14 [INFO] [stderr] Compiling libc v0.2.164 [INFO] [stderr] Compiling autocfg v1.4.0 [INFO] [stderr] Compiling libm v0.2.11 [INFO] [stderr] Compiling crossbeam-utils v0.8.20 [INFO] [stderr] Compiling byteorder v1.5.0 [INFO] [stderr] Compiling rayon-core v1.12.1 [INFO] [stderr] Compiling either v1.13.0 [INFO] [stderr] Compiling reborrow v0.5.5 [INFO] [stderr] Compiling paste v1.0.15 [INFO] [stderr] Compiling bitflags v1.3.2 [INFO] [stderr] Compiling seq-macro v0.3.5 [INFO] [stderr] Compiling once_cell v1.20.2 [INFO] [stderr] Compiling serde v1.0.215 [INFO] [stderr] Compiling equivalent v1.0.1 [INFO] [stderr] Compiling raw-cpuid v10.7.0 [INFO] [stderr] Compiling glob v0.3.1 [INFO] [stderr] Compiling hashbrown v0.15.1 [INFO] [stderr] Compiling winnow v0.6.20 [INFO] [stderr] Compiling serde_json v1.0.133 [INFO] [stderr] Compiling thiserror v1.0.69 [INFO] [stderr] Compiling toml_datetime v0.6.8 [INFO] [stderr] Compiling ryu v1.0.18 [INFO] [stderr] Compiling itoa v1.0.13 [INFO] [stderr] Compiling cudarc v0.12.1 [INFO] [stderr] Compiling num-traits v0.2.19 [INFO] [stderr] Compiling indexmap v2.6.0 [INFO] [stderr] Compiling libloading v0.8.5 [INFO] [stderr] Compiling stable_deref_trait v1.2.0 [INFO] [stderr] Compiling zip v1.1.4 [INFO] [stderr] Compiling crc32fast v1.4.2 [INFO] [stderr] Compiling syn v1.0.109 [INFO] [stderr] Compiling anyhow v1.0.93 [INFO] [stderr] error: failed to run custom build command for `cudarc v0.12.1` [INFO] [stderr] note: To improve backtraces for build dependencies, set the CARGO_PROFILE_DEV_BUILD_OVERRIDE_DEBUG=true environment variable to enable debug information generation. [INFO] [stderr] [INFO] [stderr] Caused by: [INFO] [stderr] process didn't exit successfully: `/opt/rustwide/target/debug/build/cudarc-492167b08a73ee09/build-script-build` (exit status: 101) [INFO] [stderr] --- stdout [INFO] [stderr] cargo:rerun-if-changed=build.rs [INFO] [stderr] cargo:rerun-if-env-changed=CUDA_ROOT [INFO] [stderr] cargo:rerun-if-env-changed=CUDA_PATH [INFO] [stderr] cargo:rerun-if-env-changed=CUDA_TOOLKIT_ROOT_DIR [INFO] [stderr] [INFO] [stderr] --- stderr [INFO] [stderr] [INFO] [stderr] thread 'main' panicked at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.12.1/build.rs:57:10: [INFO] [stderr] Failed to execute `nvcc`: Os { code: 2, kind: NotFound, message: "No such file or directory" } [INFO] [stderr] stack backtrace: [INFO] [stderr] 0: 0x63feb130ae12 - std::backtrace_rs::backtrace::libunwind::trace::hf6dd235ae0786829 [INFO] [stderr] at /rustc/b03b3a7ec92682be2917540b679478d41c95a30c/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9 [INFO] [stderr] 1: 0x63feb130ae12 - std::backtrace_rs::backtrace::trace_unsynchronized::h3a5b54e78104e8b2 [INFO] [stderr] at /rustc/b03b3a7ec92682be2917540b679478d41c95a30c/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14 [INFO] [stderr] 2: 0x63feb130ae12 - std::sys::backtrace::_print_fmt::hca7a5c1644e21919 [INFO] [stderr] at /rustc/b03b3a7ec92682be2917540b679478d41c95a30c/library/std/src/sys/backtrace.rs:66:9 [INFO] [stderr] 3: 0x63feb130ae12 - ::fmt::h38110959524b373c [INFO] [stderr] at /rustc/b03b3a7ec92682be2917540b679478d41c95a30c/library/std/src/sys/backtrace.rs:39:26 [INFO] [stderr] 4: 0x63feb132a6f3 - core::fmt::rt::Argument::fmt::h391eb3fdbf3d4042 [INFO] [stderr] at /rustc/b03b3a7ec92682be2917540b679478d41c95a30c/library/core/src/fmt/rt.rs:173:76 [INFO] [stderr] 5: 0x63feb132a6f3 - core::fmt::write::h5b87140645224122 [INFO] [stderr] at /rustc/b03b3a7ec92682be2917540b679478d41c95a30c/library/core/src/fmt/mod.rs:1465:25 [INFO] [stderr] 6: 0x63feb1308663 - std::io::default_write_fmt::h0f114d7226b96248 [INFO] [stderr] at /rustc/b03b3a7ec92682be2917540b679478d41c95a30c/library/std/src/io/mod.rs:639:11 [INFO] [stderr] 7: 0x63feb1308663 - std::io::Write::write_fmt::h89e75c4a7af19239 [INFO] [stderr] at /rustc/b03b3a7ec92682be2917540b679478d41c95a30c/library/std/src/io/mod.rs:1954:13 [INFO] [stderr] 8: 0x63feb130ac62 - std::sys::backtrace::BacktraceLock::print::hcd755c38f62e4492 [INFO] [stderr] at /rustc/b03b3a7ec92682be2917540b679478d41c95a30c/library/std/src/sys/backtrace.rs:42:9 [INFO] [stderr] 9: 0x63feb130bcd6 - std::panicking::default_hook::{{closure}}::h351f33591b26e6e7 [INFO] [stderr] at /rustc/b03b3a7ec92682be2917540b679478d41c95a30c/library/std/src/panicking.rs:300:27 [INFO] [stderr] 10: 0x63feb130bad9 - std::panicking::default_hook::he5bba7bf0a373c6e [INFO] [stderr] at /rustc/b03b3a7ec92682be2917540b679478d41c95a30c/library/std/src/panicking.rs:327:9 [INFO] [stderr] 11: 0x63feb130c5a2 - std::panicking::rust_panic_with_hook::hdf456b43e6535023 [INFO] [stderr] at /rustc/b03b3a7ec92682be2917540b679478d41c95a30c/library/std/src/panicking.rs:833:13 [INFO] [stderr] 12: 0x63feb130c43a - std::panicking::begin_panic_handler::{{closure}}::he1c1ab0b84006a97 [INFO] [stderr] at /rustc/b03b3a7ec92682be2917540b679478d41c95a30c/library/std/src/panicking.rs:706:13 [INFO] [stderr] 13: 0x63feb130b309 - std::sys::backtrace::__rust_end_short_backtrace::h2a71da996e10b8a0 [INFO] [stderr] at /rustc/b03b3a7ec92682be2917540b679478d41c95a30c/library/std/src/sys/backtrace.rs:168:18 [INFO] [stderr] 14: 0x63feb130c0cd - __rustc[92197b79f0fe8095]::rust_begin_unwind [INFO] [stderr] at /rustc/b03b3a7ec92682be2917540b679478d41c95a30c/library/std/src/panicking.rs:697:5 [INFO] [stderr] 15: 0x63feb13299e0 - core::panicking::panic_fmt::h723bf1d52f6dad29 [INFO] [stderr] at /rustc/b03b3a7ec92682be2917540b679478d41c95a30c/library/core/src/panicking.rs:75:14 [INFO] [stderr] 16: 0x63feb1329d56 - core::result::unwrap_failed::hee42034aaecc2a24 [INFO] [stderr] at /rustc/b03b3a7ec92682be2917540b679478d41c95a30c/library/core/src/result.rs:1761:5 [INFO] [stderr] 17: 0x63feb12e3e82 - core::result::Result::expect::h0450df4a55bbeec1 [INFO] [stderr] 18: 0x63feb12db6b6 - build_script_build::cuda_version_from_build_system::h3e66310a6413fe73 [INFO] [stderr] 19: 0x63feb12db432 - build_script_build::main::h70dad62115ae0c2a [INFO] [stderr] 20: 0x63feb12dfe43 - core::ops::function::FnOnce::call_once::hcd99fd35f59b4bf4 [INFO] [stderr] 21: 0x63feb12d8ba6 - std::sys::backtrace::__rust_begin_short_backtrace::h8a4c2593785489ea [INFO] [stderr] 22: 0x63feb12e2ee9 - std::rt::lang_start::{{closure}}::ha57e2ad07e976a7c [INFO] [stderr] 23: 0x63feb1305080 - core::ops::function::impls:: for &F>::call_once::hd25fc0ca75d54018 [INFO] [stderr] at /rustc/b03b3a7ec92682be2917540b679478d41c95a30c/library/core/src/ops/function.rs:284:21 [INFO] [stderr] 24: 0x63feb1305080 - std::panicking::catch_unwind::do_call::ha488b7241416766f [INFO] [stderr] at /rustc/b03b3a7ec92682be2917540b679478d41c95a30c/library/std/src/panicking.rs:589:40 [INFO] [stderr] 25: 0x63feb1305080 - std::panicking::catch_unwind::h81a5714cf9e2c51e [INFO] [stderr] at /rustc/b03b3a7ec92682be2917540b679478d41c95a30c/library/std/src/panicking.rs:552:19 [INFO] [stderr] 26: 0x63feb1305080 - std::panic::catch_unwind::haf54ebde94b26b04 [INFO] [stderr] at /rustc/b03b3a7ec92682be2917540b679478d41c95a30c/library/std/src/panic.rs:359:14 [INFO] [stderr] 27: 0x63feb1305080 - std::rt::lang_start_internal::{{closure}}::h4fa23b31c3653423 [INFO] [stderr] at /rustc/b03b3a7ec92682be2917540b679478d41c95a30c/library/std/src/rt.rs:175:24 [INFO] [stderr] 28: 0x63feb1305080 - std::panicking::catch_unwind::do_call::h60c222eb58f45e30 [INFO] [stderr] at /rustc/b03b3a7ec92682be2917540b679478d41c95a30c/library/std/src/panicking.rs:589:40 [INFO] [stderr] 29: 0x63feb1305080 - std::panicking::catch_unwind::h3a5c3ee5a2867e71 [INFO] [stderr] at /rustc/b03b3a7ec92682be2917540b679478d41c95a30c/library/std/src/panicking.rs:552:19 [INFO] [stderr] 30: 0x63feb1305080 - std::panic::catch_unwind::h93836bffc0bad4f2 [INFO] [stderr] at /rustc/b03b3a7ec92682be2917540b679478d41c95a30c/library/std/src/panic.rs:359:14 [INFO] [stderr] 31: 0x63feb1305080 - std::rt::lang_start_internal::h25802ecab1c1e1f0 [INFO] [stderr] at /rustc/b03b3a7ec92682be2917540b679478d41c95a30c/library/std/src/rt.rs:171:5 [INFO] [stderr] 32: 0x63feb12e2ed1 - std::rt::lang_start::hcbef5120573465b3 [INFO] [stderr] 33: 0x63feb12dcf35 - main [INFO] [stderr] 34: 0x7bea34ba11ca - [INFO] [stderr] 35: 0x7bea34ba128b - __libc_start_main [INFO] [stderr] 36: 0x63feb12d8785 - _start [INFO] [stderr] 37: 0x0 - [INFO] [stderr] warning: build failed, waiting for other jobs to finish... [INFO] running `Command { std: "docker" "inspect" "153c717e8696e53a5a04b98c4f07ca8f3dfb466a31ed5ef4b0241cee1495dec3", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "153c717e8696e53a5a04b98c4f07ca8f3dfb466a31ed5ef4b0241cee1495dec3", kill_on_drop: false }` [INFO] [stdout] 153c717e8696e53a5a04b98c4f07ca8f3dfb466a31ed5ef4b0241cee1495dec3