[INFO] cloning repository https://github.com/mixlayer/candle-gemm-bench [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/mixlayer/candle-gemm-bench" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fmixlayer%2Fcandle-gemm-bench", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fmixlayer%2Fcandle-gemm-bench'... [INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }` [INFO] [stdout] a4e0fb274b06cff54b98ced9cd1e1867a21834c4 [INFO] checking mixlayer/candle-gemm-bench against try#4f260f0f20b3133d20cfb50353c0221943af5796+rustflags=-Dunmustuse_in_always_ok for pr-148577 [INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fmixlayer%2Fcandle-gemm-bench" "/workspace/builds/worker-5-tc2/source", kill_on_drop: false }` [INFO] [stderr] Cloning into '/workspace/builds/worker-5-tc2/source'... [INFO] [stderr] done. [INFO] started tweaking git repo https://github.com/mixlayer/candle-gemm-bench [INFO] finished tweaking git repo https://github.com/mixlayer/candle-gemm-bench [INFO] tweaked toml for git repo https://github.com/mixlayer/candle-gemm-bench written to /workspace/builds/worker-5-tc2/source/Cargo.toml [INFO] validating manifest of git repo https://github.com/mixlayer/candle-gemm-bench on toolchain 4f260f0f20b3133d20cfb50353c0221943af5796 [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+4f260f0f20b3133d20cfb50353c0221943af5796" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }` [INFO] crate git repo https://github.com/mixlayer/candle-gemm-bench already has a lockfile, it will not be regenerated [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+4f260f0f20b3133d20cfb50353c0221943af5796" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] [stderr] Blocking waiting for file lock on package cache [INFO] [stderr] Blocking waiting for file lock on package cache [INFO] [stderr] Downloading crates ... [INFO] [stderr] Downloaded float8 v0.3.0 [INFO] [stderr] Downloaded sysctl v0.6.0 [INFO] [stderr] Downloaded gemm-common v0.18.2 [INFO] [stderr] Downloaded gemm-f64 v0.18.2 [INFO] [stderr] Downloaded ug v0.4.0 [INFO] [stderr] Downloaded bindgen_cuda v0.1.5 [INFO] [stderr] Downloaded gemm-c64 v0.18.2 [INFO] [stderr] Downloaded gemm-c32 v0.18.2 [INFO] [stderr] Downloaded gemm-f16 v0.18.2 [INFO] [stderr] Downloaded ug-cuda v0.4.0 [INFO] [stderr] Downloaded dyn-stack v0.13.0 [INFO] [stderr] Downloaded gemm-f32 v0.18.2 [INFO] [stderr] Downloaded zip v1.1.4 [INFO] [stderr] Downloaded gemm v0.18.2 [INFO] [stderr] Downloaded cudarc v0.16.6 [INFO] [stderr] Downloaded cudarc v0.17.2 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:4848fb76d95f26979359cc7e45710b1dbc8f3acb7aeedee7c460d7702230f228" "/opt/rustwide/cargo-home/bin/cargo" "+4f260f0f20b3133d20cfb50353c0221943af5796" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }` [INFO] [stdout] e8dce50445ef8cb8ce7c70156346718cb74e3b4a908636e48e303cb49640772e [INFO] running `Command { std: "docker" "start" "-a" "e8dce50445ef8cb8ce7c70156346718cb74e3b4a908636e48e303cb49640772e", kill_on_drop: false }` [INFO] running `Command { std: "docker" "inspect" "e8dce50445ef8cb8ce7c70156346718cb74e3b4a908636e48e303cb49640772e", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "e8dce50445ef8cb8ce7c70156346718cb74e3b4a908636e48e303cb49640772e", kill_on_drop: false }` [INFO] [stdout] e8dce50445ef8cb8ce7c70156346718cb74e3b4a908636e48e303cb49640772e [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid -Dunmustuse_in_always_ok" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:4848fb76d95f26979359cc7e45710b1dbc8f3acb7aeedee7c460d7702230f228" "/opt/rustwide/cargo-home/bin/cargo" "+4f260f0f20b3133d20cfb50353c0221943af5796" "check" "--frozen" "--all" "--all-targets" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] 2586c16a705f29da39fd032aff634bfba3b3baf0ac67d618632d85785f2546e1 [INFO] running `Command { std: "docker" "start" "-a" "2586c16a705f29da39fd032aff634bfba3b3baf0ac67d618632d85785f2546e1", kill_on_drop: false }` [INFO] [stderr] Checking reborrow v0.5.5 [INFO] [stderr] Compiling seq-macro v0.3.6 [INFO] [stderr] Checking bitflags v2.9.2 [INFO] [stderr] Compiling either v1.15.0 [INFO] [stderr] Compiling crossbeam-utils v0.8.21 [INFO] [stderr] Compiling pulp v0.21.5 [INFO] [stderr] Compiling glob v0.3.3 [INFO] [stderr] Checking raw-cpuid v10.7.0 [INFO] [stderr] Checking getrandom v0.3.3 [INFO] [stderr] Compiling num_cpus v1.17.0 [INFO] [stderr] Compiling bytemuck_derive v1.10.1 [INFO] [stderr] Checking num-integer v0.1.46 [INFO] [stderr] Checking serde v1.0.219 [INFO] [stderr] Checking rayon-core v1.13.0 [INFO] [stderr] Compiling indexmap v2.10.0 [INFO] [stderr] Checking libloading v0.8.8 [INFO] [stderr] Compiling winnow v0.7.12 [INFO] [stderr] Checking raw-cpuid v11.5.0 [INFO] [stderr] Compiling cudarc v0.16.6 [INFO] [stderr] Checking rand_core v0.9.3 [INFO] [stderr] Compiling yoke-derive v0.7.5 [INFO] [stderr] Checking rand_chacha v0.9.0 [INFO] [stderr] Compiling crossbeam-epoch v0.9.18 [INFO] [stderr] Checking rayon v1.11.0 [INFO] [stderr] Checking num-bigint v0.4.6 [INFO] [stderr] Checking num-iter v0.1.45 [INFO] [stderr] Checking tracing v0.1.41 [INFO] [stderr] Checking memmap2 v0.9.7 [INFO] [stderr] Compiling zip v1.1.4 [INFO] [stderr] error: failed to run custom build command for `cudarc v0.16.6` [INFO] [stderr] note: To improve backtraces for build dependencies, set the CARGO_PROFILE_DEV_BUILD_OVERRIDE_DEBUG=true environment variable to enable debug information generation. [INFO] [stderr] [INFO] [stderr] Caused by: [INFO] [stderr] process didn't exit successfully: `/opt/rustwide/target/debug/build/cudarc-9c49895f8b68ed79/build-script-build` (exit status: 101) [INFO] [stderr] --- stdout [INFO] [stderr] cargo:rerun-if-changed=build.rs [INFO] [stderr] cargo:rerun-if-env-changed=CUDA_ROOT [INFO] [stderr] cargo:rerun-if-env-changed=CUDA_PATH [INFO] [stderr] cargo:rerun-if-env-changed=CUDA_TOOLKIT_ROOT_DIR [INFO] [stderr] cargo:rerun-if-env-changed=CUDARC_CUDA_VERSION [INFO] [stderr] [INFO] [stderr] --- stderr [INFO] [stderr] [INFO] [stderr] thread 'main' (262) panicked at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.16.6/build.rs:98:10: [INFO] [stderr] Failed to execute `nvcc`: Os { code: 2, kind: NotFound, message: "No such file or directory" } [INFO] [stderr] stack backtrace: [INFO] [stderr] 0: 0x5c913c047612 - std::backtrace_rs::backtrace::libunwind::trace::h60171437f2d722b2 [INFO] [stderr] at /rustc/4f260f0f20b3133d20cfb50353c0221943af5796/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9 [INFO] [stderr] 1: 0x5c913c047612 - std::backtrace_rs::backtrace::trace_unsynchronized::hb96c9cd2f11fb308 [INFO] [stderr] at /rustc/4f260f0f20b3133d20cfb50353c0221943af5796/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14 [INFO] [stderr] 2: 0x5c913c047612 - std::sys::backtrace::_print_fmt::h443388da2c666fae [INFO] [stderr] at /rustc/4f260f0f20b3133d20cfb50353c0221943af5796/library/std/src/sys/backtrace.rs:66:9 [INFO] [stderr] 3: 0x5c913c047612 - ::fmt::hfd69c50d3834f6a0 [INFO] [stderr] at /rustc/4f260f0f20b3133d20cfb50353c0221943af5796/library/std/src/sys/backtrace.rs:39:26 [INFO] [stderr] 4: 0x5c913c0568df - core::fmt::rt::Argument::fmt::h9af6df8b429e8b96 [INFO] [stderr] at /rustc/4f260f0f20b3133d20cfb50353c0221943af5796/library/core/src/fmt/rt.rs:173:76 [INFO] [stderr] 5: 0x5c913c0568df - core::fmt::write::hf99e44aa440b307f [INFO] [stderr] at /rustc/4f260f0f20b3133d20cfb50353c0221943af5796/library/core/src/fmt/mod.rs:1469:25 [INFO] [stderr] 6: 0x5c913c01dce3 - std::io::default_write_fmt::h76eed4cc901ea2ed [INFO] [stderr] at /rustc/4f260f0f20b3133d20cfb50353c0221943af5796/library/std/src/io/mod.rs:639:11 [INFO] [stderr] 7: 0x5c913c01dce3 - std::io::Write::write_fmt::h0ea4702377670d3b [INFO] [stderr] at /rustc/4f260f0f20b3133d20cfb50353c0221943af5796/library/std/src/io/mod.rs:1954:13 [INFO] [stderr] 8: 0x5c913c027292 - std::sys::backtrace::BacktraceLock::print::h765dc38e60d1586c [INFO] [stderr] at /rustc/4f260f0f20b3133d20cfb50353c0221943af5796/library/std/src/sys/backtrace.rs:42:9 [INFO] [stderr] 9: 0x5c913c02905c - std::panicking::default_hook::{{closure}}::hf6c888ec21cc9dff [INFO] [stderr] at /rustc/4f260f0f20b3133d20cfb50353c0221943af5796/library/std/src/panicking.rs:301:27 [INFO] [stderr] 10: 0x5c913c028eb6 - std::panicking::default_hook::h4de38c3fa09a8abe [INFO] [stderr] at /rustc/4f260f0f20b3133d20cfb50353c0221943af5796/library/std/src/panicking.rs:328:9 [INFO] [stderr] 11: 0x5c913c029635 - std::panicking::panic_with_hook::h12558778016956e9 [INFO] [stderr] at /rustc/4f260f0f20b3133d20cfb50353c0221943af5796/library/std/src/panicking.rs:834:13 [INFO] [stderr] 12: 0x5c913c0294ca - std::panicking::panic_handler::{{closure}}::hf8970889f3c6a05a [INFO] [stderr] at /rustc/4f260f0f20b3133d20cfb50353c0221943af5796/library/std/src/panicking.rs:707:13 [INFO] [stderr] 13: 0x5c913c0273c9 - std::sys::backtrace::__rust_end_short_backtrace::h4a31ae1af7d99557 [INFO] [stderr] at /rustc/4f260f0f20b3133d20cfb50353c0221943af5796/library/std/src/sys/backtrace.rs:174:18 [INFO] [stderr] 14: 0x5c913c01281d - __rustc[f61e3ce60372bc3]::rust_begin_unwind [INFO] [stderr] at /rustc/4f260f0f20b3133d20cfb50353c0221943af5796/library/std/src/panicking.rs:698:5 [INFO] [stderr] 15: 0x5c913c059df0 - core::panicking::panic_fmt::h41b9ceaf3e19fdd8 [INFO] [stderr] at /rustc/4f260f0f20b3133d20cfb50353c0221943af5796/library/core/src/panicking.rs:80:14 [INFO] [stderr] 16: 0x5c913c059646 - core::result::unwrap_failed::h4422018fc4dc076e [INFO] [stderr] at /rustc/4f260f0f20b3133d20cfb50353c0221943af5796/library/core/src/result.rs:1862:5 [INFO] [stderr] 17: 0x5c913c00b892 - core::result::Result::expect::hbc0d709361051f70 [INFO] [stderr] 18: 0x5c913c007bb6 - build_script_build::cuda_version_from_build_system::hbf6e21108bd662b5 [INFO] [stderr] 19: 0x5c913c008597 - build_script_build::main::h75eaea78497d892d [INFO] [stderr] 20: 0x5c913c00e643 - core::ops::function::FnOnce::call_once::hb71d9ab24c6f70a4 [INFO] [stderr] 21: 0x5c913c009576 - std::sys::backtrace::__rust_begin_short_backtrace::h92c3e2a58cf6d091 [INFO] [stderr] 22: 0x5c913c00e099 - std::rt::lang_start::{{closure}}::h32eb41036af87351 [INFO] [stderr] 23: 0x5c913c01f5d0 - core::ops::function::impls:: for &F>::call_once::h3241b95ad8589c00 [INFO] [stderr] at /rustc/4f260f0f20b3133d20cfb50353c0221943af5796/library/core/src/ops/function.rs:287:21 [INFO] [stderr] 24: 0x5c913c01f5d0 - std::panicking::catch_unwind::do_call::h681126cbdf74cf71 [INFO] [stderr] at /rustc/4f260f0f20b3133d20cfb50353c0221943af5796/library/std/src/panicking.rs:590:40 [INFO] [stderr] 25: 0x5c913c01f5d0 - std::panicking::catch_unwind::h7320c7c1d11525e3 [INFO] [stderr] at /rustc/4f260f0f20b3133d20cfb50353c0221943af5796/library/std/src/panicking.rs:553:19 [INFO] [stderr] 26: 0x5c913c01f5d0 - std::panic::catch_unwind::h761bf378b04d98bb [INFO] [stderr] at /rustc/4f260f0f20b3133d20cfb50353c0221943af5796/library/std/src/panic.rs:359:14 [INFO] [stderr] 27: 0x5c913c01f5d0 - std::rt::lang_start_internal::{{closure}}::he97832817ee996ef [INFO] [stderr] at /rustc/4f260f0f20b3133d20cfb50353c0221943af5796/library/std/src/rt.rs:175:24 [INFO] [stderr] 28: 0x5c913c01f5d0 - std::panicking::catch_unwind::do_call::hb638f1881b142a85 [INFO] [stderr] at /rustc/4f260f0f20b3133d20cfb50353c0221943af5796/library/std/src/panicking.rs:590:40 [INFO] [stderr] 29: 0x5c913c01f5d0 - std::panicking::catch_unwind::hdf1f9f9fe315a005 [INFO] [stderr] at /rustc/4f260f0f20b3133d20cfb50353c0221943af5796/library/std/src/panicking.rs:553:19 [INFO] [stderr] 30: 0x5c913c01f5d0 - std::panic::catch_unwind::hcc679dac39b36e99 [INFO] [stderr] at /rustc/4f260f0f20b3133d20cfb50353c0221943af5796/library/std/src/panic.rs:359:14 [INFO] [stderr] 31: 0x5c913c01f5d0 - std::rt::lang_start_internal::ha20fd23135b38181 [INFO] [stderr] at /rustc/4f260f0f20b3133d20cfb50353c0221943af5796/library/std/src/rt.rs:171:5 [INFO] [stderr] 32: 0x5c913c00e081 - std::rt::lang_start::h5b1395df12a5eb9f [INFO] [stderr] 33: 0x5c913c00d885 - main [INFO] [stderr] 34: 0x793767ccc1ca - [INFO] [stderr] 35: 0x793767ccc28b - __libc_start_main [INFO] [stderr] 36: 0x5c913c006945 - _start [INFO] [stderr] 37: 0x0 - [INFO] [stderr] warning: build failed, waiting for other jobs to finish... [INFO] running `Command { std: "docker" "inspect" "2586c16a705f29da39fd032aff634bfba3b3baf0ac67d618632d85785f2546e1", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "2586c16a705f29da39fd032aff634bfba3b3baf0ac67d618632d85785f2546e1", kill_on_drop: false }` [INFO] [stdout] 2586c16a705f29da39fd032aff634bfba3b3baf0ac67d618632d85785f2546e1