[INFO] cloning repository https://github.com/cryptoctl/mnist-candle [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/cryptoctl/mnist-candle" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fcryptoctl%2Fmnist-candle", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fcryptoctl%2Fmnist-candle'... [INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }` [INFO] [stdout] 87db1c9e1ef3580a7ad52fa04796157ce9fdfe83 [INFO] checking cryptoctl/mnist-candle/87db1c9e1ef3580a7ad52fa04796157ce9fdfe83 against master#8f21a5c92ea55c348c275a1bc4fedbdf181e0d64 for pr-143011 [INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fcryptoctl%2Fmnist-candle" "/workspace/builds/worker-5-tc1/source", kill_on_drop: false }` [INFO] [stderr] Cloning into '/workspace/builds/worker-5-tc1/source'... [INFO] [stderr] done. [INFO] started tweaking git repo https://github.com/cryptoctl/mnist-candle [INFO] finished tweaking git repo https://github.com/cryptoctl/mnist-candle [INFO] tweaked toml for git repo https://github.com/cryptoctl/mnist-candle written to /workspace/builds/worker-5-tc1/source/Cargo.toml [INFO] validating manifest of git repo https://github.com/cryptoctl/mnist-candle on toolchain 8f21a5c92ea55c348c275a1bc4fedbdf181e0d64 [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+8f21a5c92ea55c348c275a1bc4fedbdf181e0d64" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }` [INFO] crate git repo https://github.com/cryptoctl/mnist-candle already has a lockfile, it will not be regenerated [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+8f21a5c92ea55c348c275a1bc4fedbdf181e0d64" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] [stderr] warning: profiles for the non root package will be ignored, specify profiles at the workspace root: [INFO] [stderr] package: /workspace/builds/worker-5-tc1/source/inference/Cargo.toml [INFO] [stderr] workspace: /workspace/builds/worker-5-tc1/source/Cargo.toml [INFO] [stderr] Updating crates.io index [INFO] [stderr] Downloading crates ... [INFO] [stderr] Downloaded safetensors v0.4.3 [INFO] [stderr] Downloaded candle-datasets v0.6.0 [INFO] [stderr] Downloaded pulp v0.18.21 [INFO] [stderr] Downloaded arrow-select v51.0.0 [INFO] [stderr] Downloaded arrow-schema v51.0.0 [INFO] [stderr] Downloaded arrow-data v51.0.0 [INFO] [stderr] Downloaded arrow-cast v51.0.0 [INFO] [stderr] Downloaded arrow-ipc v51.0.0 [INFO] [stderr] Downloaded arrow-buffer v51.0.0 [INFO] [stderr] Downloaded candle-nn v0.6.0 [INFO] [stderr] Downloaded candle-kernels v0.6.0 [INFO] [stderr] Downloaded arrow-array v51.0.0 [INFO] [stderr] Downloaded parquet v51.0.0 [INFO] [stderr] Downloaded cudarc v0.11.8 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:90999bfc7ae267e83380e433d8e61a7c072ca6729e92edbae886d3423b3a6f4c" "/opt/rustwide/cargo-home/bin/cargo" "+8f21a5c92ea55c348c275a1bc4fedbdf181e0d64" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }` [INFO] [stdout] dbbe240ec496a691bd506fc3ab8061f9366ba202a443c646ab4ff9f368c19e9c [INFO] running `Command { std: "docker" "start" "-a" "dbbe240ec496a691bd506fc3ab8061f9366ba202a443c646ab4ff9f368c19e9c", kill_on_drop: false }` [INFO] running `Command { std: "docker" "inspect" "dbbe240ec496a691bd506fc3ab8061f9366ba202a443c646ab4ff9f368c19e9c", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "dbbe240ec496a691bd506fc3ab8061f9366ba202a443c646ab4ff9f368c19e9c", kill_on_drop: false }` [INFO] [stdout] dbbe240ec496a691bd506fc3ab8061f9366ba202a443c646ab4ff9f368c19e9c [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:90999bfc7ae267e83380e433d8e61a7c072ca6729e92edbae886d3423b3a6f4c" "/opt/rustwide/cargo-home/bin/cargo" "+8f21a5c92ea55c348c275a1bc4fedbdf181e0d64" "check" "--frozen" "--all" "--all-targets" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] ebe71447cb9d4594064b0accc61d8efac8997ae6dd6ccd53ed96deec5065a85d [INFO] running `Command { std: "docker" "start" "-a" "ebe71447cb9d4594064b0accc61d8efac8997ae6dd6ccd53ed96deec5065a85d", kill_on_drop: false }` [INFO] [stderr] warning: profiles for the non root package will be ignored, specify profiles at the workspace root: [INFO] [stderr] package: /opt/rustwide/workdir/inference/Cargo.toml [INFO] [stderr] workspace: /opt/rustwide/workdir/Cargo.toml [INFO] [stderr] Compiling proc-macro2 v1.0.86 [INFO] [stderr] Compiling unicode-ident v1.0.12 [INFO] [stderr] Compiling libc v0.2.155 [INFO] [stderr] Checking cfg-if v1.0.0 [INFO] [stderr] Compiling autocfg v1.3.0 [INFO] [stderr] Compiling libm v0.2.8 [INFO] [stderr] Checking once_cell v1.19.0 [INFO] [stderr] Checking byteorder v1.5.0 [INFO] [stderr] Compiling crossbeam-utils v0.8.20 [INFO] [stderr] Compiling rayon-core v1.12.1 [INFO] [stderr] Compiling pkg-config v0.3.30 [INFO] [stderr] Checking either v1.13.0 [INFO] [stderr] Compiling paste v1.0.15 [INFO] [stderr] Compiling num-traits v0.2.19 [INFO] [stderr] Checking bitflags v1.3.2 [INFO] [stderr] Checking memchr v2.7.4 [INFO] [stderr] Checking crossbeam-epoch v0.9.18 [INFO] [stderr] Compiling lock_api v0.4.12 [INFO] [stderr] Compiling quote v1.0.36 [INFO] [stderr] Checking crossbeam-deque v0.8.5 [INFO] [stderr] Checking simd-adler32 v0.3.7 [INFO] [stderr] Compiling serde v1.0.204 [INFO] [stderr] Checking reborrow v0.5.5 [INFO] [stderr] Compiling syn v2.0.72 [INFO] [stderr] Checking scopeguard v1.2.0 [INFO] [stderr] Checking getrandom v0.2.15 [INFO] [stderr] Checking rand_core v0.6.4 [INFO] [stderr] Compiling jobserver v0.1.32 [INFO] [stderr] Checking rayon v1.10.0 [INFO] [stderr] Checking crc32fast v1.4.2 [INFO] [stderr] Compiling seq-macro v0.3.5 [INFO] [stderr] Checking ryu v1.0.18 [INFO] [stderr] Compiling thiserror v1.0.63 [INFO] [stderr] Compiling cc v1.1.7 [INFO] [stderr] Checking spin v0.9.8 [INFO] [stderr] Checking num-integer v0.1.46 [INFO] [stderr] Checking raw-cpuid v10.7.0 [INFO] [stderr] Checking log v0.4.22 [INFO] [stderr] Checking adler v1.0.2 [INFO] [stderr] Checking num-bigint v0.4.6 [INFO] [stderr] Checking hashbrown v0.14.5 [INFO] [stderr] Checking miniz_oxide v0.7.4 [INFO] [stderr] Compiling serde_json v1.0.122 [INFO] [stderr] Compiling equivalent v1.0.1 [INFO] [stderr] Checking static_assertions v1.1.0 [INFO] [stderr] Compiling toml_datetime v0.6.8 [INFO] [stderr] Checking minimal-lexical v0.2.1 [INFO] [stderr] Checking itoa v1.0.11 [INFO] [stderr] Compiling winnow v0.5.40 [INFO] [stderr] Checking num-rational v0.4.2 [INFO] [stderr] Compiling indexmap v2.3.0 [INFO] [stderr] Checking nom v7.1.3 [INFO] [stderr] Checking flate2 v1.0.31 [INFO] [stderr] Compiling num_cpus v1.16.0 [INFO] [stderr] Compiling anyhow v1.0.86 [INFO] [stderr] Compiling glob v0.3.1 [INFO] [stderr] Compiling vcpkg v0.2.15 [INFO] [stderr] Compiling ring v0.17.8 [INFO] [stderr] Checking lexical-util v0.8.5 [INFO] [stderr] Checking num-iter v0.1.45 [INFO] [stderr] Checking arrayvec v0.7.4 [INFO] [stderr] Compiling version_check v0.9.5 [INFO] [stderr] Compiling built v0.7.4 [INFO] [stderr] Compiling semver v1.0.23 [INFO] [stderr] Compiling wasm-bindgen-shared v0.2.93 [INFO] [stderr] Compiling openssl-sys v0.9.103 [INFO] [stderr] Checking aligned-vec v0.5.0 [INFO] [stderr] Compiling ahash v0.8.11 [INFO] [stderr] Checking v_frame v0.3.8 [INFO] [stderr] Checking itertools v0.12.1 [INFO] [stderr] Compiling rav1e v0.7.1 [INFO] [stderr] Compiling strsim v0.11.1 [INFO] [stderr] Checking bytes v1.7.1 [INFO] [stderr] Compiling zip v1.1.4 [INFO] [stderr] Compiling ident_case v1.0.1 [INFO] [stderr] Compiling toml_edit v0.21.1 [INFO] [stderr] Checking smallvec v1.13.2 [INFO] [stderr] Compiling cudarc v0.11.8 [INFO] [stderr] Compiling synstructure v0.13.1 [INFO] [stderr] Compiling fnv v1.0.7 [INFO] [stderr] Checking stable_deref_trait v1.2.0 [INFO] [stderr] error: failed to run custom build command for `cudarc v0.11.8` [INFO] [stderr] note: To improve backtraces for build dependencies, set the CARGO_PROFILE_DEV_BUILD_OVERRIDE_DEBUG=true environment variable to enable debug information generation. [INFO] [stderr] [INFO] [stderr] Caused by: [INFO] [stderr] process didn't exit successfully: `/opt/rustwide/target/debug/build/cudarc-dfd2a91858116455/build-script-build` (exit status: 101) [INFO] [stderr] --- stdout [INFO] [stderr] cargo:rerun-if-changed=build.rs [INFO] [stderr] cargo:rerun-if-env-changed=CUDA_ROOT [INFO] [stderr] cargo:rerun-if-env-changed=CUDA_PATH [INFO] [stderr] cargo:rerun-if-env-changed=CUDA_TOOLKIT_ROOT_DIR [INFO] [stderr] [INFO] [stderr] --- stderr [INFO] [stderr] [INFO] [stderr] thread 'main' panicked at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.11.8/build.rs:55:10: [INFO] [stderr] Failed to execute `nvcc`: Os { code: 2, kind: NotFound, message: "No such file or directory" } [INFO] [stderr] stack backtrace: [INFO] [stderr] 0: 0x5daaf68b5e42 - std::backtrace_rs::backtrace::libunwind::trace::h77d4f1ab393021ff [INFO] [stderr] at /rustc/8f21a5c92ea55c348c275a1bc4fedbdf181e0d64/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9 [INFO] [stderr] 1: 0x5daaf68b5e42 - std::backtrace_rs::backtrace::trace_unsynchronized::h6b52b199056dc310 [INFO] [stderr] at /rustc/8f21a5c92ea55c348c275a1bc4fedbdf181e0d64/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14 [INFO] [stderr] 2: 0x5daaf68b5e42 - std::sys::backtrace::_print_fmt::h336a00096dca5793 [INFO] [stderr] at /rustc/8f21a5c92ea55c348c275a1bc4fedbdf181e0d64/library/std/src/sys/backtrace.rs:66:9 [INFO] [stderr] 3: 0x5daaf68b5e42 - ::fmt::h4e23cde6d13531e6 [INFO] [stderr] at /rustc/8f21a5c92ea55c348c275a1bc4fedbdf181e0d64/library/std/src/sys/backtrace.rs:39:26 [INFO] [stderr] 4: 0x5daaf68d5743 - core::fmt::rt::Argument::fmt::hd73adb1dd4f13238 [INFO] [stderr] at /rustc/8f21a5c92ea55c348c275a1bc4fedbdf181e0d64/library/core/src/fmt/rt.rs:173:76 [INFO] [stderr] 5: 0x5daaf68d5743 - core::fmt::write::h24956daaf3520b88 [INFO] [stderr] at /rustc/8f21a5c92ea55c348c275a1bc4fedbdf181e0d64/library/core/src/fmt/mod.rs:1465:25 [INFO] [stderr] 6: 0x5daaf68b3433 - std::io::default_write_fmt::h5ad85cda2d892f3f [INFO] [stderr] at /rustc/8f21a5c92ea55c348c275a1bc4fedbdf181e0d64/library/std/src/io/mod.rs:639:11 [INFO] [stderr] 7: 0x5daaf68b3433 - std::io::Write::write_fmt::h744a9c29e898aaa0 [INFO] [stderr] at /rustc/8f21a5c92ea55c348c275a1bc4fedbdf181e0d64/library/std/src/io/mod.rs:1954:13 [INFO] [stderr] 8: 0x5daaf68b5c92 - std::sys::backtrace::BacktraceLock::print::h80bc63112117b07d [INFO] [stderr] at /rustc/8f21a5c92ea55c348c275a1bc4fedbdf181e0d64/library/std/src/sys/backtrace.rs:42:9 [INFO] [stderr] 9: 0x5daaf68b6d06 - std::panicking::default_hook::{{closure}}::hcc0250ffe151a9a2 [INFO] [stderr] at /rustc/8f21a5c92ea55c348c275a1bc4fedbdf181e0d64/library/std/src/panicking.rs:300:27 [INFO] [stderr] 10: 0x5daaf68b6b09 - std::panicking::default_hook::heb98c3e6f5363c1c [INFO] [stderr] at /rustc/8f21a5c92ea55c348c275a1bc4fedbdf181e0d64/library/std/src/panicking.rs:327:9 [INFO] [stderr] 11: 0x5daaf68b75d2 - std::panicking::rust_panic_with_hook::ha71490f06bda8fdd [INFO] [stderr] at /rustc/8f21a5c92ea55c348c275a1bc4fedbdf181e0d64/library/std/src/panicking.rs:833:13 [INFO] [stderr] 12: 0x5daaf68b746a - std::panicking::begin_panic_handler::{{closure}}::h842d98411b820c95 [INFO] [stderr] at /rustc/8f21a5c92ea55c348c275a1bc4fedbdf181e0d64/library/std/src/panicking.rs:706:13 [INFO] [stderr] 13: 0x5daaf68b6339 - std::sys::backtrace::__rust_end_short_backtrace::hc17b54f5216e7287 [INFO] [stderr] at /rustc/8f21a5c92ea55c348c275a1bc4fedbdf181e0d64/library/std/src/sys/backtrace.rs:168:18 [INFO] [stderr] 14: 0x5daaf68b70fd - __rustc[d39aaf4d8a5bdd9]::rust_begin_unwind [INFO] [stderr] at /rustc/8f21a5c92ea55c348c275a1bc4fedbdf181e0d64/library/std/src/panicking.rs:697:5 [INFO] [stderr] 15: 0x5daaf68d4a30 - core::panicking::panic_fmt::hafddcaa47f3ecc5a [INFO] [stderr] at /rustc/8f21a5c92ea55c348c275a1bc4fedbdf181e0d64/library/core/src/panicking.rs:75:14 [INFO] [stderr] 16: 0x5daaf68d4da6 - core::result::unwrap_failed::heb4e3621f080f33c [INFO] [stderr] at /rustc/8f21a5c92ea55c348c275a1bc4fedbdf181e0d64/library/core/src/result.rs:1761:5 [INFO] [stderr] 17: 0x5daaf688d442 - core::result::Result::expect::habac581676a6714d [INFO] [stderr] 18: 0x5daaf688e916 - build_script_build::cuda_version_from_build_system::h73a05c483314cc66 [INFO] [stderr] 19: 0x5daaf688e692 - build_script_build::main::h1b00069a3ed13e5e [INFO] [stderr] 20: 0x5daaf6889713 - core::ops::function::FnOnce::call_once::ha36ee207d0e76b02 [INFO] [stderr] 21: 0x5daaf688c406 - std::sys::backtrace::__rust_begin_short_backtrace::h7d0c05c0e0eadce1 [INFO] [stderr] 22: 0x5daaf688c369 - std::rt::lang_start::{{closure}}::h69ce079d0e2effec [INFO] [stderr] 23: 0x5daaf68b00b0 - core::ops::function::impls:: for &F>::call_once::ha6f9c4d44e1a5001 [INFO] [stderr] at /rustc/8f21a5c92ea55c348c275a1bc4fedbdf181e0d64/library/core/src/ops/function.rs:284:21 [INFO] [stderr] 24: 0x5daaf68b00b0 - std::panicking::catch_unwind::do_call::hf103a4d58b5b21e2 [INFO] [stderr] at /rustc/8f21a5c92ea55c348c275a1bc4fedbdf181e0d64/library/std/src/panicking.rs:589:40 [INFO] [stderr] 25: 0x5daaf68b00b0 - std::panicking::catch_unwind::hd0c31cdd71304f17 [INFO] [stderr] at /rustc/8f21a5c92ea55c348c275a1bc4fedbdf181e0d64/library/std/src/panicking.rs:552:19 [INFO] [stderr] 26: 0x5daaf68b00b0 - std::panic::catch_unwind::h434b753bad4487d0 [INFO] [stderr] at /rustc/8f21a5c92ea55c348c275a1bc4fedbdf181e0d64/library/std/src/panic.rs:359:14 [INFO] [stderr] 27: 0x5daaf68b00b0 - std::rt::lang_start_internal::{{closure}}::h26129cc9f6eb7a93 [INFO] [stderr] at /rustc/8f21a5c92ea55c348c275a1bc4fedbdf181e0d64/library/std/src/rt.rs:175:24 [INFO] [stderr] 28: 0x5daaf68b00b0 - std::panicking::catch_unwind::do_call::had764bf67fcbab3f [INFO] [stderr] at /rustc/8f21a5c92ea55c348c275a1bc4fedbdf181e0d64/library/std/src/panicking.rs:589:40 [INFO] [stderr] 29: 0x5daaf68b00b0 - std::panicking::catch_unwind::h4085a8f2f773b27d [INFO] [stderr] at /rustc/8f21a5c92ea55c348c275a1bc4fedbdf181e0d64/library/std/src/panicking.rs:552:19 [INFO] [stderr] 30: 0x5daaf68b00b0 - std::panic::catch_unwind::h3198cebd91ce9b7d [INFO] [stderr] at /rustc/8f21a5c92ea55c348c275a1bc4fedbdf181e0d64/library/std/src/panic.rs:359:14 [INFO] [stderr] 31: 0x5daaf68b00b0 - std::rt::lang_start_internal::hf25b94b42aad689d [INFO] [stderr] at /rustc/8f21a5c92ea55c348c275a1bc4fedbdf181e0d64/library/std/src/rt.rs:171:5 [INFO] [stderr] 32: 0x5daaf688c351 - std::rt::lang_start::h5b79a0038a353e62 [INFO] [stderr] 33: 0x5daaf6890145 - main [INFO] [stderr] 34: 0x7b4bc82891ca - [INFO] [stderr] 35: 0x7b4bc828928b - __libc_start_main [INFO] [stderr] 36: 0x5daaf6883805 - _start [INFO] [stderr] 37: 0x0 - [INFO] [stderr] warning: build failed, waiting for other jobs to finish... [INFO] running `Command { std: "docker" "inspect" "ebe71447cb9d4594064b0accc61d8efac8997ae6dd6ccd53ed96deec5065a85d", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "ebe71447cb9d4594064b0accc61d8efac8997ae6dd6ccd53ed96deec5065a85d", kill_on_drop: false }` [INFO] [stdout] ebe71447cb9d4594064b0accc61d8efac8997ae6dd6ccd53ed96deec5065a85d