[INFO] cloning repository https://github.com/cyril-k/mpi-nccl-rs [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/cyril-k/mpi-nccl-rs" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fcyril-k%2Fmpi-nccl-rs", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fcyril-k%2Fmpi-nccl-rs'... [INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }` [INFO] [stdout] 8efdcbfb6b6b1c6362f50d71755c783aec712358 [INFO] checking cyril-k/mpi-nccl-rs against try#8384de5d92dd9b1c0b67caa5c1c1b11bf606490f for pr-146300 [INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fcyril-k%2Fmpi-nccl-rs" "/workspace/builds/worker-0-tc2/source", kill_on_drop: false }` [INFO] [stderr] Cloning into '/workspace/builds/worker-0-tc2/source'... [INFO] [stderr] done. [INFO] started tweaking git repo https://github.com/cyril-k/mpi-nccl-rs [INFO] finished tweaking git repo https://github.com/cyril-k/mpi-nccl-rs [INFO] tweaked toml for git repo https://github.com/cyril-k/mpi-nccl-rs written to /workspace/builds/worker-0-tc2/source/Cargo.toml [INFO] validating manifest of git repo https://github.com/cyril-k/mpi-nccl-rs on toolchain 8384de5d92dd9b1c0b67caa5c1c1b11bf606490f [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+8384de5d92dd9b1c0b67caa5c1c1b11bf606490f" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }` [INFO] crate git repo https://github.com/cyril-k/mpi-nccl-rs already has a lockfile, it will not be regenerated [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+8384de5d92dd9b1c0b67caa5c1c1b11bf606490f" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] [stderr] Blocking waiting for file lock on package cache [INFO] [stderr] Updating crates.io index [INFO] [stderr] Blocking waiting for file lock on package cache [ERROR] error running command: no output for 300 seconds [INFO] checking cyril-k/mpi-nccl-rs against try#8384de5d92dd9b1c0b67caa5c1c1b11bf606490f for pr-146300 [INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fcyril-k%2Fmpi-nccl-rs" "/workspace/builds/worker-0-tc2/source", kill_on_drop: false }` [INFO] [stderr] Cloning into '/workspace/builds/worker-0-tc2/source'... [INFO] [stderr] done. [INFO] started tweaking git repo https://github.com/cyril-k/mpi-nccl-rs [INFO] finished tweaking git repo https://github.com/cyril-k/mpi-nccl-rs [INFO] tweaked toml for git repo https://github.com/cyril-k/mpi-nccl-rs written to /workspace/builds/worker-0-tc2/source/Cargo.toml [INFO] validating manifest of git repo https://github.com/cyril-k/mpi-nccl-rs on toolchain 8384de5d92dd9b1c0b67caa5c1c1b11bf606490f [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+8384de5d92dd9b1c0b67caa5c1c1b11bf606490f" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }` [INFO] crate git repo https://github.com/cyril-k/mpi-nccl-rs already has a lockfile, it will not be regenerated [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+8384de5d92dd9b1c0b67caa5c1c1b11bf606490f" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] [stderr] Blocking waiting for file lock on package cache [INFO] [stderr] Blocking waiting for file lock on package cache [INFO] [stderr] Downloading crates ... [INFO] [stderr] Downloaded build-probe-mpi v0.1.4 [INFO] [stderr] Downloaded mpi-sys v0.2.2 [INFO] [stderr] Downloaded libffi v3.2.0 [INFO] [stderr] Downloaded cc v1.2.21 [INFO] [stderr] Downloaded mpi v0.8.0 [INFO] [stderr] Downloaded cudarc v0.16.4 [INFO] [stderr] Downloaded libffi-sys v2.3.0 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:e90291280db7d1fac5b66fc6dad9f9662629e7365a55743daf9bdf73ebc4ea79" "/opt/rustwide/cargo-home/bin/cargo" "+8384de5d92dd9b1c0b67caa5c1c1b11bf606490f" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }` [INFO] [stdout] 2c25401a734782a2bd8d5fc80a3784624b7337ea2bb42a6ba6e390f3bd56b0d2 [INFO] running `Command { std: "docker" "start" "-a" "2c25401a734782a2bd8d5fc80a3784624b7337ea2bb42a6ba6e390f3bd56b0d2", kill_on_drop: false }` [INFO] running `Command { std: "docker" "inspect" "2c25401a734782a2bd8d5fc80a3784624b7337ea2bb42a6ba6e390f3bd56b0d2", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "2c25401a734782a2bd8d5fc80a3784624b7337ea2bb42a6ba6e390f3bd56b0d2", kill_on_drop: false }` [INFO] [stdout] 2c25401a734782a2bd8d5fc80a3784624b7337ea2bb42a6ba6e390f3bd56b0d2 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:e90291280db7d1fac5b66fc6dad9f9662629e7365a55743daf9bdf73ebc4ea79" "/opt/rustwide/cargo-home/bin/cargo" "+8384de5d92dd9b1c0b67caa5c1c1b11bf606490f" "check" "--frozen" "--all" "--all-targets" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] 418c82c4f902ba3fe9b703b5ae19705cdca63bd82b6122349d323bf42e316a98 [INFO] running `Command { std: "docker" "start" "-a" "418c82c4f902ba3fe9b703b5ae19705cdca63bd82b6122349d323bf42e316a98", kill_on_drop: false }` [INFO] [stderr] Compiling glob v0.3.2 [INFO] [stderr] Compiling prettyplease v0.2.32 [INFO] [stderr] Compiling libc v0.2.172 [INFO] [stderr] Compiling cc v1.2.21 [INFO] [stderr] Compiling rustix v0.38.44 [INFO] [stderr] Compiling bitflags v2.9.0 [INFO] [stderr] Compiling regex-syntax v0.8.5 [INFO] [stderr] Compiling syn v2.0.101 [INFO] [stderr] Compiling linux-raw-sys v0.4.15 [INFO] [stderr] Compiling either v1.15.0 [INFO] [stderr] Compiling nom v7.1.3 [INFO] [stderr] Compiling clang-sys v1.8.1 [INFO] [stderr] Compiling libloading v0.8.6 [INFO] [stderr] Compiling home v0.5.11 [INFO] [stderr] Compiling bindgen v0.69.5 [INFO] [stderr] Compiling shell-words v1.1.0 [INFO] [stderr] Compiling build-probe-mpi v0.1.4 [INFO] [stderr] Compiling itertools v0.12.1 [INFO] [stderr] Compiling log v0.4.27 [INFO] [stderr] Compiling lazy_static v1.5.0 [INFO] [stderr] Compiling lazycell v1.3.0 [INFO] [stderr] Compiling regex-automata v0.4.9 [INFO] [stderr] Compiling rustc-hash v1.1.0 [INFO] [stderr] Compiling num-traits v0.2.19 [INFO] [stderr] Compiling cexpr v0.6.0 [INFO] [stderr] Compiling libffi-sys v2.3.0 [INFO] [stderr] Checking rand_core v0.6.4 [INFO] [stderr] Checking rand v0.8.5 [INFO] [stderr] Compiling which v4.4.2 [INFO] [stderr] Compiling mpi v0.8.0 [INFO] [stderr] Compiling cudarc v0.16.4 [INFO] [stderr] Checking rand_distr v0.4.3 [INFO] [stderr] Checking smallvec v1.15.0 [INFO] [stderr] Compiling regex v1.11.1 [INFO] [stderr] error: failed to run custom build command for `cudarc v0.16.4` [INFO] [stderr] note: To improve backtraces for build dependencies, set the CARGO_PROFILE_DEV_BUILD_OVERRIDE_DEBUG=true environment variable to enable debug information generation. [INFO] [stderr] [INFO] [stderr] Caused by: [INFO] [stderr] process didn't exit successfully: `/opt/rustwide/target/debug/build/cudarc-5502b678c7c7fabc/build-script-build` (exit status: 101) [INFO] [stderr] --- stdout [INFO] [stderr] cargo:rerun-if-changed=build.rs [INFO] [stderr] cargo:rerun-if-env-changed=CUDA_ROOT [INFO] [stderr] cargo:rerun-if-env-changed=CUDA_PATH [INFO] [stderr] cargo:rerun-if-env-changed=CUDA_TOOLKIT_ROOT_DIR [INFO] [stderr] [INFO] [stderr] --- stderr [INFO] [stderr] [INFO] [stderr] thread 'main' (873) panicked at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.16.4/build.rs:77:10: [INFO] [stderr] Failed to execute `nvcc`: Os { code: 2, kind: NotFound, message: "No such file or directory" } [INFO] [stderr] stack backtrace: [INFO] [stderr] 0: 0x5bb6aa230ef2 - std::backtrace_rs::backtrace::libunwind::trace::h854815ff973fed66 [INFO] [stderr] at /rustc/8384de5d92dd9b1c0b67caa5c1c1b11bf606490f/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9 [INFO] [stderr] 1: 0x5bb6aa230ef2 - std::backtrace_rs::backtrace::trace_unsynchronized::hdab55b12702f91da [INFO] [stderr] at /rustc/8384de5d92dd9b1c0b67caa5c1c1b11bf606490f/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14 [INFO] [stderr] 2: 0x5bb6aa230ef2 - std::sys::backtrace::_print_fmt::h2d1ad7609929dee1 [INFO] [stderr] at /rustc/8384de5d92dd9b1c0b67caa5c1c1b11bf606490f/library/std/src/sys/backtrace.rs:66:9 [INFO] [stderr] 3: 0x5bb6aa230ef2 - ::fmt::h3cdba1cb2c98e695 [INFO] [stderr] at /rustc/8384de5d92dd9b1c0b67caa5c1c1b11bf606490f/library/std/src/sys/backtrace.rs:39:26 [INFO] [stderr] 4: 0x5bb6aa24053f - core::fmt::rt::Argument::fmt::h2cf1ca8d9907eed2 [INFO] [stderr] at /rustc/8384de5d92dd9b1c0b67caa5c1c1b11bf606490f/library/core/src/fmt/rt.rs:173:76 [INFO] [stderr] 5: 0x5bb6aa24053f - core::fmt::write::hcf5316c9baea7d56 [INFO] [stderr] at /rustc/8384de5d92dd9b1c0b67caa5c1c1b11bf606490f/library/core/src/fmt/mod.rs:1468:25 [INFO] [stderr] 6: 0x5bb6aa207011 - std::io::default_write_fmt::h71f6c32532aba94c [INFO] [stderr] at /rustc/8384de5d92dd9b1c0b67caa5c1c1b11bf606490f/library/std/src/io/mod.rs:639:11 [INFO] [stderr] 7: 0x5bb6aa207011 - std::io::Write::write_fmt::h5736790fb7e325c0 [INFO] [stderr] at /rustc/8384de5d92dd9b1c0b67caa5c1c1b11bf606490f/library/std/src/io/mod.rs:1954:13 [INFO] [stderr] 8: 0x5bb6aa210812 - std::sys::backtrace::BacktraceLock::print::h51fd778ed6136181 [INFO] [stderr] at /rustc/8384de5d92dd9b1c0b67caa5c1c1b11bf606490f/library/std/src/sys/backtrace.rs:42:9 [INFO] [stderr] 9: 0x5bb6aa21262c - std::panicking::default_hook::{{closure}}::h165971d9981322c0 [INFO] [stderr] at /rustc/8384de5d92dd9b1c0b67caa5c1c1b11bf606490f/library/std/src/panicking.rs:301:27 [INFO] [stderr] 10: 0x5bb6aa212486 - std::panicking::default_hook::h2b66c2d5bd429e2d [INFO] [stderr] at /rustc/8384de5d92dd9b1c0b67caa5c1c1b11bf606490f/library/std/src/panicking.rs:328:9 [INFO] [stderr] 11: 0x5bb6aa212cb5 - std::panicking::panic_with_hook::hd38763bcc95c6f3b [INFO] [stderr] at /rustc/8384de5d92dd9b1c0b67caa5c1c1b11bf606490f/library/std/src/panicking.rs:834:13 [INFO] [stderr] 12: 0x5bb6aa212b4a - std::panicking::panic_handler::{{closure}}::h7b8ab7b819441eeb [INFO] [stderr] at /rustc/8384de5d92dd9b1c0b67caa5c1c1b11bf606490f/library/std/src/panicking.rs:707:13 [INFO] [stderr] 13: 0x5bb6aa210949 - std::sys::backtrace::__rust_end_short_backtrace::ha61e8f66d2068a1d [INFO] [stderr] at /rustc/8384de5d92dd9b1c0b67caa5c1c1b11bf606490f/library/std/src/sys/backtrace.rs:174:18 [INFO] [stderr] 14: 0x5bb6aa1fb77d - __rustc[bc34ae1b7b925178]::rust_begin_unwind [INFO] [stderr] at /rustc/8384de5d92dd9b1c0b67caa5c1c1b11bf606490f/library/std/src/panicking.rs:698:5 [INFO] [stderr] 15: 0x5bb6aa243a00 - core::panicking::panic_fmt::hc4b298f76662e30d [INFO] [stderr] at /rustc/8384de5d92dd9b1c0b67caa5c1c1b11bf606490f/library/core/src/panicking.rs:75:14 [INFO] [stderr] 16: 0x5bb6aa243276 - core::result::unwrap_failed::h59f076b0294da6ea [INFO] [stderr] at /rustc/8384de5d92dd9b1c0b67caa5c1c1b11bf606490f/library/core/src/result.rs:1854:5 [INFO] [stderr] 17: 0x5bb6aa1f9ed2 - core::result::Result::expect::h26e627b1ac3b7a3b [INFO] [stderr] 18: 0x5bb6aa1f5b26 - build_script_build::cuda_version_from_build_system::h5e761f6fa87f59e3 [INFO] [stderr] 19: 0x5bb6aa1f64b2 - build_script_build::main::h8c46145982eb29c3 [INFO] [stderr] 20: 0x5bb6aa1f6cc3 - core::ops::function::FnOnce::call_once::hbd72eff3cacdc2f5 [INFO] [stderr] 21: 0x5bb6aa1f9196 - std::sys::backtrace::__rust_begin_short_backtrace::h4872f4293d009f41 [INFO] [stderr] 22: 0x5bb6aa1f9089 - std::rt::lang_start::{{closure}}::h99fb540fb9dd2593 [INFO] [stderr] 23: 0x5bb6aa208910 - core::ops::function::impls:: for &F>::call_once::he2ae81a525615853 [INFO] [stderr] at /rustc/8384de5d92dd9b1c0b67caa5c1c1b11bf606490f/library/core/src/ops/function.rs:287:21 [INFO] [stderr] 24: 0x5bb6aa208910 - std::panicking::catch_unwind::do_call::hc8cf14d2883556e2 [INFO] [stderr] at /rustc/8384de5d92dd9b1c0b67caa5c1c1b11bf606490f/library/std/src/panicking.rs:590:40 [INFO] [stderr] 25: 0x5bb6aa208910 - std::panicking::catch_unwind::he2eff0ecd31c387d [INFO] [stderr] at /rustc/8384de5d92dd9b1c0b67caa5c1c1b11bf606490f/library/std/src/panicking.rs:553:19 [INFO] [stderr] 26: 0x5bb6aa208910 - std::panic::catch_unwind::hb6e5764a5b024af9 [INFO] [stderr] at /rustc/8384de5d92dd9b1c0b67caa5c1c1b11bf606490f/library/std/src/panic.rs:359:14 [INFO] [stderr] 27: 0x5bb6aa208910 - std::rt::lang_start_internal::{{closure}}::h4187523adb7cb422 [INFO] [stderr] at /rustc/8384de5d92dd9b1c0b67caa5c1c1b11bf606490f/library/std/src/rt.rs:175:24 [INFO] [stderr] 28: 0x5bb6aa208910 - std::panicking::catch_unwind::do_call::h501d032c4bb956cb [INFO] [stderr] at /rustc/8384de5d92dd9b1c0b67caa5c1c1b11bf606490f/library/std/src/panicking.rs:590:40 [INFO] [stderr] 29: 0x5bb6aa208910 - std::panicking::catch_unwind::h1fd4ab81433c702d [INFO] [stderr] at /rustc/8384de5d92dd9b1c0b67caa5c1c1b11bf606490f/library/std/src/panicking.rs:553:19 [INFO] [stderr] 30: 0x5bb6aa208910 - std::panic::catch_unwind::hb84ab8ba139351d5 [INFO] [stderr] at /rustc/8384de5d92dd9b1c0b67caa5c1c1b11bf606490f/library/std/src/panic.rs:359:14 [INFO] [stderr] 31: 0x5bb6aa208910 - std::rt::lang_start_internal::h69489c1a1ccf310f [INFO] [stderr] at /rustc/8384de5d92dd9b1c0b67caa5c1c1b11bf606490f/library/std/src/rt.rs:171:5 [INFO] [stderr] 32: 0x5bb6aa1f9071 - std::rt::lang_start::h74727a756ee5670c [INFO] [stderr] 33: 0x5bb6aa1f88a5 - main [INFO] [stderr] 34: 0x7cf434e431ca - [INFO] [stderr] 35: 0x7cf434e4328b - __libc_start_main [INFO] [stderr] 36: 0x5bb6aa1ee955 - _start [INFO] [stderr] 37: 0x0 - [INFO] [stderr] warning: build failed, waiting for other jobs to finish... [INFO] running `Command { std: "docker" "inspect" "418c82c4f902ba3fe9b703b5ae19705cdca63bd82b6122349d323bf42e316a98", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "418c82c4f902ba3fe9b703b5ae19705cdca63bd82b6122349d323bf42e316a98", kill_on_drop: false }` [INFO] [stdout] 418c82c4f902ba3fe9b703b5ae19705cdca63bd82b6122349d323bf42e316a98