[INFO] fetching crate ug-pyo3 0.5.0... [INFO] testing ug-pyo3-0.5.0 against 1.90.0 for beta-1.91-3 [INFO] extracting crate ug-pyo3 0.5.0 into /workspace/builds/worker-0-tc1/source [INFO] started tweaking crates.io crate ug-pyo3 0.5.0 [INFO] finished tweaking crates.io crate ug-pyo3 0.5.0 [INFO] tweaked toml for crates.io crate ug-pyo3 0.5.0 written to /workspace/builds/worker-0-tc1/source/Cargo.toml [INFO] validating manifest of crates.io crate ug-pyo3 0.5.0 on toolchain 1.90.0 [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.90.0" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }` [INFO] crate crates.io crate ug-pyo3 0.5.0 already has a lockfile, it will not be regenerated [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.90.0" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] [stderr] Blocking waiting for file lock on package cache [INFO] [stderr] Updating crates.io index [INFO] [stderr] Blocking waiting for file lock on package cache [INFO] [stderr] Downloading crates ... [INFO] [stderr] Downloaded yoke v0.7.4 [INFO] [stderr] Downloaded zerofrom v0.1.4 [INFO] [stderr] Downloaded synstructure v0.13.1 [INFO] [stderr] Downloaded quote v1.0.37 [INFO] [stderr] Downloaded unicode-ident v1.0.13 [INFO] [stderr] Downloaded zerofrom-derive v0.1.4 [INFO] [stderr] Downloaded ug-cuda v0.5.0 [INFO] [stderr] Downloaded paste v1.0.15 [INFO] [stderr] Downloaded rand_distr v0.4.3 [INFO] [stderr] Downloaded serde v1.0.210 [INFO] [stderr] Downloaded ug v0.5.0 [INFO] [stderr] Downloaded syn v2.0.79 [INFO] [stderr] Downloaded once_cell v1.20.2 [INFO] [stderr] Downloaded yoke-derive v0.7.4 [INFO] [stderr] Downloaded num-traits v0.2.19 [INFO] [stderr] Downloaded memmap2 v0.9.5 [INFO] [stderr] Downloaded rand_core v0.6.4 [INFO] [stderr] Downloaded enum-as-inner v0.6.1 [INFO] [stderr] Downloaded reborrow v0.5.5 [INFO] [stderr] Downloaded winapi-util v0.1.9 [INFO] [stderr] Downloaded indoc v2.0.5 [INFO] [stderr] Downloaded memoffset v0.9.1 [INFO] [stderr] Downloaded target-lexicon v0.12.16 [INFO] [stderr] Downloaded bitflags v2.6.0 [INFO] [stderr] Downloaded num-bigint v0.4.6 [INFO] [stderr] Downloaded rayon v1.10.0 [INFO] [stderr] Downloaded serde_json v1.0.132 [INFO] [stderr] Downloaded same-file v1.0.6 [INFO] [stderr] Downloaded gemm-common v0.18.0 [INFO] [stderr] Downloaded raw-cpuid v10.7.0 [INFO] [stderr] Downloaded cudarc v0.17.3 [INFO] [stderr] Downloaded gemm-f16 v0.18.0 [INFO] [stderr] Downloaded dyn-stack v0.10.0 [INFO] [stderr] Downloaded pyo3-ffi v0.22.4 [INFO] [stderr] Downloaded pyo3-macros-backend v0.22.4 [INFO] [stderr] Downloaded portable-atomic v1.9.0 [INFO] [stderr] Downloaded pulp v0.18.22 [INFO] [stderr] Downloaded libc v0.2.159 [INFO] [stderr] Downloaded rand v0.8.5 [INFO] [stderr] Downloaded bytemuck v1.19.0 [INFO] [stderr] Downloaded num-complex v0.4.6 [INFO] [stderr] Downloaded rayon-core v1.12.1 [INFO] [stderr] Downloaded memchr v2.7.4 [INFO] [stderr] Downloaded ryu v1.0.18 [INFO] [stderr] Downloaded pin-project-lite v0.2.15 [INFO] [stderr] Downloaded tracing-attributes v0.1.27 [INFO] [stderr] Downloaded tracing v0.1.40 [INFO] [stderr] Downloaded pyo3-build-config v0.22.4 [INFO] [stderr] Downloaded gemm-c32 v0.18.0 [INFO] [stderr] Downloaded gemm-c64 v0.18.0 [INFO] [stderr] Downloaded walkdir v2.5.0 [INFO] [stderr] Downloaded gemm v0.18.0 [INFO] [stderr] Downloaded num-integer v0.1.46 [INFO] [stderr] Downloaded pyo3-macros v0.22.4 [INFO] [stderr] Downloaded unindent v0.2.3 [INFO] [stderr] Downloaded gemm-f32 v0.18.0 [INFO] [stderr] Downloaded byteorder v1.5.0 [INFO] [stderr] Downloaded sysctl v0.5.5 [INFO] [stderr] Downloaded seq-macro v0.3.5 [INFO] [stderr] Downloaded bytemuck_derive v1.8.0 [INFO] [stderr] Downloaded num v0.4.3 [INFO] [stderr] Downloaded libm v0.2.8 [INFO] [stderr] Downloaded num_cpus v1.16.0 [INFO] [stderr] Downloaded either v1.13.0 [INFO] [stderr] Downloaded pyo3 v0.22.4 [INFO] [stderr] Downloaded crossbeam-deque v0.8.5 [INFO] [stderr] Downloaded crossbeam-utils v0.8.20 [INFO] [stderr] Downloaded tracing-core v0.1.32 [INFO] [stderr] Downloaded serde_derive v1.0.210 [INFO] [stderr] Downloaded heck v0.5.0 [INFO] [stderr] Downloaded gemm-f64 v0.18.0 [INFO] [stderr] Downloaded bitflags v1.3.2 [INFO] [stderr] Downloaded crunchy v0.2.2 [INFO] [stderr] Downloaded half v2.4.1 [INFO] [stderr] Downloaded cfg-if v1.0.0 [INFO] [stderr] Downloaded hermit-abi v0.3.9 [INFO] [stderr] Downloaded crossbeam-epoch v0.9.18 [INFO] [stderr] Downloaded itoa v1.0.11 [INFO] [stderr] Downloaded libloading v0.8.5 [INFO] [stderr] Downloaded safetensors v0.4.5 [INFO] [stderr] Downloaded proc-macro2 v1.0.87 [INFO] [stderr] Downloaded num-iter v0.1.45 [INFO] [stderr] Downloaded num-rational v0.4.2 [INFO] [stderr] Downloaded autocfg v1.4.0 [INFO] [stderr] Downloaded thiserror-impl v1.0.65 [INFO] [stderr] Downloaded thiserror v1.0.65 [INFO] [stderr] Downloaded stable_deref_trait v1.2.0 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:e90291280db7d1fac5b66fc6dad9f9662629e7365a55743daf9bdf73ebc4ea79" "/opt/rustwide/cargo-home/bin/cargo" "+1.90.0" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }` [INFO] [stdout] 090b0a7944bcf81e51ec44006722dd46938de62c5e492f933cfd1e9a25e0a169 [INFO] running `Command { std: "docker" "start" "-a" "090b0a7944bcf81e51ec44006722dd46938de62c5e492f933cfd1e9a25e0a169", kill_on_drop: false }` [INFO] running `Command { std: "docker" "inspect" "090b0a7944bcf81e51ec44006722dd46938de62c5e492f933cfd1e9a25e0a169", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "090b0a7944bcf81e51ec44006722dd46938de62c5e492f933cfd1e9a25e0a169", kill_on_drop: false }` [INFO] [stdout] 090b0a7944bcf81e51ec44006722dd46938de62c5e492f933cfd1e9a25e0a169 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:e90291280db7d1fac5b66fc6dad9f9662629e7365a55743daf9bdf73ebc4ea79" "/opt/rustwide/cargo-home/bin/cargo" "+1.90.0" "build" "--frozen" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] b6120c3f427fb13d9f1b7cf43a8104c96cddbff2bc657d29c7199968ad45f804 [INFO] running `Command { std: "docker" "start" "-a" "b6120c3f427fb13d9f1b7cf43a8104c96cddbff2bc657d29c7199968ad45f804", kill_on_drop: false }` [INFO] [stderr] Compiling proc-macro2 v1.0.87 [INFO] [stderr] Compiling unicode-ident v1.0.13 [INFO] [stderr] Compiling autocfg v1.4.0 [INFO] [stderr] Compiling once_cell v1.20.2 [INFO] [stderr] Compiling libm v0.2.8 [INFO] [stderr] Compiling crossbeam-utils v0.8.20 [INFO] [stderr] Compiling target-lexicon v0.12.16 [INFO] [stderr] Compiling cfg-if v1.0.0 [INFO] [stderr] Compiling rand_core v0.6.4 [INFO] [stderr] Compiling rayon-core v1.12.1 [INFO] [stderr] Compiling paste v1.0.15 [INFO] [stderr] Compiling reborrow v0.5.5 [INFO] [stderr] Compiling either v1.13.0 [INFO] [stderr] Compiling bitflags v1.3.2 [INFO] [stderr] Compiling seq-macro v0.3.5 [INFO] [stderr] Compiling libc v0.2.159 [INFO] [stderr] Compiling raw-cpuid v10.7.0 [INFO] [stderr] Compiling serde v1.0.210 [INFO] [stderr] Compiling serde_json v1.0.132 [INFO] [stderr] Compiling stable_deref_trait v1.2.0 [INFO] [stderr] Compiling rand v0.8.5 [INFO] [stderr] Compiling thiserror v1.0.65 [INFO] [stderr] Compiling ryu v1.0.18 [INFO] [stderr] Compiling itoa v1.0.11 [INFO] [stderr] Compiling memchr v2.7.4 [INFO] [stderr] Compiling tracing-core v0.1.32 [INFO] [stderr] Compiling libloading v0.8.5 [INFO] [stderr] Compiling pin-project-lite v0.2.15 [INFO] [stderr] Compiling cudarc v0.17.3 [INFO] [stderr] Compiling heck v0.5.0 [INFO] [stderr] Compiling num-traits v0.2.19 [INFO] [stderr] Compiling memoffset v0.9.1 [INFO] [stderr] Compiling indoc v2.0.5 [INFO] [stderr] Compiling unindent v0.2.3 [INFO] [stderr] Compiling crossbeam-epoch v0.9.18 [INFO] [stderr] error: failed to run custom build command for `cudarc v0.17.3` [INFO] [stderr] note: To improve backtraces for build dependencies, set the CARGO_PROFILE_DEV_BUILD_OVERRIDE_DEBUG=true environment variable to enable debug information generation. [INFO] [stderr] [INFO] [stderr] Caused by: [INFO] [stderr] process didn't exit successfully: `/opt/rustwide/target/debug/build/cudarc-3a90d38b55d4782b/build-script-build` (exit status: 101) [INFO] [stderr] --- stdout [INFO] [stderr] cargo:rerun-if-changed=build.rs [INFO] [stderr] cargo:rerun-if-env-changed=CUDA_ROOT [INFO] [stderr] cargo:rerun-if-env-changed=CUDA_PATH [INFO] [stderr] cargo:rerun-if-env-changed=CUDA_TOOLKIT_ROOT_DIR [INFO] [stderr] cargo:rerun-if-env-changed=CUDARC_CUDA_VERSION [INFO] [stderr] [INFO] [stderr] --- stderr [INFO] [stderr] [INFO] [stderr] thread 'main' panicked at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.17.3/build.rs:101:10: [INFO] [stderr] Failed to execute `nvcc`: Os { code: 2, kind: NotFound, message: "No such file or directory" } [INFO] [stderr] stack backtrace: [INFO] [stderr] 0: 0x61f2e276fd12 - std::backtrace_rs::backtrace::libunwind::trace::h2d45396358f41939 [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9 [INFO] [stderr] 1: 0x61f2e276fd12 - std::backtrace_rs::backtrace::trace_unsynchronized::hffcefc0b67f1d6e2 [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14 [INFO] [stderr] 2: 0x61f2e276fd12 - std::sys::backtrace::_print_fmt::hd72f71d23b436b92 [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/sys/backtrace.rs:66:9 [INFO] [stderr] 3: 0x61f2e276fd12 - ::fmt::hdcfcb6d4c8489523 [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/sys/backtrace.rs:39:26 [INFO] [stderr] 4: 0x61f2e278f5f3 - core::fmt::rt::Argument::fmt::h2c56b3114963061a [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/core/src/fmt/rt.rs:173:76 [INFO] [stderr] 5: 0x61f2e278f5f3 - core::fmt::write::h8a494366950f23bb [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/core/src/fmt/mod.rs:1468:25 [INFO] [stderr] 6: 0x61f2e276d453 - std::io::default_write_fmt::ha27fbccbc65eb6fa [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/io/mod.rs:639:11 [INFO] [stderr] 7: 0x61f2e276d453 - std::io::Write::write_fmt::h6556609fca33d0b1 [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/io/mod.rs:1954:13 [INFO] [stderr] 8: 0x61f2e276fb62 - std::sys::backtrace::BacktraceLock::print::hb2a626a81e06b2dc [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/sys/backtrace.rs:42:9 [INFO] [stderr] 9: 0x61f2e2770bf3 - std::panicking::default_hook::{{closure}}::h4f78485264f12d10 [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/panicking.rs:300:27 [INFO] [stderr] 10: 0x61f2e27709d5 - std::panicking::default_hook::h2c66fc99e962531d [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/panicking.rs:327:9 [INFO] [stderr] 11: 0x61f2e27714c5 - std::panicking::rust_panic_with_hook::h33ac55f64bbd807d [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/panicking.rs:833:13 [INFO] [stderr] 12: 0x61f2e277135a - std::panicking::begin_panic_handler::{{closure}}::h30e7cb89678a57fe [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/panicking.rs:706:13 [INFO] [stderr] 13: 0x61f2e2770209 - std::sys::backtrace::__rust_end_short_backtrace::hed60f27456c16ced [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/sys/backtrace.rs:174:18 [INFO] [stderr] 14: 0x61f2e2770fed - __rustc[de2ca18b4c54d5b8]::rust_begin_unwind [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/panicking.rs:697:5 [INFO] [stderr] 15: 0x61f2e278e8c0 - core::panicking::panic_fmt::h62f63d096dd276af [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/core/src/panicking.rs:75:14 [INFO] [stderr] 16: 0x61f2e278ec56 - core::result::unwrap_failed::h95bc3f5a607b2c95 [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/core/src/result.rs:1765:5 [INFO] [stderr] 17: 0x61f2e2747652 - core::result::Result::expect::h6b234aa3fc54c81a [INFO] [stderr] 18: 0x61f2e27440a6 - build_script_build::cuda_version_from_build_system::hf095a73acd7ba2a7 [INFO] [stderr] 19: 0x61f2e27437c7 - build_script_build::main::h67803792465c18dd [INFO] [stderr] 20: 0x61f2e273e893 - core::ops::function::FnOnce::call_once::h9e7e6c481da20786 [INFO] [stderr] 21: 0x61f2e2748766 - std::sys::backtrace::__rust_begin_short_backtrace::hf21396141b5e6f44 [INFO] [stderr] 22: 0x61f2e27461f9 - std::rt::lang_start::{{closure}}::h1d28b7d215f69dd6 [INFO] [stderr] 23: 0x61f2e2769fa0 - core::ops::function::impls:: for &F>::call_once::h638295a043b40957 [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/core/src/ops/function.rs:290:21 [INFO] [stderr] 24: 0x61f2e2769fa0 - std::panicking::catch_unwind::do_call::hbd68098bdea1ca50 [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/panicking.rs:589:40 [INFO] [stderr] 25: 0x61f2e2769fa0 - std::panicking::catch_unwind::h50591d85bf847c7c [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/panicking.rs:552:19 [INFO] [stderr] 26: 0x61f2e2769fa0 - std::panic::catch_unwind::h2487b4c4f2ae22c6 [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/panic.rs:359:14 [INFO] [stderr] 27: 0x61f2e2769fa0 - std::rt::lang_start_internal::{{closure}}::h61f0945cc6c9a811 [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/rt.rs:175:24 [INFO] [stderr] 28: 0x61f2e2769fa0 - std::panicking::catch_unwind::do_call::h34b9c3722acd6bd1 [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/panicking.rs:589:40 [INFO] [stderr] 29: 0x61f2e2769fa0 - std::panicking::catch_unwind::hf9a822ea043fb0d6 [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/panicking.rs:552:19 [INFO] [stderr] 30: 0x61f2e2769fa0 - std::panic::catch_unwind::h5b3cac802237ed89 [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/panic.rs:359:14 [INFO] [stderr] 31: 0x61f2e2769fa0 - std::rt::lang_start_internal::h34f9328d113fd60a [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/rt.rs:171:5 [INFO] [stderr] 32: 0x61f2e27461e1 - std::rt::lang_start::haeca46faca3d88bf [INFO] [stderr] 33: 0x61f2e27459e5 - main [INFO] [stderr] 34: 0x7d1feb79c1ca - [INFO] [stderr] 35: 0x7d1feb79c28b - __libc_start_main [INFO] [stderr] 36: 0x61f2e273e465 - _start [INFO] [stderr] 37: 0x0 - [INFO] [stderr] warning: build failed, waiting for other jobs to finish... [INFO] running `Command { std: "docker" "inspect" "b6120c3f427fb13d9f1b7cf43a8104c96cddbff2bc657d29c7199968ad45f804", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "b6120c3f427fb13d9f1b7cf43a8104c96cddbff2bc657d29c7199968ad45f804", kill_on_drop: false }` [INFO] [stdout] b6120c3f427fb13d9f1b7cf43a8104c96cddbff2bc657d29c7199968ad45f804