[INFO] fetching crate modelbuilder 0.0.1... [INFO] testing modelbuilder-0.0.1 against 1.90.0 for beta-1.91-3 [INFO] extracting crate modelbuilder 0.0.1 into /workspace/builds/worker-3-tc1/source [INFO] started tweaking crates.io crate modelbuilder 0.0.1 [INFO] finished tweaking crates.io crate modelbuilder 0.0.1 [INFO] tweaked toml for crates.io crate modelbuilder 0.0.1 written to /workspace/builds/worker-3-tc1/source/Cargo.toml [INFO] validating manifest of crates.io crate modelbuilder 0.0.1 on toolchain 1.90.0 [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.90.0" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }` [INFO] crate crates.io crate modelbuilder 0.0.1 already has a lockfile, it will not be regenerated [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.90.0" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] [stderr] Updating crates.io index [INFO] [stderr] Downloading crates ... [INFO] [stderr] Downloaded proc-macro2 v1.0.69 [INFO] [stderr] Downloaded ioctl-sys v0.5.2 [INFO] [stderr] Downloaded uinput-sys v0.1.7 [INFO] [stderr] Downloaded input v0.7.1 [INFO] [stderr] Downloaded uinput v0.1.3 [INFO] [stderr] Downloaded riff v1.0.1 [INFO] [stderr] Downloaded wasm-bindgen-macro v0.2.88 [INFO] [stderr] Downloaded gemm v0.16.15 [INFO] [stderr] Downloaded gemm-f64 v0.16.15 [INFO] [stderr] Downloaded wasm-bindgen-shared v0.2.88 [INFO] [stderr] Downloaded gemm-c64 v0.16.15 [INFO] [stderr] Downloaded gemm-c32 v0.16.15 [INFO] [stderr] Downloaded reborrow v0.5.5 [INFO] [stderr] Downloaded zerofrom v0.1.3 [INFO] [stderr] Downloaded gemm-f32 v0.16.15 [INFO] [stderr] Downloaded futures-sink v0.3.29 [INFO] [stderr] Downloaded futures-task v0.3.29 [INFO] [stderr] Downloaded candle-kernels v0.3.1 [INFO] [stderr] Downloaded gemm-f16 v0.16.15 [INFO] [stderr] Downloaded safetensors v0.3.3 [INFO] [stderr] Downloaded errno v0.3.7 [INFO] [stderr] Downloaded memoffset v0.9.0 [INFO] [stderr] Downloaded futures-executor v0.3.29 [INFO] [stderr] Downloaded futures-core v0.3.29 [INFO] [stderr] Downloaded gemm-common v0.16.15 [INFO] [stderr] Downloaded yoke-derive v0.7.3 [INFO] [stderr] Downloaded udev v0.6.3 [INFO] [stderr] Downloaded seq-macro v0.3.5 [INFO] [stderr] Downloaded zerofrom-derive v0.1.3 [INFO] [stderr] Downloaded yoke v0.7.3 [INFO] [stderr] Downloaded wasm-bindgen-futures v0.4.38 [INFO] [stderr] Downloaded thiserror-impl v1.0.50 [INFO] [stderr] Downloaded thiserror v1.0.50 [INFO] [stderr] Downloaded synstructure v0.13.0 [INFO] [stderr] Downloaded dyn-stack v0.10.0 [INFO] [stderr] Downloaded memmap2 v0.7.1 [INFO] [stderr] Downloaded futures-macro v0.3.29 [INFO] [stderr] Downloaded futures-io v0.3.29 [INFO] [stderr] Downloaded wasm-bindgen-backend v0.2.88 [INFO] [stderr] Downloaded candle-nn v0.3.1 [INFO] [stderr] Downloaded num-complex v0.4.4 [INFO] [stderr] Downloaded mio v0.8.9 [INFO] [stderr] Downloaded futures-channel v0.3.29 [INFO] [stderr] Downloaded tempfile v3.8.1 [INFO] [stderr] Downloaded wasm-bindgen-macro-support v0.2.88 [INFO] [stderr] Downloaded bytemuck v1.14.0 [INFO] [stderr] Downloaded half v2.3.1 [INFO] [stderr] Downloaded rayon-core v1.12.0 [INFO] [stderr] Downloaded crossbeam-epoch v0.9.15 [INFO] [stderr] Downloaded openssl-sys v0.9.95 [INFO] [stderr] Downloaded futures v0.3.29 [INFO] [stderr] Downloaded pulp v0.18.4 [INFO] [stderr] Downloaded js-sys v0.3.65 [INFO] [stderr] Downloaded enum_derive v0.1.7 [INFO] [stderr] Downloaded raw-cpuid v10.7.0 [INFO] [stderr] Downloaded http v0.2.11 [INFO] [stderr] Downloaded candle-transformers v0.3.1 [INFO] [stderr] Downloaded portable-atomic v1.5.1 [INFO] [stderr] Downloaded hashbrown v0.14.2 [INFO] [stderr] Downloaded cudarc v0.9.15 [INFO] [stderr] Downloaded candle-core v0.3.1 [INFO] [stderr] Downloaded rayon v1.8.0 [INFO] [stderr] Downloaded h2 v0.3.22 [INFO] [stderr] Downloaded wasm-bindgen v0.2.88 [INFO] [stderr] Downloaded reqwest v0.11.22 [INFO] [stderr] Downloaded mki v0.2.3 [INFO] [stderr] Downloaded openssl v0.10.59 [INFO] [stderr] Downloaded rustls v0.21.9 [INFO] [stderr] Downloaded webpki-roots v0.25.2 [INFO] [stderr] Downloaded futures-util v0.3.29 [INFO] [stderr] Downloaded rustix v0.38.24 [INFO] [stderr] Downloaded tokio v1.34.0 [INFO] [stderr] Downloaded wav v1.0.0 [INFO] [stderr] Downloaded web-sys v0.3.65 [INFO] [stderr] Downloaded input-sys v1.17.0 [INFO] [stderr] Downloaded linux-raw-sys v0.4.11 [INFO] [stderr] Downloaded ring v0.17.5 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:e90291280db7d1fac5b66fc6dad9f9662629e7365a55743daf9bdf73ebc4ea79" "/opt/rustwide/cargo-home/bin/cargo" "+1.90.0" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }` [INFO] [stdout] 7a699de02e104b3084be3a1746843f16b76ccb344850641187175857d3d7c9dc [INFO] running `Command { std: "docker" "start" "-a" "7a699de02e104b3084be3a1746843f16b76ccb344850641187175857d3d7c9dc", kill_on_drop: false }` [INFO] running `Command { std: "docker" "inspect" "7a699de02e104b3084be3a1746843f16b76ccb344850641187175857d3d7c9dc", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "7a699de02e104b3084be3a1746843f16b76ccb344850641187175857d3d7c9dc", kill_on_drop: false }` [INFO] [stdout] 7a699de02e104b3084be3a1746843f16b76ccb344850641187175857d3d7c9dc [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:e90291280db7d1fac5b66fc6dad9f9662629e7365a55743daf9bdf73ebc4ea79" "/opt/rustwide/cargo-home/bin/cargo" "+1.90.0" "build" "--frozen" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] 6002f3f91b7ee5af2d0be42ec0d0a82437c7ff2d7cfdba9119c5a4ec6d881d35 [INFO] running `Command { std: "docker" "start" "-a" "6002f3f91b7ee5af2d0be42ec0d0a82437c7ff2d7cfdba9119c5a4ec6d881d35", kill_on_drop: false }` [INFO] [stderr] Compiling libc v0.2.150 [INFO] [stderr] Compiling proc-macro2 v1.0.69 [INFO] [stderr] Compiling once_cell v1.18.0 [INFO] [stderr] Compiling pkg-config v0.3.27 [INFO] [stderr] Compiling crossbeam-utils v0.8.16 [INFO] [stderr] Compiling libm v0.2.8 [INFO] [stderr] Compiling rayon-core v1.12.0 [INFO] [stderr] Compiling either v1.9.0 [INFO] [stderr] Compiling pin-project-lite v0.2.13 [INFO] [stderr] Compiling memoffset v0.9.0 [INFO] [stderr] Compiling crossbeam-epoch v0.9.15 [INFO] [stderr] Compiling num-traits v0.2.17 [INFO] [stderr] Compiling itoa v1.0.9 [INFO] [stderr] Compiling serde v1.0.192 [INFO] [stderr] Compiling reborrow v0.5.5 [INFO] [stderr] Compiling paste v1.0.14 [INFO] [stderr] Compiling futures-core v0.3.29 [INFO] [stderr] Compiling lock_api v0.4.11 [INFO] [stderr] Compiling parking_lot_core v0.9.9 [INFO] [stderr] Compiling ryu v1.0.15 [INFO] [stderr] Compiling raw-cpuid v10.7.0 [INFO] [stderr] Compiling slab v0.4.9 [INFO] [stderr] Compiling futures-channel v0.3.29 [INFO] [stderr] Compiling futures-sink v0.3.29 [INFO] [stderr] Compiling futures-task v0.3.29 [INFO] [stderr] Compiling seq-macro v0.3.5 [INFO] [stderr] Compiling bytes v1.5.0 [INFO] [stderr] Compiling smallvec v1.11.2 [INFO] [stderr] Compiling serde_json v1.0.108 [INFO] [stderr] Compiling log v0.4.20 [INFO] [stderr] Compiling futures-util v0.3.29 [INFO] [stderr] Compiling gimli v0.28.0 [INFO] [stderr] Compiling memchr v2.6.4 [INFO] [stderr] Compiling quote v1.0.33 [INFO] [stderr] Compiling tracing-core v0.1.32 [INFO] [stderr] Compiling miniz_oxide v0.7.1 [INFO] [stderr] Compiling futures-io v0.3.29 [INFO] [stderr] Compiling anyhow v1.0.75 [INFO] [stderr] Compiling syn v2.0.39 [INFO] [stderr] Compiling rustc-demangle v0.1.23 [INFO] [stderr] Compiling openssl v0.10.59 [INFO] [stderr] Compiling crossbeam-deque v0.8.3 [INFO] [stderr] Compiling bitflags v2.4.1 [INFO] [stderr] Compiling native-tls v0.2.11 [INFO] [stderr] Compiling cc v1.0.83 [INFO] [stderr] Compiling object v0.32.1 [INFO] [stderr] Compiling tinyvec v1.6.0 [INFO] [stderr] Compiling http v0.2.11 [INFO] [stderr] Compiling percent-encoding v2.3.0 [INFO] [stderr] Compiling httparse v1.8.0 [INFO] [stderr] Compiling glob v0.3.1 [INFO] [stderr] Compiling hashbrown v0.14.2 [INFO] [stderr] Compiling thiserror v1.0.50 [INFO] [stderr] Compiling form_urlencoded v1.2.0 [INFO] [stderr] Compiling libudev-sys v0.1.4 [INFO] [stderr] Compiling try-lock v0.2.4 [INFO] [stderr] Compiling unicode-bidi v0.3.13 [INFO] [stderr] Compiling cudarc v0.9.15 [INFO] [stderr] Compiling want v0.3.1 [INFO] [stderr] Compiling memoffset v0.6.5 [INFO] [stderr] Compiling indexmap v1.9.3 [INFO] [stderr] Compiling rayon v1.8.0 [INFO] [stderr] Compiling indexmap v2.1.0 [INFO] [stderr] Compiling tower-service v0.3.2 [INFO] [stderr] Compiling nix v0.10.0 [INFO] [stderr] error: failed to run custom build command for `cudarc v0.9.15` [INFO] [stderr] note: To improve backtraces for build dependencies, set the CARGO_PROFILE_DEV_BUILD_OVERRIDE_DEBUG=true environment variable to enable debug information generation. [INFO] [stderr] [INFO] [stderr] Caused by: [INFO] [stderr] process didn't exit successfully: `/opt/rustwide/target/debug/build/cudarc-10ff2d8fdb07ca1b/build-script-build` (exit status: 101) [INFO] [stderr] --- stdout [INFO] [stderr] cargo:rerun-if-changed=build.rs [INFO] [stderr] cargo:rerun-if-env-changed=CUDA_ROOT [INFO] [stderr] cargo:rerun-if-env-changed=CUDA_PATH [INFO] [stderr] cargo:rerun-if-env-changed=CUDA_TOOLKIT_ROOT_DIR [INFO] [stderr] [INFO] [stderr] --- stderr [INFO] [stderr] [INFO] [stderr] thread 'main' panicked at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.9.15/build.rs:21:13: [INFO] [stderr] Unable to find `include/cuda.h` under any of: ["/usr", "/usr/local/cuda", "/opt/cuda", "/usr/lib/cuda", "C:/Program Files/NVIDIA GPU Computing Toolkit", "C:/CUDA"]. Set the `CUDA_ROOT` environment variable to `$CUDA_ROOT/include/cuda.h` to override path. [INFO] [stderr] stack backtrace: [INFO] [stderr] 0: 0x5db2b5905be2 - std::backtrace_rs::backtrace::libunwind::trace::h2d45396358f41939 [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9 [INFO] [stderr] 1: 0x5db2b5905be2 - std::backtrace_rs::backtrace::trace_unsynchronized::hffcefc0b67f1d6e2 [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14 [INFO] [stderr] 2: 0x5db2b5905be2 - std::sys::backtrace::_print_fmt::hd72f71d23b436b92 [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/sys/backtrace.rs:66:9 [INFO] [stderr] 3: 0x5db2b5905be2 - ::fmt::hdcfcb6d4c8489523 [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/sys/backtrace.rs:39:26 [INFO] [stderr] 4: 0x5db2b5921373 - core::fmt::rt::Argument::fmt::h2c56b3114963061a [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/core/src/fmt/rt.rs:173:76 [INFO] [stderr] 5: 0x5db2b5921373 - core::fmt::write::h8a494366950f23bb [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/core/src/fmt/mod.rs:1468:25 [INFO] [stderr] 6: 0x5db2b5903663 - std::io::default_write_fmt::ha27fbccbc65eb6fa [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/io/mod.rs:639:11 [INFO] [stderr] 7: 0x5db2b5903663 - std::io::Write::write_fmt::h6556609fca33d0b1 [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/io/mod.rs:1954:13 [INFO] [stderr] 8: 0x5db2b5905a32 - std::sys::backtrace::BacktraceLock::print::hb2a626a81e06b2dc [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/sys/backtrace.rs:42:9 [INFO] [stderr] 9: 0x5db2b5906ac3 - std::panicking::default_hook::{{closure}}::h4f78485264f12d10 [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/panicking.rs:300:27 [INFO] [stderr] 10: 0x5db2b59068a5 - std::panicking::default_hook::h2c66fc99e962531d [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/panicking.rs:327:9 [INFO] [stderr] 11: 0x5db2b5907395 - std::panicking::rust_panic_with_hook::h33ac55f64bbd807d [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/panicking.rs:833:13 [INFO] [stderr] 12: 0x5db2b590722a - std::panicking::begin_panic_handler::{{closure}}::h30e7cb89678a57fe [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/panicking.rs:706:13 [INFO] [stderr] 13: 0x5db2b59060d9 - std::sys::backtrace::__rust_end_short_backtrace::hed60f27456c16ced [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/sys/backtrace.rs:174:18 [INFO] [stderr] 14: 0x5db2b5906ebd - __rustc[de2ca18b4c54d5b8]::rust_begin_unwind [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/panicking.rs:697:5 [INFO] [stderr] 15: 0x5db2b5920860 - core::panicking::panic_fmt::h62f63d096dd276af [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/core/src/panicking.rs:75:14 [INFO] [stderr] 16: 0x5db2b58e44ba - build_script_build::link_cuda::{{closure}}::haacc91180a248d6f [INFO] [stderr] 17: 0x5db2b58e28c5 - core::option::Option::unwrap_or_else::h1d3eed9afb7a7a97 [INFO] [stderr] 18: 0x5db2b58e4025 - build_script_build::link_cuda::hc9a458490c76cbaa [INFO] [stderr] 19: 0x5db2b58e3ee5 - build_script_build::main::h770ebca9a5b8a8eb [INFO] [stderr] 20: 0x5db2b58e08d3 - core::ops::function::FnOnce::call_once::h4e7d1a67c829ac6f [INFO] [stderr] 21: 0x5db2b58e0326 - std::sys::backtrace::__rust_begin_short_backtrace::h6fbcc512c673be2f [INFO] [stderr] 22: 0x5db2b58e0289 - std::rt::lang_start::{{closure}}::hd61ca52ad2abffdd [INFO] [stderr] 23: 0x5db2b5900b60 - core::ops::function::impls:: for &F>::call_once::h638295a043b40957 [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/core/src/ops/function.rs:290:21 [INFO] [stderr] 24: 0x5db2b5900b60 - std::panicking::catch_unwind::do_call::hbd68098bdea1ca50 [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/panicking.rs:589:40 [INFO] [stderr] 25: 0x5db2b5900b60 - std::panicking::catch_unwind::h50591d85bf847c7c [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/panicking.rs:552:19 [INFO] [stderr] 26: 0x5db2b5900b60 - std::panic::catch_unwind::h2487b4c4f2ae22c6 [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/panic.rs:359:14 [INFO] [stderr] 27: 0x5db2b5900b60 - std::rt::lang_start_internal::{{closure}}::h61f0945cc6c9a811 [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/rt.rs:175:24 [INFO] [stderr] 28: 0x5db2b5900b60 - std::panicking::catch_unwind::do_call::h34b9c3722acd6bd1 [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/panicking.rs:589:40 [INFO] [stderr] 29: 0x5db2b5900b60 - std::panicking::catch_unwind::hf9a822ea043fb0d6 [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/panicking.rs:552:19 [INFO] [stderr] 30: 0x5db2b5900b60 - std::panic::catch_unwind::h5b3cac802237ed89 [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/panic.rs:359:14 [INFO] [stderr] 31: 0x5db2b5900b60 - std::rt::lang_start_internal::h34f9328d113fd60a [INFO] [stderr] at /rustc/1159e78c4747b02ef996e55082b704c09b970588/library/std/src/rt.rs:171:5 [INFO] [stderr] 32: 0x5db2b58e0271 - std::rt::lang_start::ha7790ad4e4762f8e [INFO] [stderr] 33: 0x5db2b58e48a5 - main [INFO] [stderr] 34: 0x75427eb961ca - [INFO] [stderr] 35: 0x75427eb9628b - __libc_start_main [INFO] [stderr] 36: 0x5db2b58defb5 - _start [INFO] [stderr] 37: 0x0 - [INFO] [stderr] warning: build failed, waiting for other jobs to finish... [INFO] running `Command { std: "docker" "inspect" "6002f3f91b7ee5af2d0be42ec0d0a82437c7ff2d7cfdba9119c5a4ec6d881d35", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "6002f3f91b7ee5af2d0be42ec0d0a82437c7ff2d7cfdba9119c5a4ec6d881d35", kill_on_drop: false }` [INFO] [stdout] 6002f3f91b7ee5af2d0be42ec0d0a82437c7ff2d7cfdba9119c5a4ec6d881d35