[INFO] cloning repository https://github.com/golddranks/llama_test
[INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/golddranks/llama_test" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fgolddranks%2Fllama_test", kill_on_drop: false }`
[INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fgolddranks%2Fllama_test'...
[INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }`
[INFO] [stdout] b20cbcc3447d6401788a49215d7fc6332529d8ec
[INFO] testing golddranks/llama_test against 1.99.0-beta.8+cargoflags=--release for beta-release-1.100-2
[INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fgolddranks%2Fllama_test" "/workspace/builds/worker-0-tc1/source", kill_on_drop: false }`
[INFO] [stderr] Cloning into '/workspace/builds/worker-0-tc1/source'...
[INFO] [stderr] done.
[INFO] started tweaking git repo https://github.com/golddranks/llama_test
[INFO] finished tweaking git repo https://github.com/golddranks/llama_test
[INFO] tweaked toml for git repo https://github.com/golddranks/llama_test written to /workspace/builds/worker-0-tc1/source/Cargo.toml
[INFO] validating manifest of git repo https://github.com/golddranks/llama_test on toolchain 1.99.0-beta.8
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.99.0-beta.8" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] crate git repo https://github.com/golddranks/llama_test already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.99.0-beta.8" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] [stderr]     Blocking waiting for file lock on package cache
[INFO] [stderr]     Updating git repository `https://github.com/huggingface/candle.git`
[INFO] [stderr]     Updating git submodule `https://github.com/NVIDIA/cutlass.git`
[INFO] [stderr]     Updating crates.io index
[INFO] [stderr]     Blocking waiting for file lock on package cache
[INFO] [stderr]  Downloading crates ...
[INFO] [stderr]   Downloaded dyn-stack v0.10.0
[INFO] [stderr]   Downloaded darling_macro v0.20.10
[INFO] [stderr]   Downloaded gemm-c64 v0.17.1
[INFO] [stderr]   Downloaded rayon-cond v0.3.0
[INFO] [stderr]   Downloaded zerofrom-derive v0.1.4
[INFO] [stderr]   Downloaded monostate v0.1.13
[INFO] [stderr]   Downloaded serde_plain v1.0.2
[INFO] [stderr]   Downloaded proc-macro-crate v3.1.0
[INFO] [stderr]   Downloaded derive_arbitrary v1.3.2
[INFO] [stderr]   Downloaded zerofrom v0.1.4
[INFO] [stderr]   Downloaded yoke-derive v0.7.4
[INFO] [stderr]   Downloaded gemm-f32 v0.17.1
[INFO] [stderr]   Downloaded gemm-f16 v0.17.1
[INFO] [stderr]   Downloaded macro_rules_attribute v0.2.0
[INFO] [stderr]   Downloaded bindgen_cuda v0.1.5
[INFO] [stderr]   Downloaded reborrow v0.5.5
[INFO] [stderr]   Downloaded monostate-impl v0.1.13
[INFO] [stderr]   Downloaded gemm v0.17.1
[INFO] [stderr]   Downloaded seq-macro v0.3.5
[INFO] [stderr]   Downloaded gemm-f64 v0.17.1
[INFO] [stderr]   Downloaded derive_builder_macro v0.20.0
[INFO] [stderr]   Downloaded darling v0.20.10
[INFO] [stderr]   Downloaded yoke v0.7.4
[INFO] [stderr]   Downloaded either v1.13.0
[INFO] [stderr]   Downloaded macro_rules_attribute-proc_macro v0.2.0
[INFO] [stderr]   Downloaded derive_builder_core v0.20.0
[INFO] [stderr]   Downloaded unicode-normalization-alignments v0.1.12
[INFO] [stderr]   Downloaded safetensors v0.4.3
[INFO] [stderr]   Downloaded bytemuck_derive v1.7.0
[INFO] [stderr]   Downloaded memmap2 v0.9.4
[INFO] [stderr]   Downloaded gemm-common v0.17.1
[INFO] [stderr]   Downloaded sysctl v0.5.5
[INFO] [stderr]   Downloaded enum-as-inner v0.6.0
[INFO] [stderr]   Downloaded gemm-c32 v0.17.1
[INFO] [stderr]   Downloaded libloading v0.8.5
[INFO] [stderr]   Downloaded glob v0.3.1
[INFO] [stderr]   Downloaded onig v6.4.0
[INFO] [stderr]   Downloaded pkg-config v0.3.30
[INFO] [stderr]   Downloaded console v0.15.8
[INFO] [stderr]   Downloaded encode_unicode v0.3.6
[INFO] [stderr]   Downloaded tracing-attributes v0.1.27
[INFO] [stderr]   Downloaded arbitrary v1.3.2
[INFO] [stderr]   Downloaded indicatif v0.17.8
[INFO] [stderr]   Downloaded derive_builder v0.20.0
[INFO] [stderr]   Downloaded rand_distr v0.4.3
[INFO] [stderr]   Downloaded bytemuck v1.16.3
[INFO] [stderr]   Downloaded zip v1.1.4
[INFO] [stderr]   Downloaded unicode-segmentation v1.11.0
[INFO] [stderr]   Downloaded half v2.4.1
[INFO] [stderr]   Downloaded cc v1.1.7
[INFO] [stderr]   Downloaded fancy-regex v0.13.0
[INFO] [stderr]   Downloaded indexmap v2.3.0
[INFO] [stderr]   Downloaded raw-cpuid v10.7.0
[INFO] [stderr]   Downloaded tokenizers v0.19.1
[INFO] [stderr]   Downloaded darling_core v0.20.10
[INFO] [stderr]   Downloaded libm v0.2.8
[INFO] [stderr]   Downloaded toml_edit v0.21.1
[INFO] [stderr]   Downloaded pulp v0.18.21
[INFO] [stderr]   Downloaded portable-atomic v1.7.0
[INFO] [stderr]   Downloaded serde_json v1.0.122
[INFO] [stderr]   Downloaded esaxx-rs v0.1.10
[INFO] [stderr]   Downloaded syn v2.0.72
[INFO] [stderr]   Downloaded regex v1.10.6
[INFO] [stderr]   Downloaded regex-syntax v0.8.4
[INFO] [stderr]   Downloaded spm_precompiled v0.1.4
[INFO] [stderr]   Downloaded regex-automata v0.4.7
[INFO] [stderr]   Downloaded onig_sys v69.8.1
[INFO] [stderr]   Downloaded cudarc v0.11.6
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-m" "1610612736" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:77db811e55d90add9212f6832c23229e3de5f1c1f9905e8cb07319ea15df73ac" "sleep" "infinity", kill_on_drop: false }`
[INFO] [stdout] c0409112a4b230385febb481215f9c35b003a63cd5f6d8fdca4ab93d7fd7ec89
[INFO] running `Command { std: "docker" "start" "c0409112a4b230385febb481215f9c35b003a63cd5f6d8fdca4ab93d7fd7ec89", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "c0409112a4b230385febb481215f9c35b003a63cd5f6d8fdca4ab93d7fd7ec89", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-w" "/opt/rustwide/workdir" "--user" "0:0" "c0409112a4b230385febb481215f9c35b003a63cd5f6d8fdca4ab93d7fd7ec89" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.8" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "c0409112a4b230385febb481215f9c35b003a63cd5f6d8fdca4ab93d7fd7ec89", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "c0409112a4b230385febb481215f9c35b003a63cd5f6d8fdca4ab93d7fd7ec89" "/opt/rustwide/cargo-home/bin/cargo" "+1.99.0-beta.8" "build" "--frozen" "--message-format=json" "--release", kill_on_drop: false }`
[INFO] [stderr]    Compiling proc-macro2 v1.0.86
[INFO] [stderr]    Compiling unicode-ident v1.0.12
[INFO] [stderr]    Compiling libc v0.2.155
[INFO] [stderr]    Compiling crossbeam-utils v0.8.20
[INFO] [stderr]    Compiling autocfg v1.3.0
[INFO] [stderr]    Compiling byteorder v1.5.0
[INFO] [stderr]    Compiling libm v0.2.8
[INFO] [stderr]    Compiling either v1.13.0
[INFO] [stderr]    Compiling once_cell v1.19.0
[INFO] [stderr]    Compiling memchr v2.7.4
[INFO] [stderr]    Compiling reborrow v0.5.5
[INFO] [stderr]    Compiling serde v1.0.204
[INFO] [stderr]    Compiling raw-cpuid v10.7.0
[INFO] [stderr]    Compiling seq-macro v0.3.5
[INFO] [stderr]    Compiling rayon-core v1.12.1
[INFO] [stderr]    Compiling hashbrown v0.14.5
[INFO] [stderr]    Compiling equivalent v1.0.1
[INFO] [stderr]    Compiling toml_datetime v0.6.8
[INFO] [stderr]    Compiling winnow v0.5.40
[INFO] [stderr]    Compiling cc v1.1.7
[INFO] [stderr]    Compiling serde_json v1.0.122
[INFO] [stderr]    Compiling glob v0.3.1
[INFO] [stderr]    Compiling thiserror v1.0.63
[INFO] [stderr]    Compiling itoa v1.0.11
[INFO] [stderr]    Compiling ryu v1.0.18
[INFO] [stderr]    Compiling num-traits v0.2.19
[INFO] [stderr]    Compiling pkg-config v0.3.30
[INFO] [stderr]    Compiling cudarc v0.11.6
[INFO] [stderr]    Compiling zip v1.1.4
[INFO] [stderr]    Compiling regex-syntax v0.8.4
[INFO] [stderr]    Compiling stable_deref_trait v1.2.0
[INFO] [stderr]    Compiling aho-corasick v1.1.3
[INFO] [stderr]    Compiling crossbeam-epoch v0.9.18
[INFO] [stderr]    Compiling indexmap v2.3.0
[INFO] [stderr]    Compiling quote v1.0.36
[INFO] [stderr]    Compiling num_cpus v1.16.0
[INFO] [stderr] error: failed to run custom build command for `cudarc v0.11.6`
[INFO] [stderr] note: To improve backtraces for build dependencies, set the CARGO_PROFILE_RELEASE_BUILD_OVERRIDE_DEBUG=true environment variable to enable debug information generation.
[INFO] [stderr] 
[INFO] [stderr] Caused by:
[INFO] [stderr]   process didn't exit successfully: `/opt/rustwide/target/release/build/cudarc-57e6056d168f840f/build-script-build` (exit status: 101)
[INFO] [stderr]   --- stdout
[INFO] [stderr]   cargo:rerun-if-changed=build.rs
[INFO] [stderr]   cargo:rerun-if-env-changed=CUDA_ROOT
[INFO] [stderr]   cargo:rerun-if-env-changed=CUDA_PATH
[INFO] [stderr]   cargo:rerun-if-env-changed=CUDA_TOOLKIT_ROOT_DIR
[INFO] [stderr] 
[INFO] [stderr]   --- stderr
[INFO] [stderr] 
[INFO] [stderr]   thread 'main' (633) panicked at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.11.6/build.rs:53:10:
[INFO] [stderr]   Failed to execute `nvcc`: Os { code: 2, kind: NotFound, message: "No such file or directory" }
[INFO] [stderr]   stack backtrace:
[INFO] [stderr]      0:     0x580a66f4f771 - <<std[70759c8f55707aa4]::sys::backtrace::BacktraceLock>::print::DisplayBacktrace as core[df12db4294e9bfd3]::fmt::Display>::fmt
[INFO] [stderr]      1:     0x580a66f6071a - core[df12db4294e9bfd3]::fmt::write
[INFO] [stderr]      2:     0x580a66f5345c - <std[70759c8f55707aa4]::sys::stdio::unix::Stderr as core[df12db4294e9bfd3]::io::write::Write>::write_fmt
[INFO] [stderr]      3:     0x580a66f32aa6 - std[70759c8f55707aa4]::panicking::default_hook::{closure#0}
[INFO] [stderr]      4:     0x580a66f4b691 - std[70759c8f55707aa4]::panicking::default_hook
[INFO] [stderr]      5:     0x580a66f4b84b - std[70759c8f55707aa4]::panicking::panic_with_hook
[INFO] [stderr]      6:     0x580a66f32b52 - std[70759c8f55707aa4]::panicking::panic_handler::{closure#0}
[INFO] [stderr]      7:     0x580a66f2ba59 - std[70759c8f55707aa4]::sys::backtrace::__rust_end_short_backtrace::<std[70759c8f55707aa4]::panicking::panic_handler::{closure#0}, !>
[INFO] [stderr]      8:     0x580a66f3334d - __rustc[8fa7c3cbc660c2b3]::rust_begin_unwind
[INFO] [stderr]      9:     0x580a66f60e4c - core[df12db4294e9bfd3]::panicking::panic_fmt
[INFO] [stderr]     10:     0x580a66f60c22 - core[df12db4294e9bfd3]::result::unwrap_failed
[INFO] [stderr]     11:     0x580a66f1e849 - <core[df12db4294e9bfd3]::result::Result<std[70759c8f55707aa4]::process::Output, core[df12db4294e9bfd3]::io::error::Error>>::expect
[INFO] [stderr]     12:     0x580a66f197a6 - build_script_build[cd7f063f4ac76951]::cuda_version_from_build_system
[INFO] [stderr]     13:     0x580a66f1a030 - build_script_build[cd7f063f4ac76951]::main
[INFO] [stderr]     14:     0x580a66f1c5fb - <fn() as core[df12db4294e9bfd3]::ops::function::FnOnce<()>>::call_once
[INFO] [stderr]     15:     0x580a66f183ce - std[70759c8f55707aa4]::sys::backtrace::__rust_begin_short_backtrace::<fn(), ()>
[INFO] [stderr]     16:     0x580a66f1e299 - std[70759c8f55707aa4]::rt::lang_start::<()>::{closure#0}
[INFO] [stderr]     17:     0x580a66f4aac9 - std[70759c8f55707aa4]::rt::lang_start_internal
[INFO] [stderr]     18:     0x580a66f1d241 - std[70759c8f55707aa4]::rt::lang_start::<()>
[INFO] [stderr]     19:     0x580a66f1c8c5 - main
[INFO] [stderr]     20:     0x753815343601 - <unknown>
[INFO] [stderr]     21:     0x753815343718 - __libc_start_main
[INFO] [stderr]     22:     0x580a66f16ce5 - _start
[INFO] [stderr]     23:                0x0 - <unknown>
[INFO] [stderr] warning: build failed, waiting for other jobs to finish...
[INFO] running `Command { std: "docker" "inspect" "c0409112a4b230385febb481215f9c35b003a63cd5f6d8fdca4ab93d7fd7ec89", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "c0409112a4b230385febb481215f9c35b003a63cd5f6d8fdca4ab93d7fd7ec89", kill_on_drop: false }`
[INFO] [stdout] c0409112a4b230385febb481215f9c35b003a63cd5f6d8fdca4ab93d7fd7ec89
