[INFO] cloning repository https://github.com/TensorBFS/tropical-gemm
[INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/TensorBFS/tropical-gemm" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FTensorBFS%2Ftropical-gemm", kill_on_drop: false }`
[INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FTensorBFS%2Ftropical-gemm'...
[INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }`
[INFO] [stdout] b09252040b9fef3e2545c1ac339069bac2b09c15
[INFO] testing TensorBFS/tropical-gemm against 1.97.0-beta.6 for beta-1.98-1
[INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FTensorBFS%2Ftropical-gemm" "/workspace/builds/worker-7-tc1/source", kill_on_drop: false }`
[INFO] [stderr] Cloning into '/workspace/builds/worker-7-tc1/source'...
[INFO] [stderr] done.
[INFO] started tweaking git repo https://github.com/TensorBFS/tropical-gemm
[INFO] finished tweaking git repo https://github.com/TensorBFS/tropical-gemm
[INFO] tweaked toml for git repo https://github.com/TensorBFS/tropical-gemm written to /workspace/builds/worker-7-tc1/source/Cargo.toml
[INFO] validating manifest of git repo https://github.com/TensorBFS/tropical-gemm on toolchain 1.97.0-beta.6
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.97.0-beta.6" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] crate git repo https://github.com/TensorBFS/tropical-gemm already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.97.0-beta.6" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] [stderr]     Updating crates.io index
[INFO] [stderr]     Updating git repository `https://github.com/isPANN/pyo3-dlpack`
[INFO] [stderr]  Downloading crates ...
[INFO] [stderr]   Downloaded either v1.16.0
[INFO] [stderr]   Downloaded bytemuck v1.25.0
[INFO] [stderr]   Downloaded rand_xorshift v0.4.0
[INFO] [stderr]   Downloaded alloca v0.4.0
[INFO] [stderr]   Downloaded wasm-bindgen-macro v0.2.122
[INFO] [stderr]   Downloaded page_size v0.6.0
[INFO] [stderr]   Downloaded plotters-svg v0.3.7
[INFO] [stderr]   Downloaded cast v0.3.0
[INFO] [stderr]   Downloaded bit-set v0.8.0
[INFO] [stderr]   Downloaded plotters-backend v0.3.7
[INFO] [stderr]   Downloaded wasm-bindgen-shared v0.2.122
[INFO] [stderr]   Downloaded ciborium-io v0.2.2
[INFO] [stderr]   Downloaded pyo3-macros v0.28.3
[INFO] [stderr]   Downloaded bit-vec v0.8.0
[INFO] [stderr]   Downloaded ciborium-ll v0.2.2
[INFO] [stderr]   Downloaded target-lexicon v0.13.5
[INFO] [stderr]   Downloaded rusty-fork v0.3.1
[INFO] [stderr]   Downloaded tinytemplate v1.2.1
[INFO] [stderr]   Downloaded unarray v0.1.4
[INFO] [stderr]   Downloaded criterion-plot v0.8.2
[INFO] [stderr]   Downloaded oorandom v11.1.5
[INFO] [stderr]   Downloaded anes v0.1.6
[INFO] [stderr]   Downloaded autocfg v1.5.1
[INFO] [stderr]   Downloaded shlex v2.0.1
[INFO] [stderr]   Downloaded num-complex v0.4.6
[INFO] [stderr]   Downloaded safe_arch v1.0.0
[INFO] [stderr]   Downloaded libloading v0.9.0
[INFO] [stderr]   Downloaded pyo3-build-config v0.28.3
[INFO] [stderr]   Downloaded ciborium v0.2.2
[INFO] [stderr]   Downloaded portable-atomic-util v0.2.7
[INFO] [stderr]   Downloaded log v0.4.30
[INFO] [stderr]   Downloaded matrixmultiply v0.3.10
[INFO] [stderr]   Downloaded wide v1.4.0
[INFO] [stderr]   Downloaded numpy v0.28.0
[INFO] [stderr]   Downloaded wasm-bindgen v0.2.122
[INFO] [stderr]   Downloaded pyo3-macros-backend v0.28.3
[INFO] [stderr]   Downloaded wasm-bindgen-macro-support v0.2.122
[INFO] [stderr]   Downloaded cc v1.2.63
[INFO] [stderr]   Downloaded pyo3-ffi v0.28.3
[INFO] [stderr]   Downloaded zerocopy-derive v0.8.50
[INFO] [stderr]   Downloaded bumpalo v3.20.3
[INFO] [stderr]   Downloaded memchr v2.8.1
[INFO] [stderr]   Downloaded js-sys v0.3.99
[INFO] [stderr]   Downloaded criterion v0.8.2
[INFO] [stderr]   Downloaded rayon v1.12.0
[INFO] [stderr]   Downloaded plotters v0.3.7
[INFO] [stderr]   Downloaded serde_json v1.0.150
[INFO] [stderr]   Downloaded proptest v1.11.0
[INFO] [stderr]   Downloaded ndarray v0.17.2
[INFO] [stderr]   Downloaded zerocopy v0.8.50
[INFO] [stderr]   Downloaded cudarc v0.19.7
[INFO] [stderr]   Downloaded web-sys v0.3.99
[INFO] [stderr]   Downloaded pyo3 v0.28.3
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-m" "1610612736" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:3d5ced03c013a94a2f102a4510f48a6e9184255caf5fd8244f58017bde7f5210" "sleep" "infinity", kill_on_drop: false }`
[INFO] [stdout] 55ccbd322ac89d40e8783cfdb0370880c6ccf46a99aa86cdfe01d124a4dc32c9
[INFO] running `Command { std: "docker" "start" "55ccbd322ac89d40e8783cfdb0370880c6ccf46a99aa86cdfe01d124a4dc32c9", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "55ccbd322ac89d40e8783cfdb0370880c6ccf46a99aa86cdfe01d124a4dc32c9", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-w" "/opt/rustwide/workdir" "--user" "0:0" "55ccbd322ac89d40e8783cfdb0370880c6ccf46a99aa86cdfe01d124a4dc32c9" "/opt/rustwide/cargo-home/bin/cargo" "+1.97.0-beta.6" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "55ccbd322ac89d40e8783cfdb0370880c6ccf46a99aa86cdfe01d124a4dc32c9", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "55ccbd322ac89d40e8783cfdb0370880c6ccf46a99aa86cdfe01d124a4dc32c9" "/opt/rustwide/cargo-home/bin/cargo" "+1.97.0-beta.6" "build" "--frozen" "--message-format=json", kill_on_drop: false }`
[INFO] [stderr]    Compiling target-lexicon v0.13.5
[INFO] [stderr]    Compiling autocfg v1.5.1
[INFO] [stderr]    Compiling proc-macro2 v1.0.106
[INFO] [stderr]    Compiling unicode-ident v1.0.24
[INFO] [stderr]    Compiling quote v1.0.45
[INFO] [stderr]    Compiling crossbeam-utils v0.8.21
[INFO] [stderr]    Compiling rayon-core v1.13.0
[INFO] [stderr]    Compiling libc v0.2.186
[INFO] [stderr]    Compiling bytemuck v1.25.0
[INFO] [stderr]    Compiling rawpointer v0.2.1
[INFO] [stderr]    Compiling either v1.16.0
[INFO] [stderr]    Compiling safe_arch v1.0.0
[INFO] [stderr]    Compiling cudarc v0.19.7
[INFO] [stderr]    Compiling num-traits v0.2.19
[INFO] [stderr]    Compiling matrixmultiply v0.3.10
[INFO] [stderr]    Compiling thiserror v2.0.18
[INFO] [stderr]    Compiling wide v1.4.0
[INFO] [stderr]    Compiling pyo3-build-config v0.28.3
[INFO] [stderr]    Compiling crossbeam-epoch v0.9.18
[INFO] [stderr]    Compiling syn v2.0.117
[INFO] [stderr]    Compiling crossbeam-deque v0.8.6
[INFO] [stderr]    Compiling once_cell v1.21.4
[INFO] [stderr]    Compiling num-integer v0.1.46
[INFO] [stderr]    Compiling num-complex v0.4.6
[INFO] [stderr]    Compiling libloading v0.9.0
[INFO] [stderr]    Compiling rustc-hash v2.1.2
[INFO] [stderr]    Compiling ndarray v0.17.2
[INFO] [stderr]    Compiling rayon v1.12.0
[INFO] [stderr]    Compiling pyo3-ffi v0.28.3
[INFO] [stderr]    Compiling pyo3-macros-backend v0.28.3
[INFO] [stderr]    Compiling pyo3 v0.28.3
[INFO] [stderr]    Compiling numpy v0.28.0
[INFO] [stderr]    Compiling tropical-gemm v0.3.0 (/opt/rustwide/workdir/crates/tropical-gemm)
[INFO] [stderr]    Compiling thiserror-impl v2.0.18
[INFO] [stderr]    Compiling tropical-gemm-cuda v0.3.0 (/opt/rustwide/workdir/crates/tropical-gemm-cuda)
[INFO] [stderr]    Compiling pyo3-macros v0.28.3
[INFO] [stderr]    Compiling tropical-gemm-python v0.3.0 (/opt/rustwide/workdir/crates/tropical-gemm-python)
[INFO] [stderr]     Finished `dev` profile [unoptimized + debuginfo] target(s) in 56.37s
[INFO] running `Command { std: "docker" "inspect" "55ccbd322ac89d40e8783cfdb0370880c6ccf46a99aa86cdfe01d124a4dc32c9", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "55ccbd322ac89d40e8783cfdb0370880c6ccf46a99aa86cdfe01d124a4dc32c9" "/opt/rustwide/cargo-home/bin/cargo" "+1.97.0-beta.6" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }`
[INFO] [stderr]    Compiling zerocopy v0.8.50
[INFO] [stderr]    Compiling serde_core v1.0.228
[INFO] [stderr]    Compiling either v1.16.0
[INFO] [stderr]    Compiling zerocopy-derive v0.8.50
[INFO] [stderr]    Compiling shlex v2.0.1
[INFO] [stderr]    Compiling serde v1.0.228
[INFO] [stderr]    Compiling zmij v1.0.21
[INFO] [stderr]    Compiling find-msvc-tools v0.1.9
[INFO] [stderr]    Compiling serde_derive v1.0.228
[INFO] [stderr]    Compiling regex-syntax v0.8.10
[INFO] [stderr]    Compiling rayon v1.12.0
[INFO] [stderr]    Compiling cc v1.2.63
[INFO] [stderr]    Compiling serde_json v1.0.150
[INFO] [stderr]    Compiling itoa v1.0.18
[INFO] [stderr]    Compiling plotters-backend v0.3.7
[INFO] [stderr]    Compiling memchr v2.8.1
[INFO] [stderr]    Compiling ciborium-io v0.2.2
[INFO] [stderr]    Compiling anstyle v1.0.14
[INFO] [stderr]    Compiling clap_lex v1.1.0
[INFO] [stderr]    Compiling clap_builder v4.6.0
[INFO] [stderr]    Compiling plotters-svg v0.3.7
[INFO] [stderr]    Compiling itertools v0.13.0
[INFO] [stderr]    Compiling alloca v0.4.0
[INFO] [stderr]    Compiling cast v0.3.0
[INFO] [stderr]    Compiling getrandom v0.3.4
[INFO] [stderr]    Compiling regex-automata v0.4.14
[INFO] [stderr]    Compiling tropical-gemm v0.3.0 (/opt/rustwide/workdir/crates/tropical-gemm)
[INFO] [stderr]    Compiling clap v4.6.1
[INFO] [stderr]    Compiling plotters v0.3.7
[INFO] [stderr]    Compiling criterion-plot v0.8.2
[INFO] [stderr]    Compiling page_size v0.6.0
[INFO] [stderr]    Compiling anes v0.1.6
[INFO] [stderr]    Compiling oorandom v11.1.5
[INFO] [stderr]    Compiling regex v1.12.3
[INFO] [stderr]    Compiling tinytemplate v1.2.1
[INFO] [stderr]    Compiling getrandom v0.4.2
[INFO] [stderr]    Compiling rand_core v0.9.5
[INFO] [stderr]    Compiling bitflags v2.11.1
[INFO] [stderr]    Compiling rustix v1.1.4
[INFO] [stderr]    Compiling fastrand v2.4.1
[INFO] [stderr]    Compiling wait-timeout v0.2.1
[INFO] [stderr]    Compiling bit-vec v0.8.0
[INFO] [stderr]    Compiling quick-error v1.2.3
[INFO] [stderr]    Compiling rand_xorshift v0.4.0
[INFO] [stderr]    Compiling rand v0.9.4
[INFO] [stderr]    Compiling bit-set v0.8.0
[INFO] [stderr]    Compiling unarray v0.1.4
[INFO] [stderr]    Compiling tropical-gemm-cuda v0.3.0 (/opt/rustwide/workdir/crates/tropical-gemm-cuda)
[INFO] [stderr]    Compiling tropical-gemm-python v0.3.0 (/opt/rustwide/workdir/crates/tropical-gemm-python)
[INFO] [stderr]    Compiling half v2.7.1
[INFO] [stderr]    Compiling ppv-lite86 v0.2.21
[INFO] [stderr]    Compiling tempfile v3.27.0
[INFO] [stderr]    Compiling ciborium-ll v0.2.2
[INFO] [stderr]    Compiling rusty-fork v0.3.1
[INFO] [stderr]    Compiling ciborium v0.2.2
[INFO] [stderr]    Compiling rand_chacha v0.9.0
[INFO] [stderr]    Compiling proptest v1.11.0
[INFO] [stderr]    Compiling criterion v0.8.2
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 1m 13s
[INFO] running `Command { std: "docker" "inspect" "55ccbd322ac89d40e8783cfdb0370880c6ccf46a99aa86cdfe01d124a4dc32c9", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "55ccbd322ac89d40e8783cfdb0370880c6ccf46a99aa86cdfe01d124a4dc32c9" "/opt/rustwide/cargo-home/bin/cargo" "+1.97.0-beta.6" "test" "--frozen", kill_on_drop: false }`
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 0.29s
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/tropical_gemm-62f6ef983e3b91c8)
[INFO] [stdout] 
[INFO] [stdout] running 279 tests
[INFO] [stdout] test api::tests::test_builder_api ... ok
[INFO] [stdout] test api::tests::test_builder_api_trans_a ... ok
[INFO] [stdout] test api::tests::test_builder_api_trans_b ... ok
[INFO] [stdout] test api::tests::test_gemmwithargmax_dimensions ... ok
[INFO] [stdout] test api::tests::test_identity_like_matrix ... ok
[INFO] [stdout] test api::tests::test_larger_matrix ... ok
[INFO] [stdout] test api::tests::test_minplus_with_argmax ... ok
[INFO] [stdout] test api::tests::test_non_square_matrices ... ok
[INFO] [stdout] test api::tests::test_tropical_backward_a ... ok
[INFO] [stdout] test api::tests::test_single_element ... ok
[INFO] [stdout] test api::tests::test_tropical_backward_b ... ok
[INFO] [stdout] test api::tests::test_maxmul_with_argmax ... ok
[INFO] [stdout] test api::tests::test_tropical_backward_varied_argmax ... ok
[INFO] [stdout] test api::tests::test_tropical_matmul ... ok
[INFO] [stdout] test api::tests::test_tropical_matmul_batched_empty ... ok
[INFO] [stdout] test api::tests::test_tropical_matmul_batched_with_argmax_empty ... ok
[INFO] [stdout] test api::tests::test_tropical_matmul_batched_larger ... ok
[INFO] [stdout] test api::tests::test_tropical_matmul_batched ... ok
[INFO] [stdout] test api::tests::test_tropical_matmul_batched_with_argmax ... ok
[INFO] [stdout] test api::tests::test_tropical_matmul_i64 ... ok
[INFO] [stdout] test api::tests::test_tropical_backward_batched ... ok
[INFO] [stdout] test api::tests::test_tropical_matmul_max_mul ... ok
[INFO] [stdout] test api::tests::test_tropical_matmul_f32 ... ok
[INFO] [stdout] test api::tests::test_tropical_matmul_strided_batched_minplus ... ok
[INFO] [stdout] test api::tests::test_tropical_matmul_with_argmax ... ok
[INFO] [stdout] test api::tests::test_unsafe_tropical_gemm ... ok
[INFO] [stdout] test backend::tests::test_backend_clone ... ok
[INFO] [stdout] test backend::tests::test_backend_detection ... ok
[INFO] [stdout] test backend::tests::test_backend_debug ... ok
[INFO] [stdout] test backend::tests::test_backend_description_not_empty ... ok
[INFO] [stdout] test backend::tests::test_backend_eq ... ok
[INFO] [stdout] test api::tests::test_tropical_matmul_minplus_i32 ... ok
[INFO] [stdout] test api::tests::test_tropical_matmul_i32 ... ok
[INFO] [stdout] test api::tests::test_tropical_matmul_min_plus ... ok
[INFO] [stdout] test backend::tests::test_version_info_format ... ok
[INFO] [stdout] test api::tests::test_tropical_matmul_strided_batched_empty ... ok
[INFO] [stdout] test core::argmax::tests::test_gemm_with_argmax_as_mut_ptrs ... ok
[INFO] [stdout] test core::argmax::tests::test_gemm_with_argmax_get_argmax_mut ... ok
[INFO] [stdout] test core::argmax::tests::test_gemm_with_argmax_new ... ok
[INFO] [stdout] test core::argmax::tests::test_gemm_with_argmax_get_mut ... ok
[INFO] [stdout] test core::gemm::tests::test_gemm_empty_m ... ok
[INFO] [stdout] test api::tests::test_tropical_matmul_strided_batched ... ok
[INFO] [stdout] test core::gemm::tests::test_gemm_empty_n ... ok
[INFO] [stdout] test core::gemm::tests::test_gemm_empty_k ... ok
[INFO] [stdout] test core::argmax::tests::test_gemm_with_argmax_slices ... ok
[INFO] [stdout] test core::argmax::tests::test_gemm_with_argmax_with_ld ... ok
[INFO] [stdout] test core::gemm::tests::test_gemm_minplus_with_argmax ... ok
[INFO] [stdout] test core::gemm::tests::test_gemm_trans_both ... ok
[INFO] [stdout] test core::gemm::tests::test_gemm_trans_b ... ok
[INFO] [stdout] test core::gemm::tests::test_gemm_with_argmax_float_zero_cell_keeps_seed ... ok
[INFO] [stdout] test core::gemm::tests::test_gemm_with_argmax ... ok
[INFO] [stdout] test core::gemm::tests::test_gemm_trans_a ... ok
[INFO] [stdout] test core::gemm::tests::test_gemm_with_argmax_int_zero_cell_canonicalized ... ok
[INFO] [stdout] test core::gemm::tests::test_gemm_with_argmax_trans_b ... ok
[INFO] [stdout] test core::gemm::tests::test_gemm_with_argmax_trans_a ... ok
[INFO] [stdout] test core::gemm::tests::test_simple_gemm ... ok
[INFO] [stdout] test core::gemm::tests::test_gemm_larger_with_argmax ... ok
[INFO] [stdout] test core::gemm::tests::test_gemm_with_argmax_all_positions ... ok
[INFO] [stdout] test core::gemm::tests::test_gemm_with_argmax_empty_k ... ok
[INFO] [stdout] test core::kernel::tests::test_portable_kernel ... ok
[INFO] [stdout] test core::kernel::tests::test_portable_kernel_f32 ... ok
[INFO] [stdout] test core::kernel::tests::test_portable_kernel_with_argmax ... ok
[INFO] [stdout] test core::packing::tests::test_layout_clone_eq ... ok
[INFO] [stdout] test core::packing::tests::test_layout_debug ... ok
[INFO] [stdout] test core::kernel::tests::test_portable_kernel_with_argmax_offset ... ok
[INFO] [stdout] test core::packing::tests::test_pack_a_col_major ... ok
[INFO] [stdout] test core::packing::tests::test_pack_a_exact_mr ... ok
[INFO] [stdout] test core::packing::tests::test_pack_a_row_major ... ok
[INFO] [stdout] test core::packing::tests::test_pack_a_with_transpose ... ok
[INFO] [stdout] test core::packing::tests::test_pack_b_exact_nr ... ok
[INFO] [stdout] test core::packing::tests::test_pack_b_col_major ... ok
[INFO] [stdout] test core::packing::tests::test_pack_b_row_major ... ok
[INFO] [stdout] test core::packing::tests::test_pack_b_with_transpose ... ok
[INFO] [stdout] test core::packing::tests::test_packed_b_size ... ok
[INFO] [stdout] test core::packing::tests::test_transpose_debug ... ok
[INFO] [stdout] test core::tiling::tests::test_block_iterator ... ok
[INFO] [stdout] test core::packing::tests::test_transpose_clone_eq ... ok
[INFO] [stdout] test core::tiling::tests::test_clone ... ok
[INFO] [stdout] test core::packing::tests::test_packed_a_size ... ok
[INFO] [stdout] test core::tiling::tests::test_block_iterator_exact ... ok
[INFO] [stdout] test core::tiling::tests::test_debug ... ok
[INFO] [stdout] test core::tiling::tests::test_default ... ok
[INFO] [stdout] test core::tiling::tests::test_block_iterator_empty ... ok
[INFO] [stdout] test core::tiling::tests::test_validate_mc_zero ... ok
[INFO] [stdout] test core::tiling::tests::test_validate_kc_zero ... ok
[INFO] [stdout] test core::tiling::tests::test_validate_mr_zero ... ok
[INFO] [stdout] test core::tiling::tests::test_validate_nc_not_divisible ... ok
[INFO] [stdout] test core::tiling::tests::test_validate_nr_zero ... ok
[INFO] [stdout] test mat::mut_::tests::test_matmut_as_mut_ptr ... ok
[INFO] [stdout] test mat::mut_::tests::test_matmut_as_mut_slice ... ok
[INFO] [stdout] test mat::mut_::tests::test_matmut_debug ... ok
[INFO] [stdout] test core::tiling::tests::test_validate_params ... ok
[INFO] [stdout] test core::tiling::tests::test_validate_nc_zero ... ok
[INFO] [stdout] test mat::mut_::tests::test_matmut_from_slice ... ok
[INFO] [stdout] test mat::mut_::tests::test_matmut_get_mut ... ok
[INFO] [stdout] test mat::ops::tests::test_mat_mul_mat ... ok
[INFO] [stdout] test mat::ops::tests::test_mat_mul_consuming ... ok
[INFO] [stdout] test mat::ops::tests::test_matref_mul_matref ... ok
[INFO] [stdout] test mat::ops::tests::test_mat_ref_mul_matref ... ok
[INFO] [stdout] test mat::mut_::tests::test_matmut_get ... ok
[INFO] [stdout] test mat::tests::test_from_row_major_equals_col_major_transposed ... ok
[INFO] [stdout] test mat::tests::test_mat_as_mut_slice ... ok
[INFO] [stdout] test mat::tests::test_mat_as_mut_ptr ... ok
[INFO] [stdout] test mat::ops::tests::test_matref_mul_matref_by_value ... ok
[INFO] [stdout] test mat::tests::test_mat_as_ref ... ok
[INFO] [stdout] test mat::tests::test_mat_as_slice ... ok
[INFO] [stdout] test mat::tests::test_mat_clone ... ok
[INFO] [stdout] test mat::tests::test_mat_debug ... ok
[INFO] [stdout] test mat::tests::test_mat_from_vec ... ok
[INFO] [stdout] test mat::tests::test_mat_get_value ... ok
[INFO] [stdout] test mat::tests::test_mat_identity ... ok
[INFO] [stdout] test mat::tests::test_mat_index_mut ... ok
[INFO] [stdout] test mat::tests::test_mat_matmul_argmax_direct ... ok
[INFO] [stdout] test core::kernel::tests::test_portable_kernel_maxmul ... ok
[INFO] [stdout] test core::kernel::tests::test_portable_kernel_minplus ... ok
[INFO] [stdout] test mat::tests::test_mat_from_fn ... ok
[INFO] [stdout] test mat::tests::test_mat_matmul_batched_empty ... ok
[INFO] [stdout] test mat::tests::test_mat_matmul_batched ... ok
[INFO] [stdout] test mat::tests::test_mat_matmul_batched_with_argmax ... ok
[INFO] [stdout] test mat::tests::test_mat_matmul_batched_with_argmax_empty ... ok
[INFO] [stdout] test mat::tests::test_mat_matmul_direct ... ok
[INFO] [stdout] test mat::tests::test_mat_matmul_ref ... ok
[INFO] [stdout] test core::argmax::tests::test_gemm_with_argmax_with_ld_invalid - should panic ... ok
[INFO] [stdout] test mat::tests::test_mat_zeros ... ok
[INFO] [stdout] test mat::tests::test_matmul ... ok
[INFO] [stdout] test mat::tests::test_matmul_argmax ... ok
[INFO] [stdout] test mat::tests::test_matmul_argmax_dimension_mismatch - should panic ... ok
[INFO] [stdout] test mat::mut_::tests::test_matmut_size_mismatch - should panic ... ok
[INFO] [stdout] test mat::tests::test_mat_from_row_major_size_mismatch - should panic ... ok
[INFO] [stdout] test mat::tests::test_mat_from_vec_size_mismatch - should panic ... ok
[INFO] [stdout] test mat::tests::test_mat_matmul_batched_size_mismatch - should panic ... ok
[INFO] [stdout] test mat::tests::test_matmul_operator ... ok
[INFO] [stdout] test mat::tests::test_matref_copy_clone ... ok
[INFO] [stdout] test mat::tests::test_matref_debug ... ok
[INFO] [stdout] test mat::tests::test_mat_matmul_batched_with_argmax_size_mismatch - should panic ... ok
[INFO] [stdout] test mat::tests::test_matref_from_slice ... ok
[INFO] [stdout] test mat::tests::test_matref_to_owned ... ok
[INFO] [stdout] test mat::tests::test_mat_matmul_batched_dimension_mismatch - should panic ... ok
[INFO] [stdout] test mat::tests::test_matwithargmax_argmax_slice ... ok
[INFO] [stdout] test mat::tests::test_matwithargmax_backward_b ... ok
[INFO] [stdout] test mat::tests::test_matwithargmax_backward_varied_argmax ... ok
[INFO] [stdout] test mat::tests::test_matwithargmax_backward_a ... ok
[INFO] [stdout] test mat::tests::test_matwithargmax_get_value ... ok
[INFO] [stdout] test mat::tests::test_matref_from_slice_size_mismatch - should panic ... ok
[INFO] [stdout] test mat::tests::test_matwithargmax_nrows_ncols ... ok
[INFO] [stdout] test mat::tests::test_minplus_mat_matmul_direct ... ok
[INFO] [stdout] test mat::tests::test_minplus_matmul ... ok
[INFO] [stdout] test simd::detect::tests::test_all_widths ... ok
[INFO] [stdout] test simd::detect::tests::test_detect ... ok
[INFO] [stdout] test simd::detect::tests::test_simd_level_cached ... ok
[INFO] [stdout] test simd::detect::tests::test_width ... ok
[INFO] [stdout] test simd::detect::tests::test_width_bytes ... ok
[INFO] [stdout] test mat::tests::test_matref_matmul_argmax_dimension_mismatch - should panic ... ok
[INFO] [stdout] test mat::tests::test_matmul_dimension_mismatch - should panic ... ok
[INFO] [stdout] test mat::tests::test_matref_matmul_dimension_mismatch - should panic ... ok
[INFO] [stdout] test simd::dispatch::tests::test_dispatch_maxmul_f32 ... ok
[INFO] [stdout] test simd::dispatch::tests::test_dispatch_maxmul_f64 ... ok
[INFO] [stdout] test simd::dispatch::tests::test_dispatch_larger_matrix ... ok
[INFO] [stdout] test simd::dispatch::tests::test_dispatch_maxmul_i32 ... ok
[INFO] [stdout] test simd::dispatch::tests::test_dispatch_maxmul_i64 ... ok
[INFO] [stdout] test simd::dispatch::tests::test_dispatch_maxplus_f32 ... ok
[INFO] [stdout] test mat::tests::test_mat_matmul_ref_dimension_mismatch - should panic ... ok
[INFO] [stdout] test simd::dispatch::tests::test_dispatch_maxplus_f64 ... ok
[INFO] [stdout] test simd::dispatch::tests::test_dispatch_maxplus_i32 ... ok
[INFO] [stdout] test simd::dispatch::tests::test_dispatch_minplus_f32 ... ok
[INFO] [stdout] test simd::dispatch::tests::test_dispatch_maxplus_i64 ... ok
[INFO] [stdout] test simd::dispatch::tests::test_dispatch_minplus_i64 ... ok
[INFO] [stdout] test simd::kernels::avx2::tests::test_avx2_max_mul_f32 ... ok
[INFO] [stdout] test simd::kernels::avx2::tests::test_avx2_max_plus_f32 ... ok
[INFO] [stdout] test simd::kernels::avx2::tests::test_avx2_max_plus_f64 ... ok
[INFO] [stdout] test simd::dispatch::tests::test_dispatch_minplus_i32 ... ok
[INFO] [stdout] test simd::dispatch::tests::test_dispatch_minplus_f64 ... ok
[INFO] [stdout] test simd::kernels::avx2::tests::test_avx2_min_plus_f32 ... ok
[INFO] [stdout] test simd::kernels::portable::tests::test_portable_kernel_default ... ok
[INFO] [stdout] test simd::kernels::portable::tests::test_portable_kernel_execute_with_argmax ... ok
[INFO] [stdout] test types::and_or::tests::test_absorbing_zero ... ok
[INFO] [stdout] test simd::kernels::portable::tests::test_portable_kernel_execute ... ok
[INFO] [stdout] test types::and_or::tests::test_argmax_both_false ... ok
[INFO] [stdout] test types::and_or::tests::test_argmax_rhs_true ... ok
[INFO] [stdout] test types::and_or::tests::test_argmax_chain ... ok
[INFO] [stdout] test types::and_or::tests::test_argmax_self_true ... ok
[INFO] [stdout] test types::and_or::tests::test_clone_copy ... ok
[INFO] [stdout] test types::and_or::tests::test_default ... ok
[INFO] [stdout] test types::and_or::tests::test_display_debug ... ok
[INFO] [stdout] test types::and_or::tests::test_eq ... ok
[INFO] [stdout] test types::and_or::tests::test_from ... ok
[INFO] [stdout] test types::and_or::tests::test_operations ... ok
[INFO] [stdout] test types::and_or::tests::test_simd_tropical ... ok
[INFO] [stdout] test types::and_or::tests::test_value_and_from_scalar ... ok
[INFO] [stdout] test types::and_or::tests::test_operator_overloads ... ok
[INFO] [stdout] test types::and_or::tests::test_reachability_example ... ok
[INFO] [stdout] test types::and_or::tests::test_semiring_identity ... ok
[INFO] [stdout] test types::counting::tests::test_addition_different_values ... ok
[INFO] [stdout] test types::counting::tests::test_addition_equal_values ... ok
[INFO] [stdout] test types::counting::tests::test_addition_self_wins ... ok
[INFO] [stdout] test types::counting::tests::test_argmax_chain ... ok
[INFO] [stdout] test types::counting::tests::test_argmax_equal_counts_added ... ok
[INFO] [stdout] test types::counting::tests::test_argmax_rhs_wins ... ok
[INFO] [stdout] test types::counting::tests::test_argmax_self_wins ... ok
[INFO] [stdout] test types::counting::tests::test_clone_copy ... ok
[INFO] [stdout] test types::counting::tests::test_default ... ok
[INFO] [stdout] test types::counting::tests::test_different_count_type ... ok
[INFO] [stdout] test types::counting::tests::test_display_debug ... ok
[INFO] [stdout] test types::counting::tests::test_f32 ... ok
[INFO] [stdout] test types::counting::tests::test_from ... ok
[INFO] [stdout] test types::counting::tests::test_from_value ... ok
[INFO] [stdout] test types::counting::tests::test_eq ... ok
[INFO] [stdout] test types::counting::tests::test_multiplication ... ok
[INFO] [stdout] test types::counting::tests::test_operator_overloads ... ok
[INFO] [stdout] test types::counting::tests::test_path_counting_example ... ok
[INFO] [stdout] test types::counting::tests::test_semiring_identity ... ok
[INFO] [stdout] test types::counting::tests::test_simd_tropical ... ok
[INFO] [stdout] test types::counting::tests::test_value_and_from_scalar ... ok
[INFO] [stdout] test types::max_mul::tests::test_absorbing_zero ... ok
[INFO] [stdout] test types::max_mul::tests::test_argmax_chain ... ok
[INFO] [stdout] test types::max_mul::tests::test_argmax_equal_self_wins ... ok
[INFO] [stdout] test types::max_mul::tests::test_argmax_self_wins ... ok
[INFO] [stdout] test types::max_mul::tests::test_default ... ok
[INFO] [stdout] test types::max_mul::tests::test_clone_copy ... ok
[INFO] [stdout] test types::max_mul::tests::test_display_debug ... ok
[INFO] [stdout] test types::max_mul::tests::test_argmax_rhs_wins ... ok
[INFO] [stdout] test types::max_mul::tests::test_eq ... ok
[INFO] [stdout] test types::max_mul::tests::test_f32 ... ok
[INFO] [stdout] test types::max_mul::tests::test_from ... ok
[INFO] [stdout] test types::max_mul::tests::test_fuzzy_logic_example ... ok
[INFO] [stdout] test types::max_mul::tests::test_operations ... ok
[INFO] [stdout] test types::max_mul::tests::test_operator_overloads ... ok
[INFO] [stdout] test types::max_mul::tests::test_semiring_identity ... ok
[INFO] [stdout] test types::max_mul::tests::test_simd_tropical ... ok
[INFO] [stdout] test types::max_mul::tests::test_value_and_from_scalar ... ok
[INFO] [stdout] test types::max_plus::tests::test_absorbing_zero ... ok
[INFO] [stdout] test types::max_plus::tests::test_argmax ... ok
[INFO] [stdout] test types::max_plus::tests::test_argmax_chain ... ok
[INFO] [stdout] test types::max_plus::tests::test_argmax_equal_values ... ok
[INFO] [stdout] test types::max_plus::tests::test_argmax_left_wins ... ok
[INFO] [stdout] test types::max_plus::tests::test_argmax_neg_infinity ... ok
[INFO] [stdout] test types::max_plus::tests::test_clone_copy ... ok
[INFO] [stdout] test types::max_plus::tests::test_default ... ok
[INFO] [stdout] test types::max_plus::tests::test_display_debug ... ok
[INFO] [stdout] test types::max_plus::tests::test_eq ... ok
[INFO] [stdout] test types::max_plus::tests::test_f32 ... ok
[INFO] [stdout] test types::max_plus::tests::test_from ... ok
[INFO] [stdout] test types::max_plus::tests::test_operations ... ok
[INFO] [stdout] test types::max_plus::tests::test_operator_overloads ... ok
[INFO] [stdout] test types::max_plus::tests::test_semiring_identity ... ok
[INFO] [stdout] test types::max_plus::tests::test_simd_tropical ... ok
[INFO] [stdout] test types::max_plus::tests::test_value_and_from_scalar ... ok
[INFO] [stdout] test types::min_plus::tests::test_absorbing_zero ... ok
[INFO] [stdout] test types::min_plus::tests::test_argmin_chain ... ok
[INFO] [stdout] test types::min_plus::tests::test_argmin_equal_values ... ok
[INFO] [stdout] test types::min_plus::tests::test_argmin_left_wins ... ok
[INFO] [stdout] test types::min_plus::tests::test_argmin_pos_infinity ... ok
[INFO] [stdout] test types::min_plus::tests::test_argmin_right_wins ... ok
[INFO] [stdout] test types::min_plus::tests::test_clone_copy ... ok
[INFO] [stdout] test types::min_plus::tests::test_default ... ok
[INFO] [stdout] test types::min_plus::tests::test_display_debug ... ok
[INFO] [stdout] test types::min_plus::tests::test_eq ... ok
[INFO] [stdout] test types::min_plus::tests::test_f32 ... ok
[INFO] [stdout] test types::min_plus::tests::test_from ... ok
[INFO] [stdout] test types::min_plus::tests::test_operations ... ok
[INFO] [stdout] test types::min_plus::tests::test_operator_overloads ... ok
[INFO] [stdout] test types::min_plus::tests::test_semiring_identity ... ok
[INFO] [stdout] test types::min_plus::tests::test_shortest_path_scenario ... ok
[INFO] [stdout] test types::min_plus::tests::test_simd_tropical ... ok
[INFO] [stdout] test types::min_plus::tests::test_value_and_from_scalar ... ok
[INFO] [stdout] test types::scalar::tests::test_bool_scalar ... ok
[INFO] [stdout] test types::scalar::tests::test_drifted_zero_detection ... ok
[INFO] [stdout] test types::scalar::tests::test_f32_scalar ... ok
[INFO] [stdout] test types::scalar::tests::test_f64_scalar ... ok
[INFO] [stdout] test types::scalar::tests::test_float_edge_cases ... ok
[INFO] [stdout] test types::scalar::tests::test_i16_scalar ... ok
[INFO] [stdout] test types::scalar::tests::test_i32_scalar ... ok
[INFO] [stdout] test types::scalar::tests::test_i64_scalar ... ok
[INFO] [stdout] test types::scalar::tests::test_i8_scalar ... ok
[INFO] [stdout] test types::scalar::tests::test_int_edge_cases ... ok
[INFO] [stdout] test types::scalar::tests::test_u16_scalar ... ok
[INFO] [stdout] test types::scalar::tests::test_u32_scalar ... ok
[INFO] [stdout] test types::scalar::tests::test_u64_scalar ... ok
[INFO] [stdout] test types::scalar::tests::test_u8_scalar ... ok
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 279 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.05s
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] running 60 tests
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/tropical_gemm_cuda-660af963fb9e1ca5)
[INFO] [stdout] test gpu_mat::tests::test_gpu_mat_backward_a ... FAILED
[INFO] [stdout] test gpu_mat::tests::test_gpu_mat_backward_b ... FAILED
[INFO] [stdout] test gpu_mat::tests::test_gpu_mat_matmul_argmax ... FAILED
[INFO] [stdout] test gpu_mat::tests::test_gpu_mat_matmul ... FAILED
[INFO] [stdout] test memory::tests::alloc_rejects_rows_cols_overflow ... ok
[INFO] [stdout] test gpu_mat::tests::test_gpu_mat_basic ... FAILED
[INFO] [stdout] test gpu_mat::tests::test_gpu_mat_minplus ... FAILED
[INFO] [stdout] test gpu_mat::tests::test_gpu_mat_batched_with_argmax ... FAILED
[INFO] [stdout] test memory::tests::from_cuda_slice_roundtrip_preserves_data ... ok
[INFO] [stdout] test memory::tests::from_cuda_slice_rejects_rows_cols_overflow ... ok
[INFO] [stdout] test memory::tests::from_cuda_slices_pairs_matrix_and_argmax ... ok
[INFO] [stdout] test gpu_mat::tests::test_gpu_mat_batched_empty ... FAILED
[INFO] [stdout] test tests::test_backward_batched_empty ... ok
[INFO] [stdout] test tests::test_backward_empty_matrices ... ok
[INFO] [stdout] test tests::test_backward_f64 ... ok
[INFO] [stdout] test tests::test_backward_index_over_i32_max ... ignored, allocates ~16 GB of VRAM; run manually on a large-memory GPU
[INFO] [stdout] test tests::test_batched_forward_offset_over_i32_max ... ignored, allocates ~8.6 GB of VRAM; run manually on a large-memory GPU
[INFO] [stdout] test memory::tests::from_cuda_slices_rejects_dimension_mismatch_on_either_buffer ... ok
[INFO] [stdout] test gpu_mat::tests::test_gpu_mat_batched ... FAILED
[INFO] [stdout] test tests::test_context_helper_functions ... ok
[INFO] [stdout] test tests::test_error_display ... ok
[INFO] [stdout] test tests::test_argmax_finite_difference_minplus ... ok
[INFO] [stdout] test tests::test_argmax_finite_difference_b_matrix ... ok
[INFO] [stdout] test tests::test_gpu_matrix_col_major_roundtrip ... ok
[INFO] [stdout] test tests::test_context_device_name ... ok
[INFO] [stdout] test memory::tests::from_cuda_slice_into_inner_is_symmetric ... ok
[INFO] [stdout] test tests::test_single_matrix_offset_over_i32_max ... ignored, allocates ~8.6 GB of VRAM; run manually on a large-memory GPU
[INFO] [stdout] test tests::test_tropical_backward_a_gpu ... ok
[INFO] [stdout] test tests::test_tropical_backward_b_gpu ... ok
[INFO] [stdout] test tests::test_context_get_kernel ... ok
[INFO] [stdout] test tests::test_argmax_finite_difference_maxplus ... ok
[INFO] [stdout] test tests::test_tropical_backward_gpu_batched ... ok
[INFO] [stdout] test tests::test_gpu_memory_dimension_mismatch ... ok
[INFO] [stdout] test tests::test_gpu_matrix_with_argmax_accessors ... ok
[INFO] [stdout] test tests::test_gpu_memory_col_major_dimension_mismatch ... ok
[INFO] [stdout] test tests::test_tropical_gemm_batched_matches_single ... ok
[INFO] [stdout] test tests::test_tropical_gemm_gpu_dimension_mismatch ... ok
[INFO] [stdout] test tests::test_tropical_backward_gpu_integration ... ok
[INFO] [stdout] test tests::test_tropical_matmul_gpu_batched_dimension_mismatch ... ok
[INFO] [stdout] test tests::test_tropical_matmul_gpu_batched_basic ... ok
[INFO] [stdout] test tests::test_tropical_matmul_gpu_batched_with_argmax_basic ... ok
[INFO] [stdout] test tests::test_gpu_matrix_accessors ... ok
[INFO] [stdout] test tests::test_tropical_matmul_gpu_i32 ... ok
[INFO] [stdout] test memory::tests::from_cuda_slice_rejects_dimension_mismatch ... ok
[INFO] [stdout] test tests::test_tropical_matmul_gpu_i64 ... ok
[INFO] [stdout] test tests::test_tropical_matmul_gpu_dimension_mismatch_b ... ok
[INFO] [stdout] test tests::test_tropical_matmul_gpu_maxmul_with_argmax ... ok
[INFO] [stdout] test tests::test_tropical_matmul_gpu_batched_minplus ... ok
[INFO] [stdout] test tests::test_tropical_matmul_gpu_dimension_mismatch_a ... ok
[INFO] [stdout] test tests::test_tropical_matmul_gpu_strided_batched_basic ... ok
[INFO] [stdout] test tests::test_tropical_matmul_gpu_batched_empty ... ok
[INFO] [stdout] test tests::test_tropical_matmul_gpu_strided_batched_empty ... ok
[INFO] [stdout] test tests::test_tropical_matmul_gpu_with_argmax_dimension_mismatch ... ok
[INFO] [stdout] test tests::test_tropical_matmul_gpu_with_argmax_varied_winners ... ok
[INFO] [stdout] test tests::test_tropical_matmul_gpu_with_argmax_f64 ... ok
[INFO] [stdout] test tests::test_tropical_matmul_gpu_with_ctx_dimension_mismatch ... ok
[INFO] [stdout] test tests::test_tropical_matmul_gpu_with_argmax_maxplus ... ok
[INFO] [stdout] test tests::test_tropical_matmul_gpu_maxmul ... ok
[INFO] [stdout] test tests::test_tropical_matmul_gpu_with_argmax_minplus ... ok
[INFO] [stdout] test tests::test_tropical_matmul_gpu_small ... ok
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout] 
[INFO] [stdout] ---- gpu_mat::tests::test_gpu_mat_backward_a stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'gpu_mat::tests::test_gpu_mat_backward_a' (2225) panicked at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/lib.rs:200:5:
[INFO] [stdout] Unable to dynamically load the "cuda" shared library - searched for library names: ["libcuda.so", "libcuda64.so", "libcuda64_13.so", "libcuda64_132.so", "libcuda64_132_0.so", "libcuda64_130_2.so", "libcuda64_10.so", "libcuda64_11.so", "libcuda64_12.so", "libcuda64_130_0.so", "libcuda64_9.so", "libcuda.so.13", "libcuda.so.12", "libcuda.so.11", "libcuda.so.10", "libcuda.so.9", "libcuda.so.1", "libnvcuda.so", "libnvcuda64.so", "libnvcuda64_13.so", "libnvcuda64_132.so", "libnvcuda64_132_0.so", "libnvcuda64_130_2.so", "libnvcuda64_10.so", "libnvcuda64_11.so", "libnvcuda64_12.so", "libnvcuda64_130_0.so", "libnvcuda64_9.so", "libnvcuda.so.13", "libnvcuda.so.12", "libnvcuda.so.11", "libnvcuda.so.10", "libnvcuda.so.9", "libnvcuda.so.1"]. Ensure that `LD_LIBRARY_PATH` has the correct path to the installed library. If the shared library is present on the system under a different name than one of those listed above, please open a GitHub issue.
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x5bb5e9b302e8 - std[10d71ac2c42b111e]::backtrace_rs::backtrace::libunwind::trace
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9
[INFO] [stdout]    1:     0x5bb5e9b302e8 - std[10d71ac2c42b111e]::backtrace_rs::backtrace::trace_unsynchronized::<std[10d71ac2c42b111e]::sys::backtrace::_print_fmt::{closure#1}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14
[INFO] [stdout]    2:     0x5bb5e9b302e8 - std[10d71ac2c42b111e]::sys::backtrace::_print_fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:74:9
[INFO] [stdout]    3:     0x5bb5e9b302e8 - <<std[10d71ac2c42b111e]::sys::backtrace::BacktraceLock>::print::DisplayBacktrace as core[8fb95b77d25ab6c8]::fmt::Display>::fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:44:26
[INFO] [stdout]    4:     0x5bb5e9b453da - <core[8fb95b77d25ab6c8]::fmt::rt::Argument>::fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/fmt/rt.rs:152:76
[INFO] [stdout]    5:     0x5bb5e9b453da - core[8fb95b77d25ab6c8]::fmt::write
[INFO] [stdout]    6:     0x5bb5e9b34b02 - std[10d71ac2c42b111e]::io::default_write_fmt::<alloc[a7ee25936407c584]::vec::Vec<u8>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/io/mod.rs:622:11
[INFO] [stdout]    7:     0x5bb5e9b34b02 - <alloc[a7ee25936407c584]::vec::Vec<u8> as std[10d71ac2c42b111e]::io::Write>::write_fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/io/mod.rs:1977:13
[INFO] [stdout]    8:     0x5bb5e9b0de86 - <std[10d71ac2c42b111e]::sys::backtrace::BacktraceLock>::print
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:47:9
[INFO] [stdout]    9:     0x5bb5e9b0de86 - std[10d71ac2c42b111e]::panicking::default_hook::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:292:27
[INFO] [stdout]   10:     0x5bb5e9b28379 - std[10d71ac2c42b111e]::panicking::default_hook
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:316:9
[INFO] [stdout]   11:     0x5bb5e9a86cec - <alloc[a7ee25936407c584]::boxed::Box<dyn for<'a, 'b> core[8fb95b77d25ab6c8]::ops::function::Fn<(&'a std[10d71ac2c42b111e]::panic::PanicHookInfo<'b>,), Output = ()> + core[8fb95b77d25ab6c8]::marker::Sync + core[8fb95b77d25ab6c8]::marker::Send> as core[8fb95b77d25ab6c8]::ops::function::Fn<(&std[10d71ac2c42b111e]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/alloc/src/boxed.rs:2289:9
[INFO] [stdout]   12:     0x5bb5e9a86cec - test[213991da798b1c03]::test_main_inner::<test[213991da798b1c03]::test_main_static::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:155:21
[INFO] [stdout]   13:     0x5bb5e9b28532 - <alloc[a7ee25936407c584]::boxed::Box<dyn for<'a, 'b> core[8fb95b77d25ab6c8]::ops::function::Fn<(&'a std[10d71ac2c42b111e]::panic::PanicHookInfo<'b>,), Output = ()> + core[8fb95b77d25ab6c8]::marker::Sync + core[8fb95b77d25ab6c8]::marker::Send> as core[8fb95b77d25ab6c8]::ops::function::Fn<(&std[10d71ac2c42b111e]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/alloc/src/boxed.rs:2289:9
[INFO] [stdout]   14:     0x5bb5e9b28532 - std[10d71ac2c42b111e]::panicking::panic_with_hook
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:833:13
[INFO] [stdout]   15:     0x5bb5e9b0df42 - std[10d71ac2c42b111e]::panicking::panic_handler::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:698:13
[INFO] [stdout]   16:     0x5bb5e9b02ee9 - std[10d71ac2c42b111e]::sys::backtrace::__rust_end_short_backtrace::<std[10d71ac2c42b111e]::panicking::panic_handler::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:182:18
[INFO] [stdout]   17:     0x5bb5e9b0ed1d - __rustc[3be9ba60078d4c86]::rust_begin_unwind
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:689:5
[INFO] [stdout]   18:     0x5bb5e9b45b5c - core[8fb95b77d25ab6c8]::panicking::panic_fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/panicking.rs:80:14
[INFO] [stdout]   19:     0x5bb5e9ae4069 - cudarc[6f943a80b31f2234]::panic_no_lib_found::<alloc[a7ee25936407c584]::string::String>
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/lib.rs:200:5
[INFO] [stdout]   20:     0x5bb5e9ac0f76 - cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:15462:9
[INFO] [stdout]   21:     0x5bb5e9ac5fc6 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:50
[INFO] [stdout]   22:     0x5bb5e9ac5f7d - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:543:19
[INFO] [stdout]   23:     0x5bb5e9ac97c2 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:40
[INFO] [stdout]   24:     0x5bb5e9b13119 - <std[10d71ac2c42b111e]::sys::sync::once::futex::Once>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/sync/once/futex.rs:183:21
[INFO] [stdout]   25:     0x5bb5e9ac81c4 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:20
[INFO] [stdout]   26:     0x5bb5e9ac4f47 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:542:19
[INFO] [stdout]   27:     0x5bb5e9ac50ff - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_try_init::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:410:14
[INFO] [stdout]   28:     0x5bb5e9ac4f9e - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:20
[INFO] [stdout]   29:     0x5bb5e9ac186e - cudarc[6f943a80b31f2234]::driver::sys::culib
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:15454:9
[INFO] [stdout]   30:     0x5bb5e9abf017 - cudarc[6f943a80b31f2234]::driver::sys::load::<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:12:15
[INFO] [stdout]   31:     0x5bb5e9ac1062 - cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:11041:45
[INFO] [stdout]   32:     0x5bb5e9ac5d86 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:50
[INFO] [stdout]   33:     0x5bb5e9ac5d4d - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:543:19
[INFO] [stdout]   34:     0x5bb5e9ac9462 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:40
[INFO] [stdout]   35:     0x5bb5e9b13119 - <std[10d71ac2c42b111e]::sys::sync::once::futex::Once>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/sync/once/futex.rs:183:21
[INFO] [stdout]   36:     0x5bb5e9ac7c84 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:20
[INFO] [stdout]   37:     0x5bb5e9ac4910 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:542:19
[INFO] [stdout]   38:     0x5bb5e9ac49ef - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_try_init::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:410:14
[INFO] [stdout]   39:     0x5bb5e9ac494e - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:20
[INFO] [stdout]   40:     0x5bb5e9ac1889 - cudarc[6f943a80b31f2234]::driver::sys::cuInit
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:11041:21
[INFO] [stdout]   41:     0x5bb5e9ae73e9 - cudarc[6f943a80b31f2234]::driver::result::init
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/result.rs:89:14
[INFO] [stdout]   42:     0x5bb5e9aec66a - <cudarc[6f943a80b31f2234]::driver::safe::core::CudaContext>::device_count
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/safe/core.rs:280:9
[INFO] [stdout]   43:     0x5bb5e9a665d4 - tropical_gemm_cuda[29028f76903e4476]::cuda_device_count
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/lib.rs:109:8
[INFO] [stdout]   44:     0x5bb5e9a66694 - tropical_gemm_cuda[29028f76903e4476]::get_context_for_device
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/lib.rs:126:24
[INFO] [stdout]   45:     0x5bb5e9a66651 - tropical_gemm_cuda[29028f76903e4476]::get_global_context
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/lib.rs:177:5
[INFO] [stdout]   46:     0x5bb5e9a38ba4 - tropical_gemm_cuda[29028f76903e4476]::gpu_mat::tests::test_gpu_mat_backward_a
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/gpu_mat.rs:766:25
[INFO] [stdout]   47:     0x5bb5e9a32757 - tropical_gemm_cuda[29028f76903e4476]::gpu_mat::tests::test_gpu_mat_backward_a::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/gpu_mat.rs:763:33
[INFO] [stdout]   48:     0x5bb5e9a30376 - <tropical_gemm_cuda[29028f76903e4476]::gpu_mat::tests::test_gpu_mat_backward_a::{closure#0} as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   49:     0x5bb5e9a79dcb - <fn() -> core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   50:     0x5bb5e9a79dcb - test[213991da798b1c03]::__rust_begin_short_backtrace::<core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>, fn() -> core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:724:18
[INFO] [stdout]   51:     0x5bb5e9a87645 - test[213991da798b1c03]::run_test_in_process::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:747:74
[INFO] [stdout]   52:     0x5bb5e9a87645 - <core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   53:     0x5bb5e9a87645 - std[10d71ac2c42b111e]::panicking::catch_unwind::do_call::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}>, core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:581:40
[INFO] [stdout]   54:     0x5bb5e9a87645 - std[10d71ac2c42b111e]::panicking::catch_unwind::<core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>, core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:544:19
[INFO] [stdout]   55:     0x5bb5e9a87645 - std[10d71ac2c42b111e]::panic::catch_unwind::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}>, core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panic.rs:359:14
[INFO] [stdout]   56:     0x5bb5e9a87645 - test[213991da798b1c03]::run_test_in_process
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:747:27
[INFO] [stdout]   57:     0x5bb5e9a87645 - test[213991da798b1c03]::run_test::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:668:43
[INFO] [stdout]   58:     0x5bb5e9a80f54 - test[213991da798b1c03]::run_test::{closure#1}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:698:41
[INFO] [stdout]   59:     0x5bb5e9a80f54 - std[10d71ac2c42b111e]::sys::backtrace::__rust_begin_short_backtrace::<test[213991da798b1c03]::run_test::{closure#1}, ()>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:166:18
[INFO] [stdout]   60:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked::<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/thread/lifecycle.rs:70:13
[INFO] [stdout]   61:     0x5bb5e9a8a6c2 - <core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   62:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::panicking::catch_unwind::do_call::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:581:40
[INFO] [stdout]   63:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::panicking::catch_unwind::<(), core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:544:19
[INFO] [stdout]   64:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::panic::catch_unwind::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panic.rs:359:14
[INFO] [stdout]   65:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked::<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/thread/lifecycle.rs:68:26
[INFO] [stdout]   66:     0x5bb5e9a8a6c2 - <std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1} as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   67:     0x5bb5e9b2f96f - <alloc[a7ee25936407c584]::boxed::Box<dyn core[8fb95b77d25ab6c8]::ops::function::FnOnce<(), Output = ()> + core[8fb95b77d25ab6c8]::marker::Send> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/alloc/src/boxed.rs:2275:9
[INFO] [stdout]   68:     0x5bb5e9b2f96f - <std[10d71ac2c42b111e]::sys::thread::unix::Thread>::new::thread_start
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/thread/unix.rs:118:17
[INFO] [stdout]   69:     0x75580e3faaa4 - <unknown>
[INFO] [stdout]   70:     0x75580e487a64 - clone
[INFO] [stdout]   71:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] ---- gpu_mat::tests::test_gpu_mat_backward_b stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'gpu_mat::tests::test_gpu_mat_backward_b' (2226) panicked at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/lib.rs:200:5:
[INFO] [stdout] Unable to dynamically load the "cuda" shared library - searched for library names: ["libcuda.so", "libcuda64.so", "libcuda64_13.so", "libcuda64_132.so", "libcuda64_132_0.so", "libcuda64_130_2.so", "libcuda64_10.so", "libcuda64_11.so", "libcuda64_12.so", "libcuda64_130_0.so", "libcuda64_9.so", "libcuda.so.13", "libcuda.so.12", "libcuda.so.11", "libcuda.so.10", "libcuda.so.9", "libcuda.so.1", "libnvcuda.so", "libnvcuda64.so", "libnvcuda64_13.so", "libnvcuda64_132.so", "libnvcuda64_132_0.so", "libnvcuda64_130_2.so", "libnvcuda64_10.so", "libnvcuda64_11.so", "libnvcuda64_12.so", "libnvcuda64_130_0.so", "libnvcuda64_9.so", "libnvcuda.so.13", "libnvcuda.so.12", "libnvcuda.so.11", "libnvcuda.so.10", "libnvcuda.so.9", "libnvcuda.so.1"]. Ensure that `LD_LIBRARY_PATH` has the correct path to the installed library. If the shared library is present on the system under a different name than one of those listed above, please open a GitHub issue.
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x5bb5e9b302e8 - std[10d71ac2c42b111e]::backtrace_rs::backtrace::libunwind::trace
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9
[INFO] [stdout]    1:     0x5bb5e9b302e8 - std[10d71ac2c42b111e]::backtrace_rs::backtrace::trace_unsynchronized::<std[10d71ac2c42b111e]::sys::backtrace::_print_fmt::{closure#1}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14
[INFO] [stdout]    2:     0x5bb5e9b302e8 - std[10d71ac2c42b111e]::sys::backtrace::_print_fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:74:9
[INFO] [stdout]    3:     0x5bb5e9b302e8 - <<std[10d71ac2c42b111e]::sys::backtrace::BacktraceLock>::print::DisplayBacktrace as core[8fb95b77d25ab6c8]::fmt::Display>::fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:44:26
[INFO] [stdout]    4:     0x5bb5e9b453da - <core[8fb95b77d25ab6c8]::fmt::rt::Argument>::fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/fmt/rt.rs:152:76
[INFO] [stdout]    5:     0x5bb5e9b453da - core[8fb95b77d25ab6c8]::fmt::write
[INFO] [stdout]    6:     0x5bb5e9b34b02 - std[10d71ac2c42b111e]::io::default_write_fmt::<alloc[a7ee25936407c584]::vec::Vec<u8>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/io/mod.rs:622:11
[INFO] [stdout]    7:     0x5bb5e9b34b02 - <alloc[a7ee25936407c584]::vec::Vec<u8> as std[10d71ac2c42b111e]::io::Write>::write_fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/io/mod.rs:1977:13
[INFO] [stdout]    8:     0x5bb5e9b0de86 - <std[10d71ac2c42b111e]::sys::backtrace::BacktraceLock>::print
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:47:9
[INFO] [stdout]    9:     0x5bb5e9b0de86 - std[10d71ac2c42b111e]::panicking::default_hook::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:292:27
[INFO] [stdout]   10:     0x5bb5e9b28379 - std[10d71ac2c42b111e]::panicking::default_hook
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:316:9
[INFO] [stdout]   11:     0x5bb5e9a86cec - <alloc[a7ee25936407c584]::boxed::Box<dyn for<'a, 'b> core[8fb95b77d25ab6c8]::ops::function::Fn<(&'a std[10d71ac2c42b111e]::panic::PanicHookInfo<'b>,), Output = ()> + core[8fb95b77d25ab6c8]::marker::Sync + core[8fb95b77d25ab6c8]::marker::Send> as core[8fb95b77d25ab6c8]::ops::function::Fn<(&std[10d71ac2c42b111e]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/alloc/src/boxed.rs:2289:9
[INFO] [stdout]   12:     0x5bb5e9a86cec - test[213991da798b1c03]::test_main_inner::<test[213991da798b1c03]::test_main_static::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:155:21
[INFO] [stdout]   13:     0x5bb5e9b28532 - <alloc[a7ee25936407c584]::boxed::Box<dyn for<'a, 'b> core[8fb95b77d25ab6c8]::ops::function::Fn<(&'a std[10d71ac2c42b111e]::panic::PanicHookInfo<'b>,), Output = ()> + core[8fb95b77d25ab6c8]::marker::Sync + core[8fb95b77d25ab6c8]::marker::Send> as core[8fb95b77d25ab6c8]::ops::function::Fn<(&std[10d71ac2c42b111e]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/alloc/src/boxed.rs:2289:9
[INFO] [stdout]   14:     0x5bb5e9b28532 - std[10d71ac2c42b111e]::panicking::panic_with_hook
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:833:13
[INFO] [stdout]   15:     0x5bb5e9b0df42 - std[10d71ac2c42b111e]::panicking::panic_handler::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:698:13
[INFO] [stdout]   16:     0x5bb5e9b02ee9 - std[10d71ac2c42b111e]::sys::backtrace::__rust_end_short_backtrace::<std[10d71ac2c42b111e]::panicking::panic_handler::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:182:18
[INFO] [stdout]   17:     0x5bb5e9b0ed1d - __rustc[3be9ba60078d4c86]::rust_begin_unwind
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:689:5
[INFO] [stdout]   18:     0x5bb5e9b45b5c - core[8fb95b77d25ab6c8]::panicking::panic_fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/panicking.rs:80:14
[INFO] [stdout]   19:     0x5bb5e9ae4069 - cudarc[6f943a80b31f2234]::panic_no_lib_found::<alloc[a7ee25936407c584]::string::String>
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/lib.rs:200:5
[INFO] [stdout]   20:     0x5bb5e9ac0f76 - cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:15462:9
[INFO] [stdout]   21:     0x5bb5e9ac5fc6 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:50
[INFO] [stdout]   22:     0x5bb5e9ac5f7d - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:543:19
[INFO] [stdout]   23:     0x5bb5e9ac97c2 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:40
[INFO] [stdout]   24:     0x5bb5e9b13119 - <std[10d71ac2c42b111e]::sys::sync::once::futex::Once>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/sync/once/futex.rs:183:21
[INFO] [stdout]   25:     0x5bb5e9ac81c4 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:20
[INFO] [stdout]   26:     0x5bb5e9ac4f47 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:542:19
[INFO] [stdout]   27:     0x5bb5e9ac50ff - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_try_init::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:410:14
[INFO] [stdout]   28:     0x5bb5e9ac4f9e - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:20
[INFO] [stdout]   29:     0x5bb5e9ac186e - cudarc[6f943a80b31f2234]::driver::sys::culib
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:15454:9
[INFO] [stdout]   30:     0x5bb5e9abf017 - cudarc[6f943a80b31f2234]::driver::sys::load::<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:12:15
[INFO] [stdout]   31:     0x5bb5e9ac1062 - cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:11041:45
[INFO] [stdout]   32:     0x5bb5e9ac5d86 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:50
[INFO] [stdout]   33:     0x5bb5e9ac5d4d - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:543:19
[INFO] [stdout]   34:     0x5bb5e9ac9462 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:40
[INFO] [stdout]   35:     0x5bb5e9b13119 - <std[10d71ac2c42b111e]::sys::sync::once::futex::Once>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/sync/once/futex.rs:183:21
[INFO] [stdout]   36:     0x5bb5e9ac7c84 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:20
[INFO] [stdout]   37:     0x5bb5e9ac4910 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:542:19
[INFO] [stdout]   38:     0x5bb5e9ac49ef - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_try_init::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:410:14
[INFO] [stdout]   39:     0x5bb5e9ac494e - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:20
[INFO] [stdout]   40:     0x5bb5e9ac1889 - cudarc[6f943a80b31f2234]::driver::sys::cuInit
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:11041:21
[INFO] [stdout]   41:     0x5bb5e9ae73e9 - cudarc[6f943a80b31f2234]::driver::result::init
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/result.rs:89:14
[INFO] [stdout]   42:     0x5bb5e9aec66a - <cudarc[6f943a80b31f2234]::driver::safe::core::CudaContext>::device_count
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/safe/core.rs:280:9
[INFO] [stdout]   43:     0x5bb5e9a665d4 - tropical_gemm_cuda[29028f76903e4476]::cuda_device_count
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/lib.rs:109:8
[INFO] [stdout]   44:     0x5bb5e9a66694 - tropical_gemm_cuda[29028f76903e4476]::get_context_for_device
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/lib.rs:126:24
[INFO] [stdout]   45:     0x5bb5e9a66651 - tropical_gemm_cuda[29028f76903e4476]::get_global_context
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/lib.rs:177:5
[INFO] [stdout]   46:     0x5bb5e9a39674 - tropical_gemm_cuda[29028f76903e4476]::gpu_mat::tests::test_gpu_mat_backward_b
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/gpu_mat.rs:804:25
[INFO] [stdout]   47:     0x5bb5e9a32787 - tropical_gemm_cuda[29028f76903e4476]::gpu_mat::tests::test_gpu_mat_backward_b::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/gpu_mat.rs:801:33
[INFO] [stdout]   48:     0x5bb5e9a303b6 - <tropical_gemm_cuda[29028f76903e4476]::gpu_mat::tests::test_gpu_mat_backward_b::{closure#0} as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   49:     0x5bb5e9a79dcb - <fn() -> core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   50:     0x5bb5e9a79dcb - test[213991da798b1c03]::__rust_begin_short_backtrace::<core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>, fn() -> core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:724:18
[INFO] [stdout]   51:     0x5bb5e9a87645 - test[213991da798b1c03]::run_test_in_process::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:747:74
[INFO] [stdout]   52:     0x5bb5e9a87645 - <core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   53:     0x5bb5e9a87645 - std[10d71ac2c42b111e]::panicking::catch_unwind::do_call::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}>, core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:581:40
[INFO] [stdout]   54:     0x5bb5e9a87645 - std[10d71ac2c42b111e]::panicking::catch_unwind::<core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>, core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:544:19
[INFO] [stdout]   55:     0x5bb5e9a87645 - std[10d71ac2c42b111e]::panic::catch_unwind::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}>, core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panic.rs:359:14
[INFO] [stdout]   56:     0x5bb5e9a87645 - test[213991da798b1c03]::run_test_in_process
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:747:27
[INFO] [stdout]   57:     0x5bb5e9a87645 - test[213991da798b1c03]::run_test::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:668:43
[INFO] [stdout]   58:     0x5bb5e9a80f54 - test[213991da798b1c03]::run_test::{closure#1}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:698:41
[INFO] [stdout]   59:     0x5bb5e9a80f54 - std[10d71ac2c42b111e]::sys::backtrace::__rust_begin_short_backtrace::<test[213991da798b1c03]::run_test::{closure#1}, ()>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:166:18
[INFO] [stdout]   60:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked::<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/thread/lifecycle.rs:70:13
[INFO] [stdout]   61:     0x5bb5e9a8a6c2 - <core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   62:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::panicking::catch_unwind::do_call::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:581:40
[INFO] [stdout]   63:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::panicking::catch_unwind::<(), core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:544:19
[INFO] [stdout]   64:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::panic::catch_unwind::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panic.rs:359:14
[INFO] [stdout]   65:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked::<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/thread/lifecycle.rs:68:26
[INFO] [stdout]   66:     0x5bb5e9a8a6c2 - <std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1} as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   67:     0x5bb5e9b2f96f - <alloc[a7ee25936407c584]::boxed::Box<dyn core[8fb95b77d25ab6c8]::ops::function::FnOnce<(), Output = ()> + core[8fb95b77d25ab6c8]::marker::Send> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/alloc/src/boxed.rs:2275:9
[INFO] [stdout]   68:     0x5bb5e9b2f96f - <std[10d71ac2c42b111e]::sys::thread::unix::Thread>::new::thread_start
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/thread/unix.rs:118:17
[INFO] [stdout]   69:     0x75580e3faaa4 - <unknown>
[INFO] [stdout]   70:     0x75580e487a64 - clone
[INFO] [stdout]   71:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] ---- gpu_mat::tests::test_gpu_mat_matmul_argmax stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'gpu_mat::tests::test_gpu_mat_matmul_argmax' (2232) panicked at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/lib.rs:200:5:
[INFO] [stdout] Unable to dynamically load the "cuda" shared library - searched for library names: ["libcuda.so", "libcuda64.so", "libcuda64_13.so", "libcuda64_132.so", "libcuda64_132_0.so", "libcuda64_130_2.so", "libcuda64_10.so", "libcuda64_11.so", "libcuda64_12.so", "libcuda64_130_0.so", "libcuda64_9.so", "libcuda.so.13", "libcuda.so.12", "libcuda.so.11", "libcuda.so.10", "libcuda.so.9", "libcuda.so.1", "libnvcuda.so", "libnvcuda64.so", "libnvcuda64_13.so", "libnvcuda64_132.so", "libnvcuda64_132_0.so", "libnvcuda64_130_2.so", "libnvcuda64_10.so", "libnvcuda64_11.so", "libnvcuda64_12.so", "libnvcuda64_130_0.so", "libnvcuda64_9.so", "libnvcuda.so.13", "libnvcuda.so.12", "libnvcuda.so.11", "libnvcuda.so.10", "libnvcuda.so.9", "libnvcuda.so.1"]. Ensure that `LD_LIBRARY_PATH` has the correct path to the installed library. If the shared library is present on the system under a different name than one of those listed above, please open a GitHub issue.
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x5bb5e9b302e8 - std[10d71ac2c42b111e]::backtrace_rs::backtrace::libunwind::trace
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9
[INFO] [stdout]    1:     0x5bb5e9b302e8 - std[10d71ac2c42b111e]::backtrace_rs::backtrace::trace_unsynchronized::<std[10d71ac2c42b111e]::sys::backtrace::_print_fmt::{closure#1}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14
[INFO] [stdout]    2:     0x5bb5e9b302e8 - std[10d71ac2c42b111e]::sys::backtrace::_print_fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:74:9
[INFO] [stdout]    3:     0x5bb5e9b302e8 - <<std[10d71ac2c42b111e]::sys::backtrace::BacktraceLock>::print::DisplayBacktrace as core[8fb95b77d25ab6c8]::fmt::Display>::fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:44:26
[INFO] [stdout]    4:     0x5bb5e9b453da - <core[8fb95b77d25ab6c8]::fmt::rt::Argument>::fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/fmt/rt.rs:152:76
[INFO] [stdout]    5:     0x5bb5e9b453da - core[8fb95b77d25ab6c8]::fmt::write
[INFO] [stdout]    6:     0x5bb5e9b34b02 - std[10d71ac2c42b111e]::io::default_write_fmt::<alloc[a7ee25936407c584]::vec::Vec<u8>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/io/mod.rs:622:11
[INFO] [stdout]    7:     0x5bb5e9b34b02 - <alloc[a7ee25936407c584]::vec::Vec<u8> as std[10d71ac2c42b111e]::io::Write>::write_fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/io/mod.rs:1977:13
[INFO] [stdout]    8:     0x5bb5e9b0de86 - <std[10d71ac2c42b111e]::sys::backtrace::BacktraceLock>::print
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:47:9
[INFO] [stdout]    9:     0x5bb5e9b0de86 - std[10d71ac2c42b111e]::panicking::default_hook::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:292:27
[INFO] [stdout]   10:     0x5bb5e9b28379 - std[10d71ac2c42b111e]::panicking::default_hook
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:316:9
[INFO] [stdout]   11:     0x5bb5e9a86cec - <alloc[a7ee25936407c584]::boxed::Box<dyn for<'a, 'b> core[8fb95b77d25ab6c8]::ops::function::Fn<(&'a std[10d71ac2c42b111e]::panic::PanicHookInfo<'b>,), Output = ()> + core[8fb95b77d25ab6c8]::marker::Sync + core[8fb95b77d25ab6c8]::marker::Send> as core[8fb95b77d25ab6c8]::ops::function::Fn<(&std[10d71ac2c42b111e]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/alloc/src/boxed.rs:2289:9
[INFO] [stdout]   12:     0x5bb5e9a86cec - test[213991da798b1c03]::test_main_inner::<test[213991da798b1c03]::test_main_static::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:155:21
[INFO] [stdout]   13:     0x5bb5e9b28532 - <alloc[a7ee25936407c584]::boxed::Box<dyn for<'a, 'b> core[8fb95b77d25ab6c8]::ops::function::Fn<(&'a std[10d71ac2c42b111e]::panic::PanicHookInfo<'b>,), Output = ()> + core[8fb95b77d25ab6c8]::marker::Sync + core[8fb95b77d25ab6c8]::marker::Send> as core[8fb95b77d25ab6c8]::ops::function::Fn<(&std[10d71ac2c42b111e]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/alloc/src/boxed.rs:2289:9
[INFO] [stdout]   14:     0x5bb5e9b28532 - std[10d71ac2c42b111e]::panicking::panic_with_hook
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:833:13
[INFO] [stdout]   15:     0x5bb5e9b0df42 - std[10d71ac2c42b111e]::panicking::panic_handler::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:698:13
[INFO] [stdout]   16:     0x5bb5e9b02ee9 - std[10d71ac2c42b111e]::sys::backtrace::__rust_end_short_backtrace::<std[10d71ac2c42b111e]::panicking::panic_handler::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:182:18
[INFO] [stdout]   17:     0x5bb5e9b0ed1d - __rustc[3be9ba60078d4c86]::rust_begin_unwind
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:689:5
[INFO] [stdout]   18:     0x5bb5e9b45b5c - core[8fb95b77d25ab6c8]::panicking::panic_fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/panicking.rs:80:14
[INFO] [stdout]   19:     0x5bb5e9ae4069 - cudarc[6f943a80b31f2234]::panic_no_lib_found::<alloc[a7ee25936407c584]::string::String>
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/lib.rs:200:5
[INFO] [stdout]   20:     0x5bb5e9ac0f76 - cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:15462:9
[INFO] [stdout]   21:     0x5bb5e9ac5fc6 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:50
[INFO] [stdout]   22:     0x5bb5e9ac5f7d - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:543:19
[INFO] [stdout]   23:     0x5bb5e9ac97c2 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:40
[INFO] [stdout]   24:     0x5bb5e9b13119 - <std[10d71ac2c42b111e]::sys::sync::once::futex::Once>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/sync/once/futex.rs:183:21
[INFO] [stdout]   25:     0x5bb5e9ac81c4 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:20
[INFO] [stdout]   26:     0x5bb5e9ac4f47 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:542:19
[INFO] [stdout]   27:     0x5bb5e9ac50ff - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_try_init::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:410:14
[INFO] [stdout]   28:     0x5bb5e9ac4f9e - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:20
[INFO] [stdout]   29:     0x5bb5e9ac186e - cudarc[6f943a80b31f2234]::driver::sys::culib
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:15454:9
[INFO] [stdout]   30:     0x5bb5e9abf017 - cudarc[6f943a80b31f2234]::driver::sys::load::<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:12:15
[INFO] [stdout]   31:     0x5bb5e9ac1062 - cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:11041:45
[INFO] [stdout]   32:     0x5bb5e9ac5d86 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:50
[INFO] [stdout]   33:     0x5bb5e9ac5d4d - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:543:19
[INFO] [stdout]   34:     0x5bb5e9ac9462 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:40
[INFO] [stdout]   35:     0x5bb5e9b13119 - <std[10d71ac2c42b111e]::sys::sync::once::futex::Once>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/sync/once/futex.rs:183:21
[INFO] [stdout]   36:     0x5bb5e9ac7c84 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:20
[INFO] [stdout]   37:     0x5bb5e9ac4910 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:542:19
[INFO] [stdout]   38:     0x5bb5e9ac49ef - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_try_init::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:410:14
[INFO] [stdout]   39:     0x5bb5e9ac494e - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:20
[INFO] [stdout]   40:     0x5bb5e9ac1889 - cudarc[6f943a80b31f2234]::driver::sys::cuInit
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:11041:21
[INFO] [stdout]   41:     0x5bb5e9ae73e9 - cudarc[6f943a80b31f2234]::driver::result::init
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/result.rs:89:14
[INFO] [stdout]   42:     0x5bb5e9aec66a - <cudarc[6f943a80b31f2234]::driver::safe::core::CudaContext>::device_count
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/safe/core.rs:280:9
[INFO] [stdout]   43:     0x5bb5e9a665d4 - tropical_gemm_cuda[29028f76903e4476]::cuda_device_count
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/lib.rs:109:8
[INFO] [stdout]   44:     0x5bb5e9a66694 - tropical_gemm_cuda[29028f76903e4476]::get_context_for_device
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/lib.rs:126:24
[INFO] [stdout]   45:     0x5bb5e9a66651 - tropical_gemm_cuda[29028f76903e4476]::get_global_context
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/lib.rs:177:5
[INFO] [stdout]   46:     0x5bb5e9a3a481 - tropical_gemm_cuda[29028f76903e4476]::gpu_mat::tests::test_gpu_mat_matmul_argmax
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/gpu_mat.rs:626:25
[INFO] [stdout]   47:     0x5bb5e9a327e7 - tropical_gemm_cuda[29028f76903e4476]::gpu_mat::tests::test_gpu_mat_matmul_argmax::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/gpu_mat.rs:625:36
[INFO] [stdout]   48:     0x5bb5e9a30436 - <tropical_gemm_cuda[29028f76903e4476]::gpu_mat::tests::test_gpu_mat_matmul_argmax::{closure#0} as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   49:     0x5bb5e9a79dcb - <fn() -> core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   50:     0x5bb5e9a79dcb - test[213991da798b1c03]::__rust_begin_short_backtrace::<core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>, fn() -> core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:724:18
[INFO] [stdout]   51:     0x5bb5e9a87645 - test[213991da798b1c03]::run_test_in_process::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:747:74
[INFO] [stdout]   52:     0x5bb5e9a87645 - <core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   53:     0x5bb5e9a87645 - std[10d71ac2c42b111e]::panicking::catch_unwind::do_call::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}>, core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:581:40
[INFO] [stdout]   54:     0x5bb5e9a87645 - std[10d71ac2c42b111e]::panicking::catch_unwind::<core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>, core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:544:19
[INFO] [stdout]   55:     0x5bb5e9a87645 - std[10d71ac2c42b111e]::panic::catch_unwind::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}>, core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panic.rs:359:14
[INFO] [stdout]   56:     0x5bb5e9a87645 - test[213991da798b1c03]::run_test_in_process
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:747:27
[INFO] [stdout]   57:     0x5bb5e9a87645 - test[213991da798b1c03]::run_test::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:668:43
[INFO] [stdout]   58:     0x5bb5e9a80f54 - test[213991da798b1c03]::run_test::{closure#1}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:698:41
[INFO] [stdout]   59:     0x5bb5e9a80f54 - std[10d71ac2c42b111e]::sys::backtrace::__rust_begin_short_backtrace::<test[213991da798b1c03]::run_test::{closure#1}, ()>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:166:18
[INFO] [stdout]   60:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked::<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/thread/lifecycle.rs:70:13
[INFO] [stdout]   61:     0x5bb5e9a8a6c2 - <core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   62:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::panicking::catch_unwind::do_call::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:581:40
[INFO] [stdout]   63:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::panicking::catch_unwind::<(), core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:544:19
[INFO] [stdout]   64:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::panic::catch_unwind::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panic.rs:359:14
[INFO] [stdout]   65:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked::<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/thread/lifecycle.rs:68:26
[INFO] [stdout]   66:     0x5bb5e9a8a6c2 - <std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1} as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   67:     0x5bb5e9b2f96f - <alloc[a7ee25936407c584]::boxed::Box<dyn core[8fb95b77d25ab6c8]::ops::function::FnOnce<(), Output = ()> + core[8fb95b77d25ab6c8]::marker::Send> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/alloc/src/boxed.rs:2275:9
[INFO] [stdout]   68:     0x5bb5e9b2f96f - <std[10d71ac2c42b111e]::sys::thread::unix::Thread>::new::thread_start
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/thread/unix.rs:118:17
[INFO] [stdout]   69:     0x75580e3faaa4 - <unknown>
[INFO] [stdout]   70:     0x75580e487a64 - clone
[INFO] [stdout]   71:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] ---- gpu_mat::tests::test_gpu_mat_matmul stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'gpu_mat::tests::test_gpu_mat_matmul' (2231) panicked at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/lib.rs:200:5:
[INFO] [stdout] Unable to dynamically load the "cuda" shared library - searched for library names: ["libcuda.so", "libcuda64.so", "libcuda64_13.so", "libcuda64_132.so", "libcuda64_132_0.so", "libcuda64_130_2.so", "libcuda64_10.so", "libcuda64_11.so", "libcuda64_12.so", "libcuda64_130_0.so", "libcuda64_9.so", "libcuda.so.13", "libcuda.so.12", "libcuda.so.11", "libcuda.so.10", "libcuda.so.9", "libcuda.so.1", "libnvcuda.so", "libnvcuda64.so", "libnvcuda64_13.so", "libnvcuda64_132.so", "libnvcuda64_132_0.so", "libnvcuda64_130_2.so", "libnvcuda64_10.so", "libnvcuda64_11.so", "libnvcuda64_12.so", "libnvcuda64_130_0.so", "libnvcuda64_9.so", "libnvcuda.so.13", "libnvcuda.so.12", "libnvcuda.so.11", "libnvcuda.so.10", "libnvcuda.so.9", "libnvcuda.so.1"]. Ensure that `LD_LIBRARY_PATH` has the correct path to the installed library. If the shared library is present on the system under a different name than one of those listed above, please open a GitHub issue.
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x5bb5e9b302e8 - std[10d71ac2c42b111e]::backtrace_rs::backtrace::libunwind::trace
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9
[INFO] [stdout]    1:     0x5bb5e9b302e8 - std[10d71ac2c42b111e]::backtrace_rs::backtrace::trace_unsynchronized::<std[10d71ac2c42b111e]::sys::backtrace::_print_fmt::{closure#1}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14
[INFO] [stdout]    2:     0x5bb5e9b302e8 - std[10d71ac2c42b111e]::sys::backtrace::_print_fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:74:9
[INFO] [stdout]    3:     0x5bb5e9b302e8 - <<std[10d71ac2c42b111e]::sys::backtrace::BacktraceLock>::print::DisplayBacktrace as core[8fb95b77d25ab6c8]::fmt::Display>::fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:44:26
[INFO] [stdout]    4:     0x5bb5e9b453da - <core[8fb95b77d25ab6c8]::fmt::rt::Argument>::fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/fmt/rt.rs:152:76
[INFO] [stdout]    5:     0x5bb5e9b453da - core[8fb95b77d25ab6c8]::fmt::write
[INFO] [stdout]    6:     0x5bb5e9b34b02 - std[10d71ac2c42b111e]::io::default_write_fmt::<alloc[a7ee25936407c584]::vec::Vec<u8>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/io/mod.rs:622:11
[INFO] [stdout]    7:     0x5bb5e9b34b02 - <alloc[a7ee25936407c584]::vec::Vec<u8> as std[10d71ac2c42b111e]::io::Write>::write_fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/io/mod.rs:1977:13
[INFO] [stdout]    8:     0x5bb5e9b0de86 - <std[10d71ac2c42b111e]::sys::backtrace::BacktraceLock>::print
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:47:9
[INFO] [stdout]    9:     0x5bb5e9b0de86 - std[10d71ac2c42b111e]::panicking::default_hook::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:292:27
[INFO] [stdout]   10:     0x5bb5e9b28379 - std[10d71ac2c42b111e]::panicking::default_hook
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:316:9
[INFO] [stdout]   11:     0x5bb5e9a86cec - <alloc[a7ee25936407c584]::boxed::Box<dyn for<'a, 'b> core[8fb95b77d25ab6c8]::ops::function::Fn<(&'a std[10d71ac2c42b111e]::panic::PanicHookInfo<'b>,), Output = ()> + core[8fb95b77d25ab6c8]::marker::Sync + core[8fb95b77d25ab6c8]::marker::Send> as core[8fb95b77d25ab6c8]::ops::function::Fn<(&std[10d71ac2c42b111e]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/alloc/src/boxed.rs:2289:9
[INFO] [stdout]   12:     0x5bb5e9a86cec - test[213991da798b1c03]::test_main_inner::<test[213991da798b1c03]::test_main_static::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:155:21
[INFO] [stdout]   13:     0x5bb5e9b28532 - <alloc[a7ee25936407c584]::boxed::Box<dyn for<'a, 'b> core[8fb95b77d25ab6c8]::ops::function::Fn<(&'a std[10d71ac2c42b111e]::panic::PanicHookInfo<'b>,), Output = ()> + core[8fb95b77d25ab6c8]::marker::Sync + core[8fb95b77d25ab6c8]::marker::Send> as core[8fb95b77d25ab6c8]::ops::function::Fn<(&std[10d71ac2c42b111e]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/alloc/src/boxed.rs:2289:9
[INFO] [stdout]   14:     0x5bb5e9b28532 - std[10d71ac2c42b111e]::panicking::panic_with_hook
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:833:13
[INFO] [stdout]   15:     0x5bb5e9b0df42 - std[10d71ac2c42b111e]::panicking::panic_handler::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:698:13
[INFO] [stdout]   16:     0x5bb5e9b02ee9 - std[10d71ac2c42b111e]::sys::backtrace::__rust_end_short_backtrace::<std[10d71ac2c42b111e]::panicking::panic_handler::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:182:18
[INFO] [stdout]   17:     0x5bb5e9b0ed1d - __rustc[3be9ba60078d4c86]::rust_begin_unwind
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:689:5
[INFO] [stdout]   18:     0x5bb5e9b45b5c - core[8fb95b77d25ab6c8]::panicking::panic_fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/panicking.rs:80:14
[INFO] [stdout]   19:     0x5bb5e9ae4069 - cudarc[6f943a80b31f2234]::panic_no_lib_found::<alloc[a7ee25936407c584]::string::String>
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/lib.rs:200:5
[INFO] [stdout]   20:     0x5bb5e9ac0f76 - cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:15462:9
[INFO] [stdout]   21:     0x5bb5e9ac5fc6 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:50
[INFO] [stdout]   22:     0x5bb5e9ac5f7d - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:543:19
[INFO] [stdout]   23:     0x5bb5e9ac97c2 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:40
[INFO] [stdout]   24:     0x5bb5e9b13119 - <std[10d71ac2c42b111e]::sys::sync::once::futex::Once>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/sync/once/futex.rs:183:21
[INFO] [stdout]   25:     0x5bb5e9ac81c4 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:20
[INFO] [stdout]   26:     0x5bb5e9ac4f47 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:542:19
[INFO] [stdout]   27:     0x5bb5e9ac50ff - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_try_init::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:410:14
[INFO] [stdout]   28:     0x5bb5e9ac4f9e - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:20
[INFO] [stdout]   29:     0x5bb5e9ac186e - cudarc[6f943a80b31f2234]::driver::sys::culib
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:15454:9
[INFO] [stdout]   30:     0x5bb5e9abf017 - cudarc[6f943a80b31f2234]::driver::sys::load::<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:12:15
[INFO] [stdout]   31:     0x5bb5e9ac1062 - cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:11041:45
[INFO] [stdout]   32:     0x5bb5e9ac5d86 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:50
[INFO] [stdout]   33:     0x5bb5e9ac5d4d - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:543:19
[INFO] [stdout]   34:     0x5bb5e9ac9462 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:40
[INFO] [stdout]   35:     0x5bb5e9b13119 - <std[10d71ac2c42b111e]::sys::sync::once::futex::Once>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/sync/once/futex.rs:183:21
[INFO] [stdout]   36:     0x5bb5e9ac7c84 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:20
[INFO] [stdout]   37:     0x5bb5e9ac4910 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:542:19
[INFO] [stdout]   38:     0x5bb5e9ac49ef - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_try_init::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:410:14
[INFO] [stdout]   39:     0x5bb5e9ac494e - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:20
[INFO] [stdout]   40:     0x5bb5e9ac1889 - cudarc[6f943a80b31f2234]::driver::sys::cuInit
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:11041:21
[INFO] [stdout]   41:     0x5bb5e9ae73e9 - cudarc[6f943a80b31f2234]::driver::result::init
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/result.rs:89:14
[INFO] [stdout]   42:     0x5bb5e9aec66a - <cudarc[6f943a80b31f2234]::driver::safe::core::CudaContext>::device_count
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/safe/core.rs:280:9
[INFO] [stdout]   43:     0x5bb5e9a665d4 - tropical_gemm_cuda[29028f76903e4476]::cuda_device_count
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/lib.rs:109:8
[INFO] [stdout]   44:     0x5bb5e9a66694 - tropical_gemm_cuda[29028f76903e4476]::get_context_for_device
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/lib.rs:126:24
[INFO] [stdout]   45:     0x5bb5e9a66651 - tropical_gemm_cuda[29028f76903e4476]::get_global_context
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/lib.rs:177:5
[INFO] [stdout]   46:     0x5bb5e9a36dc1 - tropical_gemm_cuda[29028f76903e4476]::gpu_mat::tests::test_gpu_mat_matmul
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/gpu_mat.rs:598:25
[INFO] [stdout]   47:     0x5bb5e9a326c7 - tropical_gemm_cuda[29028f76903e4476]::gpu_mat::tests::test_gpu_mat_matmul::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/gpu_mat.rs:597:29
[INFO] [stdout]   48:     0x5bb5e9a302b6 - <tropical_gemm_cuda[29028f76903e4476]::gpu_mat::tests::test_gpu_mat_matmul::{closure#0} as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   49:     0x5bb5e9a79dcb - <fn() -> core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   50:     0x5bb5e9a79dcb - test[213991da798b1c03]::__rust_begin_short_backtrace::<core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>, fn() -> core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:724:18
[INFO] [stdout]   51:     0x5bb5e9a87645 - test[213991da798b1c03]::run_test_in_process::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:747:74
[INFO] [stdout]   52:     0x5bb5e9a87645 - <core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   53:     0x5bb5e9a87645 - std[10d71ac2c42b111e]::panicking::catch_unwind::do_call::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}>, core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:581:40
[INFO] [stdout]   54:     0x5bb5e9a87645 - std[10d71ac2c42b111e]::panicking::catch_unwind::<core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>, core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:544:19
[INFO] [stdout]   55:     0x5bb5e9a87645 - std[10d71ac2c42b111e]::panic::catch_unwind::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}>, core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panic.rs:359:14
[INFO] [stdout]   56:     0x5bb5e9a87645 - test[213991da798b1c03]::run_test_in_process
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:747:27
[INFO] [stdout]   57:     0x5bb5e9a87645 - test[213991da798b1c03]::run_test::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:668:43
[INFO] [stdout]   58:     0x5bb5e9a80f54 - test[213991da798b1c03]::run_test::{closure#1}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:698:41
[INFO] [stdout]   59:     0x5bb5e9a80f54 - std[10d71ac2c42b111e]::sys::backtrace::__rust_begin_short_backtrace::<test[213991da798b1c03]::run_test::{closure#1}, ()>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:166:18
[INFO] [stdout]   60:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked::<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/thread/lifecycle.rs:70:13
[INFO] [stdout]   61:     0x5bb5e9a8a6c2 - <core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   62:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::panicking::catch_unwind::do_call::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:581:40
[INFO] [stdout]   63:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::panicking::catch_unwind::<(), core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:544:19
[INFO] [stdout]   64:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::panic::catch_unwind::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panic.rs:359:14
[INFO] [stdout]   65:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked::<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/thread/lifecycle.rs:68:26
[INFO] [stdout]   66:     0x5bb5e9a8a6c2 - <std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1} as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   67:     0x5bb5e9b2f96f - <alloc[a7ee25936407c584]::boxed::Box<dyn core[8fb95b77d25ab6c8]::ops::function::FnOnce<(), Output = ()> + core[8fb95b77d25ab6c8]::marker::Send> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/alloc/src/boxed.rs:2275:9
[INFO] [stdout]   68:     0x5bb5e9b2f96f - <std[10d71ac2c42b111e]::sys::thread::unix::Thread>::new::thread_start
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/thread/unix.rs:118:17
[INFO] [stdout]   69:     0x75580e3faaa4 - <unknown>
[INFO] [stdout]   70:     0x75580e487a64 - clone
[INFO] [stdout]   71:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] ---- gpu_mat::tests::test_gpu_mat_basic stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'gpu_mat::tests::test_gpu_mat_basic' (2227) panicked at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/lib.rs:200:5:
[INFO] [stdout] Unable to dynamically load the "cuda" shared library - searched for library names: ["libcuda.so", "libcuda64.so", "libcuda64_13.so", "libcuda64_132.so", "libcuda64_132_0.so", "libcuda64_130_2.so", "libcuda64_10.so", "libcuda64_11.so", "libcuda64_12.so", "libcuda64_130_0.so", "libcuda64_9.so", "libcuda.so.13", "libcuda.so.12", "libcuda.so.11", "libcuda.so.10", "libcuda.so.9", "libcuda.so.1", "libnvcuda.so", "libnvcuda64.so", "libnvcuda64_13.so", "libnvcuda64_132.so", "libnvcuda64_132_0.so", "libnvcuda64_130_2.so", "libnvcuda64_10.so", "libnvcuda64_11.so", "libnvcuda64_12.so", "libnvcuda64_130_0.so", "libnvcuda64_9.so", "libnvcuda.so.13", "libnvcuda.so.12", "libnvcuda.so.11", "libnvcuda.so.10", "libnvcuda.so.9", "libnvcuda.so.1"]. Ensure that `LD_LIBRARY_PATH` has the correct path to the installed library. If the shared library is present on the system under a different name than one of those listed above, please open a GitHub issue.
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x5bb5e9b302e8 - std[10d71ac2c42b111e]::backtrace_rs::backtrace::libunwind::trace
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9
[INFO] [stdout]    1:     0x5bb5e9b302e8 - std[10d71ac2c42b111e]::backtrace_rs::backtrace::trace_unsynchronized::<std[10d71ac2c42b111e]::sys::backtrace::_print_fmt::{closure#1}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14
[INFO] [stdout]    2:     0x5bb5e9b302e8 - std[10d71ac2c42b111e]::sys::backtrace::_print_fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:74:9
[INFO] [stdout]    3:     0x5bb5e9b302e8 - <<std[10d71ac2c42b111e]::sys::backtrace::BacktraceLock>::print::DisplayBacktrace as core[8fb95b77d25ab6c8]::fmt::Display>::fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:44:26
[INFO] [stdout]    4:     0x5bb5e9b453da - <core[8fb95b77d25ab6c8]::fmt::rt::Argument>::fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/fmt/rt.rs:152:76
[INFO] [stdout]    5:     0x5bb5e9b453da - core[8fb95b77d25ab6c8]::fmt::write
[INFO] [stdout]    6:     0x5bb5e9b34b02 - std[10d71ac2c42b111e]::io::default_write_fmt::<alloc[a7ee25936407c584]::vec::Vec<u8>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/io/mod.rs:622:11
[INFO] [stdout]    7:     0x5bb5e9b34b02 - <alloc[a7ee25936407c584]::vec::Vec<u8> as std[10d71ac2c42b111e]::io::Write>::write_fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/io/mod.rs:1977:13
[INFO] [stdout]    8:     0x5bb5e9b0de86 - <std[10d71ac2c42b111e]::sys::backtrace::BacktraceLock>::print
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:47:9
[INFO] [stdout]    9:     0x5bb5e9b0de86 - std[10d71ac2c42b111e]::panicking::default_hook::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:292:27
[INFO] [stdout]   10:     0x5bb5e9b28379 - std[10d71ac2c42b111e]::panicking::default_hook
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:316:9
[INFO] [stdout]   11:     0x5bb5e9a86cec - <alloc[a7ee25936407c584]::boxed::Box<dyn for<'a, 'b> core[8fb95b77d25ab6c8]::ops::function::Fn<(&'a std[10d71ac2c42b111e]::panic::PanicHookInfo<'b>,), Output = ()> + core[8fb95b77d25ab6c8]::marker::Sync + core[8fb95b77d25ab6c8]::marker::Send> as core[8fb95b77d25ab6c8]::ops::function::Fn<(&std[10d71ac2c42b111e]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/alloc/src/boxed.rs:2289:9
[INFO] [stdout]   12:     0x5bb5e9a86cec - test[213991da798b1c03]::test_main_inner::<test[213991da798b1c03]::test_main_static::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:155:21
[INFO] [stdout]   13:     0x5bb5e9b28532 - <alloc[a7ee25936407c584]::boxed::Box<dyn for<'a, 'b> core[8fb95b77d25ab6c8]::ops::function::Fn<(&'a std[10d71ac2c42b111e]::panic::PanicHookInfo<'b>,), Output = ()> + core[8fb95b77d25ab6c8]::marker::Sync + core[8fb95b77d25ab6c8]::marker::Send> as core[8fb95b77d25ab6c8]::ops::function::Fn<(&std[10d71ac2c42b111e]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/alloc/src/boxed.rs:2289:9
[INFO] [stdout]   14:     0x5bb5e9b28532 - std[10d71ac2c42b111e]::panicking::panic_with_hook
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:833:13
[INFO] [stdout]   15:     0x5bb5e9b0df42 - std[10d71ac2c42b111e]::panicking::panic_handler::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:698:13
[INFO] [stdout]   16:     0x5bb5e9b02ee9 - std[10d71ac2c42b111e]::sys::backtrace::__rust_end_short_backtrace::<std[10d71ac2c42b111e]::panicking::panic_handler::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:182:18
[INFO] [stdout]   17:     0x5bb5e9b0ed1d - __rustc[3be9ba60078d4c86]::rust_begin_unwind
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:689:5
[INFO] [stdout]   18:     0x5bb5e9b45b5c - core[8fb95b77d25ab6c8]::panicking::panic_fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/panicking.rs:80:14
[INFO] [stdout]   19:     0x5bb5e9ae4069 - cudarc[6f943a80b31f2234]::panic_no_lib_found::<alloc[a7ee25936407c584]::string::String>
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/lib.rs:200:5
[INFO] [stdout]   20:     0x5bb5e9ac0f76 - cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:15462:9
[INFO] [stdout]   21:     0x5bb5e9ac5fc6 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:50
[INFO] [stdout]   22:     0x5bb5e9ac5f7d - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:543:19
[INFO] [stdout]   23:     0x5bb5e9ac97c2 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:40
[INFO] [stdout]   24:     0x5bb5e9b13119 - <std[10d71ac2c42b111e]::sys::sync::once::futex::Once>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/sync/once/futex.rs:183:21
[INFO] [stdout]   25:     0x5bb5e9ac81c4 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:20
[INFO] [stdout]   26:     0x5bb5e9ac4f47 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:542:19
[INFO] [stdout]   27:     0x5bb5e9ac50ff - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_try_init::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:410:14
[INFO] [stdout]   28:     0x5bb5e9ac4f9e - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:20
[INFO] [stdout]   29:     0x5bb5e9ac186e - cudarc[6f943a80b31f2234]::driver::sys::culib
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:15454:9
[INFO] [stdout]   30:     0x5bb5e9abf017 - cudarc[6f943a80b31f2234]::driver::sys::load::<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:12:15
[INFO] [stdout]   31:     0x5bb5e9ac1062 - cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:11041:45
[INFO] [stdout]   32:     0x5bb5e9ac5d86 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:50
[INFO] [stdout]   33:     0x5bb5e9ac5d4d - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:543:19
[INFO] [stdout]   34:     0x5bb5e9ac9462 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:40
[INFO] [stdout]   35:     0x5bb5e9b13119 - <std[10d71ac2c42b111e]::sys::sync::once::futex::Once>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/sync/once/futex.rs:183:21
[INFO] [stdout]   36:     0x5bb5e9ac7c84 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:20
[INFO] [stdout]   37:     0x5bb5e9ac4910 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:542:19
[INFO] [stdout]   38:     0x5bb5e9ac49ef - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_try_init::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:410:14
[INFO] [stdout]   39:     0x5bb5e9ac494e - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:20
[INFO] [stdout]   40:     0x5bb5e9ac1889 - cudarc[6f943a80b31f2234]::driver::sys::cuInit
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:11041:21
[INFO] [stdout]   41:     0x5bb5e9ae73e9 - cudarc[6f943a80b31f2234]::driver::result::init
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/result.rs:89:14
[INFO] [stdout]   42:     0x5bb5e9aec66a - <cudarc[6f943a80b31f2234]::driver::safe::core::CudaContext>::device_count
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/safe/core.rs:280:9
[INFO] [stdout]   43:     0x5bb5e9a665d4 - tropical_gemm_cuda[29028f76903e4476]::cuda_device_count
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/lib.rs:109:8
[INFO] [stdout]   44:     0x5bb5e9a66694 - tropical_gemm_cuda[29028f76903e4476]::get_context_for_device
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/lib.rs:126:24
[INFO] [stdout]   45:     0x5bb5e9a66651 - tropical_gemm_cuda[29028f76903e4476]::get_global_context
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/lib.rs:177:5
[INFO] [stdout]   46:     0x5bb5e9a36661 - tropical_gemm_cuda[29028f76903e4476]::gpu_mat::tests::test_gpu_mat_basic
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/gpu_mat.rs:574:25
[INFO] [stdout]   47:     0x5bb5e9a32697 - tropical_gemm_cuda[29028f76903e4476]::gpu_mat::tests::test_gpu_mat_basic::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/gpu_mat.rs:573:28
[INFO] [stdout]   48:     0x5bb5e9a30276 - <tropical_gemm_cuda[29028f76903e4476]::gpu_mat::tests::test_gpu_mat_basic::{closure#0} as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   49:     0x5bb5e9a79dcb - <fn() -> core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   50:     0x5bb5e9a79dcb - test[213991da798b1c03]::__rust_begin_short_backtrace::<core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>, fn() -> core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:724:18
[INFO] [stdout]   51:     0x5bb5e9a87645 - test[213991da798b1c03]::run_test_in_process::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:747:74
[INFO] [stdout]   52:     0x5bb5e9a87645 - <core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   53:     0x5bb5e9a87645 - std[10d71ac2c42b111e]::panicking::catch_unwind::do_call::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}>, core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:581:40
[INFO] [stdout]   54:     0x5bb5e9a87645 - std[10d71ac2c42b111e]::panicking::catch_unwind::<core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>, core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:544:19
[INFO] [stdout]   55:     0x5bb5e9a87645 - std[10d71ac2c42b111e]::panic::catch_unwind::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}>, core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panic.rs:359:14
[INFO] [stdout]   56:     0x5bb5e9a87645 - test[213991da798b1c03]::run_test_in_process
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:747:27
[INFO] [stdout]   57:     0x5bb5e9a87645 - test[213991da798b1c03]::run_test::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:668:43
[INFO] [stdout]   58:     0x5bb5e9a80f54 - test[213991da798b1c03]::run_test::{closure#1}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:698:41
[INFO] [stdout]   59:     0x5bb5e9a80f54 - std[10d71ac2c42b111e]::sys::backtrace::__rust_begin_short_backtrace::<test[213991da798b1c03]::run_test::{closure#1}, ()>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:166:18
[INFO] [stdout]   60:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked::<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/thread/lifecycle.rs:70:13
[INFO] [stdout]   61:     0x5bb5e9a8a6c2 - <core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   62:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::panicking::catch_unwind::do_call::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:581:40
[INFO] [stdout]   63:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::panicking::catch_unwind::<(), core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:544:19
[INFO] [stdout]   64:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::panic::catch_unwind::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panic.rs:359:14
[INFO] [stdout]   65:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked::<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/thread/lifecycle.rs:68:26
[INFO] [stdout]   66:     0x5bb5e9a8a6c2 - <std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1} as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   67:     0x5bb5e9b2f96f - <alloc[a7ee25936407c584]::boxed::Box<dyn core[8fb95b77d25ab6c8]::ops::function::FnOnce<(), Output = ()> + core[8fb95b77d25ab6c8]::marker::Send> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/alloc/src/boxed.rs:2275:9
[INFO] [stdout]   68:     0x5bb5e9b2f96f - <std[10d71ac2c42b111e]::sys::thread::unix::Thread>::new::thread_start
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/thread/unix.rs:118:17
[INFO] [stdout]   69:     0x75580e3faaa4 - <unknown>
[INFO] [stdout]   70:     0x75580e487a64 - clone
[INFO] [stdout]   71:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] ---- gpu_mat::tests::test_gpu_mat_minplus stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'gpu_mat::tests::test_gpu_mat_minplus' (2233) panicked at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/lib.rs:200:5:
[INFO] [stdout] Unable to dynamically load the "cuda" shared library - searched for library names: ["libcuda.so", "libcuda64.so", "libcuda64_13.so", "libcuda64_132.so", "libcuda64_132_0.so", "libcuda64_130_2.so", "libcuda64_10.so", "libcuda64_11.so", "libcuda64_12.so", "libcuda64_130_0.so", "libcuda64_9.so", "libcuda.so.13", "libcuda.so.12", "libcuda.so.11", "libcuda.so.10", "libcuda.so.9", "libcuda.so.1", "libnvcuda.so", "libnvcuda64.so", "libnvcuda64_13.so", "libnvcuda64_132.so", "libnvcuda64_132_0.so", "libnvcuda64_130_2.so", "libnvcuda64_10.so", "libnvcuda64_11.so", "libnvcuda64_12.so", "libnvcuda64_130_0.so", "libnvcuda64_9.so", "libnvcuda.so.13", "libnvcuda.so.12", "libnvcuda.so.11", "libnvcuda.so.10", "libnvcuda.so.9", "libnvcuda.so.1"]. Ensure that `LD_LIBRARY_PATH` has the correct path to the installed library. If the shared library is present on the system under a different name than one of those listed above, please open a GitHub issue.
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x5bb5e9b302e8 - std[10d71ac2c42b111e]::backtrace_rs::backtrace::libunwind::trace
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9
[INFO] [stdout]    1:     0x5bb5e9b302e8 - std[10d71ac2c42b111e]::backtrace_rs::backtrace::trace_unsynchronized::<std[10d71ac2c42b111e]::sys::backtrace::_print_fmt::{closure#1}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14
[INFO] [stdout]    2:     0x5bb5e9b302e8 - std[10d71ac2c42b111e]::sys::backtrace::_print_fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:74:9
[INFO] [stdout]    3:     0x5bb5e9b302e8 - <<std[10d71ac2c42b111e]::sys::backtrace::BacktraceLock>::print::DisplayBacktrace as core[8fb95b77d25ab6c8]::fmt::Display>::fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:44:26
[INFO] [stdout]    4:     0x5bb5e9b453da - <core[8fb95b77d25ab6c8]::fmt::rt::Argument>::fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/fmt/rt.rs:152:76
[INFO] [stdout]    5:     0x5bb5e9b453da - core[8fb95b77d25ab6c8]::fmt::write
[INFO] [stdout]    6:     0x5bb5e9b34b02 - std[10d71ac2c42b111e]::io::default_write_fmt::<alloc[a7ee25936407c584]::vec::Vec<u8>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/io/mod.rs:622:11
[INFO] [stdout]    7:     0x5bb5e9b34b02 - <alloc[a7ee25936407c584]::vec::Vec<u8> as std[10d71ac2c42b111e]::io::Write>::write_fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/io/mod.rs:1977:13
[INFO] [stdout]    8:     0x5bb5e9b0de86 - <std[10d71ac2c42b111e]::sys::backtrace::BacktraceLock>::print
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:47:9
[INFO] [stdout]    9:     0x5bb5e9b0de86 - std[10d71ac2c42b111e]::panicking::default_hook::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:292:27
[INFO] [stdout]   10:     0x5bb5e9b28379 - std[10d71ac2c42b111e]::panicking::default_hook
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:316:9
[INFO] [stdout]   11:     0x5bb5e9a86cec - <alloc[a7ee25936407c584]::boxed::Box<dyn for<'a, 'b> core[8fb95b77d25ab6c8]::ops::function::Fn<(&'a std[10d71ac2c42b111e]::panic::PanicHookInfo<'b>,), Output = ()> + core[8fb95b77d25ab6c8]::marker::Sync + core[8fb95b77d25ab6c8]::marker::Send> as core[8fb95b77d25ab6c8]::ops::function::Fn<(&std[10d71ac2c42b111e]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/alloc/src/boxed.rs:2289:9
[INFO] [stdout]   12:     0x5bb5e9a86cec - test[213991da798b1c03]::test_main_inner::<test[213991da798b1c03]::test_main_static::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:155:21
[INFO] [stdout]   13:     0x5bb5e9b28532 - <alloc[a7ee25936407c584]::boxed::Box<dyn for<'a, 'b> core[8fb95b77d25ab6c8]::ops::function::Fn<(&'a std[10d71ac2c42b111e]::panic::PanicHookInfo<'b>,), Output = ()> + core[8fb95b77d25ab6c8]::marker::Sync + core[8fb95b77d25ab6c8]::marker::Send> as core[8fb95b77d25ab6c8]::ops::function::Fn<(&std[10d71ac2c42b111e]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/alloc/src/boxed.rs:2289:9
[INFO] [stdout]   14:     0x5bb5e9b28532 - std[10d71ac2c42b111e]::panicking::panic_with_hook
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:833:13
[INFO] [stdout]   15:     0x5bb5e9b0df42 - std[10d71ac2c42b111e]::panicking::panic_handler::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:698:13
[INFO] [stdout]   16:     0x5bb5e9b02ee9 - std[10d71ac2c42b111e]::sys::backtrace::__rust_end_short_backtrace::<std[10d71ac2c42b111e]::panicking::panic_handler::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:182:18
[INFO] [stdout]   17:     0x5bb5e9b0ed1d - __rustc[3be9ba60078d4c86]::rust_begin_unwind
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:689:5
[INFO] [stdout]   18:     0x5bb5e9b45b5c - core[8fb95b77d25ab6c8]::panicking::panic_fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/panicking.rs:80:14
[INFO] [stdout]   19:     0x5bb5e9ae4069 - cudarc[6f943a80b31f2234]::panic_no_lib_found::<alloc[a7ee25936407c584]::string::String>
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/lib.rs:200:5
[INFO] [stdout]   20:     0x5bb5e9ac0f76 - cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:15462:9
[INFO] [stdout]   21:     0x5bb5e9ac5fc6 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:50
[INFO] [stdout]   22:     0x5bb5e9ac5f7d - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:543:19
[INFO] [stdout]   23:     0x5bb5e9ac97c2 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:40
[INFO] [stdout]   24:     0x5bb5e9b13119 - <std[10d71ac2c42b111e]::sys::sync::once::futex::Once>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/sync/once/futex.rs:183:21
[INFO] [stdout]   25:     0x5bb5e9ac81c4 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:20
[INFO] [stdout]   26:     0x5bb5e9ac4f47 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:542:19
[INFO] [stdout]   27:     0x5bb5e9ac50ff - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_try_init::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:410:14
[INFO] [stdout]   28:     0x5bb5e9ac4f9e - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:20
[INFO] [stdout]   29:     0x5bb5e9ac186e - cudarc[6f943a80b31f2234]::driver::sys::culib
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:15454:9
[INFO] [stdout]   30:     0x5bb5e9abf017 - cudarc[6f943a80b31f2234]::driver::sys::load::<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:12:15
[INFO] [stdout]   31:     0x5bb5e9ac1062 - cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:11041:45
[INFO] [stdout]   32:     0x5bb5e9ac5d86 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:50
[INFO] [stdout]   33:     0x5bb5e9ac5d4d - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:543:19
[INFO] [stdout]   34:     0x5bb5e9ac9462 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:40
[INFO] [stdout]   35:     0x5bb5e9b13119 - <std[10d71ac2c42b111e]::sys::sync::once::futex::Once>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/sync/once/futex.rs:183:21
[INFO] [stdout]   36:     0x5bb5e9ac7c84 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:20
[INFO] [stdout]   37:     0x5bb5e9ac4910 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:542:19
[INFO] [stdout]   38:     0x5bb5e9ac49ef - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_try_init::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:410:14
[INFO] [stdout]   39:     0x5bb5e9ac494e - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:20
[INFO] [stdout]   40:     0x5bb5e9ac1889 - cudarc[6f943a80b31f2234]::driver::sys::cuInit
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:11041:21
[INFO] [stdout]   41:     0x5bb5e9ae73e9 - cudarc[6f943a80b31f2234]::driver::result::init
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/result.rs:89:14
[INFO] [stdout]   42:     0x5bb5e9aec66a - <cudarc[6f943a80b31f2234]::driver::safe::core::CudaContext>::device_count
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/safe/core.rs:280:9
[INFO] [stdout]   43:     0x5bb5e9a665d4 - tropical_gemm_cuda[29028f76903e4476]::cuda_device_count
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/lib.rs:109:8
[INFO] [stdout]   44:     0x5bb5e9a66694 - tropical_gemm_cuda[29028f76903e4476]::get_context_for_device
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/lib.rs:126:24
[INFO] [stdout]   45:     0x5bb5e9a66651 - tropical_gemm_cuda[29028f76903e4476]::get_global_context
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/lib.rs:177:5
[INFO] [stdout]   46:     0x5bb5e9a38361 - tropical_gemm_cuda[29028f76903e4476]::gpu_mat::tests::test_gpu_mat_minplus
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/gpu_mat.rs:652:25
[INFO] [stdout]   47:     0x5bb5e9a32727 - tropical_gemm_cuda[29028f76903e4476]::gpu_mat::tests::test_gpu_mat_minplus::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/gpu_mat.rs:651:30
[INFO] [stdout]   48:     0x5bb5e9a30336 - <tropical_gemm_cuda[29028f76903e4476]::gpu_mat::tests::test_gpu_mat_minplus::{closure#0} as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   49:     0x5bb5e9a79dcb - <fn() -> core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   50:     0x5bb5e9a79dcb - test[213991da798b1c03]::__rust_begin_short_backtrace::<core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>, fn() -> core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:724:18
[INFO] [stdout]   51:     0x5bb5e9a87645 - test[213991da798b1c03]::run_test_in_process::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:747:74
[INFO] [stdout]   52:     0x5bb5e9a87645 - <core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   53:     0x5bb5e9a87645 - std[10d71ac2c42b111e]::panicking::catch_unwind::do_call::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}>, core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:581:40
[INFO] [stdout]   54:     0x5bb5e9a87645 - std[10d71ac2c42b111e]::panicking::catch_unwind::<core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>, core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:544:19
[INFO] [stdout]   55:     0x5bb5e9a87645 - std[10d71ac2c42b111e]::panic::catch_unwind::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}>, core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panic.rs:359:14
[INFO] [stdout]   56:     0x5bb5e9a87645 - test[213991da798b1c03]::run_test_in_process
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:747:27
[INFO] [stdout]   57:     0x5bb5e9a87645 - test[213991da798b1c03]::run_test::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:668:43
[INFO] [stdout]   58:     0x5bb5e9a80f54 - test[213991da798b1c03]::run_test::{closure#1}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:698:41
[INFO] [stdout]   59:     0x5bb5e9a80f54 - std[10d71ac2c42b111e]::sys::backtrace::__rust_begin_short_backtrace::<test[213991da798b1c03]::run_test::{closure#1}, ()>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:166:18
[INFO] [stdout]   60:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked::<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/thread/lifecycle.rs:70:13
[INFO] [stdout]   61:     0x5bb5e9a8a6c2 - <core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   62:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::panicking::catch_unwind::do_call::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:581:40
[INFO] [stdout]   63:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::panicking::catch_unwind::<(), core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:544:19
[INFO] [stdout]   64:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::panic::catch_unwind::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panic.rs:359:14
[INFO] [stdout]   65:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked::<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/thread/lifecycle.rs:68:26
[INFO] [stdout]   66:     0x5bb5e9a8a6c2 - <std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1} as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   67:     0x5bb5e9b2f96f - <alloc[a7ee25936407c584]::boxed::Box<dyn core[8fb95b77d25ab6c8]::ops::function::FnOnce<(), Output = ()> + core[8fb95b77d25ab6c8]::marker::Send> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/alloc/src/boxed.rs:2275:9
[INFO] [stdout]   68:     0x5bb5e9b2f96f - <std[10d71ac2c42b111e]::sys::thread::unix::Thread>::new::thread_start
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/thread/unix.rs:118:17
[INFO] [stdout]   69:     0x75580e3faaa4 - <unknown>
[INFO] [stdout]   70:     0x75580e487a64 - clone
[INFO] [stdout]   71:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] ---- gpu_mat::tests::test_gpu_mat_batched_with_argmax stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'gpu_mat::tests::test_gpu_mat_batched_with_argmax' (2230) panicked at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/lib.rs:200:5:
[INFO] [stdout] Unable to dynamically load the "cuda" shared library - searched for library names: ["libcuda.so", "libcuda64.so", "libcuda64_13.so", "libcuda64_132.so", "libcuda64_132_0.so", "libcuda64_130_2.so", "libcuda64_10.so", "libcuda64_11.so", "libcuda64_12.so", "libcuda64_130_0.so", "libcuda64_9.so", "libcuda.so.13", "libcuda.so.12", "libcuda.so.11", "libcuda.so.10", "libcuda.so.9", "libcuda.so.1", "libnvcuda.so", "libnvcuda64.so", "libnvcuda64_13.so", "libnvcuda64_132.so", "libnvcuda64_132_0.so", "libnvcuda64_130_2.so", "libnvcuda64_10.so", "libnvcuda64_11.so", "libnvcuda64_12.so", "libnvcuda64_130_0.so", "libnvcuda64_9.so", "libnvcuda.so.13", "libnvcuda.so.12", "libnvcuda.so.11", "libnvcuda.so.10", "libnvcuda.so.9", "libnvcuda.so.1"]. Ensure that `LD_LIBRARY_PATH` has the correct path to the installed library. If the shared library is present on the system under a different name than one of those listed above, please open a GitHub issue.
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x5bb5e9b302e8 - std[10d71ac2c42b111e]::backtrace_rs::backtrace::libunwind::trace
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9
[INFO] [stdout]    1:     0x5bb5e9b302e8 - std[10d71ac2c42b111e]::backtrace_rs::backtrace::trace_unsynchronized::<std[10d71ac2c42b111e]::sys::backtrace::_print_fmt::{closure#1}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14
[INFO] [stdout]    2:     0x5bb5e9b302e8 - std[10d71ac2c42b111e]::sys::backtrace::_print_fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:74:9
[INFO] [stdout]    3:     0x5bb5e9b302e8 - <<std[10d71ac2c42b111e]::sys::backtrace::BacktraceLock>::print::DisplayBacktrace as core[8fb95b77d25ab6c8]::fmt::Display>::fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:44:26
[INFO] [stdout]    4:     0x5bb5e9b453da - <core[8fb95b77d25ab6c8]::fmt::rt::Argument>::fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/fmt/rt.rs:152:76
[INFO] [stdout]    5:     0x5bb5e9b453da - core[8fb95b77d25ab6c8]::fmt::write
[INFO] [stdout]    6:     0x5bb5e9b34b02 - std[10d71ac2c42b111e]::io::default_write_fmt::<alloc[a7ee25936407c584]::vec::Vec<u8>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/io/mod.rs:622:11
[INFO] [stdout]    7:     0x5bb5e9b34b02 - <alloc[a7ee25936407c584]::vec::Vec<u8> as std[10d71ac2c42b111e]::io::Write>::write_fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/io/mod.rs:1977:13
[INFO] [stdout]    8:     0x5bb5e9b0de86 - <std[10d71ac2c42b111e]::sys::backtrace::BacktraceLock>::print
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:47:9
[INFO] [stdout]    9:     0x5bb5e9b0de86 - std[10d71ac2c42b111e]::panicking::default_hook::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:292:27
[INFO] [stdout]   10:     0x5bb5e9b28379 - std[10d71ac2c42b111e]::panicking::default_hook
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:316:9
[INFO] [stdout]   11:     0x5bb5e9a86cec - <alloc[a7ee25936407c584]::boxed::Box<dyn for<'a, 'b> core[8fb95b77d25ab6c8]::ops::function::Fn<(&'a std[10d71ac2c42b111e]::panic::PanicHookInfo<'b>,), Output = ()> + core[8fb95b77d25ab6c8]::marker::Sync + core[8fb95b77d25ab6c8]::marker::Send> as core[8fb95b77d25ab6c8]::ops::function::Fn<(&std[10d71ac2c42b111e]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/alloc/src/boxed.rs:2289:9
[INFO] [stdout]   12:     0x5bb5e9a86cec - test[213991da798b1c03]::test_main_inner::<test[213991da798b1c03]::test_main_static::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:155:21
[INFO] [stdout]   13:     0x5bb5e9b28532 - <alloc[a7ee25936407c584]::boxed::Box<dyn for<'a, 'b> core[8fb95b77d25ab6c8]::ops::function::Fn<(&'a std[10d71ac2c42b111e]::panic::PanicHookInfo<'b>,), Output = ()> + core[8fb95b77d25ab6c8]::marker::Sync + core[8fb95b77d25ab6c8]::marker::Send> as core[8fb95b77d25ab6c8]::ops::function::Fn<(&std[10d71ac2c42b111e]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/alloc/src/boxed.rs:2289:9
[INFO] [stdout]   14:     0x5bb5e9b28532 - std[10d71ac2c42b111e]::panicking::panic_with_hook
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:833:13
[INFO] [stdout]   15:     0x5bb5e9b0df42 - std[10d71ac2c42b111e]::panicking::panic_handler::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:698:13
[INFO] [stdout]   16:     0x5bb5e9b02ee9 - std[10d71ac2c42b111e]::sys::backtrace::__rust_end_short_backtrace::<std[10d71ac2c42b111e]::panicking::panic_handler::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:182:18
[INFO] [stdout]   17:     0x5bb5e9b0ed1d - __rustc[3be9ba60078d4c86]::rust_begin_unwind
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:689:5
[INFO] [stdout]   18:     0x5bb5e9b45b5c - core[8fb95b77d25ab6c8]::panicking::panic_fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/panicking.rs:80:14
[INFO] [stdout]   19:     0x5bb5e9ae4069 - cudarc[6f943a80b31f2234]::panic_no_lib_found::<alloc[a7ee25936407c584]::string::String>
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/lib.rs:200:5
[INFO] [stdout]   20:     0x5bb5e9ac0f76 - cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:15462:9
[INFO] [stdout]   21:     0x5bb5e9ac5fc6 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:50
[INFO] [stdout]   22:     0x5bb5e9ac5f7d - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:543:19
[INFO] [stdout]   23:     0x5bb5e9ac97c2 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:40
[INFO] [stdout]   24:     0x5bb5e9b13119 - <std[10d71ac2c42b111e]::sys::sync::once::futex::Once>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/sync/once/futex.rs:183:21
[INFO] [stdout]   25:     0x5bb5e9ac81c4 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:20
[INFO] [stdout]   26:     0x5bb5e9ac4f47 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:542:19
[INFO] [stdout]   27:     0x5bb5e9ac50ff - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_try_init::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:410:14
[INFO] [stdout]   28:     0x5bb5e9ac4f9e - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:20
[INFO] [stdout]   29:     0x5bb5e9ac186e - cudarc[6f943a80b31f2234]::driver::sys::culib
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:15454:9
[INFO] [stdout]   30:     0x5bb5e9abf017 - cudarc[6f943a80b31f2234]::driver::sys::load::<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:12:15
[INFO] [stdout]   31:     0x5bb5e9ac1062 - cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:11041:45
[INFO] [stdout]   32:     0x5bb5e9ac5d86 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:50
[INFO] [stdout]   33:     0x5bb5e9ac5d4d - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:543:19
[INFO] [stdout]   34:     0x5bb5e9ac9462 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:40
[INFO] [stdout]   35:     0x5bb5e9b13119 - <std[10d71ac2c42b111e]::sys::sync::once::futex::Once>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/sync/once/futex.rs:183:21
[INFO] [stdout]   36:     0x5bb5e9ac7c84 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:20
[INFO] [stdout]   37:     0x5bb5e9ac4910 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:542:19
[INFO] [stdout]   38:     0x5bb5e9ac49ef - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_try_init::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:410:14
[INFO] [stdout]   39:     0x5bb5e9ac494e - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:20
[INFO] [stdout]   40:     0x5bb5e9ac1889 - cudarc[6f943a80b31f2234]::driver::sys::cuInit
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:11041:21
[INFO] [stdout]   41:     0x5bb5e9ae73e9 - cudarc[6f943a80b31f2234]::driver::result::init
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/result.rs:89:14
[INFO] [stdout]   42:     0x5bb5e9aec66a - <cudarc[6f943a80b31f2234]::driver::safe::core::CudaContext>::device_count
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/safe/core.rs:280:9
[INFO] [stdout]   43:     0x5bb5e9a665d4 - tropical_gemm_cuda[29028f76903e4476]::cuda_device_count
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/lib.rs:109:8
[INFO] [stdout]   44:     0x5bb5e9a66694 - tropical_gemm_cuda[29028f76903e4476]::get_context_for_device
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/lib.rs:126:24
[INFO] [stdout]   45:     0x5bb5e9a66651 - tropical_gemm_cuda[29028f76903e4476]::get_global_context
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/lib.rs:177:5
[INFO] [stdout]   46:     0x5bb5e9a3ace4 - tropical_gemm_cuda[29028f76903e4476]::gpu_mat::tests::test_gpu_mat_batched_with_argmax
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/gpu_mat.rs:717:25
[INFO] [stdout]   47:     0x5bb5e9a32817 - tropical_gemm_cuda[29028f76903e4476]::gpu_mat::tests::test_gpu_mat_batched_with_argmax::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/gpu_mat.rs:716:42
[INFO] [stdout]   48:     0x5bb5e9a30476 - <tropical_gemm_cuda[29028f76903e4476]::gpu_mat::tests::test_gpu_mat_batched_with_argmax::{closure#0} as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   49:     0x5bb5e9a79dcb - <fn() -> core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   50:     0x5bb5e9a79dcb - test[213991da798b1c03]::__rust_begin_short_backtrace::<core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>, fn() -> core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:724:18
[INFO] [stdout]   51:     0x5bb5e9a87645 - test[213991da798b1c03]::run_test_in_process::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:747:74
[INFO] [stdout]   52:     0x5bb5e9a87645 - <core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   53:     0x5bb5e9a87645 - std[10d71ac2c42b111e]::panicking::catch_unwind::do_call::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}>, core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:581:40
[INFO] [stdout]   54:     0x5bb5e9a87645 - std[10d71ac2c42b111e]::panicking::catch_unwind::<core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>, core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:544:19
[INFO] [stdout]   55:     0x5bb5e9a87645 - std[10d71ac2c42b111e]::panic::catch_unwind::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}>, core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panic.rs:359:14
[INFO] [stdout]   56:     0x5bb5e9a87645 - test[213991da798b1c03]::run_test_in_process
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:747:27
[INFO] [stdout]   57:     0x5bb5e9a87645 - test[213991da798b1c03]::run_test::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:668:43
[INFO] [stdout]   58:     0x5bb5e9a80f54 - test[213991da798b1c03]::run_test::{closure#1}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:698:41
[INFO] [stdout]   59:     0x5bb5e9a80f54 - std[10d71ac2c42b111e]::sys::backtrace::__rust_begin_short_backtrace::<test[213991da798b1c03]::run_test::{closure#1}, ()>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:166:18
[INFO] [stdout]   60:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked::<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/thread/lifecycle.rs:70:13
[INFO] [stdout]   61:     0x5bb5e9a8a6c2 - <core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   62:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::panicking::catch_unwind::do_call::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:581:40
[INFO] [stdout]   63:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::panicking::catch_unwind::<(), core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:544:19
[INFO] [stdout]   64:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::panic::catch_unwind::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panic.rs:359:14
[INFO] [stdout]   65:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked::<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/thread/lifecycle.rs:68:26
[INFO] [stdout]   66:     0x5bb5e9a8a6c2 - <std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1} as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   67:     0x5bb5e9b2f96f - <alloc[a7ee25936407c584]::boxed::Box<dyn core[8fb95b77d25ab6c8]::ops::function::FnOnce<(), Output = ()> + core[8fb95b77d25ab6c8]::marker::Send> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/alloc/src/boxed.rs:2275:9
[INFO] [stdout]   68:     0x5bb5e9b2f96f - <std[10d71ac2c42b111e]::sys::thread::unix::Thread>::new::thread_start
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/thread/unix.rs:118:17
[INFO] [stdout]   69:     0x75580e3faaa4 - <unknown>
[INFO] [stdout]   70:     0x75580e487a64 - clone
[INFO] [stdout]   71:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] ---- gpu_mat::tests::test_gpu_mat_batched_empty stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'gpu_mat::tests::test_gpu_mat_batched_empty' (2229) panicked at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/lib.rs:200:5:
[INFO] [stdout] Unable to dynamically load the "cuda" shared library - searched for library names: ["libcuda.so", "libcuda64.so", "libcuda64_13.so", "libcuda64_132.so", "libcuda64_132_0.so", "libcuda64_130_2.so", "libcuda64_10.so", "libcuda64_11.so", "libcuda64_12.so", "libcuda64_130_0.so", "libcuda64_9.so", "libcuda.so.13", "libcuda.so.12", "libcuda.so.11", "libcuda.so.10", "libcuda.so.9", "libcuda.so.1", "libnvcuda.so", "libnvcuda64.so", "libnvcuda64_13.so", "libnvcuda64_132.so", "libnvcuda64_132_0.so", "libnvcuda64_130_2.so", "libnvcuda64_10.so", "libnvcuda64_11.so", "libnvcuda64_12.so", "libnvcuda64_130_0.so", "libnvcuda64_9.so", "libnvcuda.so.13", "libnvcuda.so.12", "libnvcuda.so.11", "libnvcuda.so.10", "libnvcuda.so.9", "libnvcuda.so.1"]. Ensure that `LD_LIBRARY_PATH` has the correct path to the installed library. If the shared library is present on the system under a different name than one of those listed above, please open a GitHub issue.
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x5bb5e9b302e8 - std[10d71ac2c42b111e]::backtrace_rs::backtrace::libunwind::trace
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9
[INFO] [stdout]    1:     0x5bb5e9b302e8 - std[10d71ac2c42b111e]::backtrace_rs::backtrace::trace_unsynchronized::<std[10d71ac2c42b111e]::sys::backtrace::_print_fmt::{closure#1}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14
[INFO] [stdout]    2:     0x5bb5e9b302e8 - std[10d71ac2c42b111e]::sys::backtrace::_print_fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:74:9
[INFO] [stdout]    3:     0x5bb5e9b302e8 - <<std[10d71ac2c42b111e]::sys::backtrace::BacktraceLock>::print::DisplayBacktrace as core[8fb95b77d25ab6c8]::fmt::Display>::fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:44:26
[INFO] [stdout]    4:     0x5bb5e9b453da - <core[8fb95b77d25ab6c8]::fmt::rt::Argument>::fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/fmt/rt.rs:152:76
[INFO] [stdout]    5:     0x5bb5e9b453da - core[8fb95b77d25ab6c8]::fmt::write
[INFO] [stdout]    6:     0x5bb5e9b34b02 - std[10d71ac2c42b111e]::io::default_write_fmt::<alloc[a7ee25936407c584]::vec::Vec<u8>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/io/mod.rs:622:11
[INFO] [stdout]    7:     0x5bb5e9b34b02 - <alloc[a7ee25936407c584]::vec::Vec<u8> as std[10d71ac2c42b111e]::io::Write>::write_fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/io/mod.rs:1977:13
[INFO] [stdout]    8:     0x5bb5e9b0de86 - <std[10d71ac2c42b111e]::sys::backtrace::BacktraceLock>::print
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:47:9
[INFO] [stdout]    9:     0x5bb5e9b0de86 - std[10d71ac2c42b111e]::panicking::default_hook::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:292:27
[INFO] [stdout]   10:     0x5bb5e9b28379 - std[10d71ac2c42b111e]::panicking::default_hook
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:316:9
[INFO] [stdout]   11:     0x5bb5e9a86cec - <alloc[a7ee25936407c584]::boxed::Box<dyn for<'a, 'b> core[8fb95b77d25ab6c8]::ops::function::Fn<(&'a std[10d71ac2c42b111e]::panic::PanicHookInfo<'b>,), Output = ()> + core[8fb95b77d25ab6c8]::marker::Sync + core[8fb95b77d25ab6c8]::marker::Send> as core[8fb95b77d25ab6c8]::ops::function::Fn<(&std[10d71ac2c42b111e]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/alloc/src/boxed.rs:2289:9
[INFO] [stdout]   12:     0x5bb5e9a86cec - test[213991da798b1c03]::test_main_inner::<test[213991da798b1c03]::test_main_static::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:155:21
[INFO] [stdout]   13:     0x5bb5e9b28532 - <alloc[a7ee25936407c584]::boxed::Box<dyn for<'a, 'b> core[8fb95b77d25ab6c8]::ops::function::Fn<(&'a std[10d71ac2c42b111e]::panic::PanicHookInfo<'b>,), Output = ()> + core[8fb95b77d25ab6c8]::marker::Sync + core[8fb95b77d25ab6c8]::marker::Send> as core[8fb95b77d25ab6c8]::ops::function::Fn<(&std[10d71ac2c42b111e]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/alloc/src/boxed.rs:2289:9
[INFO] [stdout]   14:     0x5bb5e9b28532 - std[10d71ac2c42b111e]::panicking::panic_with_hook
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:833:13
[INFO] [stdout]   15:     0x5bb5e9b0df42 - std[10d71ac2c42b111e]::panicking::panic_handler::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:698:13
[INFO] [stdout]   16:     0x5bb5e9b02ee9 - std[10d71ac2c42b111e]::sys::backtrace::__rust_end_short_backtrace::<std[10d71ac2c42b111e]::panicking::panic_handler::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:182:18
[INFO] [stdout]   17:     0x5bb5e9b0ed1d - __rustc[3be9ba60078d4c86]::rust_begin_unwind
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:689:5
[INFO] [stdout]   18:     0x5bb5e9b45b5c - core[8fb95b77d25ab6c8]::panicking::panic_fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/panicking.rs:80:14
[INFO] [stdout]   19:     0x5bb5e9ae4069 - cudarc[6f943a80b31f2234]::panic_no_lib_found::<alloc[a7ee25936407c584]::string::String>
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/lib.rs:200:5
[INFO] [stdout]   20:     0x5bb5e9ac0f76 - cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:15462:9
[INFO] [stdout]   21:     0x5bb5e9ac5fc6 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:50
[INFO] [stdout]   22:     0x5bb5e9ac5f7d - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:543:19
[INFO] [stdout]   23:     0x5bb5e9ac97c2 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:40
[INFO] [stdout]   24:     0x5bb5e9b13119 - <std[10d71ac2c42b111e]::sys::sync::once::futex::Once>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/sync/once/futex.rs:183:21
[INFO] [stdout]   25:     0x5bb5e9ac81c4 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:20
[INFO] [stdout]   26:     0x5bb5e9ac4f47 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:542:19
[INFO] [stdout]   27:     0x5bb5e9ac50ff - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_try_init::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:410:14
[INFO] [stdout]   28:     0x5bb5e9ac4f9e - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:20
[INFO] [stdout]   29:     0x5bb5e9ac186e - cudarc[6f943a80b31f2234]::driver::sys::culib
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:15454:9
[INFO] [stdout]   30:     0x5bb5e9abf017 - cudarc[6f943a80b31f2234]::driver::sys::load::<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:12:15
[INFO] [stdout]   31:     0x5bb5e9ac1062 - cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:11041:45
[INFO] [stdout]   32:     0x5bb5e9ac5d86 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:50
[INFO] [stdout]   33:     0x5bb5e9ac5d4d - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:543:19
[INFO] [stdout]   34:     0x5bb5e9ac9462 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:40
[INFO] [stdout]   35:     0x5bb5e9b13119 - <std[10d71ac2c42b111e]::sys::sync::once::futex::Once>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/sync/once/futex.rs:183:21
[INFO] [stdout]   36:     0x5bb5e9ac7c84 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:20
[INFO] [stdout]   37:     0x5bb5e9ac4910 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:542:19
[INFO] [stdout]   38:     0x5bb5e9ac49ef - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_try_init::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:410:14
[INFO] [stdout]   39:     0x5bb5e9ac494e - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:20
[INFO] [stdout]   40:     0x5bb5e9ac1889 - cudarc[6f943a80b31f2234]::driver::sys::cuInit
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:11041:21
[INFO] [stdout]   41:     0x5bb5e9ae73e9 - cudarc[6f943a80b31f2234]::driver::result::init
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/result.rs:89:14
[INFO] [stdout]   42:     0x5bb5e9aec66a - <cudarc[6f943a80b31f2234]::driver::safe::core::CudaContext>::device_count
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/safe/core.rs:280:9
[INFO] [stdout]   43:     0x5bb5e9a665d4 - tropical_gemm_cuda[29028f76903e4476]::cuda_device_count
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/lib.rs:109:8
[INFO] [stdout]   44:     0x5bb5e9a66694 - tropical_gemm_cuda[29028f76903e4476]::get_context_for_device
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/lib.rs:126:24
[INFO] [stdout]   45:     0x5bb5e9a66651 - tropical_gemm_cuda[29028f76903e4476]::get_global_context
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/lib.rs:177:5
[INFO] [stdout]   46:     0x5bb5e9a3a141 - tropical_gemm_cuda[29028f76903e4476]::gpu_mat::tests::test_gpu_mat_batched_empty
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/gpu_mat.rs:747:25
[INFO] [stdout]   47:     0x5bb5e9a327b7 - tropical_gemm_cuda[29028f76903e4476]::gpu_mat::tests::test_gpu_mat_batched_empty::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/gpu_mat.rs:746:36
[INFO] [stdout]   48:     0x5bb5e9a303f6 - <tropical_gemm_cuda[29028f76903e4476]::gpu_mat::tests::test_gpu_mat_batched_empty::{closure#0} as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   49:     0x5bb5e9a79dcb - <fn() -> core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   50:     0x5bb5e9a79dcb - test[213991da798b1c03]::__rust_begin_short_backtrace::<core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>, fn() -> core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:724:18
[INFO] [stdout]   51:     0x5bb5e9a87645 - test[213991da798b1c03]::run_test_in_process::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:747:74
[INFO] [stdout]   52:     0x5bb5e9a87645 - <core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   53:     0x5bb5e9a87645 - std[10d71ac2c42b111e]::panicking::catch_unwind::do_call::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}>, core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:581:40
[INFO] [stdout]   54:     0x5bb5e9a87645 - std[10d71ac2c42b111e]::panicking::catch_unwind::<core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>, core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:544:19
[INFO] [stdout]   55:     0x5bb5e9a87645 - std[10d71ac2c42b111e]::panic::catch_unwind::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}>, core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panic.rs:359:14
[INFO] [stdout]   56:     0x5bb5e9a87645 - test[213991da798b1c03]::run_test_in_process
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:747:27
[INFO] [stdout]   57:     0x5bb5e9a87645 - test[213991da798b1c03]::run_test::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:668:43
[INFO] [stdout]   58:     0x5bb5e9a80f54 - test[213991da798b1c03]::run_test::{closure#1}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:698:41
[INFO] [stdout]   59:     0x5bb5e9a80f54 - std[10d71ac2c42b111e]::sys::backtrace::__rust_begin_short_backtrace::<test[213991da798b1c03]::run_test::{closure#1}, ()>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:166:18
[INFO] [stdout]   60:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked::<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/thread/lifecycle.rs:70:13
[INFO] [stdout]   61:     0x5bb5e9a8a6c2 - <core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   62:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::panicking::catch_unwind::do_call::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:581:40
[INFO] [stdout]   63:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::panicking::catch_unwind::<(), core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:544:19
[INFO] [stdout]   64:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::panic::catch_unwind::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panic.rs:359:14
[INFO] [stdout]   65:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked::<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/thread/lifecycle.rs:68:26
[INFO] [stdout]   66:     0x5bb5e9a8a6c2 - <std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1} as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   67:     0x5bb5e9b2f96f - <alloc[a7ee25936407c584]::boxed::Box<dyn core[8fb95b77d25ab6c8]::ops::function::FnOnce<(), Output = ()> + core[8fb95b77d25ab6c8]::marker::Send> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/alloc/src/boxed.rs:2275:9
[INFO] [stdout]   68:     0x5bb5e9b2f96f - <std[10d71ac2c42b111e]::sys::thread::unix::Thread>::new::thread_start
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/thread/unix.rs:118:17
[INFO] [stdout]   69:     0x75580e3faaa4 - <unknown>
[INFO] [stdout]   70:     0x75580e487a64 - clone
[INFO] [stdout]   71:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] ---- gpu_mat::tests::test_gpu_mat_batched stdout ----
[INFO] [stdout] 
[INFO] [stdout] thread 'gpu_mat::tests::test_gpu_mat_batched' (2228) panicked at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/lib.rs:200:5:
[INFO] [stdout] Unable to dynamically load the "cuda" shared library - searched for library names: ["libcuda.so", "libcuda64.so", "libcuda64_13.so", "libcuda64_132.so", "libcuda64_132_0.so", "libcuda64_130_2.so", "libcuda64_10.so", "libcuda64_11.so", "libcuda64_12.so", "libcuda64_130_0.so", "libcuda64_9.so", "libcuda.so.13", "libcuda.so.12", "libcuda.so.11", "libcuda.so.10", "libcuda.so.9", "libcuda.so.1", "libnvcuda.so", "libnvcuda64.so", "libnvcuda64_13.so", "libnvcuda64_132.so", "libnvcuda64_132_0.so", "libnvcuda64_130_2.so", "libnvcuda64_10.so", "libnvcuda64_11.so", "libnvcuda64_12.so", "libnvcuda64_130_0.so", "libnvcuda64_9.so", "libnvcuda.so.13", "libnvcuda.so.12", "libnvcuda.so.11", "libnvcuda.so.10", "libnvcuda.so.9", "libnvcuda.so.1"]. Ensure that `LD_LIBRARY_PATH` has the correct path to the installed library. If the shared library is present on the system under a different name than one of those listed above, please open a GitHub issue.
[INFO] [stdout] stack backtrace:
[INFO] [stdout]    0:     0x5bb5e9b302e8 - std[10d71ac2c42b111e]::backtrace_rs::backtrace::libunwind::trace
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9
[INFO] [stdout]    1:     0x5bb5e9b302e8 - std[10d71ac2c42b111e]::backtrace_rs::backtrace::trace_unsynchronized::<std[10d71ac2c42b111e]::sys::backtrace::_print_fmt::{closure#1}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14
[INFO] [stdout]    2:     0x5bb5e9b302e8 - std[10d71ac2c42b111e]::sys::backtrace::_print_fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:74:9
[INFO] [stdout]    3:     0x5bb5e9b302e8 - <<std[10d71ac2c42b111e]::sys::backtrace::BacktraceLock>::print::DisplayBacktrace as core[8fb95b77d25ab6c8]::fmt::Display>::fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:44:26
[INFO] [stdout]    4:     0x5bb5e9b453da - <core[8fb95b77d25ab6c8]::fmt::rt::Argument>::fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/fmt/rt.rs:152:76
[INFO] [stdout]    5:     0x5bb5e9b453da - core[8fb95b77d25ab6c8]::fmt::write
[INFO] [stdout]    6:     0x5bb5e9b34b02 - std[10d71ac2c42b111e]::io::default_write_fmt::<alloc[a7ee25936407c584]::vec::Vec<u8>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/io/mod.rs:622:11
[INFO] [stdout]    7:     0x5bb5e9b34b02 - <alloc[a7ee25936407c584]::vec::Vec<u8> as std[10d71ac2c42b111e]::io::Write>::write_fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/io/mod.rs:1977:13
[INFO] [stdout]    8:     0x5bb5e9b0de86 - <std[10d71ac2c42b111e]::sys::backtrace::BacktraceLock>::print
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:47:9
[INFO] [stdout]    9:     0x5bb5e9b0de86 - std[10d71ac2c42b111e]::panicking::default_hook::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:292:27
[INFO] [stdout]   10:     0x5bb5e9b28379 - std[10d71ac2c42b111e]::panicking::default_hook
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:316:9
[INFO] [stdout]   11:     0x5bb5e9a86cec - <alloc[a7ee25936407c584]::boxed::Box<dyn for<'a, 'b> core[8fb95b77d25ab6c8]::ops::function::Fn<(&'a std[10d71ac2c42b111e]::panic::PanicHookInfo<'b>,), Output = ()> + core[8fb95b77d25ab6c8]::marker::Sync + core[8fb95b77d25ab6c8]::marker::Send> as core[8fb95b77d25ab6c8]::ops::function::Fn<(&std[10d71ac2c42b111e]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/alloc/src/boxed.rs:2289:9
[INFO] [stdout]   12:     0x5bb5e9a86cec - test[213991da798b1c03]::test_main_inner::<test[213991da798b1c03]::test_main_static::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:155:21
[INFO] [stdout]   13:     0x5bb5e9b28532 - <alloc[a7ee25936407c584]::boxed::Box<dyn for<'a, 'b> core[8fb95b77d25ab6c8]::ops::function::Fn<(&'a std[10d71ac2c42b111e]::panic::PanicHookInfo<'b>,), Output = ()> + core[8fb95b77d25ab6c8]::marker::Sync + core[8fb95b77d25ab6c8]::marker::Send> as core[8fb95b77d25ab6c8]::ops::function::Fn<(&std[10d71ac2c42b111e]::panic::PanicHookInfo,)>>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/alloc/src/boxed.rs:2289:9
[INFO] [stdout]   14:     0x5bb5e9b28532 - std[10d71ac2c42b111e]::panicking::panic_with_hook
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:833:13
[INFO] [stdout]   15:     0x5bb5e9b0df42 - std[10d71ac2c42b111e]::panicking::panic_handler::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:698:13
[INFO] [stdout]   16:     0x5bb5e9b02ee9 - std[10d71ac2c42b111e]::sys::backtrace::__rust_end_short_backtrace::<std[10d71ac2c42b111e]::panicking::panic_handler::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:182:18
[INFO] [stdout]   17:     0x5bb5e9b0ed1d - __rustc[3be9ba60078d4c86]::rust_begin_unwind
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:689:5
[INFO] [stdout]   18:     0x5bb5e9b45b5c - core[8fb95b77d25ab6c8]::panicking::panic_fmt
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/panicking.rs:80:14
[INFO] [stdout]   19:     0x5bb5e9ae4069 - cudarc[6f943a80b31f2234]::panic_no_lib_found::<alloc[a7ee25936407c584]::string::String>
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/lib.rs:200:5
[INFO] [stdout]   20:     0x5bb5e9ac0f76 - cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:15462:9
[INFO] [stdout]   21:     0x5bb5e9ac5fc6 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:50
[INFO] [stdout]   22:     0x5bb5e9ac5f7d - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:543:19
[INFO] [stdout]   23:     0x5bb5e9ac97c2 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:40
[INFO] [stdout]   24:     0x5bb5e9b13119 - <std[10d71ac2c42b111e]::sys::sync::once::futex::Once>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/sync/once/futex.rs:183:21
[INFO] [stdout]   25:     0x5bb5e9ac81c4 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:20
[INFO] [stdout]   26:     0x5bb5e9ac4f47 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:542:19
[INFO] [stdout]   27:     0x5bb5e9ac50ff - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_try_init::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:410:14
[INFO] [stdout]   28:     0x5bb5e9ac4f9e - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<libloading[89de3cdc3980eeb7]::safe::Library>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::culib::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:20
[INFO] [stdout]   29:     0x5bb5e9ac186e - cudarc[6f943a80b31f2234]::driver::sys::culib
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:15454:9
[INFO] [stdout]   30:     0x5bb5e9abf017 - cudarc[6f943a80b31f2234]::driver::sys::load::<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:12:15
[INFO] [stdout]   31:     0x5bb5e9ac1062 - cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:11041:45
[INFO] [stdout]   32:     0x5bb5e9ac5d86 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:50
[INFO] [stdout]   33:     0x5bb5e9ac5d4d - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:543:19
[INFO] [stdout]   34:     0x5bb5e9ac9462 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>::{closure#0}>::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:40
[INFO] [stdout]   35:     0x5bb5e9b13119 - <std[10d71ac2c42b111e]::sys::sync::once::futex::Once>::call
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/sync/once/futex.rs:183:21
[INFO] [stdout]   36:     0x5bb5e9ac7c84 - <std[10d71ac2c42b111e]::sync::once::Once>::call_once_force::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once.rs:226:20
[INFO] [stdout]   37:     0x5bb5e9ac4910 - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::initialize::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:542:19
[INFO] [stdout]   38:     0x5bb5e9ac49ef - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_try_init::<<std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>::{closure#0}, !>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:410:14
[INFO] [stdout]   39:     0x5bb5e9ac494e - <std[10d71ac2c42b111e]::sync::once_lock::OnceLock<unsafe extern "C" fn(u32) -> cudarc[6f943a80b31f2234]::driver::sys::cudaError_enum>>::get_or_init::<cudarc[6f943a80b31f2234]::driver::sys::cuInit::{closure#0}>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sync/once_lock.rs:321:20
[INFO] [stdout]   40:     0x5bb5e9ac1889 - cudarc[6f943a80b31f2234]::driver::sys::cuInit
[INFO] [stderr] error: test failed, to rerun pass `-p tropical-gemm-cuda --lib`
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/sys/mod.rs:11041:21
[INFO] [stdout]   41:     0x5bb5e9ae73e9 - cudarc[6f943a80b31f2234]::driver::result::init
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/result.rs:89:14
[INFO] [stdout]   42:     0x5bb5e9aec66a - <cudarc[6f943a80b31f2234]::driver::safe::core::CudaContext>::device_count
[INFO] [stdout]                                at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/cudarc-0.19.7/src/driver/safe/core.rs:280:9
[INFO] [stdout]   43:     0x5bb5e9a665d4 - tropical_gemm_cuda[29028f76903e4476]::cuda_device_count
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/lib.rs:109:8
[INFO] [stdout]   44:     0x5bb5e9a66694 - tropical_gemm_cuda[29028f76903e4476]::get_context_for_device
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/lib.rs:126:24
[INFO] [stdout]   45:     0x5bb5e9a66651 - tropical_gemm_cuda[29028f76903e4476]::get_global_context
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/lib.rs:177:5
[INFO] [stdout]   46:     0x5bb5e9a37624 - tropical_gemm_cuda[29028f76903e4476]::gpu_mat::tests::test_gpu_mat_batched
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/gpu_mat.rs:680:25
[INFO] [stdout]   47:     0x5bb5e9a326f7 - tropical_gemm_cuda[29028f76903e4476]::gpu_mat::tests::test_gpu_mat_batched::{closure#0}
[INFO] [stdout]                                at /opt/rustwide/workdir/crates/tropical-gemm-cuda/src/gpu_mat.rs:679:30
[INFO] [stdout]   48:     0x5bb5e9a302f6 - <tropical_gemm_cuda[29028f76903e4476]::gpu_mat::tests::test_gpu_mat_batched::{closure#0} as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   49:     0x5bb5e9a79dcb - <fn() -> core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   50:     0x5bb5e9a79dcb - test[213991da798b1c03]::__rust_begin_short_backtrace::<core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>, fn() -> core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:724:18
[INFO] [stdout]   51:     0x5bb5e9a87645 - test[213991da798b1c03]::run_test_in_process::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:747:74
[INFO] [stdout]   52:     0x5bb5e9a87645 - <core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   53:     0x5bb5e9a87645 - std[10d71ac2c42b111e]::panicking::catch_unwind::do_call::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}>, core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:581:40
[INFO] [stdout]   54:     0x5bb5e9a87645 - std[10d71ac2c42b111e]::panicking::catch_unwind::<core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>, core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:544:19
[INFO] [stdout]   55:     0x5bb5e9a87645 - std[10d71ac2c42b111e]::panic::catch_unwind::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<test[213991da798b1c03]::run_test_in_process::{closure#0}>, core[8fb95b77d25ab6c8]::result::Result<(), alloc[a7ee25936407c584]::string::String>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panic.rs:359:14
[INFO] [stdout]   56:     0x5bb5e9a87645 - test[213991da798b1c03]::run_test_in_process
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:747:27
[INFO] [stdout]   57:     0x5bb5e9a87645 - test[213991da798b1c03]::run_test::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:668:43
[INFO] [stdout]   58:     0x5bb5e9a80f54 - test[213991da798b1c03]::run_test::{closure#1}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/test/src/lib.rs:698:41
[INFO] [stdout]   59:     0x5bb5e9a80f54 - std[10d71ac2c42b111e]::sys::backtrace::__rust_begin_short_backtrace::<test[213991da798b1c03]::run_test::{closure#1}, ()>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/backtrace.rs:166:18
[INFO] [stdout]   60:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked::<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/thread/lifecycle.rs:70:13
[INFO] [stdout]   61:     0x5bb5e9a8a6c2 - <core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/panic/unwind_safe.rs:275:9
[INFO] [stdout]   62:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::panicking::catch_unwind::do_call::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:581:40
[INFO] [stdout]   63:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::panicking::catch_unwind::<(), core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panicking.rs:544:19
[INFO] [stdout]   64:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::panic::catch_unwind::<core[8fb95b77d25ab6c8]::panic::unwind_safe::AssertUnwindSafe<std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}::{closure#0}>, ()>
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/panic.rs:359:14
[INFO] [stdout]   65:     0x5bb5e9a8a6c2 - std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked::<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/thread/lifecycle.rs:68:26
[INFO] [stdout]   66:     0x5bb5e9a8a6c2 - <std[10d71ac2c42b111e]::thread::lifecycle::spawn_unchecked<test[213991da798b1c03]::run_test::{closure#1}, ()>::{closure#1} as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0}
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/core/src/ops/function.rs:250:5
[INFO] [stdout]   67:     0x5bb5e9b2f96f - <alloc[a7ee25936407c584]::boxed::Box<dyn core[8fb95b77d25ab6c8]::ops::function::FnOnce<(), Output = ()> + core[8fb95b77d25ab6c8]::marker::Send> as core[8fb95b77d25ab6c8]::ops::function::FnOnce<()>>::call_once
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/alloc/src/boxed.rs:2275:9
[INFO] [stdout]   68:     0x5bb5e9b2f96f - <std[10d71ac2c42b111e]::sys::thread::unix::Thread>::new::thread_start
[INFO] [stdout]                                at /rustc/b2282dd5646a57d570fc86fbe8df0e8826665ef6/library/std/src/sys/thread/unix.rs:118:17
[INFO] [stdout]   69:     0x75580e3faaa4 - <unknown>
[INFO] [stdout]   70:     0x75580e487a64 - clone
[INFO] [stdout]   71:                0x0 - <unknown>
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout]     gpu_mat::tests::test_gpu_mat_backward_a
[INFO] [stdout]     gpu_mat::tests::test_gpu_mat_backward_b
[INFO] [stdout]     gpu_mat::tests::test_gpu_mat_basic
[INFO] [stdout]     gpu_mat::tests::test_gpu_mat_batched
[INFO] [stdout]     gpu_mat::tests::test_gpu_mat_batched_empty
[INFO] [stdout]     gpu_mat::tests::test_gpu_mat_batched_with_argmax
[INFO] [stdout]     gpu_mat::tests::test_gpu_mat_matmul
[INFO] [stdout]     gpu_mat::tests::test_gpu_mat_matmul_argmax
[INFO] [stdout]     gpu_mat::tests::test_gpu_mat_minplus
[INFO] [stdout] 
[INFO] [stdout] test result: FAILED. 48 passed; 9 failed; 3 ignored; 0 measured; 0 filtered out; finished in 0.22s
[INFO] [stdout] 
[INFO] running `Command { std: "docker" "inspect" "55ccbd322ac89d40e8783cfdb0370880c6ccf46a99aa86cdfe01d124a4dc32c9", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "55ccbd322ac89d40e8783cfdb0370880c6ccf46a99aa86cdfe01d124a4dc32c9", kill_on_drop: false }`
[INFO] [stdout] 55ccbd322ac89d40e8783cfdb0370880c6ccf46a99aa86cdfe01d124a4dc32c9
