[INFO] cloning repository https://github.com/NVIDIA/nvrc
[INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/NVIDIA/nvrc" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FNVIDIA%2Fnvrc", kill_on_drop: false }`
[INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FNVIDIA%2Fnvrc'...
[INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }`
[INFO] [stdout] 570dbc505173d7ceecc1ece803a7fd7ed3e83612
[INFO] testing NVIDIA/nvrc against beta-2026-01-20 for beta-1.94-1
[INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FNVIDIA%2Fnvrc" "/workspace/builds/worker-0-tc2/source", kill_on_drop: false }`
[INFO] [stderr] Cloning into '/workspace/builds/worker-0-tc2/source'...
[INFO] [stderr] done.
[INFO] removed /workspace/builds/worker-0-tc2/source/.cargo/config.toml
[INFO] started tweaking git repo https://github.com/NVIDIA/nvrc
[INFO] finished tweaking git repo https://github.com/NVIDIA/nvrc
[INFO] tweaked toml for git repo https://github.com/NVIDIA/nvrc written to /workspace/builds/worker-0-tc2/source/Cargo.toml
[INFO] validating manifest of git repo https://github.com/NVIDIA/nvrc on toolchain beta-2026-01-20
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+beta-2026-01-20" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] crate git repo https://github.com/NVIDIA/nvrc already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+beta-2026-01-20" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:98afbf2d16093dec2546ff8915fddc74e65664aa03fc460b3712b1c2c54a33e4" "/opt/rustwide/cargo-home/bin/cargo" "+beta-2026-01-20" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] [stdout] 6618071fd3543f946c8a471ba5b0e47f288670efd542759136259b924668621e
[INFO] running `Command { std: "docker" "start" "-a" "6618071fd3543f946c8a471ba5b0e47f288670efd542759136259b924668621e", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "6618071fd3543f946c8a471ba5b0e47f288670efd542759136259b924668621e", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "6618071fd3543f946c8a471ba5b0e47f288670efd542759136259b924668621e", kill_on_drop: false }`
[INFO] [stdout] 6618071fd3543f946c8a471ba5b0e47f288670efd542759136259b924668621e
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:98afbf2d16093dec2546ff8915fddc74e65664aa03fc460b3712b1c2c54a33e4" "/opt/rustwide/cargo-home/bin/cargo" "+beta-2026-01-20" "build" "--frozen" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] 4d960bf41fdee210a120134cd4038393f400bd8d8ef232c1b81f310966a0e681
[INFO] running `Command { std: "docker" "start" "-a" "4d960bf41fdee210a120134cd4038393f400bd8d8ef232c1b81f310966a0e681", kill_on_drop: false }`
[INFO] [stderr]    Compiling libc v0.2.178
[INFO] [stderr]    Compiling rlimit v0.10.2
[INFO] [stderr]    Compiling bitflags v2.8.0
[INFO] [stderr]    Compiling nix v0.30.1
[INFO] [stderr]    Compiling kernlog v0.3.1
[INFO] [stderr]    Compiling NVRC v0.1.1 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `dev` profile [unoptimized + debuginfo] target(s) in 6.67s
[INFO] running `Command { std: "docker" "inspect" "4d960bf41fdee210a120134cd4038393f400bd8d8ef232c1b81f310966a0e681", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "4d960bf41fdee210a120134cd4038393f400bd8d8ef232c1b81f310966a0e681", kill_on_drop: false }`
[INFO] [stdout] 4d960bf41fdee210a120134cd4038393f400bd8d8ef232c1b81f310966a0e681
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:98afbf2d16093dec2546ff8915fddc74e65664aa03fc460b3712b1c2c54a33e4" "/opt/rustwide/cargo-home/bin/cargo" "+beta-2026-01-20" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] 607e521e1067bcbadb351443e9e4e9348d5e0adb417c638c78d695557aca1834
[INFO] running `Command { std: "docker" "start" "-a" "607e521e1067bcbadb351443e9e4e9348d5e0adb417c638c78d695557aca1834", kill_on_drop: false }`
[INFO] [stderr]    Compiling proc-macro2 v1.0.93
[INFO] [stderr]    Compiling futures-core v0.3.31
[INFO] [stderr]    Compiling futures-sink v0.3.31
[INFO] [stderr]    Compiling bitflags v2.8.0
[INFO] [stderr]    Compiling rustix v1.1.2
[INFO] [stderr]    Compiling getrandom v0.2.15
[INFO] [stderr]    Compiling sdd v3.0.7
[INFO] [stderr]    Compiling parking_lot_core v0.9.10
[INFO] [stderr]    Compiling getrandom v0.3.1
[INFO] [stderr]    Compiling fastrand v2.3.0
[INFO] [stderr]    Compiling futures-channel v0.3.31
[INFO] [stderr]    Compiling scc v2.3.3
[INFO] [stderr]    Compiling parking_lot v0.12.3
[INFO] [stderr]    Compiling uuid v1.4.1
[INFO] [stderr]    Compiling nix v0.30.1
[INFO] [stderr]    Compiling futures-util v0.3.31
[INFO] [stderr]    Compiling mktemp v0.5.1
[INFO] [stderr]    Compiling quote v1.0.38
[INFO] [stderr]    Compiling syn v2.0.98
[INFO] [stderr]    Compiling NVRC v0.1.1 (/opt/rustwide/workdir)
[INFO] [stderr]    Compiling tempfile v3.23.0
[INFO] [stderr]    Compiling futures-executor v0.3.31
[INFO] [stderr]    Compiling futures v0.3.31
[INFO] [stderr]    Compiling serial_test_derive v3.2.0
[INFO] [stderr]    Compiling serial_test v3.2.0
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 11.36s
[INFO] running `Command { std: "docker" "inspect" "607e521e1067bcbadb351443e9e4e9348d5e0adb417c638c78d695557aca1834", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "607e521e1067bcbadb351443e9e4e9348d5e0adb417c638c78d695557aca1834", kill_on_drop: false }`
[INFO] [stdout] 607e521e1067bcbadb351443e9e4e9348d5e0adb417c638c78d695557aca1834
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:98afbf2d16093dec2546ff8915fddc74e65664aa03fc460b3712b1c2c54a33e4" "/opt/rustwide/cargo-home/bin/cargo" "+beta-2026-01-20" "test" "--frozen", kill_on_drop: false }`
[INFO] [stdout] eb1632c592f0de56d9732c8beb4c8beb1ce2505709037f1e81511b3560913a00
[INFO] running `Command { std: "docker" "start" "-a" "eb1632c592f0de56d9732c8beb4c8beb1ce2505709037f1e81511b3560913a00", kill_on_drop: false }`
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 0.08s
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/NVRC-28afb209ad566c3d)
[INFO] [stdout] 
[INFO] [stdout] running 104 tests
[INFO] [stdout] test daemon::tests::test_check_daemons_empty ... ok
[INFO] [stdout] test daemon::tests::test_dcgm_exporter_args ... ok
[INFO] [stdout] test daemon::tests::test_dcgm_exporter_skipped_by_default ... ok
[INFO] [stdout] test daemon::tests::test_fabricmanager_args ... ok
[INFO] [stdout] test daemon::tests::test_nv_fabricmanager_skipped_by_default ... ok
[INFO] [stdout] test daemon::tests::test_nv_hostengine_skipped_by_default ... ok
[INFO] [stdout] test daemon::tests::test_persistenced_args_without_uvm ... ok
[INFO] [stdout] test daemon::tests::test_hostengine_args ... ok
[INFO] [stdout] test daemon::tests::test_persistenced_args_with_uvm ... ok
[INFO] [stdout] test daemon::tests::test_spawn_dcgm_exporter_success ... ok
[INFO] [stdout] test daemon::tests::test_spawn_hostengine_success ... ok
[INFO] [stdout] test daemon::tests::test_spawn_fabricmanager_success ... ok
[INFO] [stdout] test kata_agent::tests::test_kata_agent_not_found ... ok
[INFO] [stdout] test execute::tests::test_foreground_success ... ok
[INFO] [stdout] test daemon::tests::test_spawn_persistenced_uvm_disabled ... ok
[INFO] [stdout] test kernel_params::tests::test_nvidia_smi_srs ... ok
[INFO] [stdout] test execute::tests::test_background_check_later ... ok
[INFO] [stdout] test kernel_params::tests::test_nvrc_fabricmanager ... ok
[INFO] [stdout] test kernel_params::tests::test_nvrc_dcgm_parameter_handling ... ok
[INFO] [stdout] test execute::tests::test_background_spawns ... ok
[INFO] [stdout] test kernel_params::tests::test_parse_boolean ... ok
[INFO] [stdout] test kernel_params::tests::test_process_kernel_params_combined ... ok
[INFO] [stdout] test kernel_params::tests::test_nvrc_mode ... ok
[INFO] [stdout] test daemon::tests::test_spawn_persistenced_success ... ok
[INFO] [stdout] test kernel_params::tests::test_process_kernel_params_gpu_settings ... ok
[INFO] [stdout] test kernel_params::tests::test_process_kernel_params_from_proc_cmdline ... ok
[INFO] [stdout] test execute::tests::test_foreground_failure_exit_code ... ok
[INFO] [stdout] test daemon::tests::test_spawn_persistenced_binary_not_found ... ok
[INFO] [stdout] test kata_agent::tests::test_agent_setup ... FAILED
[INFO] [stdout] test kata_agent::tests::test_exec_agent_not_found ... ok
[INFO] [stdout] test kernel_params::tests::test_nvidia_smi_lgc ... ok
[INFO] [stdout] test kernel_params::tests::test_nvidia_smi_pl ... ok
[INFO] [stdout] test execute::tests::test_background_not_found ... ok
[INFO] [stdout] test execute::tests::test_foreground_with_args ... ok
[INFO] [stdout] test kernel_params::tests::test_process_kernel_params_nvswitch_nvl5_mode ... ok
[INFO] [stdout] test kernel_params::tests::test_process_kernel_params_with_fabricmanager_and_uvm ... ok
[INFO] [stdout] test kernel_params::tests::test_process_kernel_params_with_mode ... ok
[INFO] [stdout] test kmsg::tests::test_kmsg_at_dev_null ... ok
[INFO] [stdout] test kmsg::tests::test_kmsg_at_nonexistent ... ok
[INFO] [stdout] test kernel_params::tests::test_process_kernel_params_nvswitch_nvl4_mode ... ok
[INFO] [stdout] test kmsg::tests::test_kmsg_at_temp_file ... ok
[INFO] [stdout] test lockdown::tests::test_disable_modules_loading ... ignored
[INFO] [stdout] test lockdown::tests::test_power_off_function_exists ... ok
[INFO] [stdout] test lockdown::tests::test_set_panic_hook ... ignored
[INFO] [stdout] test kernel_params::tests::test_nvidia_smi_lmc ... ok
[INFO] [stdout] test execute::tests::test_foreground_not_found ... ok
[INFO] [stdout] test lockdown::tests::test_set_panic_hook_with_custom_action ... ok
[INFO] [stdout] test kernel_params::tests::test_nvrc_log_debug ... FAILED
[INFO] [stdout] test macros::tests::test_or_panic_ok ... ok
[INFO] [stdout] test kernel_params::tests::test_uvm_persistenced_mode ... ok
[INFO] [stdout] test mount::tests::test_fs_available ... ok
[INFO] [stdout] test mount::tests::test_fs_available_empty ... ok
[INFO] [stdout] test kata_agent::tests::test_syslog_loop_timeout ... ok
[INFO] [stdout] test mount::tests::test_mount_optional_target_not_exists ... ok
[INFO] [stdout] test kernel_params::tests::test_process_kernel_params_nvrc_log_0 ... FAILED
[INFO] [stdout] test macros::tests::test_or_panic_with_io_error ... ok
[INFO] [stdout] test mount::tests::test_readonly_fails_nonexistent ... ok
[INFO] [stdout] test macros::tests::test_or_panic_err ... ok
[INFO] [stdout] test mount::tests::test_mount_fails_nonexistent_target ... ok
[INFO] [stdout] test nvrc::tests::test_check_daemons_still_running ... ok
[INFO] [stdout] test nvrc::tests::test_default ... ok
[INFO] [stdout] test nvrc::tests::test_track_daemon ... ok
[INFO] [stdout] test kernel_params::tests::test_process_kernel_params_nvrc_log_unknown ... FAILED
[INFO] [stdout] test kmsg::tests::test_kmsg_routes_to_dev_null_when_log_off ... ok
[INFO] [stdout] test smi::tests::test_lmc_none ... ok
[INFO] [stdout] test mount::tests::test_setup_at_with_temp_root ... FAILED
[INFO] [stdout] test smi::tests::test_pl_none ... ok
[INFO] [stdout] test smi::tests::test_lgc_some_fails_without_nvidia_smi ... ok
[INFO] [stdout] test smi::tests::test_srs_none ... ok
[INFO] [stdout] test smi::tests::test_lgc_none ... ok
[INFO] [stdout] test kmsg::tests::test_kernlog_setup ... FAILED
[INFO] [stdout] test syslog::tests::test_bind_already_exists ... ok
[INFO] [stdout] test syslog::tests::test_bind_nonexistent_dir ... ok
[INFO] [stdout] test syslog::tests::test_bind_success ... ok
[INFO] [stdout] test syslog::tests::test_poll_dev_log ... ok
[INFO] [stdout] test smi::tests::test_lmc_some_fails_without_nvidia_smi ... ok
[INFO] [stdout] test kernel_params::tests::test_process_kernel_params_nvrc_log_none ... FAILED
[INFO] [stdout] test smi::tests::test_pl_some_fails_without_nvidia_smi ... ok
[INFO] [stdout] test kmsg::tests::test_kmsg_routes_to_kmsg_when_debug ... ok
[INFO] [stdout] test syslog::tests::test_poll_at_custom_path ... ok
[INFO] [stdout] test syslog::tests::test_poll_socket_no_data ... ok
[INFO] [stdout] test syslog::tests::test_poll_socket_strips_priority ... ok
[INFO] [stdout] test syslog::tests::test_strip_priority_edge_cases ... ok
[INFO] [stdout] test syslog::tests::test_strip_priority_no_prefix ... ok
[INFO] [stdout] test syslog::tests::test_strip_priority_normal ... ok
[INFO] [stdout] test test_utils::tests::test_require_root_impl_when_root ... ok
[INFO] [stdout] test test_utils::tests::test_require_root_when_actually_root ... ok
[INFO] [stdout] test syslog::tests::test_poll_socket_trims_trailing_whitespace ... ok
[INFO] [stdout] test syslog::tests::test_poll_once_with_data ... ok
[INFO] [stdout] test syslog::tests::test_poll_socket_with_data ... ok
[INFO] [stdout] test syslog::tests::test_poll_socket_multiple_messages ... ok
[INFO] [stdout] test smi::tests::test_srs_some_fails_without_nvidia_smi ... ok
[INFO] [stdout] test syslog::tests::test_poll_once_no_data ... ok
[INFO] [stdout] test kernel_params::tests::test_process_kernel_params_nvrc_log_trace ... FAILED
[INFO] [stdout] test toolkit::tests::test_ctk_fails_without_binary ... ok
[INFO] [stdout] test toolkit::tests::test_nvidia_ctk_cdi_fails_without_binary ... ok
[INFO] [stdout] test modprobe::tests::test_load_loop ... FAILED
[INFO] [stdout] test nvrc::tests::test_check_daemons_success ... ok
[INFO] [stdout] test nvrc::tests::test_check_daemons_failure ... ok
[INFO] [stdout] test nvrc::tests::test_check_daemons_multiple ... ok
[INFO] [stdout] test modprobe::tests::test_load_nonexistent ... ok
[INFO] [stdout] test kernel_params::tests::test_process_kernel_params_nvrc_log_debug ... FAILED
[INFO] [stdout] test kernel_params::tests::test_process_kernel_params_nvrc_log_info ... FAILED
[INFO] [stdout] test kata_agent::tests::test_fork_agent_with_timeout has been running for over 60 seconds
[ERROR] error running command: no output for 300 seconds
[INFO] running `Command { std: "docker" "inspect" "eb1632c592f0de56d9732c8beb4c8beb1ce2505709037f1e81511b3560913a00", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "eb1632c592f0de56d9732c8beb4c8beb1ce2505709037f1e81511b3560913a00", kill_on_drop: false }`
[INFO] [stdout] eb1632c592f0de56d9732c8beb4c8beb1ce2505709037f1e81511b3560913a00
