[INFO] cloning repository https://github.com/NVIDIA/nvrc
[INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/NVIDIA/nvrc" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FNVIDIA%2Fnvrc", kill_on_drop: false }`
[INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FNVIDIA%2Fnvrc'...
[INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }`
[INFO] [stdout] 570dbc505173d7ceecc1ece803a7fd7ed3e83612
[INFO] testing NVIDIA/nvrc against master#2fd6efc32704647e64d3d646d21c4c68eae100e4 for pr-149852-1
[INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FNVIDIA%2Fnvrc" "/workspace/builds/worker-7-tc1/source", kill_on_drop: false }`
[INFO] [stderr] Cloning into '/workspace/builds/worker-7-tc1/source'...
[INFO] [stderr] done.
[INFO] removed /workspace/builds/worker-7-tc1/source/.cargo/config.toml
[INFO] started tweaking git repo https://github.com/NVIDIA/nvrc
[INFO] finished tweaking git repo https://github.com/NVIDIA/nvrc
[INFO] tweaked toml for git repo https://github.com/NVIDIA/nvrc written to /workspace/builds/worker-7-tc1/source/Cargo.toml
[INFO] validating manifest of git repo https://github.com/NVIDIA/nvrc on toolchain 2fd6efc32704647e64d3d646d21c4c68eae100e4
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+2fd6efc32704647e64d3d646d21c4c68eae100e4" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] crate git repo https://github.com/NVIDIA/nvrc already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+2fd6efc32704647e64d3d646d21c4c68eae100e4" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] [stderr]     Updating crates.io index
[INFO] [stderr]  Downloading crates ...
[INFO] [stderr]   Downloaded serial_test v3.2.0
[INFO] [stderr]   Downloaded serial_test_derive v3.2.0
[INFO] [stderr]   Downloaded redox_syscall v0.5.10
[INFO] [stderr]   Downloaded kernlog v0.3.1
[INFO] [stderr]   Downloaded rlimit v0.10.2
[INFO] [stderr]   Downloaded sdd v3.0.7
[INFO] [stderr]   Downloaded uuid v1.4.1
[INFO] [stderr]   Downloaded scc v2.3.3
[INFO] [stderr]   Downloaded mktemp v0.5.1
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:aa71247004a7fa38d13ec170f48f06cdedf5bc50b2a8645e56ed7e992e6fa513" "/opt/rustwide/cargo-home/bin/cargo" "+2fd6efc32704647e64d3d646d21c4c68eae100e4" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] [stdout] 425aa41d76aa45fc11f8e0d2efdb3dcc008fce157a4a1d76ee6238f887fcfa53
[INFO] running `Command { std: "docker" "start" "-a" "425aa41d76aa45fc11f8e0d2efdb3dcc008fce157a4a1d76ee6238f887fcfa53", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "425aa41d76aa45fc11f8e0d2efdb3dcc008fce157a4a1d76ee6238f887fcfa53", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "425aa41d76aa45fc11f8e0d2efdb3dcc008fce157a4a1d76ee6238f887fcfa53", kill_on_drop: false }`
[INFO] [stdout] 425aa41d76aa45fc11f8e0d2efdb3dcc008fce157a4a1d76ee6238f887fcfa53
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:aa71247004a7fa38d13ec170f48f06cdedf5bc50b2a8645e56ed7e992e6fa513" "/opt/rustwide/cargo-home/bin/cargo" "+2fd6efc32704647e64d3d646d21c4c68eae100e4" "build" "--frozen" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] 64772faff09a58279ed2635c681ae28460cfca803792f9484d9b38b3cdff2109
[INFO] running `Command { std: "docker" "start" "-a" "64772faff09a58279ed2635c681ae28460cfca803792f9484d9b38b3cdff2109", kill_on_drop: false }`
[INFO] [stderr]    Compiling libc v0.2.178
[INFO] [stderr]    Compiling nix v0.30.1
[INFO] [stderr]    Compiling rlimit v0.10.2
[INFO] [stderr]    Compiling bitflags v2.8.0
[INFO] [stderr]    Compiling log v0.4.29
[INFO] [stderr]    Compiling kernlog v0.3.1
[INFO] [stderr]    Compiling NVRC v0.1.1 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `dev` profile [unoptimized + debuginfo] target(s) in 7.68s
[INFO] running `Command { std: "docker" "inspect" "64772faff09a58279ed2635c681ae28460cfca803792f9484d9b38b3cdff2109", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "64772faff09a58279ed2635c681ae28460cfca803792f9484d9b38b3cdff2109", kill_on_drop: false }`
[INFO] [stdout] 64772faff09a58279ed2635c681ae28460cfca803792f9484d9b38b3cdff2109
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:aa71247004a7fa38d13ec170f48f06cdedf5bc50b2a8645e56ed7e992e6fa513" "/opt/rustwide/cargo-home/bin/cargo" "+2fd6efc32704647e64d3d646d21c4c68eae100e4" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] c4e18ad93e99bc6ecca635d4c436c49d5fce81ebe55cd1faad77c9241ae38f92
[INFO] running `Command { std: "docker" "start" "-a" "c4e18ad93e99bc6ecca635d4c436c49d5fce81ebe55cd1faad77c9241ae38f92", kill_on_drop: false }`
[INFO] [stderr]    Compiling proc-macro2 v1.0.93
[INFO] [stderr]    Compiling futures-core v0.3.31
[INFO] [stderr]    Compiling futures-sink v0.3.31
[INFO] [stderr]    Compiling unicode-ident v1.0.16
[INFO] [stderr]    Compiling slab v0.4.9
[INFO] [stderr]    Compiling lock_api v0.4.12
[INFO] [stderr]    Compiling bitflags v2.8.0
[INFO] [stderr]    Compiling getrandom v0.3.1
[INFO] [stderr]    Compiling rustix v1.1.2
[INFO] [stderr]    Compiling futures-channel v0.3.31
[INFO] [stderr]    Compiling parking_lot_core v0.9.10
[INFO] [stderr]    Compiling getrandom v0.2.15
[INFO] [stderr]    Compiling linux-raw-sys v0.11.0
[INFO] [stderr]    Compiling sdd v3.0.7
[INFO] [stderr]    Compiling futures-util v0.3.31
[INFO] [stderr]    Compiling uuid v1.4.1
[INFO] [stderr]    Compiling parking_lot v0.12.3
[INFO] [stderr]    Compiling scc v2.3.3
[INFO] [stderr]    Compiling nix v0.30.1
[INFO] [stderr]    Compiling mktemp v0.5.1
[INFO] [stderr]    Compiling quote v1.0.38
[INFO] [stderr]    Compiling syn v2.0.98
[INFO] [stderr]    Compiling tempfile v3.23.0
[INFO] [stderr]    Compiling NVRC v0.1.1 (/opt/rustwide/workdir)
[INFO] [stderr]    Compiling futures-executor v0.3.31
[INFO] [stderr]    Compiling futures v0.3.31
[INFO] [stderr]    Compiling serial_test_derive v3.2.0
[INFO] [stderr]    Compiling serial_test v3.2.0
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 25.95s
[INFO] running `Command { std: "docker" "inspect" "c4e18ad93e99bc6ecca635d4c436c49d5fce81ebe55cd1faad77c9241ae38f92", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "c4e18ad93e99bc6ecca635d4c436c49d5fce81ebe55cd1faad77c9241ae38f92", kill_on_drop: false }`
[INFO] [stdout] c4e18ad93e99bc6ecca635d4c436c49d5fce81ebe55cd1faad77c9241ae38f92
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-7-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:aa71247004a7fa38d13ec170f48f06cdedf5bc50b2a8645e56ed7e992e6fa513" "/opt/rustwide/cargo-home/bin/cargo" "+2fd6efc32704647e64d3d646d21c4c68eae100e4" "test" "--frozen", kill_on_drop: false }`
[INFO] [stdout] ff82acee5e309b77a6d6df7c1b66dd9a1eb728e1618270c53c2e8f30977e09b9
[INFO] running `Command { std: "docker" "start" "-a" "ff82acee5e309b77a6d6df7c1b66dd9a1eb728e1618270c53c2e8f30977e09b9", kill_on_drop: false }`
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 0.11s
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/NVRC-c76f1a65bce6db10)
[INFO] [stdout] 
[INFO] [stdout] running 104 tests
[INFO] [stdout] test daemon::tests::test_dcgm_exporter_args ... ok
[INFO] [stdout] test daemon::tests::test_dcgm_exporter_skipped_by_default ... ok
[INFO] [stdout] test daemon::tests::test_nv_fabricmanager_skipped_by_default ... ok
[INFO] [stdout] test daemon::tests::test_nv_hostengine_skipped_by_default ... ok
[INFO] [stdout] test daemon::tests::test_persistenced_args_with_uvm ... ok
[INFO] [stdout] test daemon::tests::test_persistenced_args_without_uvm ... ok
[INFO] [stdout] test daemon::tests::test_fabricmanager_args ... ok
[INFO] [stdout] test daemon::tests::test_check_daemons_empty ... ok
[INFO] [stdout] test daemon::tests::test_spawn_hostengine_success ... ok
[INFO] [stdout] test daemon::tests::test_spawn_dcgm_exporter_success ... ok
[INFO] [stdout] test daemon::tests::test_hostengine_args ... ok
[INFO] [stdout] test daemon::tests::test_spawn_fabricmanager_success ... ok
[INFO] [stdout] test execute::tests::test_background_check_later ... ok
[INFO] [stdout] test execute::tests::test_foreground_success ... ok
[INFO] [stdout] test execute::tests::test_background_spawns ... ok
[INFO] [stdout] test daemon::tests::test_spawn_persistenced_uvm_disabled ... ok
[INFO] [stdout] test daemon::tests::test_spawn_persistenced_success ... ok
[INFO] [stdout] test execute::tests::test_background_not_found ... ok
[INFO] [stdout] test execute::tests::test_foreground_not_found ... ok
[INFO] [stdout] test daemon::tests::test_spawn_persistenced_binary_not_found ... ok
[INFO] [stdout] test kata_agent::tests::test_agent_setup ... FAILED
[INFO] [stdout] test execute::tests::test_foreground_failure_exit_code ... ok
[INFO] [stdout] test kata_agent::tests::test_exec_agent_not_found ... ok
[INFO] [stdout] test kernel_params::tests::test_nvidia_smi_srs ... ok
[INFO] [stdout] test kernel_params::tests::test_nvrc_dcgm_parameter_handling ... ok
[INFO] [stdout] test execute::tests::test_foreground_with_args ... ok
[INFO] [stdout] test kernel_params::tests::test_nvrc_fabricmanager ... ok
[INFO] [stdout] test kernel_params::tests::test_nvidia_smi_lmc ... ok
[INFO] [stdout] test kernel_params::tests::test_nvrc_mode ... ok
[INFO] [stdout] test kernel_params::tests::test_parse_boolean ... ok
[INFO] [stdout] test kernel_params::tests::test_nvidia_smi_lgc ... ok
[INFO] [stdout] test kernel_params::tests::test_process_kernel_params_combined ... ok
[INFO] [stdout] test kernel_params::tests::test_process_kernel_params_from_proc_cmdline ... ok
[INFO] [stdout] test kernel_params::tests::test_process_kernel_params_gpu_settings ... ok
[INFO] [stdout] test kernel_params::tests::test_nvrc_log_debug ... FAILED
[INFO] [stdout] test kernel_params::tests::test_process_kernel_params_nvrc_log_debug ... FAILED
[INFO] [stdout] test kernel_params::tests::test_process_kernel_params_nvrc_log_info ... FAILED
[INFO] [stdout] test kernel_params::tests::test_nvidia_smi_pl ... ok
[INFO] [stdout] test kernel_params::tests::test_process_kernel_params_nvrc_log_unknown ... FAILED
[INFO] [stdout] test kernel_params::tests::test_process_kernel_params_nvswitch_nvl4_mode ... ok
[INFO] [stdout] test kernel_params::tests::test_process_kernel_params_nvrc_log_0 ... FAILED
[INFO] [stdout] test kernel_params::tests::test_process_kernel_params_nvswitch_nvl5_mode ... ok
[INFO] [stdout] test kernel_params::tests::test_process_kernel_params_with_fabricmanager_and_uvm ... ok
[INFO] [stdout] test kernel_params::tests::test_process_kernel_params_with_mode ... ok
[INFO] [stdout] test kernel_params::tests::test_uvm_persistenced_mode ... ok
[INFO] [stdout] test kernel_params::tests::test_process_kernel_params_nvrc_log_none ... FAILED
[INFO] [stdout] test kmsg::tests::test_kmsg_at_dev_null ... ok
[INFO] [stdout] test kmsg::tests::test_kmsg_at_nonexistent ... ok
[INFO] [stdout] test kmsg::tests::test_kmsg_at_temp_file ... ok
[INFO] [stdout] test lockdown::tests::test_disable_modules_loading ... ignored
[INFO] [stdout] test lockdown::tests::test_power_off_function_exists ... ok
[INFO] [stdout] test kmsg::tests::test_kernlog_setup ... FAILED
[INFO] [stdout] test lockdown::tests::test_set_panic_hook ... ignored
[INFO] [stdout] test lockdown::tests::test_set_panic_hook_with_custom_action ... ok
[INFO] [stdout] test macros::tests::test_or_panic_ok ... ok
[INFO] [stdout] test macros::tests::test_or_panic_err ... ok
[INFO] [stdout] test kernel_params::tests::test_process_kernel_params_nvrc_log_trace ... FAILED
[INFO] [stdout] test kmsg::tests::test_kmsg_routes_to_dev_null_when_log_off ... ok
[INFO] [stdout] test mount::tests::test_fs_available ... ok
[INFO] [stdout] test kmsg::tests::test_kmsg_routes_to_kmsg_when_debug ... ok
[INFO] [stdout] test mount::tests::test_fs_available_empty ... ok
[INFO] [stdout] test mount::tests::test_mount_optional_target_not_exists ... ok
[INFO] [stdout] test mount::tests::test_readonly_fails_nonexistent ... ok
[INFO] [stdout] test modprobe::tests::test_load_nonexistent ... ok
[INFO] [stdout] test mount::tests::test_mount_fails_nonexistent_target ... ok
[INFO] [stdout] test macros::tests::test_or_panic_with_io_error ... ok
[INFO] [stdout] test nvrc::tests::test_check_daemons_still_running ... ok
[INFO] [stdout] test modprobe::tests::test_load_loop ... FAILED
[INFO] [stdout] test nvrc::tests::test_default ... ok
[INFO] [stdout] test nvrc::tests::test_track_daemon ... ok
[INFO] [stdout] test smi::tests::test_lgc_none ... ok
[INFO] [stdout] test smi::tests::test_lgc_some_fails_without_nvidia_smi ... ok
[INFO] [stdout] test smi::tests::test_lmc_none ... ok
[INFO] [stdout] test smi::tests::test_lmc_some_fails_without_nvidia_smi ... ok
[INFO] [stdout] test smi::tests::test_pl_none ... ok
[INFO] [stdout] test nvrc::tests::test_check_daemons_success ... ok
[INFO] [stdout] test smi::tests::test_srs_none ... ok
[INFO] [stdout] test smi::tests::test_pl_some_fails_without_nvidia_smi ... ok
[INFO] [stdout] test syslog::tests::test_bind_already_exists ... ok
[INFO] [stdout] test nvrc::tests::test_check_daemons_multiple ... ok
[INFO] [stdout] test syslog::tests::test_bind_success ... ok
[INFO] [stdout] test mount::tests::test_setup_at_with_temp_root ... FAILED
[INFO] [stdout] test syslog::tests::test_poll_dev_log ... ok
[INFO] [stdout] test syslog::tests::test_poll_once_no_data ... ok
[INFO] [stdout] test syslog::tests::test_poll_once_with_data ... ok
[INFO] [stdout] test syslog::tests::test_bind_nonexistent_dir ... ok
[INFO] [stdout] test syslog::tests::test_poll_at_custom_path ... ok
[INFO] [stdout] test syslog::tests::test_poll_socket_no_data ... ok
[INFO] [stdout] test syslog::tests::test_poll_socket_trims_trailing_whitespace ... ok
[INFO] [stdout] test syslog::tests::test_poll_socket_multiple_messages ... ok
[INFO] [stdout] test syslog::tests::test_poll_socket_with_data ... ok
[INFO] [stdout] test syslog::tests::test_strip_priority_edge_cases ... ok
[INFO] [stdout] test syslog::tests::test_poll_socket_strips_priority ... ok
[INFO] [stdout] test syslog::tests::test_strip_priority_no_prefix ... ok
[INFO] [stdout] test syslog::tests::test_strip_priority_normal ... ok
[INFO] [stdout] test test_utils::tests::test_require_root_impl_when_root ... ok
[INFO] [stdout] test test_utils::tests::test_require_root_when_actually_root ... ok
[INFO] [stdout] test smi::tests::test_srs_some_fails_without_nvidia_smi ... ok
[INFO] [stdout] test nvrc::tests::test_check_daemons_failure ... ok
[INFO] [stdout] test toolkit::tests::test_ctk_fails_without_binary ... ok
[INFO] [stdout] test toolkit::tests::test_nvidia_ctk_cdi_fails_without_binary ... ok
[INFO] [stdout] test kata_agent::tests::test_syslog_loop_timeout ... ok
[INFO] [stdout] test kata_agent::tests::test_fork_agent_with_timeout has been running for over 60 seconds
[INFO] [stdout] test kata_agent::tests::test_kata_agent_not_found has been running for over 60 seconds
[ERROR] error running command: no output for 300 seconds
[INFO] running `Command { std: "docker" "inspect" "ff82acee5e309b77a6d6df7c1b66dd9a1eb728e1618270c53c2e8f30977e09b9", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "ff82acee5e309b77a6d6df7c1b66dd9a1eb728e1618270c53c2e8f30977e09b9", kill_on_drop: false }`
[INFO] [stdout] ff82acee5e309b77a6d6df7c1b66dd9a1eb728e1618270c53c2e8f30977e09b9
