[INFO] fetching crate oxicuda-train 0.1.4...
[INFO] testing oxicuda-train-0.1.4 against 1.95.0 for beta-1.96-2
[INFO] extracting crate oxicuda-train 0.1.4 into /workspace/builds/worker-6-tc1/source
[INFO] started tweaking crates.io crate oxicuda-train 0.1.4
[INFO] finished tweaking crates.io crate oxicuda-train 0.1.4
[INFO] tweaked toml for crates.io crate oxicuda-train 0.1.4 written to /workspace/builds/worker-6-tc1/source/Cargo.toml
[INFO] validating manifest of crates.io crate oxicuda-train 0.1.4 on toolchain 1.95.0
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.95.0" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] crate crates.io crate oxicuda-train 0.1.4 already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.95.0" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] [stderr]     Updating crates.io index
[INFO] [stderr]  Downloading crates ...
[INFO] [stderr]   Downloaded libloading v0.9.0
[INFO] [stderr]   Downloaded criterion-plot v0.8.2
[INFO] [stderr]   Downloaded page_size v0.6.0
[INFO] [stderr]   Downloaded alloca v0.4.0
[INFO] [stderr]   Downloaded oxicuda-launch v0.1.4
[INFO] [stderr]   Downloaded oxicuda-memory v0.1.4
[INFO] [stderr]   Downloaded oxicuda-driver v0.1.4
[INFO] [stderr]   Downloaded criterion v0.8.2
[INFO] [stderr]   Downloaded oxicuda-ptx v0.1.4
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+1.95.0" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] [stdout] 4dc7e2f7b53a6eedd5e58e35b51c2032dca4a522bbd561e1b2dac2be30e7e76a
[INFO] running `Command { std: "docker" "start" "-a" "4dc7e2f7b53a6eedd5e58e35b51c2032dca4a522bbd561e1b2dac2be30e7e76a", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "4dc7e2f7b53a6eedd5e58e35b51c2032dca4a522bbd561e1b2dac2be30e7e76a", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "4dc7e2f7b53a6eedd5e58e35b51c2032dca4a522bbd561e1b2dac2be30e7e76a", kill_on_drop: false }`
[INFO] [stdout] 4dc7e2f7b53a6eedd5e58e35b51c2032dca4a522bbd561e1b2dac2be30e7e76a
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+1.95.0" "build" "--frozen" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] 00412bba9c50c28c8dc9333e12b8f36f832834b0170e9db5f890adcd6f183b0f
[INFO] running `Command { std: "docker" "start" "-a" "00412bba9c50c28c8dc9333e12b8f36f832834b0170e9db5f890adcd6f183b0f", kill_on_drop: false }`
[INFO] [stderr]    Compiling syn v2.0.117
[INFO] [stderr]    Compiling libloading v0.9.0
[INFO] [stderr]    Compiling num-traits v0.2.19
[INFO] [stderr]    Compiling tracing-attributes v0.1.31
[INFO] [stderr]    Compiling thiserror-impl v2.0.18
[INFO] [stderr]    Compiling tracing v0.1.44
[INFO] [stderr]    Compiling thiserror v2.0.18
[INFO] [stderr]    Compiling oxicuda-driver v0.1.4
[INFO] [stderr]    Compiling oxicuda-ptx v0.1.4
[INFO] [stderr]    Compiling oxicuda-memory v0.1.4
[INFO] [stderr]    Compiling oxicuda-launch v0.1.4
[INFO] [stderr]    Compiling oxicuda-train v0.1.4 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `dev` profile [unoptimized + debuginfo] target(s) in 20.90s
[INFO] running `Command { std: "docker" "inspect" "00412bba9c50c28c8dc9333e12b8f36f832834b0170e9db5f890adcd6f183b0f", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "00412bba9c50c28c8dc9333e12b8f36f832834b0170e9db5f890adcd6f183b0f", kill_on_drop: false }`
[INFO] [stdout] 00412bba9c50c28c8dc9333e12b8f36f832834b0170e9db5f890adcd6f183b0f
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+1.95.0" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] 87c8c32d5ff78c6522bcc704f9ae8d5c990809c76e79adf36b6d40f339015909
[INFO] running `Command { std: "docker" "start" "-a" "87c8c32d5ff78c6522bcc704f9ae8d5c990809c76e79adf36b6d40f339015909", kill_on_drop: false }`
[INFO] [stderr]    Compiling zerocopy v0.8.48
[INFO] [stderr]    Compiling zerocopy-derive v0.8.48
[INFO] [stderr]    Compiling cc v1.2.60
[INFO] [stderr]    Compiling serde_derive v1.0.228
[INFO] [stderr]    Compiling libc v0.2.184
[INFO] [stderr]    Compiling memchr v2.8.0
[INFO] [stderr]    Compiling plotters-backend v0.3.7
[INFO] [stderr]    Compiling ciborium-io v0.2.2
[INFO] [stderr]    Compiling clap_builder v4.6.0
[INFO] [stderr]    Compiling regex-automata v0.4.14
[INFO] [stderr]    Compiling plotters-svg v0.3.7
[INFO] [stderr]    Compiling itertools v0.13.0
[INFO] [stderr]    Compiling serde_json v1.0.149
[INFO] [stderr]    Compiling cast v0.3.0
[INFO] [stderr]    Compiling page_size v0.6.0
[INFO] [stderr]    Compiling plotters v0.3.7
[INFO] [stderr]    Compiling alloca v0.4.0
[INFO] [stderr]    Compiling oorandom v11.1.5
[INFO] [stderr]    Compiling anes v0.1.6
[INFO] [stderr]    Compiling regex v1.12.3
[INFO] [stderr]    Compiling clap v4.6.0
[INFO] [stderr]    Compiling criterion-plot v0.8.2
[INFO] [stderr]    Compiling approx v0.5.1
[INFO] [stderr]    Compiling serde v1.0.228
[INFO] [stderr]    Compiling tinytemplate v1.2.1
[INFO] [stderr]    Compiling half v2.7.1
[INFO] [stderr]    Compiling ciborium-ll v0.2.2
[INFO] [stderr]    Compiling ciborium v0.2.2
[INFO] [stderr]    Compiling criterion v0.8.2
[INFO] [stderr]    Compiling oxicuda-train v0.1.4 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 40.69s
[INFO] running `Command { std: "docker" "inspect" "87c8c32d5ff78c6522bcc704f9ae8d5c990809c76e79adf36b6d40f339015909", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "87c8c32d5ff78c6522bcc704f9ae8d5c990809c76e79adf36b6d40f339015909", kill_on_drop: false }`
[INFO] [stdout] 87c8c32d5ff78c6522bcc704f9ae8d5c990809c76e79adf36b6d40f339015909
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+1.95.0" "test" "--frozen", kill_on_drop: false }`
[INFO] [stdout] 3e7725dd4224fa1a6c65c572adcc66ec3a64494f100049991d7070fc2a165092
[INFO] running `Command { std: "docker" "start" "-a" "3e7725dd4224fa1a6c65c572adcc66ec3a64494f100049991d7070fc2a165092", kill_on_drop: false }`
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 0.13s
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/oxicuda_train-7bac5478fef07ba7)
[INFO] [stdout] 
[INFO] [stdout] running 167 tests
[INFO] [stdout] test amp::tests::double_unscale_returns_error ... ok
[INFO] [stdout] test amp::tests::has_overflow_finite ... ok
[INFO] [stdout] test amp::tests::has_overflow_nan ... ok
[INFO] [stdout] test amp::tests::overflow_check_ptx_sm80 ... ok
[INFO] [stdout] test amp::tests::amp_full_loop_converges ... ok
[INFO] [stdout] test amp::tests::scale_loss ... ok
[INFO] [stdout] test amp::tests::state_summary_reflects_current_state ... ok
[INFO] [stdout] test amp::tests::has_overflow_inf ... ok
[INFO] [stdout] test amp::tests::step_taken_on_finite_gradients ... ok
[INFO] [stdout] test amp::tests::reset_restores_initial_state ... ok
[INFO] [stdout] test amp::tests::unscale_detects_inf ... ok
[INFO] [stdout] test amp::tests::unscale_detects_nan ... ok
[INFO] [stdout] test amp::tests::unscale_divides_by_scale ... ok
[INFO] [stdout] test amp::tests::update_decreases_scale_on_overflow ... ok
[INFO] [stdout] test amp::tests::unscale_ptx_sm75 ... ok
[INFO] [stdout] test amp::tests::update_grows_scale_after_interval ... ok
[INFO] [stdout] test amp::tests::step_skipped_on_overflow ... ok
[INFO] [stdout] test checkpoint::tests::clear_resets_all ... ok
[INFO] [stdout] test amp::tests::update_min_scale_error ... ok
[INFO] [stdout] test checkpoint::tests::get_shaped_buffer ... ok
[INFO] [stdout] test amp::tests::step_without_unscale_returns_error ... ok
[INFO] [stdout] test checkpoint::tests::none_policy_never_checkpoints ... ok
[INFO] [stdout] test checkpoint::tests::offload_policy_always_checkpoints ... ok
[INFO] [stdout] test checkpoint::tests::recompute_fn_runs ... ok
[INFO] [stdout] test checkpoint::tests::save_and_retrieve ... ok
[INFO] [stdout] test checkpoint::tests::selective_policy ... ok
[INFO] [stdout] test checkpoint::tests::uniform_policy_skips_odd_layers ... ok
[INFO] [stdout] test checkpoint::tests::stats_are_correct ... ok
[INFO] [stdout] test checkpoint::tests::max_segments_overflow_error ... ok
[INFO] [stdout] test checkpoint::tests::segment_order_preserved ... ok
[INFO] [stdout] test ema::tests::ema_lags_behind_changing_params ... ok
[INFO] [stdout] test ema::tests::ema_tracks_constant_sequence ... ok
[INFO] [stdout] test ema::tests::copy_to_uninitialised_error ... ok
[INFO] [stdout] test ema::tests::num_params_matches ... ok
[INFO] [stdout] test ema::tests::restore_from_works ... ok
[INFO] [stdout] test ema::tests::second_update_blends ... ok
[INFO] [stdout] test ema::tests::update_count_mismatch_error ... ok
[INFO] [stdout] test ema::tests::update_empty_params_error ... ok
[INFO] [stdout] test ema::tests::update_shape_mismatch_error ... ok
[INFO] [stdout] test gpu_optimizer::adagrad::tests::adagrad_accumulator_grows_monotonically ... ok
[INFO] [stdout] test gpu_optimizer::adagrad::tests::adagrad_converges ... ok
[INFO] [stdout] test gpu_optimizer::adagrad::tests::adagrad_empty_error ... ok
[INFO] [stdout] test ema::tests::first_update_copies_params ... ok
[INFO] [stdout] test ema::tests::fixed_decay_unchanged ... ok
[INFO] [stdout] test gpu_optimizer::adagrad::tests::adagrad_name ... ok
[INFO] [stdout] test gpu_optimizer::adagrad::tests::adagrad_reduces_param ... ok
[INFO] [stdout] test gpu_optimizer::adagrad::tests::adagrad_set_lr ... ok
[INFO] [stdout] test gpu_optimizer::adagrad::tests::adagrad_step_count ... ok
[INFO] [stdout] test gpu_optimizer::adam::tests::adam_amsgrad_smoke ... ok
[INFO] [stdout] test ema::tests::layer_decay_override ... ok
[INFO] [stdout] test ema::tests::total_elements_counts_all ... ok
[INFO] [stdout] test ema::tests::copy_to_overwrites_params ... ok
[INFO] [stdout] test ema::tests::bias_corrected_decay_early_steps ... ok
[INFO] [stdout] test gpu_optimizer::adam::tests::adam_name ... ok
[INFO] [stdout] test gpu_optimizer::adam::tests::adam_negative_gradient_increases_param ... ok
[INFO] [stdout] test gpu_optimizer::adam::tests::adam_no_gradient_error ... ok
[INFO] [stdout] test gpu_optimizer::adam::tests::adam_single_step_decreases_param ... ok
[INFO] [stdout] test gpu_optimizer::adam::tests::adam_skips_no_grad_params ... ok
[INFO] [stdout] test gpu_optimizer::adam::tests::adam_multiple_steps_converge_to_zero_gradient ... ok
[INFO] [stdout] test gpu_optimizer::adam::tests::adam_set_lr ... ok
[INFO] [stdout] test gpu_optimizer::adamw::tests::adamw_name ... ok
[INFO] [stdout] test gpu_optimizer::adamw::tests::adamw_step_decreases_param ... ok
[INFO] [stdout] test gpu_optimizer::adam::tests::adam_weight_decay_effect ... ok
[INFO] [stdout] test gpu_optimizer::adamw::tests::adamw_decoupled_wd_vs_adam_l2 ... ok
[INFO] [stdout] test gpu_optimizer::adamw::tests::adamw_weight_decay_reduces_large_params ... ok
[INFO] [stdout] test gpu_optimizer::came::tests::came_matrix_step_works ... ok
[INFO] [stdout] test gpu_optimizer::came::tests::came_name ... ok
[INFO] [stdout] test gpu_optimizer::came::tests::came_flat_step_decreases_param ... ok
[INFO] [stdout] test gpu_optimizer::came::tests::came_converges_flat ... ok
[INFO] [stdout] test gpu_optimizer::adagrad::tests::adagrad_no_grad_error ... ok
[INFO] [stdout] test gpu_optimizer::lion::tests::lion_positive_grad_decreases_param ... ok
[INFO] [stdout] test gpu_optimizer::adamw::tests::adamw_converges_to_zero ... ok
[INFO] [stdout] test gpu_optimizer::lion::tests::lion_update_magnitude_equals_lr ... ok
[INFO] [stdout] test gpu_optimizer::came::tests::came_matrix_memory_is_factored ... ok
[INFO] [stdout] test gpu_optimizer::lion::tests::lion_zero_gradient_no_change_no_wd ... ok
[INFO] [stdout] test gpu_optimizer::muon::tests::muon_name ... ok
[INFO] [stdout] test gpu_optimizer::muon::tests::muon_positive_grad_decreases_param ... ok
[INFO] [stdout] test gpu_optimizer::muon::tests::muon_without_ns_is_nesterov ... ok
[INFO] [stdout] test gpu_optimizer::muon::tests::newton_schulz_preserves_direction ... ok
[INFO] [stdout] test gpu_optimizer::muon::tests::muon_convergence ... ok
[INFO] [stdout] test gpu_optimizer::muon::tests::muon_matrix_with_ns ... ok
[INFO] [stdout] test gpu_optimizer::radam::tests::radam_converges ... ok
[INFO] [stdout] test gpu_optimizer::radam::tests::radam_empty_error ... ok
[INFO] [stdout] test gpu_optimizer::radam::tests::radam_name ... ok
[INFO] [stdout] test gpu_optimizer::radam::tests::radam_no_grad_error ... ok
[INFO] [stdout] test gpu_optimizer::radam::tests::radam_reduces_param_early ... ok
[INFO] [stdout] test gpu_optimizer::radam::tests::radam_scalars_sgd_warmup ... ok
[INFO] [stdout] test gpu_optimizer::radam::tests::radam_scalars_tractable ... ok
[INFO] [stdout] test gpu_optimizer::radam::tests::radam_sgd_warmup_regime ... ok
[INFO] [stdout] test gpu_optimizer::radam::tests::radam_step_count ... ok
[INFO] [stdout] test gpu_optimizer::radam::tests::radam_weight_decay_reduces_more ... ok
[INFO] [stdout] test gpu_optimizer::rmsprop::tests::rmsprop_empty_error ... ok
[INFO] [stdout] test gpu_optimizer::rmsprop::tests::rmsprop_name ... ok
[INFO] [stdout] test gpu_optimizer::rmsprop::tests::rmsprop_no_grad_error ... ok
[INFO] [stdout] test gpu_optimizer::rmsprop::tests::rmsprop_reduces_param ... ok
[INFO] [stdout] test gpu_optimizer::lion::tests::lion_convergence ... ok
[INFO] [stdout] test gpu_optimizer::lion::tests::lion_name ... ok
[INFO] [stdout] test gpu_optimizer::lion::tests::lion_negative_grad_increases_param ... ok
[INFO] [stdout] test gpu_optimizer::lion::tests::lion_only_one_moment_buffer ... ok
[INFO] [stdout] test gpu_optimizer::tests::param_tensor_len ... ok
[INFO] [stdout] test gpu_optimizer::rmsprop::tests::rmsprop_with_momentum_converges ... ok
[INFO] [stdout] test gpu_optimizer::tests::adam_bias_corrections_step1 ... ok
[INFO] [stdout] test gpu_optimizer::tests::param_tensor_accumulate_grad ... ok
[INFO] [stdout] test gpu_optimizer::tests::param_tensor_set_grad_shape_mismatch ... ok
[INFO] [stdout] test gpu_optimizer::tests::param_tensor_zero_grad ... ok
[INFO] [stdout] test grad_accum::tests::accumulate_and_finalise_averages ... ok
[INFO] [stdout] test grad_accum::tests::accumulate_multi_param ... ok
[INFO] [stdout] test grad_accum::tests::accumulate_sum_mode ... ok
[INFO] [stdout] test grad_accum::tests::finalise_before_ready_returns_error ... ok
[INFO] [stdout] test grad_accum::tests::k_and_current_step ... ok
[INFO] [stdout] test grad_clip::tests::clip_grad_norm_function ... ok
[INFO] [stdout] test grad_accum::tests::reset_clears_state ... ok
[INFO] [stdout] test grad_clip::tests::clip_grad_value_function ... ok
[INFO] [stdout] test grad_clip::tests::global_norm_clip_empty_error ... ok
[INFO] [stdout] test grad_clip::tests::global_norm_clip_multi_param ... ok
[INFO] [stdout] test grad_clip::tests::global_norm_clip_no_op_when_below_max ... ok
[INFO] [stdout] test grad_clip::tests::global_norm_clip_scales_down_large_grads ... ok
[INFO] [stdout] test grad_clip::tests::per_layer_clip_clips_independently ... ok
[INFO] [stdout] test grad_clip::tests::value_clip_hard_clamps ... ok
[INFO] [stdout] test handle::tests::handle_debug ... ignored, requires GPU
[INFO] [stdout] test handle::tests::handle_from_parts_round_trip ... ignored, requires GPU
[INFO] [stdout] test gpu_optimizer::rmsprop::tests::rmsprop_centred_converges ... ok
[INFO] [stdout] test gpu_optimizer::rmsprop::tests::rmsprop_converges ... ok
[INFO] [stdout] test gpu_optimizer::rmsprop::tests::rmsprop_step_count ... ok
[INFO] [stdout] test lr_scheduler::tests::cosine_annealing_reaches_min_at_t_max ... ok
[INFO] [stdout] test gpu_optimizer::tests::param_tensor_set_grad_ok ... ok
[INFO] [stdout] test lr_scheduler::tests::cosine_annealing_starts_at_max ... ok
[INFO] [stdout] test lr_scheduler::tests::cyclic_lr_oscillates ... ok
[INFO] [stdout] test lr_scheduler::tests::one_cycle_warmup_then_decay ... ok
[INFO] [stdout] test lr_scheduler::tests::constant_lr_stays_constant ... ok
[INFO] [stdout] test lr_scheduler::tests::polynomial_decay_linear ... ok
[INFO] [stdout] test lr_scheduler::tests::linear_warmup_reaches_base_lr ... ok
[INFO] [stdout] test lr_scheduler::tests::exponential_lr_decays_every_step ... ok
[INFO] [stdout] test lr_scheduler::tests::linear_warmup_starts_near_zero ... ok
[INFO] [stdout] test lr_scheduler::tests::multi_step_lr_decays_at_milestones ... ok
[INFO] [stdout] test lr_scheduler::tests::all_schedulers_implement_trait ... ok
[INFO] [stdout] test lr_scheduler::tests::reduce_on_plateau_reduces_after_patience ... ok
[INFO] [stdout] test lr_scheduler::tests::reduce_on_plateau_resets_on_improvement ... ok
[INFO] [stdout] test lr_scheduler::tests::step_lr_decays_at_boundary ... ok
[INFO] [stdout] test lr_scheduler::tests::warmup_cosine_warmup_phase ... ok
[INFO] [stdout] test lr_scheduler::tests::warmup_cosine_annealing_phase ... ok
[INFO] [stdout] test ptx_kernels::tests::adamw_ptx_has_weight_decay ... ok
[INFO] [stdout] test ptx_kernels::tests::adam_ptx_smoke_sm80 ... ok
[INFO] [stdout] test ptx_kernels::tests::add_inplace_ptx_smoke ... ok
[INFO] [stdout] test ptx_kernels::tests::came_row_factor_ptx_smoke ... ok
[INFO] [stdout] test ptx_kernels::tests::came_col_factor_ptx_smoke ... ok
[INFO] [stdout] test ptx_kernels::tests::norm_sq_ptx_has_warp_reduce ... ok
[INFO] [stdout] test ptx_kernels::tests::all_kernels_have_grid_stride ... ok
[INFO] [stdout] test tests::e2e_came_with_cyclic_lr ... ok
[INFO] [stdout] test tests::e2e_checkpoint_and_recompute ... ok
[INFO] [stdout] test ptx_kernels::tests::scale_inplace_ptx_smoke ... ok
[INFO] [stdout] test ptx_kernels::tests::adam_ptx_smoke_sm90 ... ok
[INFO] [stdout] test ptx_kernels::tests::lion_ptx_sign_trick ... ok
[INFO] [stdout] test tests::e2e_training_loop_adamw_with_scheduler ... ok
[INFO] [stdout] test tests::e2e_zero_stage2_with_adamw ... ok
[INFO] [stdout] test gpu_optimizer::adam::tests::adam_empty_params_error ... ok
[INFO] [stdout] test ptx_kernels::tests::sgd_ptx_has_nesterov ... ok
[INFO] [stdout] test zero::tests::memory_estimate_stage1 ... ok
[INFO] [stdout] test zero::tests::shard_range_evenly_divided ... ok
[INFO] [stdout] test zero::tests::zero_stage3_updates_only_owned_shard ... ok
[INFO] [stdout] test zero::tests::zero_stage2_zeros_non_owned_grads_rank0 ... ok
[INFO] [stdout] test zero::tests::zero_stage1_matches_base ... ok
[INFO] [stdout] test tests::e2e_gradient_accumulation_with_lion ... ok
[INFO] [stdout] test tests::e2e_muon_with_reduce_on_plateau ... ok
[INFO] [stdout] test zero::tests::shard_range_remainder ... ok
[INFO] [stdout] test zero::tests::zero_name ... ok
[INFO] [stdout] test zero::tests::invalid_rank_panics ... ok
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 165 passed; 0 failed; 2 ignored; 0 measured; 0 filtered out; finished in 0.08s
[INFO] [stdout] 
[INFO] [stderr]    Doc-tests oxicuda_train
[INFO] [stdout] 
[INFO] [stdout] running 8 tests
[INFO] [stdout] test src/lib.rs - (line 22) - compile ... ok
[INFO] [stdout] test src/lib.rs - checkpoint (line 111) ... ok
[INFO] [stdout] test src/lib.rs - grad_accum (line 92) ... ok
[INFO] [stdout] test src/lib.rs - ema (line 126) ... ok
[INFO] [stdout] test src/lib.rs - zero (line 118) ... ok
[INFO] [stdout] test src/handle.rs - handle::TrainHandle (line 21) - compile ... ok
[INFO] [stdout] test src/lib.rs - amp (line 124) ... ok
[INFO] [stdout] test src/lib.rs - grad_clip (line 94) ... ok
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 8 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s
[INFO] [stdout] 
[INFO] [stdout] all doctests ran in 0.76s; merged doctests compilation took 0.74s
[INFO] running `Command { std: "docker" "inspect" "3e7725dd4224fa1a6c65c572adcc66ec3a64494f100049991d7070fc2a165092", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "3e7725dd4224fa1a6c65c572adcc66ec3a64494f100049991d7070fc2a165092", kill_on_drop: false }`
[INFO] [stdout] 3e7725dd4224fa1a6c65c572adcc66ec3a64494f100049991d7070fc2a165092
