[INFO] cloning repository https://github.com/errorhugo/gpt-from-scratch-in-rust [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/errorhugo/gpt-from-scratch-in-rust" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ferrorhugo%2Fgpt-from-scratch-in-rust", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ferrorhugo%2Fgpt-from-scratch-in-rust'... [INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }` [INFO] [stdout] 7b10a2d92926a305a1b996a1e5a713262c435c0c [INFO] testing errorhugo/gpt-from-scratch-in-rust against master#ad85bc524b1ad696e42061ad8338d382dffbdbe5 for pr-146237 [INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ferrorhugo%2Fgpt-from-scratch-in-rust" "/workspace/builds/worker-3-tc1/source", kill_on_drop: false }` [INFO] [stderr] Cloning into '/workspace/builds/worker-3-tc1/source'... [INFO] [stderr] done. [INFO] started tweaking git repo https://github.com/errorhugo/gpt-from-scratch-in-rust [INFO] finished tweaking git repo https://github.com/errorhugo/gpt-from-scratch-in-rust [INFO] tweaked toml for git repo https://github.com/errorhugo/gpt-from-scratch-in-rust written to /workspace/builds/worker-3-tc1/source/Cargo.toml [INFO] validating manifest of git repo https://github.com/errorhugo/gpt-from-scratch-in-rust on toolchain ad85bc524b1ad696e42061ad8338d382dffbdbe5 [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+ad85bc524b1ad696e42061ad8338d382dffbdbe5" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }` [INFO] crate git repo https://github.com/errorhugo/gpt-from-scratch-in-rust already has a lockfile, it will not be regenerated [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+ad85bc524b1ad696e42061ad8338d382dffbdbe5" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] [stderr] Updating crates.io index [INFO] [stderr] Downloading crates ... [INFO] [stderr] Downloaded config-derive v0.15.0 [INFO] [stderr] Downloaded monostate-impl v0.1.14 [INFO] [stderr] Downloaded monostate v0.1.14 [INFO] [stderr] Downloaded float-ord v0.3.2 [INFO] [stderr] Downloaded rayon-cond v0.4.0 [INFO] [stderr] Downloaded yeslogic-fontconfig-sys v6.0.0 [INFO] [stderr] Downloaded nichi v0.5.1 [INFO] [stderr] Downloaded bincode_derive v2.0.1 [INFO] [stderr] Downloaded macro_rules_attribute v0.2.2 [INFO] [stderr] Downloaded gemm-f16 v0.18.2 [INFO] [stderr] Downloaded safetensors v0.4.5 [INFO] [stderr] Downloaded dyn-stack v0.13.0 [INFO] [stderr] Downloaded sysctl v0.6.0 [INFO] [stderr] Downloaded virtue v0.0.18 [INFO] [stderr] Downloaded gemm-common v0.18.2 [INFO] [stderr] Downloaded pulp v0.18.22 [INFO] [stderr] Downloaded candle-nn v0.9.1 [INFO] [stderr] Downloaded gemm-c32 v0.18.2 [INFO] [stderr] Downloaded candle-core v0.9.1 [INFO] [stderr] Downloaded pulp v0.21.5 [INFO] [stderr] Downloaded onig_sys v69.9.1 [INFO] [stderr] Downloaded rand_distr v0.5.1 [INFO] [stderr] Downloaded libredox v0.1.6 [INFO] [stderr] Downloaded pathfinder_simd v0.5.5 [INFO] [stderr] Downloaded font-kit v0.14.3 [INFO] [stderr] Downloaded readable v0.16.0 [INFO] [stderr] Downloaded compact_str v0.9.0 [INFO] [stderr] Downloaded ug v0.4.0 [INFO] [stderr] Downloaded hf-hub v0.4.3 [INFO] [stderr] Downloaded gemm-f64 v0.18.2 [INFO] [stderr] Downloaded plotters-bitmap v0.3.7 [INFO] [stderr] Downloaded enum-as-inner v0.6.1 [INFO] [stderr] Downloaded dary_heap v0.3.7 [INFO] [stderr] Downloaded dwrote v0.11.3 [INFO] [stderr] Downloaded macro_rules_attribute-proc_macro v0.2.2 [INFO] [stderr] Downloaded unty v0.0.4 [INFO] [stderr] Downloaded gemm-f32 v0.18.2 [INFO] [stderr] Downloaded onig v6.5.1 [INFO] [stderr] Downloaded freetype-sys v0.20.1 [INFO] [stderr] Downloaded zip v1.1.4 [INFO] [stderr] Downloaded gemm-c64 v0.18.2 [INFO] [stderr] Downloaded gemm v0.18.2 [INFO] [stderr] Downloaded twelf v0.15.0 [INFO] [stderr] Downloaded tokenizers v0.21.2 [INFO] [stderr] Downloaded bincode v2.0.1 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:7ad1b28ee6f5f7f699f6cf7015098d6ccdd96d6f2d78dd06228f5b4c9faf309c" "/opt/rustwide/cargo-home/bin/cargo" "+ad85bc524b1ad696e42061ad8338d382dffbdbe5" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }` [INFO] [stdout] 0742a9ed5d59dcbd83c3b451754c96a062ea958bde4d14b5f842dd54eee1a472 [INFO] running `Command { std: "docker" "start" "-a" "0742a9ed5d59dcbd83c3b451754c96a062ea958bde4d14b5f842dd54eee1a472", kill_on_drop: false }` [INFO] running `Command { std: "docker" "inspect" "0742a9ed5d59dcbd83c3b451754c96a062ea958bde4d14b5f842dd54eee1a472", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "0742a9ed5d59dcbd83c3b451754c96a062ea958bde4d14b5f842dd54eee1a472", kill_on_drop: false }` [INFO] [stdout] 0742a9ed5d59dcbd83c3b451754c96a062ea958bde4d14b5f842dd54eee1a472 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:7ad1b28ee6f5f7f699f6cf7015098d6ccdd96d6f2d78dd06228f5b4c9faf309c" "/opt/rustwide/cargo-home/bin/cargo" "+ad85bc524b1ad696e42061ad8338d382dffbdbe5" "build" "--frozen" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] 8c2395c2ff5bb472fb87e51be4da10f32d1c1c3735a9b6ad65aac810e893f017 [INFO] running `Command { std: "docker" "start" "-a" "8c2395c2ff5bb472fb87e51be4da10f32d1c1c3735a9b6ad65aac810e893f017", kill_on_drop: false }` [INFO] [stderr] Compiling libc v0.2.174 [INFO] [stderr] Compiling bytemuck_derive v1.10.0 [INFO] [stderr] Compiling num-traits v0.2.19 [INFO] [stderr] Compiling cc v1.2.30 [INFO] [stderr] Compiling seq-macro v0.3.6 [INFO] [stderr] Compiling displaydoc v0.2.5 [INFO] [stderr] Compiling memchr v2.7.5 [INFO] [stderr] Compiling yoke v0.8.0 [INFO] [stderr] Compiling bitflags v2.9.1 [INFO] [stderr] Compiling zerovec v0.11.2 [INFO] [stderr] Compiling crc32fast v1.5.0 [INFO] [stderr] Compiling pulp v0.21.5 [INFO] [stderr] Compiling raw-cpuid v11.5.0 [INFO] [stderr] Compiling serde_json v1.0.141 [INFO] [stderr] Compiling zerotrie v0.2.2 [INFO] [stderr] Compiling getrandom v0.3.3 [INFO] [stderr] Compiling miniz_oxide v0.8.9 [INFO] [stderr] Compiling rand_core v0.9.3 [INFO] [stderr] Compiling bytemuck v1.23.1 [INFO] [stderr] Compiling smallvec v1.15.1 [INFO] [stderr] Compiling rand_chacha v0.9.0 [INFO] [stderr] Compiling num-complex v0.4.6 [INFO] [stderr] Compiling dyn-stack v0.13.0 [INFO] [stderr] Compiling rand v0.9.2 [INFO] [stderr] Compiling tinystr v0.8.1 [INFO] [stderr] Compiling potential_utf v0.1.2 [INFO] [stderr] Compiling dyn-stack v0.10.0 [INFO] [stderr] Compiling icu_locale_core v2.0.0 [INFO] [stderr] Compiling pulp v0.18.22 [INFO] [stderr] Compiling icu_collections v2.0.0 [INFO] [stderr] Compiling ring v0.17.14 [INFO] [stderr] Compiling dirs-sys v0.5.0 [INFO] [stderr] Compiling rand_distr v0.5.1 [INFO] [stderr] Compiling icu_provider v2.0.0 [INFO] [stderr] Compiling flate2 v1.1.2 [INFO] [stderr] Compiling rustls-pki-types v1.12.0 [INFO] [stderr] Compiling num-integer v0.1.46 [INFO] [stderr] Compiling libloading v0.8.8 [INFO] [stderr] Compiling half v2.6.0 [INFO] [stderr] Compiling winnow v0.7.12 [INFO] [stderr] Compiling darling_core v0.20.11 [INFO] [stderr] Compiling icu_properties v2.0.1 [INFO] [stderr] Compiling icu_normalizer v2.0.0 [INFO] [stderr] Compiling dirs v6.0.0 [INFO] [stderr] Compiling gemm-common v0.17.1 [INFO] [stderr] Compiling getrandom v0.2.16 [INFO] [stderr] Compiling portable-atomic v1.11.1 [INFO] [stderr] Compiling pathfinder_simd v0.5.5 [INFO] [stderr] Compiling num-bigint v0.4.6 [INFO] [stderr] Compiling freetype-sys v0.20.1 [INFO] [stderr] Compiling aho-corasick v1.1.3 [INFO] [stderr] Compiling yeslogic-fontconfig-sys v6.0.0 [INFO] [stderr] Compiling rustls v0.23.29 [INFO] [stderr] Compiling gemm-common v0.18.2 [INFO] [stderr] Compiling anstyle-parse v0.2.7 [INFO] [stderr] Compiling idna_adapter v1.2.1 [INFO] [stderr] Compiling idna v1.0.3 [INFO] [stderr] Compiling gemm-f32 v0.18.2 [INFO] [stderr] Compiling gemm-c32 v0.18.2 [INFO] [stderr] Compiling regex-automata v0.4.9 [INFO] [stderr] Compiling toml_edit v0.22.27 [INFO] [stderr] Compiling rustls-webpki v0.103.4 [INFO] [stderr] Compiling darling_macro v0.20.11 [INFO] [stderr] Compiling darling v0.20.11 [INFO] [stderr] Compiling num-rational v0.4.2 [INFO] [stderr] Compiling gemm-f16 v0.18.2 [INFO] [stderr] Compiling gemm-c64 v0.18.2 [INFO] [stderr] Compiling gemm-f64 v0.18.2 [INFO] [stderr] Compiling proc-macro-crate v3.3.0 [INFO] [stderr] Compiling gemm-f32 v0.17.1 [INFO] [stderr] Compiling num-iter v0.1.45 [INFO] [stderr] Compiling webpki-roots v1.0.2 [INFO] [stderr] Compiling onig_sys v69.9.1 [INFO] [stderr] Compiling castaway v0.2.4 [INFO] [stderr] Compiling yoke-derive v0.7.5 [INFO] [stderr] Compiling indexmap v1.9.3 [INFO] [stderr] Compiling tracing-attributes v0.1.30 [INFO] [stderr] Compiling num_enum_derive v0.7.4 [INFO] [stderr] Compiling zip v1.1.4 [INFO] [stderr] Compiling anstyle v1.0.11 [INFO] [stderr] Compiling colorchoice v1.0.4 [INFO] [stderr] Compiling anstyle-query v1.1.3 [INFO] [stderr] Compiling virtue v0.0.18 [INFO] [stderr] Compiling anstream v0.6.19 [INFO] [stderr] Compiling num_enum v0.7.4 [INFO] [stderr] Compiling tracing v0.1.41 [INFO] [stderr] Compiling yoke v0.7.5 [INFO] [stderr] Compiling gemm v0.18.2 [INFO] [stderr] Compiling gemm-f16 v0.17.1 [INFO] [stderr] Compiling png v0.17.16 [INFO] [stderr] Compiling webpki-roots v0.26.11 [INFO] [stderr] Compiling num v0.4.3 [INFO] [stderr] Compiling regex v1.11.1 [INFO] [stderr] Compiling bincode_derive v2.0.1 [INFO] [stderr] Compiling url v2.5.4 [INFO] [stderr] Compiling derive_builder_core v0.20.2 [INFO] [stderr] Compiling gemm-f64 v0.17.1 [INFO] [stderr] Compiling gemm-c64 v0.17.1 [INFO] [stderr] Compiling gemm-c32 v0.17.1 [INFO] [stderr] Compiling console v0.15.11 [INFO] [stderr] Compiling dlib v0.5.2 [INFO] [stderr] Compiling safetensors v0.4.5 [INFO] [stderr] Compiling esaxx-rs v0.1.10 [INFO] [stderr] Compiling num_cpus v1.17.0 [INFO] [stderr] Compiling memmap2 v0.9.7 [INFO] [stderr] Compiling socks v0.3.4 [INFO] [stderr] Compiling ahash v0.8.12 [INFO] [stderr] Compiling unty v0.0.4 [INFO] [stderr] Compiling hashbrown v0.12.3 [INFO] [stderr] Compiling font-kit v0.14.3 [INFO] [stderr] Compiling plotters-backend v0.3.7 [INFO] [stderr] Compiling jpeg-decoder v0.3.2 [INFO] [stderr] Compiling clap_lex v0.7.5 [INFO] [stderr] Compiling weezl v0.1.10 [INFO] [stderr] Compiling same-file v1.0.6 [INFO] [stderr] Compiling nom v7.1.3 [INFO] [stderr] Compiling walkdir v2.5.0 [INFO] [stderr] Compiling image v0.24.9 [INFO] [stderr] Compiling gif v0.12.0 [INFO] [stderr] Compiling indicatif v0.17.11 [INFO] [stderr] Compiling clap_builder v4.5.41 [INFO] [stderr] Compiling ureq v2.12.1 [INFO] [stderr] Compiling derive_more v0.99.20 [INFO] [stderr] Compiling chrono v0.4.41 [INFO] [stderr] Compiling clap_derive v4.5.41 [INFO] [stderr] Compiling bincode v2.0.1 [INFO] [stderr] Compiling gemm v0.17.1 [INFO] [stderr] Compiling ug v0.4.0 [INFO] [stderr] Compiling derive_builder_macro v0.20.2 [INFO] [stderr] Compiling pathfinder_geometry v0.5.1 [INFO] [stderr] Compiling syn v1.0.109 [INFO] [stderr] Compiling itertools v0.14.0 [INFO] [stderr] Compiling monostate-impl v0.1.14 [INFO] [stderr] Compiling float-ord v0.3.2 [INFO] [stderr] Compiling macro_rules_attribute-proc_macro v0.2.2 [INFO] [stderr] Compiling spm_precompiled v0.1.4 [INFO] [stderr] Compiling macro_rules_attribute v0.2.2 [INFO] [stderr] Compiling candle-core v0.9.1 [INFO] [stderr] Compiling monostate v0.1.14 [INFO] [stderr] Compiling hf-hub v0.4.3 [INFO] [stderr] Compiling nichi v0.5.1 [INFO] [stderr] Compiling clap v4.5.41 [INFO] [stderr] Compiling derive_builder v0.20.2 [INFO] [stderr] Compiling serde_yaml v0.8.26 [INFO] [stderr] Compiling plotters-bitmap v0.3.7 [INFO] [stderr] Compiling onig v6.5.1 [INFO] [stderr] Compiling plotters-svg v0.3.7 [INFO] [stderr] Compiling rayon-cond v0.4.0 [INFO] [stderr] Compiling compact_str v0.7.1 [INFO] [stderr] Compiling compact_str v0.9.0 [INFO] [stderr] Compiling console v0.16.0 [INFO] [stderr] Compiling shellexpand v3.1.1 [INFO] [stderr] Compiling unicode-normalization-alignments v0.1.12 [INFO] [stderr] Compiling dary_heap v0.3.7 [INFO] [stderr] Compiling envy v0.4.2 [INFO] [stderr] Compiling ttf-parser v0.20.0 [INFO] [stderr] Compiling indicatif v0.18.0 [INFO] [stderr] Compiling readable v0.16.0 [INFO] [stderr] Compiling tokenizers v0.21.2 [INFO] [stderr] Compiling config-derive v0.15.0 [INFO] [stderr] Compiling plotters v0.3.7 [INFO] [stderr] Compiling twelf v0.15.0 [INFO] [stderr] Compiling candle-nn v0.9.1 [INFO] [stderr] Compiling mgpt v0.1.0 (/opt/rustwide/workdir) [INFO] [stderr] Finished `dev` profile [unoptimized + debuginfo] target(s) in 4m 00s [INFO] running `Command { std: "docker" "inspect" "8c2395c2ff5bb472fb87e51be4da10f32d1c1c3735a9b6ad65aac810e893f017", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "8c2395c2ff5bb472fb87e51be4da10f32d1c1c3735a9b6ad65aac810e893f017", kill_on_drop: false }` [INFO] [stdout] 8c2395c2ff5bb472fb87e51be4da10f32d1c1c3735a9b6ad65aac810e893f017 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:7ad1b28ee6f5f7f699f6cf7015098d6ccdd96d6f2d78dd06228f5b4c9faf309c" "/opt/rustwide/cargo-home/bin/cargo" "+ad85bc524b1ad696e42061ad8338d382dffbdbe5" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] 97677cc842117ff51916555aab877cc3fa4f794ee45ac556bd888ad5dd476c60 [INFO] running `Command { std: "docker" "start" "-a" "97677cc842117ff51916555aab877cc3fa4f794ee45ac556bd888ad5dd476c60", kill_on_drop: false }` [INFO] [stderr] Compiling mgpt v0.1.0 (/opt/rustwide/workdir) [INFO] [stderr] Finished `test` profile [unoptimized + debuginfo] target(s) in 10.34s [INFO] running `Command { std: "docker" "inspect" "97677cc842117ff51916555aab877cc3fa4f794ee45ac556bd888ad5dd476c60", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "97677cc842117ff51916555aab877cc3fa4f794ee45ac556bd888ad5dd476c60", kill_on_drop: false }` [INFO] [stdout] 97677cc842117ff51916555aab877cc3fa4f794ee45ac556bd888ad5dd476c60 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-3-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:7ad1b28ee6f5f7f699f6cf7015098d6ccdd96d6f2d78dd06228f5b4c9faf309c" "/opt/rustwide/cargo-home/bin/cargo" "+ad85bc524b1ad696e42061ad8338d382dffbdbe5" "test" "--frozen", kill_on_drop: false }` [INFO] [stdout] 176eacf4d45ad62f264aa04349e86c69eb5607de28715bc8076aceb1e7bbed5b [INFO] running `Command { std: "docker" "start" "-a" "176eacf4d45ad62f264aa04349e86c69eb5607de28715bc8076aceb1e7bbed5b", kill_on_drop: false }` [INFO] [stderr] Finished `test` profile [unoptimized + debuginfo] target(s) in 0.34s [INFO] [stderr] Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/mgpt-38dd3fe9065cd5dc) [INFO] [stdout] [INFO] [stdout] running 38 tests [INFO] [stdout] test datasets::pretrain_dataset_loader::tests::test_decode_line_valid_and_invalid_json ... ok [INFO] [stdout] test config::tests::test_load_config ... ok [INFO] [stdout] test llm::feedforward::tests::test_mlp_forward ... ok [INFO] [stdout] test datasets::pretrain_dataset_loader::tests::test_make_result_valid_input ... FAILED [INFO] [stdout] test datasets::pretrain_dataset_loader::tests::test_load_tokenizer ... FAILED [INFO] [stdout] test llm::inference::tests::test_batch_inputs_with_padding ... FAILED [INFO] [stdout] test datasets::pretrain_dataset_loader::tests::test_process_line_padding_and_truncation ... FAILED [INFO] [stdout] test datasets::pretrain_dataset_loader::tests::test_iter_overall_loader ... FAILED [INFO] [stdout] test datasets::pretrain_dataset_loader::tests::test_make_result_empty_input ... FAILED [INFO] [stdout] test llm::inference::tests::test_model_params ... FAILED [INFO] [stdout] test llm::mgpt::tests::test_llm_generate_for_batch_inputs ... FAILED [INFO] [stdout] test llm::inference::tests::test_inference ... FAILED [INFO] [stdout] test llm::mgpt::tests::test_llm_generate_with_tokenizer ... FAILED [INFO] [stdout] test llm::multi_head_attention::tests::test_multihead_attn_forward ... ok [INFO] [stdout] test llm::multi_head_attention::tests::test_tril ... ok [INFO] [stdout] test llm::nn_utils::tests::test_multinomial_sample_batch_2_vocab_4_n3 ... ok [INFO] [stdout] test llm::nn_utils::tests::test_masked_cross_entropy_basic ... ok [INFO] [stdout] test llm::nn_utils::tests::test_multinomial_sample_invalid_input ... ok [INFO] [stdout] test llm::nn_utils::tests::test_multinomial_sample_zero_prob ... ok [INFO] [stdout] test llm::positional_encoding::tests::test_sinusoidial_position_encoding ... ok [INFO] [stdout] test llm::nn_utils::tests::test_draw_loss_series ... FAILED [INFO] [stdout] test llm::scheduler::tests::test_lr_scheduler_cosine ... ok [INFO] [stdout] test llm::pretrain::tests::test_pretrain_llm ... FAILED [INFO] [stdout] test datasets::pretrain_dataset_loader::tests::test_prtrain_dataset_loader ... FAILED [INFO] [stdout] test processor::logits_processor_list::tests::test_logits_processor_list ... ok [INFO] [stdout] test processor::repetition_penalty_processor::tests::test_repetition_penalty_processor ... ok [INFO] [stdout] test processor::temperature_processor::tests::test_temperature_processor ... ok [INFO] [stdout] test llm::mgpt::tests::test_llm_forward ... ok [INFO] [stdout] test processor::topk_processor::tests::test_top_k_processor ... ok [INFO] [stdout] test processor::topp_processor::tests::test_top_p_processor ... ok [INFO] [stdout] test processor::utils::tests::test_normalized_random_vec ... ok [INFO] [stdout] test llm::mgpt::tests::test_llm_generate_with_1batch ... ok [INFO] [stdout] test llm::transformer_block::tests::test_transformer_block ... ok [INFO] [stdout] test llm::mgpt::tests::test_llm_generate_with_generation_config ... ok [INFO] [stdout] test llm::mgpt::tests::test_llm_generate ... ok [INFO] [stdout] test tokenizer::bert_tokenizer::tests::test_custom_tokenizer ... FAILED [INFO] [stdout] test llm::scheduler::tests::test_plot_schedule ... ok [INFO] [stdout] test llm::pretrain::tests::test_pretrain_llm_with_manual_data ... ok [INFO] [stdout] [INFO] [stdout] failures: [INFO] [stdout] [INFO] [stdout] ---- datasets::pretrain_dataset_loader::tests::test_make_result_valid_input stdout ---- [INFO] [stdout] start to load tokenizer from: ./out/tokenizer/tokenizer.json [INFO] [stdout] [INFO] [stdout] thread 'datasets::pretrain_dataset_loader::tests::test_make_result_valid_input' (22) panicked at src/datasets/pretrain_dataset_loader.rs:343:74: [INFO] [stdout] called `Result::unwrap()` on an `Err` value: TokenizersError(Os { code: 2, kind: NotFound, message: "No such file or directory" }) [INFO] [stdout] stack backtrace: [INFO] [stdout] 0: 0x5bac1736e6c2 - std::backtrace_rs::backtrace::libunwind::trace::h52580dd202462214 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9 [INFO] [stdout] 1: 0x5bac1736e6c2 - std::backtrace_rs::backtrace::trace_unsynchronized::hc969519abce0f52b [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14 [INFO] [stdout] 2: 0x5bac1736e6c2 - std::sys::backtrace::_print_fmt::hfd5825900b6e0030 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/backtrace.rs:66:9 [INFO] [stdout] 3: 0x5bac1736e6c2 - ::fmt::h427144ad75cfb218 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/backtrace.rs:39:26 [INFO] [stdout] 4: 0x5bac1738258f - core::fmt::rt::Argument::fmt::hd5ccc9cf97cea7f7 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/fmt/rt.rs:173:76 [INFO] [stdout] 5: 0x5bac1738258f - core::fmt::write::h593aaf5adf0f5dae [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/fmt/mod.rs:1468:25 [INFO] [stdout] 6: 0x5bac17338c81 - std::io::default_write_fmt::h305b5a0727055346 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/io/mod.rs:639:11 [INFO] [stdout] 7: 0x5bac17338c81 - std::io::Write::write_fmt::h76f14a8a88733dc5 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/io/mod.rs:1954:13 [INFO] [stdout] 8: 0x5bac173452d2 - std::sys::backtrace::BacktraceLock::print::h3953113552dca3ca [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/backtrace.rs:42:9 [INFO] [stdout] 9: 0x5bac1734acff - std::panicking::default_hook::{{closure}}::h486b96ad75eafbb8 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:301:27 [INFO] [stdout] 10: 0x5bac1734ab91 - std::panicking::default_hook::h99456317c5a1a20c [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:325:9 [INFO] [stdout] 11: 0x5bac15c065ee - as core::ops::function::Fn>::call::h441e4551014e4cf8 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/alloc/src/boxed.rs:1999:9 [INFO] [stdout] 12: 0x5bac15c065ee - test::test_main_with_exit_callback::{{closure}}::hdbca54e17f1a00e4 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:145:21 [INFO] [stdout] 13: 0x5bac1734b46f - as core::ops::function::Fn>::call::h1e57b72c4e1d3045 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/alloc/src/boxed.rs:1999:9 [INFO] [stdout] 14: 0x5bac1734b46f - std::panicking::panic_with_hook::h67ab0df20212e4ea [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:842:13 [INFO] [stdout] 15: 0x5bac1734b21a - std::panicking::panic_handler::{{closure}}::hc9e4a933ae92e208 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:707:13 [INFO] [stdout] 16: 0x5bac17345419 - std::sys::backtrace::__rust_end_short_backtrace::hbfa72df9b68c2d19 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/backtrace.rs:174:18 [INFO] [stdout] 17: 0x5bac1732bd4d - __rustc[8cce077e14951490]::rust_begin_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:698:5 [INFO] [stdout] 18: 0x5bac1738cd50 - core::panicking::panic_fmt::h49931053d20abf41 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/panicking.rs:75:14 [INFO] [stdout] 19: 0x5bac1738bda6 - core::result::unwrap_failed::h7f5a2d4cf85d933f [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/result.rs:1854:5 [INFO] [stdout] 20: 0x5bac15ad47fa - core::result::Result::unwrap::h24c213f02c8e0c4a [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/result.rs:1225:23 [INFO] [stdout] 21: 0x5bac15ad47fa - mgpt::datasets::pretrain_dataset_loader::tests::test_make_result_valid_input::h16eb19d065e47da3 [INFO] [stdout] at /opt/rustwide/workdir/src/datasets/pretrain_dataset_loader.rs:343:74 [INFO] [stdout] 22: 0x5bac15ad5377 - mgpt::datasets::pretrain_dataset_loader::tests::test_make_result_valid_input::{{closure}}::hb0ea955d48c86275 [INFO] [stdout] at /opt/rustwide/workdir/src/datasets/pretrain_dataset_loader.rs:342:38 [INFO] [stdout] 23: 0x5bac15b44fb6 - core::ops::function::FnOnce::call_once::h79ef103cda6a5ed4 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 24: 0x5bac15c063ab - core::ops::function::FnOnce::call_once::h5d9016d521f5aee4 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 25: 0x5bac15c063ab - test::__rust_begin_short_backtrace::h123fcee610330442 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:663:18 [INFO] [stdout] 26: 0x5bac15c1be95 - test::run_test_in_process::{{closure}}::h0442efda2e6359b2 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:686:74 [INFO] [stdout] 27: 0x5bac15c1be95 - as core::ops::function::FnOnce<()>>::call_once::hfe3528c8dd09682c [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 28: 0x5bac15c1be95 - std::panicking::catch_unwind::do_call::hb1659f7844fe8531 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:590:40 [INFO] [stdout] 29: 0x5bac15c1be95 - std::panicking::catch_unwind::hdc1f4be0019e72ad [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:553:19 [INFO] [stdout] 30: 0x5bac15c1be95 - std::panic::catch_unwind::hd6d7ccfa4513e770 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panic.rs:359:14 [INFO] [stdout] 31: 0x5bac15c1be95 - test::run_test_in_process::h6bbb839ed0802366 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:686:27 [INFO] [stdout] 32: 0x5bac15c1be95 - test::run_test::{{closure}}::he4fad7398c8acc11 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:607:43 [INFO] [stdout] 33: 0x5bac15bf2804 - test::run_test::{{closure}}::h41975797e198d26c [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:637:41 [INFO] [stdout] 34: 0x5bac15bf2804 - std::sys::backtrace::__rust_begin_short_backtrace::hfb46c397857336f1 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 35: 0x5bac15bf61aa - std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}}::hddf826a64f532bea [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 36: 0x5bac15bf61aa - as core::ops::function::FnOnce<()>>::call_once::hc3518c3eab91aeb3 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 37: 0x5bac15bf61aa - std::panicking::catch_unwind::do_call::h7bf3ad6dc012415a [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:590:40 [INFO] [stdout] 38: 0x5bac15bf61aa - std::panicking::catch_unwind::h8b88f0375c767e36 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:553:19 [INFO] [stdout] 39: 0x5bac15bf61aa - std::panic::catch_unwind::h66cb5d61a90f7bc5 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panic.rs:359:14 [INFO] [stdout] 40: 0x5bac15bf61aa - std::thread::Builder::spawn_unchecked_::{{closure}}::h65bc9d15fb966bbd [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 41: 0x5bac15bf61aa - core::ops::function::FnOnce::call_once{{vtable.shim}}::he8d2c9a8796342e5 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 42: 0x5bac1733f23f - as core::ops::function::FnOnce>::call_once::hef12b47e5c033835 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 43: 0x5bac1733f23f - std::sys::pal::unix::thread::Thread::new::thread_start::h135087e7c97657bc [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 44: 0x75e761df6aa4 - [INFO] [stdout] 45: 0x75e761e83a34 - clone [INFO] [stdout] 46: 0x0 - [INFO] [stdout] [INFO] [stdout] ---- datasets::pretrain_dataset_loader::tests::test_load_tokenizer stdout ---- [INFO] [stdout] start to load tokenizer from: ./out/tokenizer/tokenizer.json [INFO] [stdout] Error: No such file or directory (os error 2) [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error:: for anyhow::Error>::from [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.98/src/backtrace.rs:27:14 [INFO] [stdout] 1: as core::ops::try_trait::FromResidual>>::from_residual [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/result.rs:2176:27 [INFO] [stdout] 2: mgpt::datasets::pretrain_dataset_loader::tests::test_load_tokenizer [INFO] [stdout] at ./src/datasets/pretrain_dataset_loader.rs:239:25 [INFO] [stdout] 3: mgpt::datasets::pretrain_dataset_loader::tests::test_load_tokenizer::{{closure}} [INFO] [stdout] at ./src/datasets/pretrain_dataset_loader.rs:238:33 [INFO] [stdout] 4: core::ops::function::FnOnce::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 5: core::ops::function::FnOnce::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 6: test::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:663:18 [INFO] [stdout] 7: test::run_test_in_process::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:686:74 [INFO] [stdout] 8: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 9: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:590:40 [INFO] [stdout] 10: std::panicking::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:553:19 [INFO] [stdout] 11: std::panic::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panic.rs:359:14 [INFO] [stdout] 12: test::run_test_in_process [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:686:27 [INFO] [stdout] 13: test::run_test::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:607:43 [INFO] [stdout] 14: test::run_test::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:637:41 [INFO] [stdout] 15: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 16: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 17: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 18: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:590:40 [INFO] [stdout] 19: std::panicking::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:553:19 [INFO] [stdout] 20: std::panic::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panic.rs:359:14 [INFO] [stdout] 21: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 22: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 23: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 24: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 25: [INFO] [stdout] 26: clone [INFO] [stdout] [INFO] [stdout] ---- llm::inference::tests::test_batch_inputs_with_padding stdout ---- [INFO] [stdout] start to load tokenizer from: ./out/tokenizer/tokenizer.json [INFO] [stdout] Error: No such file or directory (os error 2) [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error:: for anyhow::Error>::from [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.98/src/backtrace.rs:27:14 [INFO] [stdout] 1: as core::ops::try_trait::FromResidual>>::from_residual [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/result.rs:2176:27 [INFO] [stdout] 2: mgpt::llm::inference::tests::test_batch_inputs_with_padding [INFO] [stdout] at ./src/llm/inference.rs:142:25 [INFO] [stdout] 3: mgpt::llm::inference::tests::test_batch_inputs_with_padding::{{closure}} [INFO] [stdout] at ./src/llm/inference.rs:141:44 [INFO] [stdout] 4: core::ops::function::FnOnce::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 5: core::ops::function::FnOnce::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 6: test::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:663:18 [INFO] [stdout] 7: test::run_test_in_process::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:686:74 [INFO] [stdout] 8: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 9: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:590:40 [INFO] [stdout] 10: std::panicking::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:553:19 [INFO] [stdout] 11: std::panic::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panic.rs:359:14 [INFO] [stdout] 12: test::run_test_in_process [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:686:27 [INFO] [stdout] 13: test::run_test::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:607:43 [INFO] [stdout] 14: test::run_test::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:637:41 [INFO] [stdout] 15: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 16: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 17: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 18: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:590:40 [INFO] [stdout] 19: std::panicking::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:553:19 [INFO] [stdout] 20: std::panic::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panic.rs:359:14 [INFO] [stdout] 21: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 22: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 23: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 24: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 25: [INFO] [stdout] 26: clone [INFO] [stdout] [INFO] [stdout] ---- datasets::pretrain_dataset_loader::tests::test_process_line_padding_and_truncation stdout ---- [INFO] [stdout] start to load tokenizer from: ./out/tokenizer/tokenizer.json [INFO] [stdout] Error: No such file or directory (os error 2) [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error:: for anyhow::Error>::from [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.98/src/backtrace.rs:27:14 [INFO] [stdout] 1: as core::ops::try_trait::FromResidual>>::from_residual [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/result.rs:2176:27 [INFO] [stdout] 2: mgpt::datasets::pretrain_dataset_loader::tests::test_process_line_padding_and_truncation [INFO] [stdout] at ./src/datasets/pretrain_dataset_loader.rs:270:25 [INFO] [stdout] 3: mgpt::datasets::pretrain_dataset_loader::tests::test_process_line_padding_and_truncation::{{closure}} [INFO] [stdout] at ./src/datasets/pretrain_dataset_loader.rs:269:54 [INFO] [stdout] 4: core::ops::function::FnOnce::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 5: core::ops::function::FnOnce::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 6: test::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:663:18 [INFO] [stdout] 7: test::run_test_in_process::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:686:74 [INFO] [stdout] 8: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 9: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:590:40 [INFO] [stdout] 10: std::panicking::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:553:19 [INFO] [stdout] 11: std::panic::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panic.rs:359:14 [INFO] [stdout] 12: test::run_test_in_process [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:686:27 [INFO] [stdout] 13: test::run_test::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:607:43 [INFO] [stdout] 14: test::run_test::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:637:41 [INFO] [stdout] 15: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 16: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 17: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 18: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:590:40 [INFO] [stdout] 19: std::panicking::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:553:19 [INFO] [stdout] 20: std::panic::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panic.rs:359:14 [INFO] [stdout] 21: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 22: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 23: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 24: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 25: [INFO] [stdout] 26: clone [INFO] [stdout] [INFO] [stdout] ---- datasets::pretrain_dataset_loader::tests::test_iter_overall_loader stdout ---- [INFO] [stdout] start to load tokenizer from: ./out/tokenizer/tokenizer.json [INFO] [stdout] Error: No such file or directory (os error 2) [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error:: for anyhow::Error>::from [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.98/src/backtrace.rs:27:14 [INFO] [stdout] 1: as core::ops::try_trait::FromResidual>>::from_residual [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/result.rs:2176:27 [INFO] [stdout] 2: mgpt::datasets::pretrain_dataset_loader::tests::test_iter_overall_loader [INFO] [stdout] at ./src/datasets/pretrain_dataset_loader.rs:367:25 [INFO] [stdout] 3: mgpt::datasets::pretrain_dataset_loader::tests::test_iter_overall_loader::{{closure}} [INFO] [stdout] at ./src/datasets/pretrain_dataset_loader.rs:366:38 [INFO] [stdout] 4: core::ops::function::FnOnce::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 5: core::ops::function::FnOnce::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 6: test::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:663:18 [INFO] [stdout] 7: test::run_test_in_process::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:686:74 [INFO] [stdout] 8: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 9: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:590:40 [INFO] [stdout] 10: std::panicking::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:553:19 [INFO] [stdout] 11: std::panic::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panic.rs:359:14 [INFO] [stdout] 12: test::run_test_in_process [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:686:27 [INFO] [stdout] 13: test::run_test::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:607:43 [INFO] [stdout] 14: test::run_test::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:637:41 [INFO] [stdout] 15: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 16: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 17: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 18: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:590:40 [INFO] [stdout] 19: std::panicking::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:553:19 [INFO] [stdout] 20: std::panic::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panic.rs:359:14 [INFO] [stdout] 21: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 22: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 23: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 24: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 25: [INFO] [stdout] 26: clone [INFO] [stdout] [INFO] [stdout] ---- datasets::pretrain_dataset_loader::tests::test_make_result_empty_input stdout ---- [INFO] [stdout] start to load tokenizer from: ./out/tokenizer/tokenizer.json [INFO] [stdout] [INFO] [stdout] thread 'datasets::pretrain_dataset_loader::tests::test_make_result_empty_input' (21) panicked at src/datasets/pretrain_dataset_loader.rs:323:74: [INFO] [stdout] called `Result::unwrap()` on an `Err` value: TokenizersError(Os { code: 2, kind: NotFound, message: "No such file or directory" }) [INFO] [stdout] stack backtrace: [INFO] [stdout] 0: 0x5bac1736e6c2 - std::backtrace_rs::backtrace::libunwind::trace::h52580dd202462214 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9 [INFO] [stdout] 1: 0x5bac1736e6c2 - std::backtrace_rs::backtrace::trace_unsynchronized::hc969519abce0f52b [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14 [INFO] [stdout] 2: 0x5bac1736e6c2 - std::sys::backtrace::_print_fmt::hfd5825900b6e0030 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/backtrace.rs:66:9 [INFO] [stdout] 3: 0x5bac1736e6c2 - ::fmt::h427144ad75cfb218 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/backtrace.rs:39:26 [INFO] [stdout] 4: 0x5bac1738258f - core::fmt::rt::Argument::fmt::hd5ccc9cf97cea7f7 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/fmt/rt.rs:173:76 [INFO] [stdout] 5: 0x5bac1738258f - core::fmt::write::h593aaf5adf0f5dae [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/fmt/mod.rs:1468:25 [INFO] [stdout] 6: 0x5bac17338c81 - std::io::default_write_fmt::h305b5a0727055346 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/io/mod.rs:639:11 [INFO] [stdout] 7: 0x5bac17338c81 - std::io::Write::write_fmt::h76f14a8a88733dc5 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/io/mod.rs:1954:13 [INFO] [stdout] 8: 0x5bac173452d2 - std::sys::backtrace::BacktraceLock::print::h3953113552dca3ca [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/backtrace.rs:42:9 [INFO] [stdout] 9: 0x5bac1734acff - std::panicking::default_hook::{{closure}}::h486b96ad75eafbb8 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:301:27 [INFO] [stdout] 10: 0x5bac1734ab91 - std::panicking::default_hook::h99456317c5a1a20c [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:325:9 [INFO] [stdout] 11: 0x5bac15c065ee - as core::ops::function::Fn>::call::h441e4551014e4cf8 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/alloc/src/boxed.rs:1999:9 [INFO] [stdout] 12: 0x5bac15c065ee - test::test_main_with_exit_callback::{{closure}}::hdbca54e17f1a00e4 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:145:21 [INFO] [stdout] 13: 0x5bac1734b46f - as core::ops::function::Fn>::call::h1e57b72c4e1d3045 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/alloc/src/boxed.rs:1999:9 [INFO] [stdout] 14: 0x5bac1734b46f - std::panicking::panic_with_hook::h67ab0df20212e4ea [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:842:13 [INFO] [stdout] 15: 0x5bac1734b21a - std::panicking::panic_handler::{{closure}}::hc9e4a933ae92e208 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:707:13 [INFO] [stdout] 16: 0x5bac17345419 - std::sys::backtrace::__rust_end_short_backtrace::hbfa72df9b68c2d19 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/backtrace.rs:174:18 [INFO] [stdout] 17: 0x5bac1732bd4d - __rustc[8cce077e14951490]::rust_begin_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:698:5 [INFO] [stdout] 18: 0x5bac1738cd50 - core::panicking::panic_fmt::h49931053d20abf41 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/panicking.rs:75:14 [INFO] [stdout] 19: 0x5bac1738bda6 - core::result::unwrap_failed::h7f5a2d4cf85d933f [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/result.rs:1854:5 [INFO] [stdout] 20: 0x5bac15ad4322 - core::result::Result::unwrap::h24c213f02c8e0c4a [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/result.rs:1225:23 [INFO] [stdout] 21: 0x5bac15ad4322 - mgpt::datasets::pretrain_dataset_loader::tests::test_make_result_empty_input::h27b6fb53786c015c [INFO] [stdout] at /opt/rustwide/workdir/src/datasets/pretrain_dataset_loader.rs:323:74 [INFO] [stdout] 22: 0x5bac15ad4707 - mgpt::datasets::pretrain_dataset_loader::tests::test_make_result_empty_input::{{closure}}::h3ed93251ef7af34f [INFO] [stdout] at /opt/rustwide/workdir/src/datasets/pretrain_dataset_loader.rs:322:38 [INFO] [stdout] 23: 0x5bac15b44d06 - core::ops::function::FnOnce::call_once::h40e99950c95a0344 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 24: 0x5bac15c063ab - core::ops::function::FnOnce::call_once::h5d9016d521f5aee4 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 25: 0x5bac15c063ab - test::__rust_begin_short_backtrace::h123fcee610330442 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:663:18 [INFO] [stdout] 26: 0x5bac15c1be95 - test::run_test_in_process::{{closure}}::h0442efda2e6359b2 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:686:74 [INFO] [stdout] 27: 0x5bac15c1be95 - as core::ops::function::FnOnce<()>>::call_once::hfe3528c8dd09682c [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 28: 0x5bac15c1be95 - std::panicking::catch_unwind::do_call::hb1659f7844fe8531 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:590:40 [INFO] [stdout] 29: 0x5bac15c1be95 - std::panicking::catch_unwind::hdc1f4be0019e72ad [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:553:19 [INFO] [stdout] 30: 0x5bac15c1be95 - std::panic::catch_unwind::hd6d7ccfa4513e770 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panic.rs:359:14 [INFO] [stdout] 31: 0x5bac15c1be95 - test::run_test_in_process::h6bbb839ed0802366 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:686:27 [INFO] [stdout] 32: 0x5bac15c1be95 - test::run_test::{{closure}}::he4fad7398c8acc11 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:607:43 [INFO] [stdout] 33: 0x5bac15bf2804 - test::run_test::{{closure}}::h41975797e198d26c [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:637:41 [INFO] [stdout] 34: 0x5bac15bf2804 - std::sys::backtrace::__rust_begin_short_backtrace::hfb46c397857336f1 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 35: 0x5bac15bf61aa - std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}}::hddf826a64f532bea [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 36: 0x5bac15bf61aa - as core::ops::function::FnOnce<()>>::call_once::hc3518c3eab91aeb3 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 37: 0x5bac15bf61aa - std::panicking::catch_unwind::do_call::h7bf3ad6dc012415a [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:590:40 [INFO] [stdout] 38: 0x5bac15bf61aa - std::panicking::catch_unwind::h8b88f0375c767e36 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:553:19 [INFO] [stdout] 39: 0x5bac15bf61aa - std::panic::catch_unwind::h66cb5d61a90f7bc5 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panic.rs:359:14 [INFO] [stdout] 40: 0x5bac15bf61aa - std::thread::Builder::spawn_unchecked_::{{closure}}::h65bc9d15fb966bbd [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 41: 0x5bac15bf61aa - core::ops::function::FnOnce::call_once{{vtable.shim}}::he8d2c9a8796342e5 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 42: 0x5bac1733f23f - as core::ops::function::FnOnce>::call_once::hef12b47e5c033835 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 43: 0x5bac1733f23f - std::sys::pal::unix::thread::Thread::new::thread_start::h135087e7c97657bc [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 44: 0x75e761df6aa4 - [INFO] [stdout] 45: 0x75e761e83a34 - clone [INFO] [stdout] 46: 0x0 - [INFO] [stdout] [INFO] [stdout] ---- llm::inference::tests::test_model_params stdout ---- [INFO] [stdout] Error: No such file or directory (os error 2) [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error:: for anyhow::Error>::from [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.98/src/backtrace.rs:27:14 [INFO] [stdout] 1: as core::ops::try_trait::FromResidual>>::from_residual [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/result.rs:2176:27 [INFO] [stdout] 2: mgpt::llm::inference::tests::test_model_params [INFO] [stdout] at ./src/llm/inference.rs:170:13 [INFO] [stdout] 3: mgpt::llm::inference::tests::test_model_params::{{closure}} [INFO] [stdout] at ./src/llm/inference.rs:168:31 [INFO] [stdout] 4: core::ops::function::FnOnce::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 5: core::ops::function::FnOnce::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 6: test::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:663:18 [INFO] [stdout] 7: test::run_test_in_process::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:686:74 [INFO] [stdout] 8: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 9: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:590:40 [INFO] [stdout] 10: std::panicking::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:553:19 [INFO] [stdout] 11: std::panic::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panic.rs:359:14 [INFO] [stdout] 12: test::run_test_in_process [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:686:27 [INFO] [stdout] 13: test::run_test::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:607:43 [INFO] [stdout] 14: test::run_test::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:637:41 [INFO] [stdout] 15: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 16: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 17: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 18: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:590:40 [INFO] [stdout] 19: std::panicking::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:553:19 [INFO] [stdout] 20: std::panic::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panic.rs:359:14 [INFO] [stdout] 21: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 22: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 23: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 24: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 25: [INFO] [stdout] 26: clone [INFO] [stdout] [INFO] [stdout] ---- llm::mgpt::tests::test_llm_generate_for_batch_inputs stdout ---- [INFO] [stdout] start to load tokenizer from: ./out/tokenizer/tokenizer.json [INFO] [stdout] Error: No such file or directory (os error 2) [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error:: for anyhow::Error>::from [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.98/src/backtrace.rs:27:14 [INFO] [stdout] 1: as core::ops::try_trait::FromResidual>>::from_residual [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/result.rs:2176:27 [INFO] [stdout] 2: mgpt::llm::mgpt::tests::test_llm_generate_for_batch_inputs [INFO] [stdout] at ./src/llm/mgpt.rs:464:25 [INFO] [stdout] 3: mgpt::llm::mgpt::tests::test_llm_generate_for_batch_inputs::{{closure}} [INFO] [stdout] at ./src/llm/mgpt.rs:457:48 [INFO] [stdout] 4: core::ops::function::FnOnce::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 5: core::ops::function::FnOnce::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 6: test::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:663:18 [INFO] [stdout] 7: test::run_test_in_process::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:686:74 [INFO] [stdout] 8: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 9: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:590:40 [INFO] [stdout] 10: std::panicking::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:553:19 [INFO] [stdout] 11: std::panic::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panic.rs:359:14 [INFO] [stdout] 12: test::run_test_in_process [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:686:27 [INFO] [stdout] 13: test::run_test::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:607:43 [INFO] [stdout] 14: test::run_test::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:637:41 [INFO] [stdout] 15: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 16: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 17: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 18: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:590:40 [INFO] [stdout] 19: std::panicking::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:553:19 [INFO] [stdout] 20: std::panic::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panic.rs:359:14 [INFO] [stdout] 21: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 22: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 23: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 24: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 25: [INFO] [stdout] 26: clone [INFO] [stdout] [INFO] [stdout] ---- llm::inference::tests::test_inference stdout ---- [INFO] [stdout] start to load tokenizer from: ./out/tokenizer/tokenizer.json [INFO] [stdout] Error: No such file or directory (os error 2) [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error:: for anyhow::Error>::from [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.98/src/backtrace.rs:27:14 [INFO] [stdout] 1: as core::ops::try_trait::FromResidual>>::from_residual [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/result.rs:2176:27 [INFO] [stdout] 2: mgpt::llm::inference::tests::test_inference [INFO] [stdout] at ./src/llm/inference.rs:105:25 [INFO] [stdout] 3: mgpt::llm::inference::tests::test_inference::{{closure}} [INFO] [stdout] at ./src/llm/inference.rs:103:28 [INFO] [stdout] 4: core::ops::function::FnOnce::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 5: core::ops::function::FnOnce::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 6: test::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:663:18 [INFO] [stdout] 7: test::run_test_in_process::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:686:74 [INFO] [stdout] 8: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 9: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:590:40 [INFO] [stdout] 10: std::panicking::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:553:19 [INFO] [stdout] 11: std::panic::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panic.rs:359:14 [INFO] [stdout] 12: test::run_test_in_process [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:686:27 [INFO] [stdout] 13: test::run_test::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:607:43 [INFO] [stdout] 14: test::run_test::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:637:41 [INFO] [stdout] 15: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 16: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 17: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 18: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:590:40 [INFO] [stdout] 19: std::panicking::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:553:19 [INFO] [stdout] 20: std::panic::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panic.rs:359:14 [INFO] [stdout] 21: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 22: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 23: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 24: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 25: [INFO] [stdout] 26: clone [INFO] [stdout] [INFO] [stdout] ---- llm::mgpt::tests::test_llm_generate_with_tokenizer stdout ---- [INFO] [stdout] start to load tokenizer from: ./out/tokenizer/tokenizer.json [INFO] [stdout] Error: No such file or directory (os error 2) [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error:: for anyhow::Error>::from [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.98/src/backtrace.rs:27:14 [INFO] [stdout] 1: as core::ops::try_trait::FromResidual>>::from_residual [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/result.rs:2176:27 [INFO] [stdout] 2: mgpt::llm::mgpt::tests::test_llm_generate_with_tokenizer [INFO] [stdout] at ./src/llm/mgpt.rs:423:25 [INFO] [stdout] 3: mgpt::llm::mgpt::tests::test_llm_generate_with_tokenizer::{{closure}} [INFO] [stdout] at ./src/llm/mgpt.rs:416:46 [INFO] [stdout] 4: core::ops::function::FnOnce::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 5: core::ops::function::FnOnce::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 6: test::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:663:18 [INFO] [stdout] 7: test::run_test_in_process::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:686:74 [INFO] [stdout] 8: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 9: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:590:40 [INFO] [stdout] 10: std::panicking::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:553:19 [INFO] [stdout] 11: std::panic::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panic.rs:359:14 [INFO] [stdout] 12: test::run_test_in_process [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:686:27 [INFO] [stdout] 13: test::run_test::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:607:43 [INFO] [stdout] 14: test::run_test::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:637:41 [INFO] [stdout] 15: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 16: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 17: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 18: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:590:40 [INFO] [stdout] 19: std::panicking::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:553:19 [INFO] [stdout] 20: std::panic::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panic.rs:359:14 [INFO] [stdout] 21: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 22: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 23: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 24: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 25: [INFO] [stdout] 26: clone [INFO] [stdout] [INFO] [stdout] ---- llm::nn_utils::tests::test_draw_loss_series stdout ---- [INFO] [stdout] Error: Read-only file system (os error 30) [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error:: for anyhow::Error>::from [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.98/src/backtrace.rs:27:14 [INFO] [stdout] 1: as core::ops::try_trait::FromResidual>>::from_residual [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/result.rs:2176:27 [INFO] [stdout] 2: mgpt::llm::nn_utils::tests::test_draw_loss_series [INFO] [stdout] at ./src/llm/nn_utils.rs:297:9 [INFO] [stdout] 3: mgpt::llm::nn_utils::tests::test_draw_loss_series::{{closure}} [INFO] [stdout] at ./src/llm/nn_utils.rs:286:35 [INFO] [stdout] 4: core::ops::function::FnOnce::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 5: core::ops::function::FnOnce::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 6: test::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:663:18 [INFO] [stdout] 7: test::run_test_in_process::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:686:74 [INFO] [stdout] 8: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 9: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:590:40 [INFO] [stdout] 10: std::panicking::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:553:19 [INFO] [stdout] 11: std::panic::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panic.rs:359:14 [INFO] [stdout] 12: test::run_test_in_process [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:686:27 [INFO] [stdout] 13: test::run_test::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:607:43 [INFO] [stdout] 14: test::run_test::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:637:41 [INFO] [stdout] 15: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 16: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 17: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 18: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:590:40 [INFO] [stdout] 19: std::panicking::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:553:19 [INFO] [stdout] 20: std::panic::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panic.rs:359:14 [INFO] [stdout] 21: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 22: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 23: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 24: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 25: [INFO] [stdout] 26: clone [INFO] [stdout] [INFO] [stdout] ---- llm::pretrain::tests::test_pretrain_llm stdout ---- [INFO] [stdout] [INFO] [stdout] thread 'llm::pretrain::tests::test_pretrain_llm' (43) panicked at src/llm/pretrain.rs:303:80: [INFO] [stdout] called `Result::unwrap()` on an `Err` value: Os { code: 2, kind: NotFound, message: "No such file or directory" } [INFO] [stdout] stack backtrace: [INFO] [stdout] 0: 0x5bac1736e6c2 - std::backtrace_rs::backtrace::libunwind::trace::h52580dd202462214 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9 [INFO] [stdout] 1: 0x5bac1736e6c2 - std::backtrace_rs::backtrace::trace_unsynchronized::hc969519abce0f52b [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14 [INFO] [stdout] 2: 0x5bac1736e6c2 - std::sys::backtrace::_print_fmt::hfd5825900b6e0030 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/backtrace.rs:66:9 [INFO] [stdout] 3: 0x5bac1736e6c2 - ::fmt::h427144ad75cfb218 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/backtrace.rs:39:26 [INFO] [stdout] 4: 0x5bac1738258f - core::fmt::rt::Argument::fmt::hd5ccc9cf97cea7f7 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/fmt/rt.rs:173:76 [INFO] [stdout] 5: 0x5bac1738258f - core::fmt::write::h593aaf5adf0f5dae [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/fmt/mod.rs:1468:25 [INFO] [stdout] 6: 0x5bac17338c81 - std::io::default_write_fmt::h305b5a0727055346 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/io/mod.rs:639:11 [INFO] [stdout] 7: 0x5bac17338c81 - std::io::Write::write_fmt::h76f14a8a88733dc5 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/io/mod.rs:1954:13 [INFO] [stdout] 8: 0x5bac173452d2 - std::sys::backtrace::BacktraceLock::print::h3953113552dca3ca [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/backtrace.rs:42:9 [INFO] [stdout] 9: 0x5bac1734acff - std::panicking::default_hook::{{closure}}::h486b96ad75eafbb8 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:301:27 [INFO] [stdout] 10: 0x5bac1734ab91 - std::panicking::default_hook::h99456317c5a1a20c [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:325:9 [INFO] [stdout] 11: 0x5bac15c065ee - as core::ops::function::Fn>::call::h441e4551014e4cf8 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/alloc/src/boxed.rs:1999:9 [INFO] [stdout] 12: 0x5bac15c065ee - test::test_main_with_exit_callback::{{closure}}::hdbca54e17f1a00e4 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:145:21 [INFO] [stdout] 13: 0x5bac1734b46f - as core::ops::function::Fn>::call::h1e57b72c4e1d3045 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/alloc/src/boxed.rs:1999:9 [INFO] [stdout] 14: 0x5bac1734b46f - std::panicking::panic_with_hook::h67ab0df20212e4ea [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:842:13 [INFO] [stdout] 15: 0x5bac1734b21a - std::panicking::panic_handler::{{closure}}::hc9e4a933ae92e208 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:707:13 [INFO] [stdout] 16: 0x5bac17345419 - std::sys::backtrace::__rust_end_short_backtrace::hbfa72df9b68c2d19 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/backtrace.rs:174:18 [INFO] [stdout] 17: 0x5bac1732bd4d - __rustc[8cce077e14951490]::rust_begin_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:698:5 [INFO] [stdout] 18: 0x5bac1738cd50 - core::panicking::panic_fmt::h49931053d20abf41 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/panicking.rs:75:14 [INFO] [stdout] 19: 0x5bac1738bda6 - core::result::unwrap_failed::h7f5a2d4cf85d933f [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/result.rs:1854:5 [INFO] [stdout] 20: 0x5bac15ae74a4 - core::result::Result::unwrap::h2d40d1101fa9bba5 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/result.rs:1225:23 [INFO] [stdout] 21: 0x5bac15ae74a4 - mgpt::llm::pretrain::tests::test_pretrain_llm::hdb0f29207dec351d [INFO] [stdout] at /opt/rustwide/workdir/src/llm/pretrain.rs:303:80 [INFO] [stdout] 22: 0x5bac15ae8eb7 - mgpt::llm::pretrain::tests::test_pretrain_llm::{{closure}}::h6f29c93fe015c6dd [INFO] [stdout] at /opt/rustwide/workdir/src/llm/pretrain.rs:301:31 [INFO] [stdout] 23: 0x5bac15b45466 - core::ops::function::FnOnce::call_once::hb865b262cdcc09f1 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 24: 0x5bac15c063ab - core::ops::function::FnOnce::call_once::h5d9016d521f5aee4 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 25: 0x5bac15c063ab - test::__rust_begin_short_backtrace::h123fcee610330442 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:663:18 [INFO] [stdout] 26: 0x5bac15c1be95 - test::run_test_in_process::{{closure}}::h0442efda2e6359b2 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:686:74 [INFO] [stdout] 27: 0x5bac15c1be95 - as core::ops::function::FnOnce<()>>::call_once::hfe3528c8dd09682c [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 28: 0x5bac15c1be95 - std::panicking::catch_unwind::do_call::hb1659f7844fe8531 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:590:40 [INFO] [stdout] 29: 0x5bac15c1be95 - std::panicking::catch_unwind::hdc1f4be0019e72ad [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:553:19 [INFO] [stdout] 30: 0x5bac15c1be95 - std::panic::catch_unwind::hd6d7ccfa4513e770 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panic.rs:359:14 [INFO] [stdout] 31: 0x5bac15c1be95 - test::run_test_in_process::h6bbb839ed0802366 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:686:27 [INFO] [stdout] 32: 0x5bac15c1be95 - test::run_test::{{closure}}::he4fad7398c8acc11 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:607:43 [INFO] [stdout] 33: 0x5bac15bf2804 - test::run_test::{{closure}}::h41975797e198d26c [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:637:41 [INFO] [stdout] 34: 0x5bac15bf2804 - std::sys::backtrace::__rust_begin_short_backtrace::hfb46c397857336f1 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 35: 0x5bac15bf61aa - std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}}::hddf826a64f532bea [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 36: 0x5bac15bf61aa - as core::ops::function::FnOnce<()>>::call_once::hc3518c3eab91aeb3 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 37: 0x5bac15bf61aa - std::panicking::catch_unwind::do_call::h7bf3ad6dc012415a [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:590:40 [INFO] [stdout] 38: 0x5bac15bf61aa - std::panicking::catch_unwind::h8b88f0375c767e36 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:553:19 [INFO] [stdout] 39: 0x5bac15bf61aa - std::panic::catch_unwind::h66cb5d61a90f7bc5 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panic.rs:359:14 [INFO] [stdout] 40: 0x5bac15bf61aa - std::thread::Builder::spawn_unchecked_::{{closure}}::h65bc9d15fb966bbd [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 41: 0x5bac15bf61aa - core::ops::function::FnOnce::call_once{{vtable.shim}}::he8d2c9a8796342e5 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 42: 0x5bac1733f23f - as core::ops::function::FnOnce>::call_once::hef12b47e5c033835 [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 43: 0x5bac1733f23f - std::sys::pal::unix::thread::Thread::new::thread_start::h135087e7c97657bc [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 44: 0x75e761df6aa4 - [INFO] [stdout] 45: 0x75e761e83a34 - clone [INFO] [stdout] 46: 0x0 - [INFO] [stdout] [INFO] [stdout] ---- datasets::pretrain_dataset_loader::tests::test_prtrain_dataset_loader stdout ---- [INFO] [stdout] start to load tokenizer from: ./out/tokenizer/tokenizer.json [INFO] [stdout] Error: No such file or directory (os error 2) [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error:: for anyhow::Error>::from [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.98/src/backtrace.rs:27:14 [INFO] [stdout] 1: as core::ops::try_trait::FromResidual>>::from_residual [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/result.rs:2176:27 [INFO] [stdout] 2: mgpt::datasets::pretrain_dataset_loader::tests::test_prtrain_dataset_loader [INFO] [stdout] at ./src/datasets/pretrain_dataset_loader.rs:246:25 [INFO] [stdout] 3: mgpt::datasets::pretrain_dataset_loader::tests::test_prtrain_dataset_loader::{{closure}} [INFO] [stdout] at ./src/datasets/pretrain_dataset_loader.rs:245:41 [INFO] [stdout] 4: core::ops::function::FnOnce::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 5: core::ops::function::FnOnce::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 6: test::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:663:18 [INFO] [stdout] 7: test::run_test_in_process::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:686:74 [INFO] [stdout] 8: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 9: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:590:40 [INFO] [stdout] 10: std::panicking::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:553:19 [INFO] [stdout] 11: std::panic::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panic.rs:359:14 [INFO] [stdout] 12: test::run_test_in_process [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:686:27 [INFO] [stdout] 13: test::run_test::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:607:43 [INFO] [stdout] 14: test::run_test::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:637:41 [INFO] [stdout] 15: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 16: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 17: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 18: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:590:40 [INFO] [stdout] 19: std::panicking::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:553:19 [INFO] [stdout] 20: std::panic::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panic.rs:359:14 [INFO] [stdout] 21: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 22: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 23: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 24: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 25: [INFO] [stdout] 26: clone [INFO] [stdout] [INFO] [stdout] ---- tokenizer::bert_tokenizer::tests::test_custom_tokenizer stdout ---- [INFO] [stdout] Error: Read-only file system (os error 30) [INFO] [stdout] [INFO] [stdout] Stack backtrace: [INFO] [stdout] 0: anyhow::error:: for anyhow::Error>::from [INFO] [stdout] at /opt/rustwide/cargo-home/registry/src/index.crates.io-1949cf8c6b5b557f/anyhow-1.0.98/src/backtrace.rs:27:14 [INFO] [stdout] 1: as core::ops::try_trait::FromResidual>>::from_residual [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/result.rs:2176:27 [INFO] [stdout] 2: mgpt::tokenizer::bert_tokenizer::tests::test_custom_tokenizer [INFO] [stdout] at ./src/tokenizer/bert_tokenizer.rs:57:9 [INFO] [stdout] 3: mgpt::tokenizer::bert_tokenizer::tests::test_custom_tokenizer::{{closure}} [INFO] [stdout] at ./src/tokenizer/bert_tokenizer.rs:53:35 [INFO] [stdout] 4: core::ops::function::FnOnce::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 5: core::ops::function::FnOnce::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 6: test::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:663:18 [INFO] [stdout] 7: test::run_test_in_process::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:686:74 [INFO] [stdout] 8: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 9: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:590:40 [INFO] [stdout] 10: std::panicking::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:553:19 [INFO] [stdout] 11: std::panic::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panic.rs:359:14 [INFO] [stdout] 12: test::run_test_in_process [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:686:27 [INFO] [stdout] 13: test::run_test::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:607:43 [INFO] [stdout] 14: test::run_test::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/test/src/lib.rs:637:41 [INFO] [stdout] 15: std::sys::backtrace::__rust_begin_short_backtrace [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/backtrace.rs:158:18 [INFO] [stdout] 16: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/thread/mod.rs:559:17 [INFO] [stdout] 17: as core::ops::function::FnOnce<()>>::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/panic/unwind_safe.rs:274:9 [INFO] [stdout] 18: std::panicking::catch_unwind::do_call [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:590:40 [INFO] [stdout] 19: std::panicking::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panicking.rs:553:19 [INFO] [stdout] 20: std::panic::catch_unwind [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/panic.rs:359:14 [INFO] [stdout] 21: std::thread::Builder::spawn_unchecked_::{{closure}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/thread/mod.rs:557:30 [INFO] [stdout] 22: core::ops::function::FnOnce::call_once{{vtable.shim}} [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/core/src/ops/function.rs:253:5 [INFO] [stdout] 23: as core::ops::function::FnOnce>::call_once [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/alloc/src/boxed.rs:1985:9 [INFO] [stdout] 24: std::sys::pal::unix::thread::Thread::new::thread_start [INFO] [stdout] at /rustc/ad85bc524b1ad696e42061ad8338d382dffbdbe5/library/std/src/sys/pal/unix/thread.rs:118:17 [INFO] [stdout] 25: [INFO] [stdout] 26: clone [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] failures: [INFO] [stdout] datasets::pretrain_dataset_loader::tests::test_iter_overall_loader [INFO] [stdout] datasets::pretrain_dataset_loader::tests::test_load_tokenizer [INFO] [stdout] datasets::pretrain_dataset_loader::tests::test_make_result_empty_input [INFO] [stdout] datasets::pretrain_dataset_loader::tests::test_make_result_valid_input [INFO] [stdout] datasets::pretrain_dataset_loader::tests::test_process_line_padding_and_truncation [INFO] [stdout] datasets::pretrain_dataset_loader::tests::test_prtrain_dataset_loader [INFO] [stdout] llm::inference::tests::test_batch_inputs_with_padding [INFO] [stdout] llm::inference::tests::test_inference [INFO] [stdout] llm::inference::tests::test_model_params [INFO] [stdout] llm::mgpt::tests::test_llm_generate_for_batch_inputs [INFO] [stdout] llm::mgpt::tests::test_llm_generate_with_tokenizer [INFO] [stdout] llm::nn_utils::tests::test_draw_loss_series [INFO] [stdout] llm::pretrain::tests::test_pretrain_llm [INFO] [stdout] tokenizer::bert_tokenizer::tests::test_custom_tokenizer [INFO] [stdout] [INFO] [stdout] test result: FAILED. 24 passed; 14 failed; 0 ignored; 0 measured; 0 filtered out; finished in 4.42s [INFO] [stdout] [INFO] [stderr] error: test failed, to rerun pass `--lib` [INFO] running `Command { std: "docker" "inspect" "176eacf4d45ad62f264aa04349e86c69eb5607de28715bc8076aceb1e7bbed5b", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "176eacf4d45ad62f264aa04349e86c69eb5607de28715bc8076aceb1e7bbed5b", kill_on_drop: false }` [INFO] [stdout] 176eacf4d45ad62f264aa04349e86c69eb5607de28715bc8076aceb1e7bbed5b