[INFO] cloning repository https://github.com/Amir-Zecharia/compress-tokens [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/Amir-Zecharia/compress-tokens" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FAmir-Zecharia%2Fcompress-tokens", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FAmir-Zecharia%2Fcompress-tokens'... [INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }` [INFO] [stdout] 1497f9a44a5f9d9de48c7dcd032e58eaeaab50cd [INFO] testing Amir-Zecharia/compress-tokens against 1.97.0-beta.6 for beta-1.98-1 [INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FAmir-Zecharia%2Fcompress-tokens" "/workspace/builds/worker-4-tc1/source", kill_on_drop: false }` [INFO] [stderr] Cloning into '/workspace/builds/worker-4-tc1/source'... [INFO] [stderr] done. [INFO] started tweaking git repo https://github.com/Amir-Zecharia/compress-tokens [INFO] finished tweaking git repo https://github.com/Amir-Zecharia/compress-tokens [INFO] tweaked toml for git repo https://github.com/Amir-Zecharia/compress-tokens written to /workspace/builds/worker-4-tc1/source/Cargo.toml [INFO] validating manifest of git repo https://github.com/Amir-Zecharia/compress-tokens on toolchain 1.97.0-beta.6 [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.97.0-beta.6" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }` [INFO] crate git repo https://github.com/Amir-Zecharia/compress-tokens already has a lockfile, it will not be regenerated [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.97.0-beta.6" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] [stderr] Updating crates.io index [INFO] [stderr] Downloading crates ... [INFO] [stderr] Downloaded hf-hub v0.3.2 [INFO] [stderr] Downloaded tokenizers v0.20.4 [INFO] [stderr] Downloaded serde_plain v1.0.2 [INFO] [stderr] Downloaded candle-transformers v0.8.4 [INFO] [stderr] Downloaded candle-nn v0.8.4 [INFO] [stderr] Downloaded fancy-regex v0.13.0 [INFO] [stderr] Downloaded toml_parser v1.0.10+spec-1.1.0 [INFO] [stderr] Downloaded toml_datetime v1.0.1+spec-1.1.0 [INFO] [stderr] Downloaded toml_edit v0.25.5+spec-1.1.0 [INFO] [stderr] Downloaded ug v0.1.0 [INFO] [stderr] Downloaded ug-metal v0.1.0 [INFO] [stderr] Downloaded candle-core v0.8.4 [INFO] [stderr] Downloaded candle-metal-kernels v0.8.4 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-4-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-4-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-m" "1610612736" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:3d5ced03c013a94a2f102a4510f48a6e9184255caf5fd8244f58017bde7f5210" "sleep" "infinity", kill_on_drop: false }` [INFO] [stdout] f69f54bbf015a89ecac41cc7422c11eea00d523581732b70e47c8df874e153e7 [INFO] running `Command { std: "docker" "start" "f69f54bbf015a89ecac41cc7422c11eea00d523581732b70e47c8df874e153e7", kill_on_drop: false }` [INFO] running `Command { std: "docker" "inspect" "f69f54bbf015a89ecac41cc7422c11eea00d523581732b70e47c8df874e153e7", kill_on_drop: false }` [INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-w" "/opt/rustwide/workdir" "--user" "0:0" "f69f54bbf015a89ecac41cc7422c11eea00d523581732b70e47c8df874e153e7" "/opt/rustwide/cargo-home/bin/cargo" "+1.97.0-beta.6" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }` [INFO] running `Command { std: "docker" "inspect" "f69f54bbf015a89ecac41cc7422c11eea00d523581732b70e47c8df874e153e7", kill_on_drop: false }` [INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "f69f54bbf015a89ecac41cc7422c11eea00d523581732b70e47c8df874e153e7" "/opt/rustwide/cargo-home/bin/cargo" "+1.97.0-beta.6" "build" "--frozen" "--message-format=json", kill_on_drop: false }` [INFO] [stderr] Compiling zerocopy v0.8.47 [INFO] [stderr] Compiling num-traits v0.2.19 [INFO] [stderr] Compiling cc v1.2.57 [INFO] [stderr] Compiling stable_deref_trait v1.2.1 [INFO] [stderr] Compiling bitflags v2.11.0 [INFO] [stderr] Compiling reborrow v0.5.5 [INFO] [stderr] Compiling seq-macro v0.3.6 [INFO] [stderr] Compiling syn v2.0.117 [INFO] [stderr] Compiling getrandom v0.3.4 [INFO] [stderr] Compiling pulp v0.21.5 [INFO] [stderr] Compiling dyn-stack-macros v0.1.3 [INFO] [stderr] Compiling rayon v1.11.0 [INFO] [stderr] Compiling raw-cpuid v10.7.0 [INFO] [stderr] Compiling serde_json v1.0.149 [INFO] [stderr] Compiling getrandom v0.2.17 [INFO] [stderr] Compiling toml_parser v1.0.10+spec-1.1.0 [INFO] [stderr] Compiling mio v1.1.1 [INFO] [stderr] Compiling socket2 v0.6.3 [INFO] [stderr] Compiling openssl v0.10.76 [INFO] [stderr] Compiling raw-cpuid v11.6.0 [INFO] [stderr] Compiling toml_datetime v1.0.1+spec-1.1.0 [INFO] [stderr] Compiling rand_core v0.9.5 [INFO] [stderr] Compiling futures-io v0.3.32 [INFO] [stderr] Compiling rustls-pki-types v1.14.0 [INFO] [stderr] Compiling http v0.2.12 [INFO] [stderr] Compiling simd-adler32 v0.3.8 [INFO] [stderr] Compiling aho-corasick v1.1.4 [INFO] [stderr] Compiling zip v1.1.4 [INFO] [stderr] Compiling regex-syntax v0.8.10 [INFO] [stderr] Compiling block-buffer v0.10.4 [INFO] [stderr] Compiling toml_edit v0.25.5+spec-1.1.0 [INFO] [stderr] Compiling miniz_oxide v0.8.9 [INFO] [stderr] Compiling crypto-common v0.1.7 [INFO] [stderr] Compiling rand_core v0.6.4 [INFO] [stderr] Compiling memmap2 v0.9.10 [INFO] [stderr] Compiling socket2 v0.5.10 [INFO] [stderr] Compiling rustls v0.23.37 [INFO] [stderr] Compiling webpki-roots v1.0.6 [INFO] [stderr] Compiling digest v0.10.7 [INFO] [stderr] Compiling cpufeatures v0.2.17 [INFO] [stderr] Compiling esaxx-rs v0.1.10 [INFO] [stderr] Compiling bit-vec v0.6.3 [INFO] [stderr] Compiling dirs-sys v0.4.1 [INFO] [stderr] Compiling console v0.15.11 [INFO] [stderr] Compiling num-integer v0.1.46 [INFO] [stderr] Compiling http-body v0.4.6 [INFO] [stderr] Compiling num-bigint v0.4.6 [INFO] [stderr] Compiling proc-macro-crate v3.5.0 [INFO] [stderr] Compiling num-iter v0.1.45 [INFO] [stderr] Compiling flate2 v1.1.9 [INFO] [stderr] Compiling bit-set v0.5.3 [INFO] [stderr] Compiling webpki-roots v0.26.11 [INFO] [stderr] Compiling sha2 v0.10.9 [INFO] [stderr] Compiling portable-atomic v1.13.1 [INFO] [stderr] Compiling itertools v0.11.0 [INFO] [stderr] Compiling macro_rules_attribute-proc_macro v0.2.2 [INFO] [stderr] Compiling openssl-sys v0.9.112 [INFO] [stderr] Compiling ring v0.17.14 [INFO] [stderr] Compiling onig_sys v69.9.1 [INFO] [stderr] Compiling compress-tokens v0.1.0 (/opt/rustwide/workdir) [INFO] [stderr] Compiling indicatif v0.17.11 [INFO] [stderr] Compiling dirs v5.0.1 [INFO] [stderr] Compiling unicode-normalization-alignments v0.1.12 [INFO] [stderr] Compiling itertools v0.12.1 [INFO] [stderr] Compiling macro_rules_attribute v0.2.2 [INFO] [stderr] Compiling regex-automata v0.4.14 [INFO] [stderr] Compiling native-tls v0.2.18 [INFO] [stderr] Compiling num-rational v0.4.2 [INFO] [stderr] Compiling rayon-cond v0.3.0 [INFO] [stderr] Compiling synstructure v0.13.2 [INFO] [stderr] Compiling darling_core v0.20.11 [INFO] [stderr] Compiling zerocopy-derive v0.8.47 [INFO] [stderr] Compiling bytemuck_derive v1.10.2 [INFO] [stderr] Compiling zerofrom-derive v0.1.6 [INFO] [stderr] Compiling displaydoc v0.2.5 [INFO] [stderr] Compiling yoke-derive v0.8.1 [INFO] [stderr] Compiling zerovec-derive v0.11.2 [INFO] [stderr] Compiling serde_derive v1.0.228 [INFO] [stderr] Compiling tracing-attributes v0.1.31 [INFO] [stderr] Compiling thiserror-impl v1.0.69 [INFO] [stderr] Compiling futures-macro v0.3.32 [INFO] [stderr] Compiling tokio-macros v2.6.1 [INFO] [stderr] Compiling openssl-macros v0.1.1 [INFO] [stderr] Compiling futures-util v0.3.32 [INFO] [stderr] Compiling tokio v1.50.0 [INFO] [stderr] Compiling num_enum_derive v0.7.6 [INFO] [stderr] Compiling yoke-derive v0.7.5 [INFO] [stderr] Compiling rustls-webpki v0.103.10 [INFO] [stderr] Compiling tracing v0.1.44 [INFO] [stderr] Compiling thiserror v1.0.69 [INFO] [stderr] Compiling zerofrom v0.1.6 [INFO] [stderr] Compiling bytemuck v1.25.0 [INFO] [stderr] Compiling monostate-impl v0.1.18 [INFO] [stderr] Compiling onig v6.5.1 [INFO] [stderr] Compiling yoke v0.8.1 [INFO] [stderr] Compiling monostate v0.1.18 [INFO] [stderr] Compiling num-complex v0.4.6 [INFO] [stderr] Compiling zerovec v0.11.5 [INFO] [stderr] Compiling dyn-stack v0.13.2 [INFO] [stderr] Compiling dyn-stack v0.10.0 [INFO] [stderr] Compiling zerotrie v0.2.3 [INFO] [stderr] Compiling yoke v0.7.5 [INFO] [stderr] Compiling num_enum v0.7.6 [INFO] [stderr] Compiling pulp v0.18.22 [INFO] [stderr] Compiling num v0.4.3 [INFO] [stderr] Compiling fancy-regex v0.13.0 [INFO] [stderr] Compiling regex v1.12.3 [INFO] [stderr] Compiling clap_derive v4.6.0 [INFO] [stderr] Compiling tinystr v0.8.2 [INFO] [stderr] Compiling potential_utf v0.1.4 [INFO] [stderr] Compiling icu_locale_core v2.1.1 [INFO] [stderr] Compiling darling_macro v0.20.11 [INFO] [stderr] Compiling icu_collections v2.1.1 [INFO] [stderr] Compiling futures-executor v0.3.32 [INFO] [stderr] Compiling darling v0.20.11 [INFO] [stderr] Compiling futures v0.3.32 [INFO] [stderr] Compiling serde v1.0.228 [INFO] [stderr] Compiling derive_builder_core v0.20.2 [INFO] [stderr] Compiling icu_provider v2.1.1 [INFO] [stderr] Compiling safetensors v0.4.5 [INFO] [stderr] Compiling icu_normalizer v2.1.1 [INFO] [stderr] Compiling icu_properties v2.1.2 [INFO] [stderr] Compiling serde_urlencoded v0.7.1 [INFO] [stderr] Compiling spm_precompiled v0.1.4 [INFO] [stderr] Compiling serde_plain v1.0.2 [INFO] [stderr] Compiling clap v4.6.0 [INFO] [stderr] Compiling derive_builder_macro v0.20.2 [INFO] [stderr] Compiling derive_builder v0.20.2 [INFO] [stderr] Compiling idna_adapter v1.2.1 [INFO] [stderr] Compiling idna v1.1.0 [INFO] [stderr] Compiling url v2.5.8 [INFO] [stderr] Compiling tokio-util v0.7.18 [INFO] [stderr] Compiling tokio-native-tls v0.3.1 [INFO] [stderr] Compiling ppv-lite86 v0.2.21 [INFO] [stderr] Compiling rand_chacha v0.9.0 [INFO] [stderr] Compiling rand_chacha v0.3.1 [INFO] [stderr] Compiling rand v0.9.2 [INFO] [stderr] Compiling rand v0.8.5 [INFO] [stderr] Compiling h2 v0.3.27 [INFO] [stderr] Compiling ureq v2.12.1 [INFO] [stderr] Compiling rand_distr v0.5.1 [INFO] [stderr] Compiling tokenizers v0.20.4 [INFO] [stderr] Compiling half v2.7.1 [INFO] [stderr] Compiling gemm-common v0.18.2 [INFO] [stderr] Compiling gemm-common v0.17.1 [INFO] [stderr] Compiling gemm-f32 v0.18.2 [INFO] [stderr] Compiling gemm-c32 v0.18.2 [INFO] [stderr] Compiling gemm-f64 v0.18.2 [INFO] [stderr] Compiling gemm-c64 v0.18.2 [INFO] [stderr] Compiling gemm-f32 v0.17.1 [INFO] [stderr] Compiling gemm-c64 v0.17.1 [INFO] [stderr] Compiling gemm-c32 v0.17.1 [INFO] [stderr] Compiling gemm-f64 v0.17.1 [INFO] [stderr] Compiling gemm-f16 v0.17.1 [INFO] [stderr] Compiling gemm-f16 v0.18.2 [INFO] [stderr] Compiling gemm v0.18.2 [INFO] [stderr] Compiling ug v0.1.0 [INFO] [stderr] Compiling gemm v0.17.1 [INFO] [stderr] Compiling hyper v0.14.32 [INFO] [stderr] Compiling candle-core v0.8.4 [INFO] [stderr] Compiling hyper-tls v0.5.0 [INFO] [stderr] Compiling reqwest v0.11.27 [INFO] [stderr] Compiling hf-hub v0.3.2 [INFO] [stderr] Compiling candle-nn v0.8.4 [INFO] [stderr] Compiling candle-transformers v0.8.4 [INFO] [stderr] Finished `dev` profile [unoptimized + debuginfo] target(s) in 2m 24s [INFO] running `Command { std: "docker" "inspect" "f69f54bbf015a89ecac41cc7422c11eea00d523581732b70e47c8df874e153e7", kill_on_drop: false }` [INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "f69f54bbf015a89ecac41cc7422c11eea00d523581732b70e47c8df874e153e7" "/opt/rustwide/cargo-home/bin/cargo" "+1.97.0-beta.6" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }` [INFO] [stderr] Compiling compress-tokens v0.1.0 (/opt/rustwide/workdir) [INFO] [stderr] Finished `test` profile [unoptimized + debuginfo] target(s) in 4.05s [INFO] running `Command { std: "docker" "inspect" "f69f54bbf015a89ecac41cc7422c11eea00d523581732b70e47c8df874e153e7", kill_on_drop: false }` [INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-w" "/opt/rustwide/workdir" "--user" "0:0" "f69f54bbf015a89ecac41cc7422c11eea00d523581732b70e47c8df874e153e7" "/opt/rustwide/cargo-home/bin/cargo" "+1.97.0-beta.6" "test" "--frozen", kill_on_drop: false }` [INFO] [stderr] Finished `test` profile [unoptimized + debuginfo] target(s) in 0.36s [INFO] [stderr] Running unittests src/main.rs (/opt/rustwide/target/debug/deps/compress_tokens-1b3dcf2196d4870c) [INFO] [stdout] [INFO] [stdout] running 11 tests [INFO] [stdout] test compress::tests::elbow_keep_ratio_filters_infinity ... ok [INFO] [stdout] test compress::tests::elbow_keep_ratio_returns_valid_range ... ok [INFO] [stdout] test compress::tests::elbow_keep_ratio_too_few_tokens ... ok [INFO] [stdout] test compress::tests::elbow_keep_ratio_simple_distribution ... ok [INFO] [stdout] test compress::tests::select_tokens_half_preserves_order ... ok [INFO] [stdout] test compress::tests::select_tokens_keep_all ... ok [INFO] [stdout] test compress::tests::select_tokens_keep_none_returns_first ... ok [INFO] [stdout] test compress::tests::select_tokens_keeps_highest_surprisal ... ok [INFO] [stdout] test compress::tests::select_tokens_known_inputs_outputs ... ok [INFO] [stdout] test compress::tests::select_tokens_preserves_order ... ok [INFO] [stdout] test compress::tests::select_tokens_single ... ok [INFO] [stdout] [INFO] [stdout] test result: ok. 11 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s [INFO] [stdout] [INFO] running `Command { std: "docker" "inspect" "f69f54bbf015a89ecac41cc7422c11eea00d523581732b70e47c8df874e153e7", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "f69f54bbf015a89ecac41cc7422c11eea00d523581732b70e47c8df874e153e7", kill_on_drop: false }` [INFO] [stdout] f69f54bbf015a89ecac41cc7422c11eea00d523581732b70e47c8df874e153e7