[INFO] cloning repository https://github.com/akitenkrad/rs-jailbreak-bench [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/akitenkrad/rs-jailbreak-bench" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fakitenkrad%2Frs-jailbreak-bench", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fakitenkrad%2Frs-jailbreak-bench'... [INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }` [INFO] [stdout] 8d5f3716676b9546741e3c309f902e5e83c20320 [INFO] checking akitenkrad/rs-jailbreak-bench against master#2972b5e59f1c5529b6ba770437812fd83ab4ebd4 for pr-154781 [INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Fakitenkrad%2Frs-jailbreak-bench" "/workspace/builds/worker-0-tc1/source", kill_on_drop: false }` [INFO] [stderr] Cloning into '/workspace/builds/worker-0-tc1/source'... [INFO] [stderr] done. [INFO] started tweaking git repo https://github.com/akitenkrad/rs-jailbreak-bench [INFO] removed 0 missing examples [INFO] finished tweaking git repo https://github.com/akitenkrad/rs-jailbreak-bench [INFO] tweaked toml for git repo https://github.com/akitenkrad/rs-jailbreak-bench written to /workspace/builds/worker-0-tc1/source/Cargo.toml [INFO] validating manifest of git repo https://github.com/akitenkrad/rs-jailbreak-bench on toolchain 2972b5e59f1c5529b6ba770437812fd83ab4ebd4 [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+2972b5e59f1c5529b6ba770437812fd83ab4ebd4" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }` [INFO] crate git repo https://github.com/akitenkrad/rs-jailbreak-bench already has a lockfile, it will not be regenerated [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+2972b5e59f1c5529b6ba770437812fd83ab4ebd4" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] [stderr] Blocking waiting for file lock on package cache [INFO] [stderr] Updating git repository `https://github.com/akitenkrad/rs-anthropic-tools` [INFO] [stderr] Updating git repository `https://github.com/akitenkrad/rs-openai-tools` [INFO] [stderr] Updating crates.io index [INFO] [stderr] Blocking waiting for file lock on package cache [INFO] [stderr] Downloading crates ... [INFO] [stderr] Downloaded tokio-test v0.4.5 [INFO] [stderr] Downloaded ollama-rs v0.3.3 [INFO] [stderr] Downloaded rust-ini v0.20.0 [INFO] [stderr] Downloaded zune-jpeg v0.5.11 [INFO] [stderr] Downloaded config v0.14.1 [INFO] [stderr] Downloaded yaml-rust2 v0.8.1 [INFO] [stderr] Downloaded tiktoken-rs v0.9.1 [INFO] [stderr] Downloaded aws-lc-sys v0.37.0 [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+2972b5e59f1c5529b6ba770437812fd83ab4ebd4" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }` [INFO] [stdout] 0d778c407192ddd2e23603f1b33f8b19abc2e5d4a5f939b92aa4061d65f1a49f [INFO] running `Command { std: "docker" "start" "-a" "0d778c407192ddd2e23603f1b33f8b19abc2e5d4a5f939b92aa4061d65f1a49f", kill_on_drop: false }` [INFO] running `Command { std: "docker" "inspect" "0d778c407192ddd2e23603f1b33f8b19abc2e5d4a5f939b92aa4061d65f1a49f", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "0d778c407192ddd2e23603f1b33f8b19abc2e5d4a5f939b92aa4061d65f1a49f", kill_on_drop: false }` [INFO] [stdout] 0d778c407192ddd2e23603f1b33f8b19abc2e5d4a5f939b92aa4061d65f1a49f [INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-0-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+2972b5e59f1c5529b6ba770437812fd83ab4ebd4" "check" "--frozen" "--all" "--all-targets" "--message-format=json", kill_on_drop: false }` [INFO] [stdout] 6e7bfd037c2fd8daec58338bac593b03de8cad0a941432e82a5926da63cd2fbc [INFO] running `Command { std: "docker" "start" "-a" "6e7bfd037c2fd8daec58338bac593b03de8cad0a941432e82a5926da63cd2fbc", kill_on_drop: false }` [INFO] [stderr] Compiling syn v2.0.114 [INFO] [stderr] Compiling zerocopy v0.8.33 [INFO] [stderr] Checking errno v0.3.14 [INFO] [stderr] Compiling fs_extra v1.3.0 [INFO] [stderr] Compiling cc v1.2.54 [INFO] [stderr] Checking parking_lot_core v0.9.12 [INFO] [stderr] Checking getrandom v0.2.17 [INFO] [stderr] Checking tracing-core v0.1.36 [INFO] [stderr] Compiling aws-lc-rs v1.15.4 [INFO] [stderr] Compiling zmij v1.0.16 [INFO] [stderr] Compiling thiserror v2.0.18 [INFO] [stderr] Compiling serde_json v1.0.149 [INFO] [stderr] Compiling rustls v0.23.36 [INFO] [stderr] Checking signal-hook-registry v1.4.8 [INFO] [stderr] Checking num-bigint v0.4.6 [INFO] [stderr] Checking regex-automata v0.4.13 [INFO] [stderr] Checking flate2 v1.1.8 [INFO] [stderr] Checking parking_lot v0.12.5 [INFO] [stderr] Compiling once_cell v1.21.3 [INFO] [stderr] Compiling unicase v2.9.0 [INFO] [stderr] Compiling pest v2.8.5 [INFO] [stderr] Checking rand_core v0.9.5 [INFO] [stderr] Compiling simd_helpers v0.1.0 [INFO] [stderr] Checking openssl-probe v0.2.1 [INFO] [stderr] Checking digest v0.10.7 [INFO] [stderr] Compiling const-random-macro v0.1.16 [INFO] [stderr] Checking rustls-native-certs v0.8.3 [INFO] [stderr] Checking pxfm v0.1.27 [INFO] [stderr] Compiling mime_guess v2.0.5 [INFO] [stderr] Checking zune-core v0.5.1 [INFO] [stderr] Checking bytemuck v1.24.0 [INFO] [stderr] Compiling portable-atomic v1.13.0 [INFO] [stderr] Checking bit-set v0.5.3 [INFO] [stderr] Checking png v0.18.0 [INFO] [stderr] Checking sha1 v0.10.6 [INFO] [stderr] Checking rand_core v0.6.4 [INFO] [stderr] Checking webpki-roots v1.0.5 [INFO] [stderr] Checking toml_write v0.1.2 [INFO] [stderr] Checking data-encoding v2.10.0 [INFO] [stderr] Checking qoi v0.4.1 [INFO] [stderr] Checking const-random v0.1.18 [INFO] [stderr] Checking webpki-roots v0.26.11 [INFO] [stderr] Checking dlv-list v0.5.2 [INFO] [stderr] Checking console v0.15.11 [INFO] [stderr] Checking zune-jpeg v0.5.11 [INFO] [stderr] Checking dirs-sys v0.4.1 [INFO] [stderr] Checking tracing-log v0.2.0 [INFO] [stderr] Checking predicates-core v1.0.9 [INFO] [stderr] Checking number_prefix v0.4.0 [INFO] [stderr] Compiling mockall_derive v0.13.1 [INFO] [stderr] Checking nom v7.1.3 [INFO] [stderr] Checking dirs v5.0.1 [INFO] [stderr] Compiling cmake v0.1.57 [INFO] [stderr] Checking dirs-sys v0.5.0 [INFO] [stderr] Checking termtree v0.5.1 [INFO] [stderr] Checking unsafe-libyaml v0.2.11 [INFO] [stderr] Checking rustix v1.1.3 [INFO] [stderr] Checking indicatif v0.17.11 [INFO] [stderr] Checking predicates v3.1.3 [INFO] [stderr] Checking predicates-tree v1.0.12 [INFO] [stderr] Checking dirs v6.0.0 [INFO] [stderr] Checking uuid v1.20.0 [INFO] [stderr] Checking downcast v0.11.0 [INFO] [stderr] Checking diff v0.1.13 [INFO] [stderr] Checking fragile v2.0.1 [INFO] [stderr] Checking pretty_assertions v1.4.1 [INFO] [stderr] Checking num-rational v0.4.2 [INFO] [stderr] Compiling aws-lc-sys v0.37.0 [INFO] [stderr] Compiling openssl-sys v0.9.111 [INFO] [stderr] Compiling ring v0.17.14 [INFO] [stderr] Compiling pest_meta v2.8.5 [INFO] [stderr] Compiling openssl v0.10.75 [INFO] [stderr] Compiling native-tls v0.2.14 [INFO] [stderr] Checking tempfile v3.24.0 [INFO] [stderr] Checking moxcms v0.7.11 [INFO] [stderr] Checking regex v1.12.2 [INFO] [stderr] Checking bstr v1.12.1 [INFO] [stderr] Checking fancy-regex v0.13.0 [INFO] [stderr] Checking matchers v0.2.0 [INFO] [stderr] Compiling synstructure v0.13.2 [INFO] [stderr] Compiling pest_generator v2.8.5 [INFO] [stderr] Compiling serde_derive_internals v0.29.1 [INFO] [stderr] Checking tiktoken-rs v0.9.1 [INFO] [stderr] Compiling zerocopy-derive v0.8.33 [INFO] [stderr] Compiling zerofrom-derive v0.1.6 [INFO] [stderr] Compiling yoke-derive v0.8.1 [INFO] [stderr] Compiling tokio-macros v2.6.0 [INFO] [stderr] Compiling serde_derive v1.0.228 [INFO] [stderr] Compiling zerovec-derive v0.11.2 [INFO] [stderr] Compiling displaydoc v0.2.5 [INFO] [stderr] Compiling futures-macro v0.3.31 [INFO] [stderr] Compiling tracing-attributes v0.1.31 [INFO] [stderr] Compiling openssl-macros v0.1.1 [INFO] [stderr] Compiling equator-macro v0.4.2 [INFO] [stderr] Compiling thiserror-impl v2.0.18 [INFO] [stderr] Compiling arg_enum_proc_macro v0.3.4 [INFO] [stderr] Checking equator v0.4.2 [INFO] [stderr] Compiling profiling-procmacros v1.0.17 [INFO] [stderr] Checking tokio v1.49.0 [INFO] [stderr] Checking aligned-vec v0.6.4 [INFO] [stderr] Checking zerofrom v0.1.6 [INFO] [stderr] Checking futures-util v0.3.31 [INFO] [stderr] Compiling num-derive v0.4.2 [INFO] [stderr] Checking yoke v0.8.1 [INFO] [stderr] Checking profiling v1.0.17 [INFO] [stderr] Checking v_frame v0.3.9 [INFO] [stderr] Compiling fax_derive v0.2.0 [INFO] [stderr] Checking zerotrie v0.2.3 [INFO] [stderr] Checking av1-grain v0.2.5 [INFO] [stderr] Compiling ref-cast-impl v1.0.25 [INFO] [stderr] Checking zerovec v0.11.5 [INFO] [stderr] Compiling strum_macros v0.27.2 [INFO] [stderr] Checking av-scenechange v0.14.1 [INFO] [stderr] Compiling async-stream-impl v0.3.6 [INFO] [stderr] Checking ref-cast v1.0.25 [INFO] [stderr] Checking tracing v0.1.44 [INFO] [stderr] Checking tinystr v0.8.2 [INFO] [stderr] Checking potential_utf v0.1.4 [INFO] [stderr] Compiling thiserror-impl v1.0.69 [INFO] [stderr] Checking fax v0.2.6 [INFO] [stderr] Checking icu_collections v2.1.1 [INFO] [stderr] Compiling schemars_derive v1.2.0 [INFO] [stderr] Checking icu_locale_core v2.1.1 [INFO] [stderr] Compiling pest_derive v2.8.5 [INFO] [stderr] Checking tracing-subscriber v0.3.22 [INFO] [stderr] Checking async-stream v0.3.6 [INFO] [stderr] Compiling async-trait v0.1.89 [INFO] [stderr] Compiling derive-new v0.7.0 [INFO] [stderr] Checking rav1e v0.8.1 [INFO] [stderr] Checking ppv-lite86 v0.2.21 [INFO] [stderr] Checking icu_provider v2.1.1 [INFO] [stderr] Checking serde v1.0.228 [INFO] [stderr] Checking icu_normalizer v2.1.1 [INFO] [stderr] Checking icu_properties v2.1.2 [INFO] [stderr] Checking ahash v0.8.12 [INFO] [stderr] Checking half v2.7.1 [INFO] [stderr] Checking rand_chacha v0.9.0 [INFO] [stderr] Checking tiff v0.10.3 [INFO] [stderr] Checking exr v1.74.0 [INFO] [stderr] Checking hashbrown v0.14.5 [INFO] [stderr] Checking rand_chacha v0.3.1 [INFO] [stderr] Checking toml_datetime v0.6.11 [INFO] [stderr] Checking serde_spanned v0.6.9 [INFO] [stderr] Checking serde_urlencoded v0.7.1 [INFO] [stderr] Checking rand v0.9.2 [INFO] [stderr] Checking futures-executor v0.3.31 [INFO] [stderr] Checking toml_edit v0.22.27 [INFO] [stderr] Checking rand v0.8.5 [INFO] [stderr] Checking json5 v0.4.1 [INFO] [stderr] Checking ron v0.8.1 [INFO] [stderr] Checking ordered-multimap v0.7.3 [INFO] [stderr] Checking hashlink v0.8.4 [INFO] [stderr] Checking strum v0.27.2 [INFO] [stderr] Checking schemars v1.2.0 [INFO] [stderr] Checking thiserror v1.0.69 [INFO] [stderr] Checking rust-ini v0.20.0 [INFO] [stderr] Checking futures v0.3.31 [INFO] [stderr] Checking chrono v0.4.43 [INFO] [stderr] Checking serde_yaml v0.9.34+deprecated [INFO] [stderr] Checking idna_adapter v1.2.1 [INFO] [stderr] Checking idna v1.1.0 [INFO] [stderr] Checking yaml-rust2 v0.8.1 [INFO] [stderr] Checking tungstenite v0.28.0 [INFO] [stderr] Checking url v2.5.8 [INFO] [stderr] Checking tokio-util v0.7.18 [INFO] [stderr] Checking tower v0.5.3 [INFO] [stderr] Checking tokio-native-tls v0.3.1 [INFO] [stderr] Checking tokio-stream v0.1.18 [INFO] [stderr] Checking tokio-test v0.4.5 [INFO] [stderr] Checking toml v0.8.23 [INFO] [stderr] Checking tokio-tungstenite v0.28.0 [INFO] [stderr] Checking mockall v0.13.1 [INFO] [stderr] Checking h2 v0.4.13 [INFO] [stderr] Checking tower-http v0.6.8 [INFO] [stderr] Checking config v0.14.1 [INFO] [stderr] Checking ravif v0.12.0 [INFO] [stderr] Checking image v0.25.9 [INFO] [stderr] Checking hyper v1.8.1 [INFO] [stderr] Checking hyper-util v0.1.19 [INFO] [stderr] Checking rustls-webpki v0.103.9 [INFO] [stderr] Checking hyper-tls v0.6.0 [INFO] [stderr] Checking reqwest v0.12.28 [INFO] [stderr] Checking ollama-rs v0.3.3 [INFO] [stderr] Checking tokio-rustls v0.26.4 [INFO] [stderr] Checking rustls-platform-verifier v0.6.2 [INFO] [stderr] Checking ureq v2.12.1 [INFO] [stderr] Checking hyper-rustls v0.27.7 [INFO] [stderr] Checking reqwest v0.13.1 [INFO] [stderr] Checking hf-hub v0.3.2 [INFO] [stderr] Checking anthropic-tools v1.0.1 (https://github.com/akitenkrad/rs-anthropic-tools#af23f6d2) [INFO] [stderr] Checking openai-tools v1.0.4 (https://github.com/akitenkrad/rs-openai-tools#1e7a46f7) [INFO] [stderr] Checking rs-jailbreak-bench v0.1.0 (/opt/rustwide/workdir) [INFO] [stdout] warning: constant `JAILBREAK_INDICATORS` is never used [INFO] [stdout] --> src/judge/prompts.rs:112:11 [INFO] [stdout] | [INFO] [stdout] 112 | pub const JAILBREAK_INDICATORS: &[&str] = &[ [INFO] [stdout] | ^^^^^^^^^^^^^^^^^^^^ [INFO] [stdout] | [INFO] [stdout] = note: `#[warn(dead_code)]` (part of `#[warn(unused)]`) on by default [INFO] [stdout] [INFO] [stdout] [INFO] [stdout] warning: method `is_too_short` is never used [INFO] [stdout] --> src/judge/refusal_judge.rs:139:8 [INFO] [stdout] | [INFO] [stdout] 66 | impl KeywordRefusalJudge { [INFO] [stdout] | ------------------------ method in this implementation [INFO] [stdout] ... [INFO] [stdout] 139 | fn is_too_short(&self, response: &str) -> bool { [INFO] [stdout] | ^^^^^^^^^^^^ [INFO] [stdout] [INFO] [stdout] [INFO] [stderr] Finished `dev` profile [unoptimized + debuginfo] target(s) in 1m 28s [INFO] running `Command { std: "docker" "inspect" "6e7bfd037c2fd8daec58338bac593b03de8cad0a941432e82a5926da63cd2fbc", kill_on_drop: false }` [INFO] running `Command { std: "docker" "rm" "-f" "6e7bfd037c2fd8daec58338bac593b03de8cad0a941432e82a5926da63cd2fbc", kill_on_drop: false }` [INFO] [stdout] 6e7bfd037c2fd8daec58338bac593b03de8cad0a941432e82a5926da63cd2fbc