[INFO] cloning repository https://github.com/fourpenny/candle-mnist [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/fourpenny/candle-mnist" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist'... [INFO] [stderr] /workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist: No space left on device [WARN] Retrying crate fetch in 3 seconds (attempt 1) [INFO] cloning repository https://github.com/fourpenny/candle-mnist [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/fourpenny/candle-mnist" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist'... [INFO] [stderr] error: copy-fd: write returned: No space left on device [INFO] [stderr] fatal: cannot copy '/usr/share/git-core/templates/hooks/pre-push.sample' to '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist/hooks/pre-push.sample': No space left on device [WARN] Retrying crate fetch in 3 seconds (attempt 2) [INFO] cloning repository https://github.com/fourpenny/candle-mnist [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/fourpenny/candle-mnist" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist'... [INFO] [stderr] /workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist/hooks/: No space left on device [WARN] Retrying crate fetch in 3 seconds (attempt 3) [INFO] cloning repository https://github.com/fourpenny/candle-mnist [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/fourpenny/candle-mnist" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist'... [INFO] [stderr] /workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist: No space left on device [WARN] Retrying crate fetch in 3 seconds (attempt 4) [INFO] cloning repository https://github.com/fourpenny/candle-mnist [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/fourpenny/candle-mnist" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist'... [INFO] [stderr] /workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist: No space left on device [WARN] Retrying crate fetch in 3 seconds (attempt 5) [INFO] cloning repository https://github.com/fourpenny/candle-mnist [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/fourpenny/candle-mnist" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist'... [INFO] [stderr] /workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist: No space left on device [WARN] Retrying crate fetch in 3 seconds (attempt 6) [INFO] cloning repository https://github.com/fourpenny/candle-mnist [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/fourpenny/candle-mnist" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist'... [INFO] [stderr] /workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist: No space left on device [WARN] Retrying crate fetch in 3 seconds (attempt 7) [INFO] cloning repository https://github.com/fourpenny/candle-mnist [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/fourpenny/candle-mnist" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist'... [INFO] [stderr] /workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist: No space left on device [WARN] Retrying crate fetch in 3 seconds (attempt 8) [INFO] cloning repository https://github.com/fourpenny/candle-mnist [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/fourpenny/candle-mnist" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist'... [INFO] [stderr] /workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist: No space left on device [WARN] Retrying crate fetch in 3 seconds (attempt 9) [INFO] cloning repository https://github.com/fourpenny/candle-mnist [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/fourpenny/candle-mnist" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist'... [INFO] [stderr] /workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist: No space left on device [WARN] Retrying crate fetch in 3 seconds (attempt 10) [INFO] cloning repository https://github.com/fourpenny/candle-mnist [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/fourpenny/candle-mnist" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist'... [INFO] [stderr] /workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist: No space left on device [WARN] Retrying crate fetch in 3 seconds (attempt 11) [INFO] cloning repository https://github.com/fourpenny/candle-mnist [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/fourpenny/candle-mnist" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist'... [INFO] [stderr] /workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist: No space left on device [WARN] Retrying crate fetch in 3 seconds (attempt 12) [INFO] cloning repository https://github.com/fourpenny/candle-mnist [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/fourpenny/candle-mnist" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist'... [INFO] [stderr] /workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist: No space left on device [WARN] Retrying crate fetch in 3 seconds (attempt 13) [INFO] cloning repository https://github.com/fourpenny/candle-mnist [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/fourpenny/candle-mnist" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist'... [INFO] [stderr] /workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist: No space left on device [WARN] Retrying crate fetch in 3 seconds (attempt 14) [INFO] cloning repository https://github.com/fourpenny/candle-mnist [INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/fourpenny/candle-mnist" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist", kill_on_drop: false }` [INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist'... [INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }` [INFO] [stdout] c8451d1ec3c36dd2d0201277b694f1fb5b3d3063 [INFO] checking fourpenny/candle-mnist against try#86f78589b09557f70c9db3f56ad1921e0a9f76ef for pr-138438 [INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist" "/workspace/builds/worker-6-tc2/source", kill_on_drop: false }` [INFO] [stderr] Cloning into '/workspace/builds/worker-6-tc2/source'... [INFO] [stderr] done. [INFO] validating manifest of git repo https://github.com/fourpenny/candle-mnist on toolchain 86f78589b09557f70c9db3f56ad1921e0a9f76ef [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+86f78589b09557f70c9db3f56ad1921e0a9f76ef" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }` [INFO] started tweaking git repo https://github.com/fourpenny/candle-mnist [INFO] finished tweaking git repo https://github.com/fourpenny/candle-mnist [INFO] tweaked toml for git repo https://github.com/fourpenny/candle-mnist written to /workspace/builds/worker-6-tc2/source/Cargo.toml [INFO] crate git repo https://github.com/fourpenny/candle-mnist already has a lockfile, it will not be regenerated [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+86f78589b09557f70c9db3f56ad1921e0a9f76ef" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] [stderr] Blocking waiting for file lock on package cache [INFO] [stderr] Updating git submodule `https://github.com/NVIDIA/cutlass.git` [INFO] [stderr] warning: spurious network error (3 tries remaining): cannot extend packfile '/workspace/cargo-home/git/checkouts/candle-5b4d092929d18d36/e6d86b0/candle-flash-attn/cutlass/.git/objects/pack/pack_git2_9bd5362d2cf0a8c6': No space left on device; class=Os (2) [INFO] [stderr] warning: spurious network error (2 tries remaining): cannot extend packfile '/workspace/cargo-home/git/checkouts/candle-5b4d092929d18d36/e6d86b0/candle-flash-attn/cutlass/.git/objects/pack/pack_git2_81cb78d5cd5790ab': No space left on device; class=Os (2) [INFO] [stderr] warning: spurious network error (1 tries remaining): cannot extend packfile '/workspace/cargo-home/git/checkouts/candle-5b4d092929d18d36/e6d86b0/candle-flash-attn/cutlass/.git/objects/pack/pack_git2_aa7f49111b984214': No space left on device; class=Os (2) [INFO] [stderr] error: failed to get `candle-core` as a dependency of package `candle_tut v0.1.0 (/workspace/builds/worker-6-tc2/source)` [INFO] [stderr] [INFO] [stderr] Caused by: [INFO] [stderr] failed to load source for dependency `candle-core` [INFO] [stderr] [INFO] [stderr] Caused by: [INFO] [stderr] Unable to update https://github.com/huggingface/candle.git#e6d86b08 [INFO] [stderr] [INFO] [stderr] Caused by: [INFO] [stderr] failed to update submodule `candle-examples/examples/flash-attn/cutlass` [INFO] [stderr] [INFO] [stderr] Caused by: [INFO] [stderr] failed to fetch submodule `candle-examples/examples/flash-attn/cutlass` from https://github.com/NVIDIA/cutlass.git [INFO] [stderr] [INFO] [stderr] Caused by: [INFO] [stderr] revision c4f6b8c6bc94ff69048492fb34df0dfaf1983933 not found [INFO] [stderr] [INFO] [stderr] Caused by: [INFO] [stderr] cannot extend packfile '/workspace/cargo-home/git/checkouts/candle-5b4d092929d18d36/e6d86b0/candle-flash-attn/cutlass/.git/objects/pack/pack_git2_3ee994063328e7dd': No space left on device; class=Os (2) [INFO] checking fourpenny/candle-mnist against try#86f78589b09557f70c9db3f56ad1921e0a9f76ef for pr-138438 [INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist" "/workspace/builds/worker-6-tc2/source", kill_on_drop: false }` [INFO] [stderr] Cloning into '/workspace/builds/worker-6-tc2/source'... [INFO] [stderr] done. [INFO] validating manifest of git repo https://github.com/fourpenny/candle-mnist on toolchain 86f78589b09557f70c9db3f56ad1921e0a9f76ef [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+86f78589b09557f70c9db3f56ad1921e0a9f76ef" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }` [INFO] started tweaking git repo https://github.com/fourpenny/candle-mnist [INFO] finished tweaking git repo https://github.com/fourpenny/candle-mnist [INFO] tweaked toml for git repo https://github.com/fourpenny/candle-mnist written to /workspace/builds/worker-6-tc2/source/Cargo.toml [INFO] crate git repo https://github.com/fourpenny/candle-mnist already has a lockfile, it will not be regenerated [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+86f78589b09557f70c9db3f56ad1921e0a9f76ef" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] [stderr] Blocking waiting for file lock on package cache [INFO] [stderr] Updating git submodule `https://github.com/NVIDIA/cutlass.git` [INFO] [stderr] warning: spurious network error (3 tries remaining): cannot extend packfile '/workspace/cargo-home/git/checkouts/candle-5b4d092929d18d36/e6d86b0/candle-flash-attn/cutlass/.git/objects/pack/pack_git2_7b369a93ca1b008b': No space left on device; class=Os (2) [INFO] [stderr] warning: spurious network error (2 tries remaining): cannot extend packfile '/workspace/cargo-home/git/checkouts/candle-5b4d092929d18d36/e6d86b0/candle-flash-attn/cutlass/.git/objects/pack/pack_git2_1a7d1f558cf8e2bd': No space left on device; class=Os (2) [INFO] [stderr] warning: spurious network error (1 tries remaining): cannot extend packfile '/workspace/cargo-home/git/checkouts/candle-5b4d092929d18d36/e6d86b0/candle-flash-attn/cutlass/.git/objects/pack/pack_git2_6d97f00942ee9597': No space left on device; class=Os (2) [INFO] [stderr] error: failed to get `candle-core` as a dependency of package `candle_tut v0.1.0 (/workspace/builds/worker-6-tc2/source)` [INFO] [stderr] [INFO] [stderr] Caused by: [INFO] [stderr] failed to load source for dependency `candle-core` [INFO] [stderr] [INFO] [stderr] Caused by: [INFO] [stderr] Unable to update https://github.com/huggingface/candle.git#e6d86b08 [INFO] [stderr] [INFO] [stderr] Caused by: [INFO] [stderr] failed to update submodule `candle-examples/examples/flash-attn/cutlass` [INFO] [stderr] [INFO] [stderr] Caused by: [INFO] [stderr] failed to fetch submodule `candle-examples/examples/flash-attn/cutlass` from https://github.com/NVIDIA/cutlass.git [INFO] [stderr] [INFO] [stderr] Caused by: [INFO] [stderr] revision c4f6b8c6bc94ff69048492fb34df0dfaf1983933 not found [INFO] [stderr] [INFO] [stderr] Caused by: [INFO] [stderr] cannot extend packfile '/workspace/cargo-home/git/checkouts/candle-5b4d092929d18d36/e6d86b0/candle-flash-attn/cutlass/.git/objects/pack/pack_git2_dd499a3fb09bd352': No space left on device; class=Os (2) [INFO] checking fourpenny/candle-mnist against try#86f78589b09557f70c9db3f56ad1921e0a9f76ef for pr-138438 [INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist" "/workspace/builds/worker-6-tc2/source", kill_on_drop: false }` [INFO] [stderr] Cloning into '/workspace/builds/worker-6-tc2/source'... [INFO] [stderr] done. [INFO] validating manifest of git repo https://github.com/fourpenny/candle-mnist on toolchain 86f78589b09557f70c9db3f56ad1921e0a9f76ef [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+86f78589b09557f70c9db3f56ad1921e0a9f76ef" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }` [INFO] started tweaking git repo https://github.com/fourpenny/candle-mnist [INFO] finished tweaking git repo https://github.com/fourpenny/candle-mnist [INFO] tweaked toml for git repo https://github.com/fourpenny/candle-mnist written to /workspace/builds/worker-6-tc2/source/Cargo.toml [INFO] crate git repo https://github.com/fourpenny/candle-mnist already has a lockfile, it will not be regenerated [INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+86f78589b09557f70c9db3f56ad1921e0a9f76ef" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }` [INFO] [stderr] Blocking waiting for file lock on package cache [INFO] [stderr] error: failed to get `candle-core` as a dependency of package `candle_tut v0.1.0 (/workspace/builds/worker-6-tc2/source)` [INFO] [stderr] [INFO] [stderr] Caused by: [INFO] [stderr] failed to load source for dependency `candle-core` [INFO] [stderr] [INFO] [stderr] Caused by: [INFO] [stderr] Unable to update https://github.com/huggingface/candle.git#e6d86b08 [INFO] [stderr] [INFO] [stderr] Caused by: [INFO] [stderr] could not write to '/workspace/cargo-home/git/checkouts/candle-5b4d092929d18d36/e6d86b0/candle-transformers/src/models/jina_bert.rs': No space left on device; class=Os (2) [INFO] checking fourpenny/candle-mnist against try#86f78589b09557f70c9db3f56ad1921e0a9f76ef for pr-138438 [INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist" "/workspace/builds/worker-6-tc2/source", kill_on_drop: false }` [INFO] [stderr] Cloning into '/workspace/builds/worker-6-tc2/source'... [INFO] [stderr] error: failed to write new configuration file /workspace/builds/worker-6-tc2/source/.git/config.lock [INFO] [stderr] fatal: could not set 'remote.origin.fetch' to '+refs/heads/*:refs/remotes/origin/*' [INFO] checking fourpenny/candle-mnist against try#86f78589b09557f70c9db3f56ad1921e0a9f76ef for pr-138438 [INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2Ffourpenny%2Fcandle-mnist" "/workspace/builds/worker-6-tc2/source", kill_on_drop: false }` [INFO] [stderr] fatal: could not create work tree dir '/workspace/builds/worker-6-tc2/source': No space left on device failed to checkout https://github.com/fourpenny/candle-mnist Caused by: command failed: exit status: 128