[INFO] fetching crate remotecache 0.0.0...
[INFO] testing remotecache-0.0.0 against 1.75.0 for beta-1.76-1
[INFO] extracting crate remotecache 0.0.0 into /workspace/builds/worker-6-tc1/source
[INFO] validating manifest of crates.io crate remotecache 0.0.0 on toolchain 1.75.0
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.75.0" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] started tweaking crates.io crate remotecache 0.0.0
[INFO] finished tweaking crates.io crate remotecache 0.0.0
[INFO] tweaked toml for crates.io crate remotecache 0.0.0 written to /workspace/builds/worker-6-tc1/source/Cargo.toml
[INFO] crate crates.io crate remotecache 0.0.0 already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.75.0" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] [stderr]     Updating crates.io index
[INFO] [stderr]  Downloading crates ...
[INFO] [stderr]   Downloaded serde v1.0.167
[INFO] [stderr]   Downloaded fs4 v0.6.6
[INFO] [stderr]   Downloaded serde_derive v1.0.167
[INFO] [stderr]   Downloaded toml_edit v0.19.12
[INFO] [stderr]   Downloaded winnow v0.4.8
[INFO] [stderr]   Downloaded regex-automata v0.3.1
[INFO] [stderr]   Downloaded flexbuffers v2.0.0
[INFO] [stderr]   Downloaded async-trait v0.1.71
[INFO] [stderr]   Downloaded test-log v0.2.12
[INFO] [stderr]   Downloaded tokio-rusqlite v0.4.0
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:2788e3201cd34a07e3172128adcd8b3090168a8e3bcc40d7c032b9dda1df7d1c" "/opt/rustwide/cargo-home/bin/cargo" "+1.75.0" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] [stdout] 7c16de5c9edfa3355f6c69775081d9493b784981bab1cfc97e20220c1dce28c1
[INFO] running `Command { std: "docker" "start" "-a" "7c16de5c9edfa3355f6c69775081d9493b784981bab1cfc97e20220c1dce28c1", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "7c16de5c9edfa3355f6c69775081d9493b784981bab1cfc97e20220c1dce28c1", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "7c16de5c9edfa3355f6c69775081d9493b784981bab1cfc97e20220c1dce28c1", kill_on_drop: false }`
[INFO] [stdout] 7c16de5c9edfa3355f6c69775081d9493b784981bab1cfc97e20220c1dce28c1
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:2788e3201cd34a07e3172128adcd8b3090168a8e3bcc40d7c032b9dda1df7d1c" "/opt/rustwide/cargo-home/bin/cargo" "+1.75.0" "build" "--frozen" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] 45a4e1b7760986f3abbac974a353f3f4e6cd4b92010bb472d5a6768a55e997ba
[INFO] running `Command { std: "docker" "start" "-a" "45a4e1b7760986f3abbac974a353f3f4e6cd4b92010bb472d5a6768a55e997ba", kill_on_drop: false }`
[INFO] [stderr]    Compiling proc-macro2 v1.0.63
[INFO] [stderr]    Compiling unicode-ident v1.0.10
[INFO] [stderr]    Compiling quote v1.0.29
[INFO] [stderr]    Compiling once_cell v1.18.0
[INFO] [stderr]    Compiling libc v0.2.147
[INFO] [stderr]    Compiling bytes v1.4.0
[INFO] [stderr]    Compiling pin-project-lite v0.2.10
[INFO] [stderr]    Compiling tokio v1.29.1
[INFO] [stderr]    Compiling indexmap v1.9.3
[INFO] [stderr]    Compiling futures-core v0.3.28
[INFO] [stderr]    Compiling anyhow v1.0.71
[INFO] [stderr]    Compiling either v1.8.1
[INFO] [stderr]    Compiling tracing-core v0.1.31
[INFO] [stderr]    Compiling itertools v0.10.5
[INFO] [stderr]    Compiling slab v0.4.8
[INFO] [stderr]    Compiling futures-task v0.3.28
[INFO] [stderr]    Compiling syn v2.0.23
[INFO] [stderr]    Compiling syn v1.0.109
[INFO] [stderr]    Compiling ahash v0.8.3
[INFO] [stderr]    Compiling equivalent v1.0.0
[INFO] [stderr]    Compiling rustversion v1.0.13
[INFO] [stderr]    Compiling futures-util v0.3.28
[INFO] [stderr]    Compiling serde v1.0.167
[INFO] [stderr]    Compiling signal-hook-registry v1.4.1
[INFO] [stderr]    Compiling mio v0.8.8
[INFO] [stderr]    Compiling num_cpus v1.16.0
[INFO] [stderr]    Compiling socket2 v0.4.9
[INFO] [stderr]    Compiling itoa v1.0.8
[INFO] [stderr]    Compiling memchr v2.5.0
[INFO] [stderr]    Compiling bitflags v2.3.3
[INFO] [stderr]    Compiling http v0.2.9
[INFO] [stderr]    Compiling io-lifetimes v1.0.11
[INFO] [stderr]    Compiling getrandom v0.2.10
[INFO] [stderr]    Compiling rustix v0.37.23
[INFO] [stderr]    Compiling typenum v1.16.0
[INFO] [stderr]    Compiling rustix v0.38.3
[INFO] [stderr]    Compiling allocator-api2 v0.2.15
[INFO] [stderr]    Compiling winnow v0.4.8
[INFO] [stderr]    Compiling futures-sink v0.3.28
[INFO] [stderr]    Compiling hashbrown v0.14.0
[INFO] [stderr]    Compiling rand_core v0.6.4
[INFO] [stderr]    Compiling tempfile v3.6.0
[INFO] [stderr]    Compiling linux-raw-sys v0.3.8
[INFO] [stderr]    Compiling futures-channel v0.3.28
[INFO] [stderr]    Compiling regex-syntax v0.7.3
[INFO] [stderr]    Compiling tower-service v0.3.2
[INFO] [stderr]    Compiling prettyplease v0.1.25
[INFO] [stderr]    Compiling httparse v1.8.0
[INFO] [stderr]    Compiling linux-raw-sys v0.4.3
[INFO] [stderr]    Compiling async-trait v0.1.71
[INFO] [stderr]    Compiling rand_chacha v0.3.1
[INFO] [stderr]    Compiling indexmap v2.0.0
[INFO] [stderr]    Compiling regex-automata v0.3.1
[INFO] [stderr]    Compiling http-body v0.4.5
[INFO] [stderr]    Compiling toml_datetime v0.6.3
[INFO] [stderr]    Compiling try-lock v0.2.4
[INFO] [stderr]    Compiling fastrand v1.9.0
[INFO] [stderr]    Compiling fixedbitset v0.4.2
[INFO] [stderr]    Compiling vcpkg v0.2.15
[INFO] [stderr]    Compiling pkg-config v0.3.27
[INFO] [stderr]    Compiling petgraph v0.6.3
[INFO] [stderr]    Compiling prost-derive v0.11.9
[INFO] [stderr]    Compiling toml_edit v0.19.12
[INFO] [stderr]    Compiling libsqlite3-sys v0.26.0
[INFO] [stderr]    Compiling regex v1.9.1
[INFO] [stderr]    Compiling tokio-macros v2.1.0
[INFO] [stderr]    Compiling tracing-attributes v0.1.26
[INFO] [stderr]    Compiling futures-macro v0.3.28
[INFO] [stderr]    Compiling serde_derive v1.0.167
[INFO] [stderr]    Compiling pin-project-internal v1.1.2
[INFO] [stderr]    Compiling prost v0.11.9
[INFO] [stderr]    Compiling want v0.3.1
[INFO] [stderr]    Compiling prost-types v0.11.9
[INFO] [stderr]    Compiling generic-array v0.14.7
[INFO] [stderr]    Compiling tracing v0.1.37
[INFO] [stderr]    Compiling rand v0.8.5
[INFO] [stderr]    Compiling which v4.4.0
[INFO] [stderr]    Compiling axum-core v0.3.4
[INFO] [stderr]    Compiling crossbeam-utils v0.8.16
[INFO] [stderr]    Compiling multimap v0.8.3
[INFO] [stderr]    Compiling log v0.4.19
[INFO] [stderr]    Compiling tower-layer v0.3.2
[INFO] [stderr]    Compiling prost-build v0.11.9
[INFO] [stderr]    Compiling anstyle-parse v0.2.1
[INFO] [stderr]    Compiling pin-project v1.1.2
[INFO] [stderr]    Compiling is-terminal v0.4.9
[INFO] [stderr]    Compiling aho-corasick v1.0.2
[INFO] [stderr]    Compiling proc-macro-crate v1.3.1
[INFO] [stderr]    Compiling axum v0.6.18
[INFO] [stderr]    Compiling anstyle v1.0.1
[INFO] [stderr]    Compiling anstyle-query v1.0.0
[INFO] [stderr]    Compiling regex-syntax v0.6.29
[INFO] [stderr]    Compiling mime v0.3.17
[INFO] [stderr]    Compiling smallvec v1.11.0
[INFO] [stderr]    Compiling num_enum_derive v0.5.11
[INFO] [stderr]    Compiling tonic-build v0.9.2
[INFO] [stderr]    Compiling tokio-util v0.7.8
[INFO] [stderr]    Compiling tokio-io-timeout v1.2.0
[INFO] [stderr]    Compiling regex-automata v0.1.10
[INFO] [stderr]    Compiling h2 v0.3.20
[INFO] [stderr]    Compiling tower v0.4.13
[INFO] [stderr]    Compiling anstream v0.3.2
[INFO] [stderr]    Compiling block-buffer v0.10.4
[INFO] [stderr]    Compiling crypto-common v0.1.6
[INFO] [stderr]    Compiling serde_spanned v0.6.3
[INFO] [stderr]    Compiling hashlink v0.8.3
[INFO] [stderr]    Compiling thiserror v1.0.43
[INFO] [stderr]    Compiling sync_wrapper v0.1.2
[INFO] [stderr]    Compiling overload v0.1.1
[INFO] [stderr]    Compiling fallible-iterator v0.2.0
[INFO] [stderr]    Compiling percent-encoding v2.3.0
[INFO] [stderr]    Compiling matchit v0.7.0
[INFO] [stderr]    Compiling fallible-streaming-iterator v0.1.9
[INFO] [stderr]    Compiling clap_lex v0.5.0
[INFO] [stderr]    Compiling tracing-log v0.1.3
[INFO] [stderr]    Compiling nu-ansi-term v0.46.0
[INFO] [stderr]    Compiling clap_builder v4.3.11
[INFO] [stderr]    Compiling hyper v0.14.27
[INFO] [stderr]    Compiling rusqlite v0.29.0
[INFO] [stderr]    Compiling crossbeam-channel v0.5.8
[INFO] [stderr]    Compiling digest v0.10.7
[INFO] [stderr]    Compiling matchers v0.1.0
[INFO] [stderr]    Compiling remotecache v0.0.0 (/opt/rustwide/workdir)
[INFO] [stderr]    Compiling num_enum v0.5.11
[INFO] [stderr]    Compiling tokio-stream v0.1.14
[INFO] [stderr]    Compiling thiserror-impl v1.0.43
[INFO] [stderr]    Compiling clap_derive v4.3.2
[INFO] [stderr]    Compiling hyper-timeout v0.4.1
[INFO] [stderr]    Compiling sharded-slab v0.1.4
[INFO] [stderr]    Compiling path-dedot v3.1.0
[INFO] [stderr]    Compiling thread_local v1.1.7
[INFO] [stderr]    Compiling cpufeatures v0.2.9
[INFO] [stderr]    Compiling base64 v0.21.2
[INFO] [stderr]    Compiling tracing-subscriber v0.3.17
[INFO] [stderr]    Compiling sha2 v0.10.7
[INFO] [stderr]    Compiling flexbuffers v2.0.0
[INFO] [stderr]    Compiling backoff v0.4.0
[INFO] [stderr]    Compiling path-absolutize v3.1.0
[INFO] [stderr]    Compiling toml v0.7.6
[INFO] [stderr]    Compiling tokio-rusqlite v0.4.0
[INFO] [stderr]    Compiling clap v4.3.11
[INFO] [stderr]    Compiling fs4 v0.6.6
[INFO] [stderr]    Compiling hex v0.4.3
[INFO] [stderr]    Compiling tonic v0.9.2
[INFO] [stderr]     Finished dev [unoptimized + debuginfo] target(s) in 1m 01s
[INFO] running `Command { std: "docker" "inspect" "45a4e1b7760986f3abbac974a353f3f4e6cd4b92010bb472d5a6768a55e997ba", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "45a4e1b7760986f3abbac974a353f3f4e6cd4b92010bb472d5a6768a55e997ba", kill_on_drop: false }`
[INFO] [stdout] 45a4e1b7760986f3abbac974a353f3f4e6cd4b92010bb472d5a6768a55e997ba
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:2788e3201cd34a07e3172128adcd8b3090168a8e3bcc40d7c032b9dda1df7d1c" "/opt/rustwide/cargo-home/bin/cargo" "+1.75.0" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] ef3ce99f61b194207087d477d1e0f88b12f9a4715ff9d0e83926974e528d3e14
[INFO] running `Command { std: "docker" "start" "-a" "ef3ce99f61b194207087d477d1e0f88b12f9a4715ff9d0e83926974e528d3e14", kill_on_drop: false }`
[INFO] [stderr]    Compiling anyhow v1.0.71
[INFO] [stderr]    Compiling test-log v0.2.12
[INFO] [stderr]    Compiling prost-derive v0.11.9
[INFO] [stderr]    Compiling prost v0.11.9
[INFO] [stderr]    Compiling tonic v0.9.2
[INFO] [stderr]    Compiling prost-types v0.11.9
[INFO] [stderr]    Compiling prost-build v0.11.9
[INFO] [stderr]    Compiling tonic-build v0.9.2
[INFO] [stderr]    Compiling remotecache v0.0.0 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished test [unoptimized + debuginfo] target(s) in 27.45s
[INFO] running `Command { std: "docker" "inspect" "ef3ce99f61b194207087d477d1e0f88b12f9a4715ff9d0e83926974e528d3e14", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "ef3ce99f61b194207087d477d1e0f88b12f9a4715ff9d0e83926974e528d3e14", kill_on_drop: false }`
[INFO] [stdout] ef3ce99f61b194207087d477d1e0f88b12f9a4715ff9d0e83926974e528d3e14
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:2788e3201cd34a07e3172128adcd8b3090168a8e3bcc40d7c032b9dda1df7d1c" "/opt/rustwide/cargo-home/bin/cargo" "+1.75.0" "test" "--frozen", kill_on_drop: false }`
[INFO] [stdout] abf4648aca89176e59f8dec11d7346a04c35900c9488731ddb90f04c9359d50f
[INFO] running `Command { std: "docker" "start" "-a" "abf4648aca89176e59f8dec11d7346a04c35900c9488731ddb90f04c9359d50f", kill_on_drop: false }`
[INFO] [stderr]     Finished test [unoptimized + debuginfo] target(s) in 0.28s
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/remotecache-25ec1afcca1e106a)
[INFO] [stdout] 
[INFO] [stdout] running 21 tests
[INFO] [stdout] test tests::multi::multi_cache_works_without_in_memory_caching ... FAILED
[INFO] [stdout] test tests::mem::generates_in_background_and_caches_values ... ok
[INFO] [stdout] test tests::mem::can_cache_multiple_types ... ok
[INFO] [stdout] test tests::multi::multi_cache_caches_results_in_memory ... FAILED
[INFO] [stdout] test tests::persistent::local_remote_apis_work_concurrently ... FAILED
[INFO] [stdout] test tests::persistent::local_server_does_not_reassign_long_running_tasks ... FAILED
[INFO] [stdout] test tests::multi::multi_cache_writes_through ... FAILED
[INFO] [stdout] test tests::persistent::local_client_cacheable_api_works ... FAILED
[INFO] [stdout] test tests::multi::multi_cache_blocks_on_generator_in_nested_cache ... FAILED
[INFO] [stdout] test tests::persistent::local_server_persists_cached_values ... FAILED
[INFO] [stdout] test tests::persistent::local_server_reassigns_failed_tasks ... FAILED
[INFO] [stdout] test tests::persistent::remote_client_cacheable_api_works ... FAILED
[INFO] [stdout] test tests::persistent::local_server_recovers_from_failures_on_restart ... FAILED
[INFO] [stdout] test tests::persistent::remote_server_does_not_reassign_long_running_tasks ... FAILED
[INFO] [stdout] test tests::persistent::remote_server_recovers_from_failures_on_restart ... FAILED
[INFO] [stdout] test tests::persistent::remote_server_persists_cached_values ... FAILED
[INFO] [stdout] test tests::persistent::remote_server_reassigns_failed_tasks ... FAILED
[INFO] [stdout] test tests::persistent::servers_cannot_be_started_with_same_root ... FAILED
[INFO] [stdout] test tests::mem::panics_on_mismatched_types - should panic ... ok
[INFO] [stdout] test tests::mem::cache_should_not_hang_on_panic ... ok
[INFO] [stdout] test tests::mem::cacheable_api_works ... ok
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout] 
[INFO] [stdout] ---- tests::multi::multi_cache_works_without_in_memory_caching stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::multi::multi_cache_caches_results_in_memory stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::local_remote_apis_work_concurrently stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::local_server_does_not_reassign_long_running_tasks stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::multi::multi_cache_writes_through stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::local_client_cacheable_api_works stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::multi::multi_cache_blocks_on_generator_in_nested_cache stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::local_server_persists_cached_values stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::local_server_reassigns_failed_tasks stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::remote_client_cacheable_api_works stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::local_server_recovers_from_failures_on_restart stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::remote_server_does_not_reassign_long_running_tasks stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::remote_server_recovers_from_failures_on_restart stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::remote_server_persists_cached_values stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::remote_server_reassigns_failed_tasks stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::servers_cannot_be_started_with_same_root stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout]     tests::multi::multi_cache_blocks_on_generator_in_nested_cache
[INFO] [stdout]     tests::multi::multi_cache_caches_results_in_memory
[INFO] [stdout]     tests::multi::multi_cache_works_without_in_memory_caching
[INFO] [stdout]     tests::multi::multi_cache_writes_through
[INFO] [stdout]     tests::persistent::local_client_cacheable_api_works
[INFO] [stdout]     tests::persistent::local_remote_apis_work_concurrently
[INFO] [stdout]     tests::persistent::local_server_does_not_reassign_long_running_tasks
[INFO] [stdout]     tests::persistent::local_server_persists_cached_values
[INFO] [stdout]     tests::persistent::local_server_reassigns_failed_tasks
[INFO] [stdout]     tests::persistent::local_server_recovers_from_failures_on_restart
[INFO] [stdout]     tests::persistent::remote_client_cacheable_api_works
[INFO] [stdout]     tests::persistent::remote_server_does_not_reassign_long_running_tasks
[INFO] [stdout]     tests::persistent::remote_server_persists_cached_values
[INFO] [stdout]     tests::persistent::remote_server_reassigns_failed_tasks
[INFO] [stdout]     tests::persistent::remote_server_recovers_from_failures_on_restart
[INFO] [stdout]     tests::persistent::servers_cannot_be_started_with_same_root
[INFO] [stdout] 
[INFO] [stdout] test result: FAILED. 5 passed; 16 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.23s
[INFO] [stdout] 
[INFO] [stderr] error: test failed, to rerun pass `--lib`
[INFO] running `Command { std: "docker" "inspect" "abf4648aca89176e59f8dec11d7346a04c35900c9488731ddb90f04c9359d50f", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "abf4648aca89176e59f8dec11d7346a04c35900c9488731ddb90f04c9359d50f", kill_on_drop: false }`
[INFO] [stdout] abf4648aca89176e59f8dec11d7346a04c35900c9488731ddb90f04c9359d50f
[INFO] testing remotecache-0.0.0 against beta-2023-12-22 for beta-1.76-1
[INFO] extracting crate remotecache 0.0.0 into /workspace/builds/worker-6-tc2/source
[INFO] validating manifest of crates.io crate remotecache 0.0.0 on toolchain beta-2023-12-22
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+beta-2023-12-22" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] started tweaking crates.io crate remotecache 0.0.0
[INFO] finished tweaking crates.io crate remotecache 0.0.0
[INFO] tweaked toml for crates.io crate remotecache 0.0.0 written to /workspace/builds/worker-6-tc2/source/Cargo.toml
[INFO] crate crates.io crate remotecache 0.0.0 already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+beta-2023-12-22" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:2788e3201cd34a07e3172128adcd8b3090168a8e3bcc40d7c032b9dda1df7d1c" "/opt/rustwide/cargo-home/bin/cargo" "+beta-2023-12-22" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] [stdout] 997f72a715915d1de9f3755f2fe4abbf89b7642b0b8643d89487d7119da8fc33
[INFO] running `Command { std: "docker" "start" "-a" "997f72a715915d1de9f3755f2fe4abbf89b7642b0b8643d89487d7119da8fc33", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "997f72a715915d1de9f3755f2fe4abbf89b7642b0b8643d89487d7119da8fc33", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "997f72a715915d1de9f3755f2fe4abbf89b7642b0b8643d89487d7119da8fc33", kill_on_drop: false }`
[INFO] [stdout] 997f72a715915d1de9f3755f2fe4abbf89b7642b0b8643d89487d7119da8fc33
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:2788e3201cd34a07e3172128adcd8b3090168a8e3bcc40d7c032b9dda1df7d1c" "/opt/rustwide/cargo-home/bin/cargo" "+beta-2023-12-22" "build" "--frozen" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] 97f61aca16f034b92257696114a0426838f44062c959955db12d78e05150aa1f
[INFO] running `Command { std: "docker" "start" "-a" "97f61aca16f034b92257696114a0426838f44062c959955db12d78e05150aa1f", kill_on_drop: false }`
[INFO] [stderr]    Compiling proc-macro2 v1.0.63
[INFO] [stderr]    Compiling unicode-ident v1.0.10
[INFO] [stderr]    Compiling quote v1.0.29
[INFO] [stderr]    Compiling libc v0.2.147
[INFO] [stderr]    Compiling once_cell v1.18.0
[INFO] [stderr]    Compiling pin-project-lite v0.2.10
[INFO] [stderr]    Compiling bytes v1.4.0
[INFO] [stderr]    Compiling indexmap v1.9.3
[INFO] [stderr]    Compiling tokio v1.29.1
[INFO] [stderr]    Compiling futures-core v0.3.28
[INFO] [stderr]    Compiling either v1.8.1
[INFO] [stderr]    Compiling anyhow v1.0.71
[INFO] [stderr]    Compiling itertools v0.10.5
[INFO] [stderr]    Compiling tracing-core v0.1.31
[INFO] [stderr]    Compiling slab v0.4.8
[INFO] [stderr]    Compiling futures-task v0.3.28
[INFO] [stderr]    Compiling signal-hook-registry v1.4.1
[INFO] [stderr]    Compiling mio v0.8.8
[INFO] [stderr]    Compiling syn v2.0.23
[INFO] [stderr]    Compiling syn v1.0.109
[INFO] [stderr]    Compiling num_cpus v1.16.0
[INFO] [stderr]    Compiling socket2 v0.4.9
[INFO] [stderr]    Compiling ahash v0.8.3
[INFO] [stderr]    Compiling futures-util v0.3.28
[INFO] [stderr]    Compiling rustversion v1.0.13
[INFO] [stderr]    Compiling equivalent v1.0.0
[INFO] [stderr]    Compiling serde v1.0.167
[INFO] [stderr]    Compiling itoa v1.0.8
[INFO] [stderr]    Compiling bitflags v2.3.3
[INFO] [stderr]    Compiling memchr v2.5.0
[INFO] [stderr]    Compiling http v0.2.9
[INFO] [stderr]    Compiling io-lifetimes v1.0.11
[INFO] [stderr]    Compiling getrandom v0.2.10
[INFO] [stderr]    Compiling winnow v0.4.8
[INFO] [stderr]    Compiling typenum v1.16.0
[INFO] [stderr]    Compiling rustix v0.37.23
[INFO] [stderr]    Compiling rustix v0.38.3
[INFO] [stderr]    Compiling allocator-api2 v0.2.15
[INFO] [stderr]    Compiling futures-sink v0.3.28
[INFO] [stderr]    Compiling rand_core v0.6.4
[INFO] [stderr]    Compiling hashbrown v0.14.0
[INFO] [stderr]    Compiling tempfile v3.6.0
[INFO] [stderr]    Compiling linux-raw-sys v0.4.3
[INFO] [stderr]    Compiling futures-channel v0.3.28
[INFO] [stderr]    Compiling linux-raw-sys v0.3.8
[INFO] [stderr]    Compiling prettyplease v0.1.25
[INFO] [stderr]    Compiling tower-service v0.3.2
[INFO] [stderr]    Compiling httparse v1.8.0
[INFO] [stderr]    Compiling async-trait v0.1.71
[INFO] [stderr]    Compiling regex-syntax v0.7.3
[INFO] [stderr]    Compiling rand_chacha v0.3.1
[INFO] [stderr]    Compiling indexmap v2.0.0
[INFO] [stderr]    Compiling http-body v0.4.5
[INFO] [stderr]    Compiling fastrand v1.9.0
[INFO] [stderr]    Compiling fixedbitset v0.4.2
[INFO] [stderr]    Compiling try-lock v0.2.4
[INFO] [stderr]    Compiling toml_datetime v0.6.3
[INFO] [stderr]    Compiling pkg-config v0.3.27
[INFO] [stderr]    Compiling vcpkg v0.2.15
[INFO] [stderr]    Compiling toml_edit v0.19.12
[INFO] [stderr]    Compiling regex-automata v0.3.1
[INFO] [stderr]    Compiling libsqlite3-sys v0.26.0
[INFO] [stderr]    Compiling want v0.3.1
[INFO] [stderr]    Compiling petgraph v0.6.3
[INFO] [stderr]    Compiling generic-array v0.14.7
[INFO] [stderr]    Compiling prost-derive v0.11.9
[INFO] [stderr]    Compiling rand v0.8.5
[INFO] [stderr]    Compiling regex v1.9.1
[INFO] [stderr]    Compiling tokio-macros v2.1.0
[INFO] [stderr]    Compiling tracing-attributes v0.1.26
[INFO] [stderr]    Compiling futures-macro v0.3.28
[INFO] [stderr]    Compiling serde_derive v1.0.167
[INFO] [stderr]    Compiling pin-project-internal v1.1.2
[INFO] [stderr]    Compiling prost v0.11.9
[INFO] [stderr]    Compiling which v4.4.0
[INFO] [stderr]    Compiling prost-types v0.11.9
[INFO] [stderr]    Compiling tracing v0.1.37
[INFO] [stderr]    Compiling axum-core v0.3.4
[INFO] [stderr]    Compiling log v0.4.19
[INFO] [stderr]    Compiling tower-layer v0.3.2
[INFO] [stderr]    Compiling crossbeam-utils v0.8.16
[INFO] [stderr]    Compiling multimap v0.8.3
[INFO] [stderr]    Compiling anstyle-parse v0.2.1
[INFO] [stderr]    Compiling proc-macro-crate v1.3.1
[INFO] [stderr]    Compiling pin-project v1.1.2
[INFO] [stderr]    Compiling prost-build v0.11.9
[INFO] [stderr]    Compiling is-terminal v0.4.9
[INFO] [stderr]    Compiling aho-corasick v1.0.2
[INFO] [stderr]    Compiling axum v0.6.18
[INFO] [stderr]    Compiling smallvec v1.11.0
[INFO] [stderr]    Compiling anstyle-query v1.0.0
[INFO] [stderr]    Compiling regex-syntax v0.6.29
[INFO] [stderr]    Compiling anstyle v1.0.1
[INFO] [stderr]    Compiling mime v0.3.17
[INFO] [stderr]    Compiling anstream v0.3.2
[INFO] [stderr]    Compiling tonic-build v0.9.2
[INFO] [stderr]    Compiling num_enum_derive v0.5.11
[INFO] [stderr]    Compiling tokio-util v0.7.8
[INFO] [stderr]    Compiling h2 v0.3.20
[INFO] [stderr]    Compiling tower v0.4.13
[INFO] [stderr]    Compiling tokio-io-timeout v1.2.0
[INFO] [stderr]    Compiling regex-automata v0.1.10
[INFO] [stderr]    Compiling block-buffer v0.10.4
[INFO] [stderr]    Compiling crypto-common v0.1.6
[INFO] [stderr]    Compiling hashlink v0.8.3
[INFO] [stderr]    Compiling overload v0.1.1
[INFO] [stderr]    Compiling serde_spanned v0.6.3
[INFO] [stderr]    Compiling thiserror v1.0.43
[INFO] [stderr]    Compiling clap_lex v0.5.0
[INFO] [stderr]    Compiling sync_wrapper v0.1.2
[INFO] [stderr]    Compiling percent-encoding v2.3.0
[INFO] [stderr]    Compiling fallible-iterator v0.2.0
[INFO] [stderr]    Compiling matchit v0.7.0
[INFO] [stderr]    Compiling fallible-streaming-iterator v0.1.9
[INFO] [stderr]    Compiling rusqlite v0.29.0
[INFO] [stderr]    Compiling tracing-log v0.1.3
[INFO] [stderr]    Compiling clap_builder v4.3.11
[INFO] [stderr]    Compiling hyper v0.14.27
[INFO] [stderr]    Compiling nu-ansi-term v0.46.0
[INFO] [stderr]    Compiling digest v0.10.7
[INFO] [stderr]    Compiling matchers v0.1.0
[INFO] [stderr]    Compiling crossbeam-channel v0.5.8
[INFO] [stderr]    Compiling num_enum v0.5.11
[INFO] [stderr]    Compiling remotecache v0.0.0 (/opt/rustwide/workdir)
[INFO] [stderr]    Compiling tokio-stream v0.1.14
[INFO] [stderr]    Compiling clap_derive v4.3.2
[INFO] [stderr]    Compiling thiserror-impl v1.0.43
[INFO] [stderr]    Compiling sharded-slab v0.1.4
[INFO] [stderr]    Compiling thread_local v1.1.7
[INFO] [stderr]    Compiling path-dedot v3.1.0
[INFO] [stderr]    Compiling cpufeatures v0.2.9
[INFO] [stderr]    Compiling base64 v0.21.2
[INFO] [stderr]    Compiling sha2 v0.10.7
[INFO] [stderr]    Compiling flexbuffers v2.0.0
[INFO] [stderr]    Compiling backoff v0.4.0
[INFO] [stderr]    Compiling path-absolutize v3.1.0
[INFO] [stderr]    Compiling hyper-timeout v0.4.1
[INFO] [stderr]    Compiling tracing-subscriber v0.3.17
[INFO] [stderr]    Compiling tokio-rusqlite v0.4.0
[INFO] [stderr]    Compiling toml v0.7.6
[INFO] [stderr]    Compiling fs4 v0.6.6
[INFO] [stderr]    Compiling hex v0.4.3
[INFO] [stderr]    Compiling clap v4.3.11
[INFO] [stderr]    Compiling tonic v0.9.2
[INFO] [stderr]     Finished dev [unoptimized + debuginfo] target(s) in 1m 13s
[INFO] running `Command { std: "docker" "inspect" "97f61aca16f034b92257696114a0426838f44062c959955db12d78e05150aa1f", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "97f61aca16f034b92257696114a0426838f44062c959955db12d78e05150aa1f", kill_on_drop: false }`
[INFO] [stdout] 97f61aca16f034b92257696114a0426838f44062c959955db12d78e05150aa1f
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:2788e3201cd34a07e3172128adcd8b3090168a8e3bcc40d7c032b9dda1df7d1c" "/opt/rustwide/cargo-home/bin/cargo" "+beta-2023-12-22" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] aedbee3106c354286b39664b8db97657f3d4c5441038de534e4af069a09539da
[INFO] running `Command { std: "docker" "start" "-a" "aedbee3106c354286b39664b8db97657f3d4c5441038de534e4af069a09539da", kill_on_drop: false }`
[INFO] [stderr]    Compiling anyhow v1.0.71
[INFO] [stderr]    Compiling test-log v0.2.12
[INFO] [stderr]    Compiling prost-derive v0.11.9
[INFO] [stderr]    Compiling prost v0.11.9
[INFO] [stderr]    Compiling prost-types v0.11.9
[INFO] [stderr]    Compiling tonic v0.9.2
[INFO] [stderr]    Compiling prost-build v0.11.9
[INFO] [stderr]    Compiling tonic-build v0.9.2
[INFO] [stderr]    Compiling remotecache v0.0.0 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished test [unoptimized + debuginfo] target(s) in 23.29s
[INFO] running `Command { std: "docker" "inspect" "aedbee3106c354286b39664b8db97657f3d4c5441038de534e4af069a09539da", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "aedbee3106c354286b39664b8db97657f3d4c5441038de534e4af069a09539da", kill_on_drop: false }`
[INFO] [stdout] aedbee3106c354286b39664b8db97657f3d4c5441038de534e4af069a09539da
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-6-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:2788e3201cd34a07e3172128adcd8b3090168a8e3bcc40d7c032b9dda1df7d1c" "/opt/rustwide/cargo-home/bin/cargo" "+beta-2023-12-22" "test" "--frozen", kill_on_drop: false }`
[INFO] [stdout] 71e87f05065d6fdd0e658a259fc3c6e73e703bf2accb5ea56f0d59e13e4d548d
[INFO] running `Command { std: "docker" "start" "-a" "71e87f05065d6fdd0e658a259fc3c6e73e703bf2accb5ea56f0d59e13e4d548d", kill_on_drop: false }`
[INFO] [stderr]     Finished test [unoptimized + debuginfo] target(s) in 0.26s
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/remotecache-b316751140a49749)
[INFO] [stdout] 
[INFO] [stdout] running 21 tests
[INFO] [stdout] test tests::multi::multi_cache_works_without_in_memory_caching ... FAILED
[INFO] [stdout] test tests::multi::multi_cache_writes_through ... FAILED
[INFO] [stdout] test tests::multi::multi_cache_blocks_on_generator_in_nested_cache ... FAILED
[INFO] [stdout] test tests::persistent::local_client_cacheable_api_works ... FAILED
[INFO] [stdout] test tests::persistent::local_remote_apis_work_concurrently ... FAILED
[INFO] [stdout] test tests::persistent::local_server_persists_cached_values ... FAILED
[INFO] [stdout] test tests::persistent::local_server_reassigns_failed_tasks ... FAILED
[INFO] [stdout] test tests::persistent::local_server_recovers_from_failures_on_restart ... FAILED
[INFO] [stdout] test tests::mem::can_cache_multiple_types ... ok
[INFO] [stdout] test tests::persistent::remote_server_does_not_reassign_long_running_tasks ... FAILED
[INFO] [stdout] test tests::persistent::remote_server_persists_cached_values ... FAILED
[INFO] [stdout] test tests::persistent::remote_server_reassigns_failed_tasks ... FAILED
[INFO] [stdout] test tests::persistent::remote_server_recovers_from_failures_on_restart ... FAILED
[INFO] [stdout] test tests::persistent::servers_cannot_be_started_with_same_root ... FAILED
[INFO] [stdout] test tests::multi::multi_cache_caches_results_in_memory ... FAILED
[INFO] [stdout] test tests::persistent::remote_client_cacheable_api_works ... FAILED
[INFO] [stdout] test tests::persistent::local_server_does_not_reassign_long_running_tasks ... FAILED
[INFO] [stdout] test tests::mem::generates_in_background_and_caches_values ... ok
[INFO] [stdout] test tests::mem::panics_on_mismatched_types - should panic ... ok
[INFO] [stdout] test tests::mem::cache_should_not_hang_on_panic ... ok
[INFO] [stdout] test tests::mem::cacheable_api_works ... ok
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout] 
[INFO] [stdout] ---- tests::multi::multi_cache_works_without_in_memory_caching stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::multi::multi_cache_writes_through stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::multi::multi_cache_blocks_on_generator_in_nested_cache stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::local_client_cacheable_api_works stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::local_remote_apis_work_concurrently stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::local_server_persists_cached_values stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::local_server_reassigns_failed_tasks stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::local_server_recovers_from_failures_on_restart stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::remote_server_does_not_reassign_long_running_tasks stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::remote_server_persists_cached_values stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::remote_server_reassigns_failed_tasks stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::remote_server_recovers_from_failures_on_restart stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::servers_cannot_be_started_with_same_root stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::multi::multi_cache_caches_results_in_memory stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::remote_client_cacheable_api_works stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::local_server_does_not_reassign_long_running_tasks stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout]     tests::multi::multi_cache_blocks_on_generator_in_nested_cache
[INFO] [stdout]     tests::multi::multi_cache_caches_results_in_memory
[INFO] [stdout]     tests::multi::multi_cache_works_without_in_memory_caching
[INFO] [stdout]     tests::multi::multi_cache_writes_through
[INFO] [stdout]     tests::persistent::local_client_cacheable_api_works
[INFO] [stdout]     tests::persistent::local_remote_apis_work_concurrently
[INFO] [stdout]     tests::persistent::local_server_does_not_reassign_long_running_tasks
[INFO] [stdout]     tests::persistent::local_server_persists_cached_values
[INFO] [stdout]     tests::persistent::local_server_reassigns_failed_tasks
[INFO] [stdout]     tests::persistent::local_server_recovers_from_failures_on_restart
[INFO] [stdout]     tests::persistent::remote_client_cacheable_api_works
[INFO] [stdout]     tests::persistent::remote_server_does_not_reassign_long_running_tasks
[INFO] [stdout]     tests::persistent::remote_server_persists_cached_values
[INFO] [stdout]     tests::persistent::remote_server_reassigns_failed_tasks
[INFO] [stdout]     tests::persistent::remote_server_recovers_from_failures_on_restart
[INFO] [stdout]     tests::persistent::servers_cannot_be_started_with_same_root
[INFO] [stdout] 
[INFO] [stdout] test result: FAILED. 5 passed; 16 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.11s
[INFO] [stdout] 
[INFO] [stderr] error: test failed, to rerun pass `--lib`
[INFO] running `Command { std: "docker" "inspect" "71e87f05065d6fdd0e658a259fc3c6e73e703bf2accb5ea56f0d59e13e4d548d", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "71e87f05065d6fdd0e658a259fc3c6e73e703bf2accb5ea56f0d59e13e4d548d", kill_on_drop: false }`
[INFO] [stdout] 71e87f05065d6fdd0e658a259fc3c6e73e703bf2accb5ea56f0d59e13e4d548d
