[INFO] fetching crate remotecache 0.0.0...
[INFO] testing remotecache-0.0.0 against 1.76.0 for beta-1.77-1
[INFO] extracting crate remotecache 0.0.0 into /workspace/builds/worker-2-tc1/source
[INFO] validating manifest of crates.io crate remotecache 0.0.0 on toolchain 1.76.0
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.76.0" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] started tweaking crates.io crate remotecache 0.0.0
[INFO] finished tweaking crates.io crate remotecache 0.0.0
[INFO] tweaked toml for crates.io crate remotecache 0.0.0 written to /workspace/builds/worker-2-tc1/source/Cargo.toml
[INFO] crate crates.io crate remotecache 0.0.0 already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1.76.0" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] [stderr]     Updating crates.io index
[INFO] [stderr]  Downloading crates ...
[INFO] [stderr]   Downloaded serde_derive v1.0.167
[INFO] [stderr]   Downloaded serde v1.0.167
[INFO] [stderr]   Downloaded allocator-api2 v0.2.15
[INFO] [stderr]   Downloaded flexbuffers v2.0.0
[INFO] [stderr]   Downloaded test-log v0.2.12
[INFO] [stderr]   Downloaded toml_edit v0.19.12
[INFO] [stderr]   Downloaded regex-automata v0.3.1
[INFO] [stderr]   Downloaded winnow v0.4.8
[INFO] [stderr]   Downloaded tokio-rusqlite v0.4.0
[INFO] [stderr]   Downloaded async-trait v0.1.71
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:2788e3201cd34a07e3172128adcd8b3090168a8e3bcc40d7c032b9dda1df7d1c" "/opt/rustwide/cargo-home/bin/cargo" "+1.76.0" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] [stdout] 71b72486f38ac9be3eac584ceea5901b10924a7a309341ac4d81591e1030230b
[INFO] running `Command { std: "docker" "start" "-a" "71b72486f38ac9be3eac584ceea5901b10924a7a309341ac4d81591e1030230b", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "71b72486f38ac9be3eac584ceea5901b10924a7a309341ac4d81591e1030230b", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "71b72486f38ac9be3eac584ceea5901b10924a7a309341ac4d81591e1030230b", kill_on_drop: false }`
[INFO] [stdout] 71b72486f38ac9be3eac584ceea5901b10924a7a309341ac4d81591e1030230b
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:2788e3201cd34a07e3172128adcd8b3090168a8e3bcc40d7c032b9dda1df7d1c" "/opt/rustwide/cargo-home/bin/cargo" "+1.76.0" "build" "--frozen" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] 33c1c9adc98d8617d1180b468b17a4a3eaafd438e01dd105d2971f589d5e8cd6
[INFO] running `Command { std: "docker" "start" "-a" "33c1c9adc98d8617d1180b468b17a4a3eaafd438e01dd105d2971f589d5e8cd6", kill_on_drop: false }`
[INFO] [stderr]    Compiling proc-macro2 v1.0.63
[INFO] [stderr]    Compiling unicode-ident v1.0.10
[INFO] [stderr]    Compiling quote v1.0.29
[INFO] [stderr]    Compiling once_cell v1.18.0
[INFO] [stderr]    Compiling libc v0.2.147
[INFO] [stderr]    Compiling bytes v1.4.0
[INFO] [stderr]    Compiling pin-project-lite v0.2.10
[INFO] [stderr]    Compiling futures-core v0.3.28
[INFO] [stderr]    Compiling anyhow v1.0.71
[INFO] [stderr]    Compiling either v1.8.1
[INFO] [stderr]    Compiling tokio v1.29.1
[INFO] [stderr]    Compiling slab v0.4.8
[INFO] [stderr]    Compiling futures-task v0.3.28
[INFO] [stderr]    Compiling ahash v0.8.3
[INFO] [stderr]    Compiling equivalent v1.0.0
[INFO] [stderr]    Compiling rustversion v1.0.13
[INFO] [stderr]    Compiling serde v1.0.167
[INFO] [stderr]    Compiling futures-util v0.3.28
[INFO] [stderr]    Compiling tracing-core v0.1.31
[INFO] [stderr]    Compiling itertools v0.10.5
[INFO] [stderr]    Compiling memchr v2.5.0
[INFO] [stderr]    Compiling io-lifetimes v1.0.11
[INFO] [stderr]    Compiling itoa v1.0.8
[INFO] [stderr]    Compiling bitflags v2.3.3
[INFO] [stderr]    Compiling rustix v0.38.3
[INFO] [stderr]    Compiling typenum v1.16.0
[INFO] [stderr]    Compiling http v0.2.9
[INFO] [stderr]    Compiling futures-sink v0.3.28
[INFO] [stderr]    Compiling rustix v0.37.23
[INFO] [stderr]    Compiling allocator-api2 v0.2.15
[INFO] [stderr]    Compiling winnow v0.4.8
[INFO] [stderr]    Compiling generic-array v0.14.7
[INFO] [stderr]    Compiling tempfile v3.6.0
[INFO] [stderr]    Compiling heck v0.4.1
[INFO] [stderr]    Compiling hashbrown v0.14.0
[INFO] [stderr]    Compiling async-trait v0.1.71
[INFO] [stderr]    Compiling linux-raw-sys v0.3.8
[INFO] [stderr]    Compiling linux-raw-sys v0.4.3
[INFO] [stderr]    Compiling syn v2.0.23
[INFO] [stderr]    Compiling syn v1.0.109
[INFO] [stderr]    Compiling signal-hook-registry v1.4.1
[INFO] [stderr]    Compiling socket2 v0.4.9
[INFO] [stderr]    Compiling mio v0.8.8
[INFO] [stderr]    Compiling num_cpus v1.16.0
[INFO] [stderr]    Compiling getrandom v0.2.10
[INFO] [stderr]    Compiling prettyplease v0.1.25
[INFO] [stderr]    Compiling ppv-lite86 v0.2.17
[INFO] [stderr]    Compiling regex-syntax v0.7.3
[INFO] [stderr]    Compiling futures-channel v0.3.28
[INFO] [stderr]    Compiling rand_core v0.6.4
[INFO] [stderr]    Compiling indexmap v2.0.0
[INFO] [stderr]    Compiling http-body v0.4.5
[INFO] [stderr]    Compiling toml_datetime v0.6.3
[INFO] [stderr]    Compiling rand_chacha v0.3.1
[INFO] [stderr]    Compiling fastrand v1.9.0
[INFO] [stderr]    Compiling fixedbitset v0.4.2
[INFO] [stderr]    Compiling try-lock v0.2.4
[INFO] [stderr]    Compiling vcpkg v0.2.15
[INFO] [stderr]    Compiling pkg-config v0.3.27
[INFO] [stderr]    Compiling want v0.3.1
[INFO] [stderr]    Compiling petgraph v0.6.3
[INFO] [stderr]    Compiling rand v0.8.5
[INFO] [stderr]    Compiling which v4.4.0
[INFO] [stderr]    Compiling axum-core v0.3.4
[INFO] [stderr]    Compiling utf8parse v0.2.1
[INFO] [stderr]    Compiling log v0.4.19
[INFO] [stderr]    Compiling toml_edit v0.19.12
[INFO] [stderr]    Compiling httpdate v1.0.2
[INFO] [stderr]    Compiling multimap v0.8.3
[INFO] [stderr]    Compiling crossbeam-utils v0.8.16
[INFO] [stderr]    Compiling anstyle-parse v0.2.1
[INFO] [stderr]    Compiling axum v0.6.18
[INFO] [stderr]    Compiling aho-corasick v1.0.2
[INFO] [stderr]    Compiling anstyle v1.0.1
[INFO] [stderr]    Compiling anstyle-query v1.0.0
[INFO] [stderr]    Compiling colorchoice v1.0.0
[INFO] [stderr]    Compiling regex-syntax v0.6.29
[INFO] [stderr]    Compiling smallvec v1.11.0
[INFO] [stderr]    Compiling libsqlite3-sys v0.26.0
[INFO] [stderr]    Compiling hashlink v0.8.3
[INFO] [stderr]    Compiling regex-automata v0.3.1
[INFO] [stderr]    Compiling crypto-common v0.1.6
[INFO] [stderr]    Compiling block-buffer v0.10.4
[INFO] [stderr]    Compiling matchit v0.7.0
[INFO] [stderr]    Compiling fallible-streaming-iterator v0.1.9
[INFO] [stderr]    Compiling fallible-iterator v0.2.0
[INFO] [stderr]    Compiling overload v0.1.1
[INFO] [stderr]    Compiling thiserror v1.0.43
[INFO] [stderr]    Compiling percent-encoding v2.3.0
[INFO] [stderr]    Compiling clap_lex v0.5.0
[INFO] [stderr]    Compiling nu-ansi-term v0.46.0
[INFO] [stderr]    Compiling is-terminal v0.4.9
[INFO] [stderr]    Compiling anstream v0.3.2
[INFO] [stderr]    Compiling tracing-log v0.1.3
[INFO] [stderr]    Compiling rusqlite v0.29.0
[INFO] [stderr]    Compiling digest v0.10.7
[INFO] [stderr]    Compiling proc-macro-crate v1.3.1
[INFO] [stderr]    Compiling clap_builder v4.3.11
[INFO] [stderr]    Compiling crossbeam-channel v0.5.8
[INFO] [stderr]    Compiling sharded-slab v0.1.4
[INFO] [stderr]    Compiling thread_local v1.1.7
[INFO] [stderr]    Compiling path-dedot v3.1.0
[INFO] [stderr]    Compiling instant v0.1.12
[INFO] [stderr]    Compiling base64 v0.21.2
[INFO] [stderr]    Compiling byteorder v1.4.3
[INFO] [stderr]    Compiling cpufeatures v0.2.9
[INFO] [stderr]    Compiling path-absolutize v3.1.0
[INFO] [stderr]    Compiling sha2 v0.10.7
[INFO] [stderr]    Compiling regex-automata v0.1.10
[INFO] [stderr]    Compiling backoff v0.4.0
[INFO] [stderr]    Compiling hex v0.4.3
[INFO] [stderr]    Compiling regex v1.9.1
[INFO] [stderr]    Compiling matchers v0.1.0
[INFO] [stderr]    Compiling tokio-macros v2.1.0
[INFO] [stderr]    Compiling tracing-attributes v0.1.26
[INFO] [stderr]    Compiling futures-macro v0.3.28
[INFO] [stderr]    Compiling serde_derive v1.0.167
[INFO] [stderr]    Compiling pin-project-internal v1.1.2
[INFO] [stderr]    Compiling clap_derive v4.3.2
[INFO] [stderr]    Compiling thiserror-impl v1.0.43
[INFO] [stderr]    Compiling prost-derive v0.11.9
[INFO] [stderr]    Compiling num_enum_derive v0.5.11
[INFO] [stderr]    Compiling num_enum v0.5.11
[INFO] [stderr]    Compiling pin-project v1.1.2
[INFO] [stderr]    Compiling tracing v0.1.37
[INFO] [stderr]    Compiling tracing-subscriber v0.3.17
[INFO] [stderr]    Compiling prost v0.11.9
[INFO] [stderr]    Compiling clap v4.3.11
[INFO] [stderr]    Compiling prost-types v0.11.9
[INFO] [stderr]    Compiling prost-build v0.11.9
[INFO] [stderr]    Compiling tonic-build v0.9.2
[INFO] [stderr]    Compiling tokio-util v0.7.8
[INFO] [stderr]    Compiling tokio-io-timeout v1.2.0
[INFO] [stderr]    Compiling tokio-stream v0.1.14
[INFO] [stderr]    Compiling fs4 v0.6.6
[INFO] [stderr]    Compiling tokio-rusqlite v0.4.0
[INFO] [stderr]    Compiling remotecache v0.0.0 (/opt/rustwide/workdir)
[INFO] [stderr]    Compiling h2 v0.3.20
[INFO] [stderr]    Compiling tower v0.4.13
[INFO] [stderr]    Compiling serde_spanned v0.6.3
[INFO] [stderr]    Compiling flexbuffers v2.0.0
[INFO] [stderr]    Compiling toml v0.7.6
[INFO] [stderr]    Compiling hyper v0.14.27
[INFO] [stderr]    Compiling hyper-timeout v0.4.1
[INFO] [stderr]    Compiling tonic v0.9.2
[INFO] [stderr]     Finished dev [unoptimized + debuginfo] target(s) in 39.19s
[INFO] running `Command { std: "docker" "inspect" "33c1c9adc98d8617d1180b468b17a4a3eaafd438e01dd105d2971f589d5e8cd6", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "33c1c9adc98d8617d1180b468b17a4a3eaafd438e01dd105d2971f589d5e8cd6", kill_on_drop: false }`
[INFO] [stdout] 33c1c9adc98d8617d1180b468b17a4a3eaafd438e01dd105d2971f589d5e8cd6
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:2788e3201cd34a07e3172128adcd8b3090168a8e3bcc40d7c032b9dda1df7d1c" "/opt/rustwide/cargo-home/bin/cargo" "+1.76.0" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] b1bd2b4dcef02d8fff4ba55bd4be470f3edfdabce0b9b303bd7dbd41e57f8ae5
[INFO] running `Command { std: "docker" "start" "-a" "b1bd2b4dcef02d8fff4ba55bd4be470f3edfdabce0b9b303bd7dbd41e57f8ae5", kill_on_drop: false }`
[INFO] [stderr]    Compiling anyhow v1.0.71
[INFO] [stderr]    Compiling test-log v0.2.12
[INFO] [stderr]    Compiling prost-derive v0.11.9
[INFO] [stderr]    Compiling prost v0.11.9
[INFO] [stderr]    Compiling prost-types v0.11.9
[INFO] [stderr]    Compiling tonic v0.9.2
[INFO] [stderr]    Compiling prost-build v0.11.9
[INFO] [stderr]    Compiling tonic-build v0.9.2
[INFO] [stderr]    Compiling remotecache v0.0.0 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished test [unoptimized + debuginfo] target(s) in 16.04s
[INFO] running `Command { std: "docker" "inspect" "b1bd2b4dcef02d8fff4ba55bd4be470f3edfdabce0b9b303bd7dbd41e57f8ae5", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "b1bd2b4dcef02d8fff4ba55bd4be470f3edfdabce0b9b303bd7dbd41e57f8ae5", kill_on_drop: false }`
[INFO] [stdout] b1bd2b4dcef02d8fff4ba55bd4be470f3edfdabce0b9b303bd7dbd41e57f8ae5
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:2788e3201cd34a07e3172128adcd8b3090168a8e3bcc40d7c032b9dda1df7d1c" "/opt/rustwide/cargo-home/bin/cargo" "+1.76.0" "test" "--frozen", kill_on_drop: false }`
[INFO] [stdout] 93f3391373e605ad0e244984bd5f95ae8b98621384424608234ce9a0f3e1102b
[INFO] running `Command { std: "docker" "start" "-a" "93f3391373e605ad0e244984bd5f95ae8b98621384424608234ce9a0f3e1102b", kill_on_drop: false }`
[INFO] [stderr]     Finished test [unoptimized + debuginfo] target(s) in 0.26s
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/remotecache-4fabc15d56cf14c9)
[INFO] [stdout] 
[INFO] [stdout] running 21 tests
[INFO] [stdout] test tests::mem::can_cache_multiple_types ... ok
[INFO] [stdout] test tests::multi::multi_cache_blocks_on_generator_in_nested_cache ... FAILED
[INFO] [stdout] test tests::multi::multi_cache_caches_results_in_memory ... FAILED
[INFO] [stdout] test tests::persistent::local_client_cacheable_api_works ... FAILED
[INFO] [stdout] test tests::multi::multi_cache_writes_through ... FAILED
[INFO] [stdout] test tests::multi::multi_cache_works_without_in_memory_caching ... FAILED
[INFO] [stdout] test tests::mem::generates_in_background_and_caches_values ... ok
[INFO] [stdout] test tests::persistent::local_server_reassigns_failed_tasks ... FAILED
[INFO] [stdout] test tests::persistent::local_server_does_not_reassign_long_running_tasks ... FAILED
[INFO] [stdout] test tests::persistent::local_remote_apis_work_concurrently ... FAILED
[INFO] [stdout] test tests::persistent::local_server_persists_cached_values ... FAILED
[INFO] [stdout] test tests::persistent::local_server_recovers_from_failures_on_restart ... FAILED
[INFO] [stdout] test tests::persistent::remote_client_cacheable_api_works ... FAILED
[INFO] [stdout] test tests::persistent::remote_server_does_not_reassign_long_running_tasks ... FAILED
[INFO] [stdout] test tests::persistent::remote_server_persists_cached_values ... FAILED
[INFO] [stdout] test tests::persistent::remote_server_recovers_from_failures_on_restart ... FAILED
[INFO] [stdout] test tests::persistent::servers_cannot_be_started_with_same_root ... FAILED
[INFO] [stdout] test tests::persistent::remote_server_reassigns_failed_tasks ... FAILED
[INFO] [stdout] test tests::mem::panics_on_mismatched_types - should panic ... ok
[INFO] [stdout] test tests::mem::cache_should_not_hang_on_panic ... ok
[INFO] [stdout] test tests::mem::cacheable_api_works ... ok
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout] 
[INFO] [stdout] ---- tests::multi::multi_cache_blocks_on_generator_in_nested_cache stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::multi::multi_cache_caches_results_in_memory stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::local_client_cacheable_api_works stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::multi::multi_cache_writes_through stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::multi::multi_cache_works_without_in_memory_caching stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::local_server_reassigns_failed_tasks stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::local_server_does_not_reassign_long_running_tasks stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::local_remote_apis_work_concurrently stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::local_server_persists_cached_values stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::local_server_recovers_from_failures_on_restart stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::remote_client_cacheable_api_works stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::remote_server_does_not_reassign_long_running_tasks stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::remote_server_persists_cached_values stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::remote_server_recovers_from_failures_on_restart stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::servers_cannot_be_started_with_same_root stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::remote_server_reassigns_failed_tasks stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout]     tests::multi::multi_cache_blocks_on_generator_in_nested_cache
[INFO] [stdout]     tests::multi::multi_cache_caches_results_in_memory
[INFO] [stdout]     tests::multi::multi_cache_works_without_in_memory_caching
[INFO] [stdout]     tests::multi::multi_cache_writes_through
[INFO] [stdout]     tests::persistent::local_client_cacheable_api_works
[INFO] [stdout]     tests::persistent::local_remote_apis_work_concurrently
[INFO] [stdout]     tests::persistent::local_server_does_not_reassign_long_running_tasks
[INFO] [stdout]     tests::persistent::local_server_persists_cached_values
[INFO] [stdout]     tests::persistent::local_server_reassigns_failed_tasks
[INFO] [stdout]     tests::persistent::local_server_recovers_from_failures_on_restart
[INFO] [stdout]     tests::persistent::remote_client_cacheable_api_works
[INFO] [stdout]     tests::persistent::remote_server_does_not_reassign_long_running_tasks
[INFO] [stdout]     tests::persistent::remote_server_persists_cached_values
[INFO] [stdout]     tests::persistent::remote_server_reassigns_failed_tasks
[INFO] [stdout]     tests::persistent::remote_server_recovers_from_failures_on_restart
[INFO] [stdout]     tests::persistent::servers_cannot_be_started_with_same_root
[INFO] [stdout] 
[INFO] [stdout] test result: FAILED. 5 passed; 16 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.07s
[INFO] [stdout] 
[INFO] [stderr] error: test failed, to rerun pass `--lib`
[INFO] running `Command { std: "docker" "inspect" "93f3391373e605ad0e244984bd5f95ae8b98621384424608234ce9a0f3e1102b", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "93f3391373e605ad0e244984bd5f95ae8b98621384424608234ce9a0f3e1102b", kill_on_drop: false }`
[INFO] [stdout] 93f3391373e605ad0e244984bd5f95ae8b98621384424608234ce9a0f3e1102b
[INFO] testing remotecache-0.0.0 against beta-2024-02-10 for beta-1.77-1
[INFO] extracting crate remotecache 0.0.0 into /workspace/builds/worker-2-tc2/source
[INFO] validating manifest of crates.io crate remotecache 0.0.0 on toolchain beta-2024-02-10
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+beta-2024-02-10" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] started tweaking crates.io crate remotecache 0.0.0
[INFO] finished tweaking crates.io crate remotecache 0.0.0
[INFO] tweaked toml for crates.io crate remotecache 0.0.0 written to /workspace/builds/worker-2-tc2/source/Cargo.toml
[INFO] crate crates.io crate remotecache 0.0.0 already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+beta-2024-02-10" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:2788e3201cd34a07e3172128adcd8b3090168a8e3bcc40d7c032b9dda1df7d1c" "/opt/rustwide/cargo-home/bin/cargo" "+beta-2024-02-10" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] [stdout] efd48852c95cb6c9af99b2b1d1a429c8bd8755760abafe814e4587e418650044
[INFO] running `Command { std: "docker" "start" "-a" "efd48852c95cb6c9af99b2b1d1a429c8bd8755760abafe814e4587e418650044", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "efd48852c95cb6c9af99b2b1d1a429c8bd8755760abafe814e4587e418650044", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "efd48852c95cb6c9af99b2b1d1a429c8bd8755760abafe814e4587e418650044", kill_on_drop: false }`
[INFO] [stdout] efd48852c95cb6c9af99b2b1d1a429c8bd8755760abafe814e4587e418650044
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:2788e3201cd34a07e3172128adcd8b3090168a8e3bcc40d7c032b9dda1df7d1c" "/opt/rustwide/cargo-home/bin/cargo" "+beta-2024-02-10" "build" "--frozen" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] 245f9edc8369fbfd6ab640626e401de518dcb71805659d573ffca65334312cef
[INFO] running `Command { std: "docker" "start" "-a" "245f9edc8369fbfd6ab640626e401de518dcb71805659d573ffca65334312cef", kill_on_drop: false }`
[INFO] [stderr]    Compiling proc-macro2 v1.0.63
[INFO] [stderr]    Compiling quote v1.0.29
[INFO] [stderr]    Compiling unicode-ident v1.0.10
[INFO] [stderr]    Compiling libc v0.2.147
[INFO] [stderr]    Compiling once_cell v1.18.0
[INFO] [stderr]    Compiling pin-project-lite v0.2.10
[INFO] [stderr]    Compiling bytes v1.4.0
[INFO] [stderr]    Compiling futures-core v0.3.28
[INFO] [stderr]    Compiling anyhow v1.0.71
[INFO] [stderr]    Compiling either v1.8.1
[INFO] [stderr]    Compiling tokio v1.29.1
[INFO] [stderr]    Compiling slab v0.4.8
[INFO] [stderr]    Compiling futures-task v0.3.28
[INFO] [stderr]    Compiling ahash v0.8.3
[INFO] [stderr]    Compiling equivalent v1.0.0
[INFO] [stderr]    Compiling futures-util v0.3.28
[INFO] [stderr]    Compiling rustversion v1.0.13
[INFO] [stderr]    Compiling serde v1.0.167
[INFO] [stderr]    Compiling tracing-core v0.1.31
[INFO] [stderr]    Compiling itertools v0.10.5
[INFO] [stderr]    Compiling bitflags v2.3.3
[INFO] [stderr]    Compiling memchr v2.5.0
[INFO] [stderr]    Compiling io-lifetimes v1.0.11
[INFO] [stderr]    Compiling itoa v1.0.8
[INFO] [stderr]    Compiling futures-sink v0.3.28
[INFO] [stderr]    Compiling rustix v0.37.23
[INFO] [stderr]    Compiling http v0.2.9
[INFO] [stderr]    Compiling winnow v0.4.8
[INFO] [stderr]    Compiling typenum v1.16.0
[INFO] [stderr]    Compiling allocator-api2 v0.2.15
[INFO] [stderr]    Compiling rustix v0.38.3
[INFO] [stderr]    Compiling tempfile v3.6.0
[INFO] [stderr]    Compiling generic-array v0.14.7
[INFO] [stderr]    Compiling linux-raw-sys v0.3.8
[INFO] [stderr]    Compiling hashbrown v0.14.0
[INFO] [stderr]    Compiling num_cpus v1.16.0
[INFO] [stderr]    Compiling mio v0.8.8
[INFO] [stderr]    Compiling syn v2.0.23
[INFO] [stderr]    Compiling syn v1.0.109
[INFO] [stderr]    Compiling signal-hook-registry v1.4.1
[INFO] [stderr]    Compiling socket2 v0.4.9
[INFO] [stderr]    Compiling getrandom v0.2.10
[INFO] [stderr]    Compiling rand_core v0.6.4
[INFO] [stderr]    Compiling linux-raw-sys v0.4.3
[INFO] [stderr]    Compiling regex-syntax v0.7.3
[INFO] [stderr]    Compiling async-trait v0.1.71
[INFO] [stderr]    Compiling ppv-lite86 v0.2.17
[INFO] [stderr]    Compiling futures-channel v0.3.28
[INFO] [stderr]    Compiling prettyplease v0.1.25
[INFO] [stderr]    Compiling heck v0.4.1
[INFO] [stderr]    Compiling http-body v0.4.5
[INFO] [stderr]    Compiling rand_chacha v0.3.1
[INFO] [stderr]    Compiling fixedbitset v0.4.2
[INFO] [stderr]    Compiling fastrand v1.9.0
[INFO] [stderr]    Compiling vcpkg v0.2.15
[INFO] [stderr]    Compiling try-lock v0.2.4
[INFO] [stderr]    Compiling pkg-config v0.3.27
[INFO] [stderr]    Compiling toml_datetime v0.6.3
[INFO] [stderr]    Compiling rand v0.8.5
[INFO] [stderr]    Compiling petgraph v0.6.3
[INFO] [stderr]    Compiling indexmap v2.0.0
[INFO] [stderr]    Compiling want v0.3.1
[INFO] [stderr]    Compiling which v4.4.0
[INFO] [stderr]    Compiling axum-core v0.3.4
[INFO] [stderr]    Compiling crossbeam-utils v0.8.16
[INFO] [stderr]    Compiling log v0.4.19
[INFO] [stderr]    Compiling multimap v0.8.3
[INFO] [stderr]    Compiling httpdate v1.0.2
[INFO] [stderr]    Compiling utf8parse v0.2.1
[INFO] [stderr]    Compiling axum v0.6.18
[INFO] [stderr]    Compiling aho-corasick v1.0.2
[INFO] [stderr]    Compiling toml_edit v0.19.12
[INFO] [stderr]    Compiling anstyle-parse v0.2.1
[INFO] [stderr]    Compiling regex-syntax v0.6.29
[INFO] [stderr]    Compiling anstyle v1.0.1
[INFO] [stderr]    Compiling anstyle-query v1.0.0
[INFO] [stderr]    Compiling smallvec v1.11.0
[INFO] [stderr]    Compiling colorchoice v1.0.0
[INFO] [stderr]    Compiling libsqlite3-sys v0.26.0
[INFO] [stderr]    Compiling regex-automata v0.3.1
[INFO] [stderr]    Compiling hashlink v0.8.3
[INFO] [stderr]    Compiling crypto-common v0.1.6
[INFO] [stderr]    Compiling block-buffer v0.10.4
[INFO] [stderr]    Compiling clap_lex v0.5.0
[INFO] [stderr]    Compiling fallible-iterator v0.2.0
[INFO] [stderr]    Compiling fallible-streaming-iterator v0.1.9
[INFO] [stderr]    Compiling percent-encoding v2.3.0
[INFO] [stderr]    Compiling matchit v0.7.0
[INFO] [stderr]    Compiling thiserror v1.0.43
[INFO] [stderr]    Compiling overload v0.1.1
[INFO] [stderr]    Compiling nu-ansi-term v0.46.0
[INFO] [stderr]    Compiling rusqlite v0.29.0
[INFO] [stderr]    Compiling tracing-log v0.1.3
[INFO] [stderr]    Compiling is-terminal v0.4.9
[INFO] [stderr]    Compiling anstream v0.3.2
[INFO] [stderr]    Compiling digest v0.10.7
[INFO] [stderr]    Compiling crossbeam-channel v0.5.8
[INFO] [stderr]    Compiling clap_builder v4.3.11
[INFO] [stderr]    Compiling sharded-slab v0.1.4
[INFO] [stderr]    Compiling path-dedot v3.1.0
[INFO] [stderr]    Compiling proc-macro-crate v1.3.1
[INFO] [stderr]    Compiling thread_local v1.1.7
[INFO] [stderr]    Compiling instant v0.1.12
[INFO] [stderr]    Compiling byteorder v1.4.3
[INFO] [stderr]    Compiling base64 v0.21.2
[INFO] [stderr]    Compiling regex v1.9.1
[INFO] [stderr]    Compiling regex-automata v0.1.10
[INFO] [stderr]    Compiling cpufeatures v0.2.9
[INFO] [stderr]    Compiling sha2 v0.10.7
[INFO] [stderr]    Compiling backoff v0.4.0
[INFO] [stderr]    Compiling path-absolutize v3.1.0
[INFO] [stderr]    Compiling hex v0.4.3
[INFO] [stderr]    Compiling matchers v0.1.0
[INFO] [stderr]    Compiling tokio-macros v2.1.0
[INFO] [stderr]    Compiling tracing-attributes v0.1.26
[INFO] [stderr]    Compiling serde_derive v1.0.167
[INFO] [stderr]    Compiling futures-macro v0.3.28
[INFO] [stderr]    Compiling pin-project-internal v1.1.2
[INFO] [stderr]    Compiling thiserror-impl v1.0.43
[INFO] [stderr]    Compiling clap_derive v4.3.2
[INFO] [stderr]    Compiling prost-derive v0.11.9
[INFO] [stderr]    Compiling num_enum_derive v0.5.11
[INFO] [stderr]    Compiling pin-project v1.1.2
[INFO] [stderr]    Compiling tracing v0.1.37
[INFO] [stderr]    Compiling num_enum v0.5.11
[INFO] [stderr]    Compiling tracing-subscriber v0.3.17
[INFO] [stderr]    Compiling prost v0.11.9
[INFO] [stderr]    Compiling clap v4.3.11
[INFO] [stderr]    Compiling prost-types v0.11.9
[INFO] [stderr]    Compiling prost-build v0.11.9
[INFO] [stderr]    Compiling tonic-build v0.9.2
[INFO] [stderr]    Compiling remotecache v0.0.0 (/opt/rustwide/workdir)
[INFO] [stderr]    Compiling tokio-util v0.7.8
[INFO] [stderr]    Compiling tokio-io-timeout v1.2.0
[INFO] [stderr]    Compiling tokio-stream v0.1.14
[INFO] [stderr]    Compiling fs4 v0.6.6
[INFO] [stderr]    Compiling tokio-rusqlite v0.4.0
[INFO] [stderr]    Compiling h2 v0.3.20
[INFO] [stderr]    Compiling tower v0.4.13
[INFO] [stderr]    Compiling serde_spanned v0.6.3
[INFO] [stderr]    Compiling flexbuffers v2.0.0
[INFO] [stderr]    Compiling hyper v0.14.27
[INFO] [stderr]    Compiling toml v0.7.6
[INFO] [stderr]    Compiling hyper-timeout v0.4.1
[INFO] [stderr]    Compiling tonic v0.9.2
[INFO] [stderr]     Finished dev [unoptimized + debuginfo] target(s) in 26.02s
[INFO] running `Command { std: "docker" "inspect" "245f9edc8369fbfd6ab640626e401de518dcb71805659d573ffca65334312cef", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "245f9edc8369fbfd6ab640626e401de518dcb71805659d573ffca65334312cef", kill_on_drop: false }`
[INFO] [stdout] 245f9edc8369fbfd6ab640626e401de518dcb71805659d573ffca65334312cef
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:2788e3201cd34a07e3172128adcd8b3090168a8e3bcc40d7c032b9dda1df7d1c" "/opt/rustwide/cargo-home/bin/cargo" "+beta-2024-02-10" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] 22f58c3ca39729d3d4988f3485fc32d99d05f3b658a28ef97c3889faa97fe437
[INFO] running `Command { std: "docker" "start" "-a" "22f58c3ca39729d3d4988f3485fc32d99d05f3b658a28ef97c3889faa97fe437", kill_on_drop: false }`
[INFO] [stderr]    Compiling anyhow v1.0.71
[INFO] [stderr]    Compiling test-log v0.2.12
[INFO] [stderr]    Compiling prost-derive v0.11.9
[INFO] [stderr]    Compiling prost v0.11.9
[INFO] [stderr]    Compiling prost-types v0.11.9
[INFO] [stderr]    Compiling tonic v0.9.2
[INFO] [stderr]    Compiling prost-build v0.11.9
[INFO] [stderr]    Compiling tonic-build v0.9.2
[INFO] [stderr]    Compiling remotecache v0.0.0 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished test [unoptimized + debuginfo] target(s) in 13.31s
[INFO] running `Command { std: "docker" "inspect" "22f58c3ca39729d3d4988f3485fc32d99d05f3b658a28ef97c3889faa97fe437", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "22f58c3ca39729d3d4988f3485fc32d99d05f3b658a28ef97c3889faa97fe437", kill_on_drop: false }`
[INFO] [stdout] 22f58c3ca39729d3d4988f3485fc32d99d05f3b658a28ef97c3889faa97fe437
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc2/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-2-tc2/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=warn" "-e" "RUSTDOCFLAGS=--cap-lints=warn" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:2788e3201cd34a07e3172128adcd8b3090168a8e3bcc40d7c032b9dda1df7d1c" "/opt/rustwide/cargo-home/bin/cargo" "+beta-2024-02-10" "test" "--frozen", kill_on_drop: false }`
[INFO] [stdout] f834b2abd4f3e4768b8e3e6964270f8f5291d32260cd9c2fae1677d4eec4a7e5
[INFO] running `Command { std: "docker" "start" "-a" "f834b2abd4f3e4768b8e3e6964270f8f5291d32260cd9c2fae1677d4eec4a7e5", kill_on_drop: false }`
[INFO] [stderr]     Finished test [unoptimized + debuginfo] target(s) in 0.24s
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/remotecache-b316751140a49749)
[INFO] [stdout] 
[INFO] [stdout] running 21 tests
[INFO] [stdout] test tests::mem::generates_in_background_and_caches_values ... ok
[INFO] [stdout] test tests::mem::can_cache_multiple_types ... ok
[INFO] [stdout] test tests::multi::multi_cache_caches_results_in_memory ... FAILED
[INFO] [stdout] test tests::multi::multi_cache_works_without_in_memory_caching ... FAILED
[INFO] [stdout] test tests::persistent::local_server_reassigns_failed_tasks ... FAILED
[INFO] [stdout] test tests::persistent::local_server_recovers_from_failures_on_restart ... FAILED
[INFO] [stdout] test tests::persistent::local_server_does_not_reassign_long_running_tasks ... FAILED
[INFO] [stdout] test tests::persistent::local_remote_apis_work_concurrently ... FAILED
[INFO] [stdout] test tests::multi::multi_cache_writes_through ... FAILED
[INFO] [stdout] test tests::persistent::local_server_persists_cached_values ... FAILED
[INFO] [stdout] test tests::persistent::local_client_cacheable_api_works ... FAILED
[INFO] [stdout] test tests::multi::multi_cache_blocks_on_generator_in_nested_cache ... FAILED
[INFO] [stdout] test tests::persistent::remote_client_cacheable_api_works ... FAILED
[INFO] [stdout] test tests::persistent::remote_server_reassigns_failed_tasks ... FAILED
[INFO] [stdout] test tests::persistent::remote_server_recovers_from_failures_on_restart ... FAILED
[INFO] [stdout] test tests::persistent::remote_server_does_not_reassign_long_running_tasks ... FAILED
[INFO] [stdout] test tests::persistent::remote_server_persists_cached_values ... FAILED
[INFO] [stdout] test tests::persistent::servers_cannot_be_started_with_same_root ... FAILED
[INFO] [stdout] test tests::mem::cache_should_not_hang_on_panic ... ok
[INFO] [stdout] test tests::mem::panics_on_mismatched_types - should panic ... ok
[INFO] [stdout] test tests::mem::cacheable_api_works ... ok
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout] 
[INFO] [stdout] ---- tests::multi::multi_cache_caches_results_in_memory stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::multi::multi_cache_works_without_in_memory_caching stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::local_server_reassigns_failed_tasks stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::local_server_recovers_from_failures_on_restart stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::local_server_does_not_reassign_long_running_tasks stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::local_remote_apis_work_concurrently stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::multi::multi_cache_writes_through stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::local_server_persists_cached_values stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::local_client_cacheable_api_works stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::multi::multi_cache_blocks_on_generator_in_nested_cache stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::remote_client_cacheable_api_works stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::remote_server_reassigns_failed_tasks stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::remote_server_recovers_from_failures_on_restart stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::remote_server_does_not_reassign_long_running_tasks stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::remote_server_persists_cached_values stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] ---- tests::persistent::servers_cannot_be_started_with_same_root stdout ----
[INFO] [stdout] Error: Io(Os { code: 30, kind: ReadOnlyFilesystem, message: "Read-only file system" })
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] failures:
[INFO] [stdout]     tests::multi::multi_cache_blocks_on_generator_in_nested_cache
[INFO] [stdout]     tests::multi::multi_cache_caches_results_in_memory
[INFO] [stdout]     tests::multi::multi_cache_works_without_in_memory_caching
[INFO] [stdout]     tests::multi::multi_cache_writes_through
[INFO] [stdout]     tests::persistent::local_client_cacheable_api_works
[INFO] [stdout]     tests::persistent::local_remote_apis_work_concurrently
[INFO] [stdout]     tests::persistent::local_server_does_not_reassign_long_running_tasks
[INFO] [stdout]     tests::persistent::local_server_persists_cached_values
[INFO] [stdout]     tests::persistent::local_server_reassigns_failed_tasks
[INFO] [stdout]     tests::persistent::local_server_recovers_from_failures_on_restart
[INFO] [stdout]     tests::persistent::remote_client_cacheable_api_works
[INFO] [stdout]     tests::persistent::remote_server_does_not_reassign_long_running_tasks
[INFO] [stdout]     tests::persistent::remote_server_persists_cached_values
[INFO] [stdout]     tests::persistent::remote_server_reassigns_failed_tasks
[INFO] [stdout]     tests::persistent::remote_server_recovers_from_failures_on_restart
[INFO] [stdout]     tests::persistent::servers_cannot_be_started_with_same_root
[INFO] [stdout] 
[INFO] [stdout] test result: FAILED. 5 passed; 16 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.05s
[INFO] [stdout] 
[INFO] [stderr] error: test failed, to rerun pass `--lib`
[INFO] running `Command { std: "docker" "inspect" "f834b2abd4f3e4768b8e3e6964270f8f5291d32260cd9c2fae1677d4eec4a7e5", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "f834b2abd4f3e4768b8e3e6964270f8f5291d32260cd9c2fae1677d4eec4a7e5", kill_on_drop: false }`
[INFO] [stdout] f834b2abd4f3e4768b8e3e6964270f8f5291d32260cd9c2fae1677d4eec4a7e5
