Your services are stateless, and will not persist any changes or downloads between restarts.

You can add volumes to persist data, so you don’t have to repeatedly download models and you can work with consistent sets of data.

Open the volumes view on a service to attach a persistent volume.

You can set:

• the container mount path which determines where in the container the volume is mounted
• (optional) a volume mount path which determines which path on the volume is mounted at the container mount path

You can use a combination of container mount paths and volume mount paths to mount multiple paths in a container and persist the data written to them.

The filesystem of a container is determined by how the image is built. You can shell into a container and run commands like ls to explore the filesystem.

Many images allow you to set the directory to look for models or to save downloads as environment variables.

:northflank: Add a persistent volume

Upload data to your volumes

You can download data from the internet using command-line tools such as ollama pull and huggingface-cli download, or transfer data to and from your volumes using curl or wget, from another HTTP server.

:northflank: Transfer data to and from containers