Pump up the Volumes: Data in Docker
Part 6 of Learn Enough Docker to be Useful
This article is about using data with Docker. In it, we’ll focus on Docker volumes. Check out the previous articles in the series if you haven’t yet. We covered Dockerconcepts, theecosystem, Dockerfiles ,slimming down images, andpopular commands.
Pushing the food metaphor running through these articles to the breaking point, let’s compare data in Docker to spices. Just as there are many spices in the world, there are many ways to save data with Docker.
Quick FYI: this guide is current for Docker Engine Version 18.09.1 and API version 1.39 .
Data in Docker can either be temporary or persistent. Let’s check out temporary data first.
Data can be kept temporarily inside a Docker container in two ways.
By default, files created by an application inside a container are stored in the writable layer of the container. You don’t have to set anything up. This is the quick and dirty way. Just save a file and go about your business. However this data will not exist when your container does.
You have another option if you want better performance for saving temporary data with Docker. If you don’t need your data to persist beyond the life of the container, a tmpfs mount is a temporary mount that uses the host’s memory. A tmpfs mount has the benefit of faster read and write operations.
Many times you will want your data to exist even after the container is long gone. You need to persist your data.
There are two ways to persist data beyond the life of the container. One way is to bind mount a file system to the container. With a bind mount, processes outside Docker also can modify the data.
Bind mounts are difficult to back up, migrate, or share with other Containers. Volumes are a better way to persist data.
A Volume is a a file system that lives on a host machine outside of any container. Volumes are created and managed by Docker. Volumes are:
- free-floating filesystems, separate from any one container
- sharable with other containers
- efficient for input and output
- able to be hosted on remote cloud providers
- able to have their content pre-populated by a container
- handy for testing
That’s a lot of useful functionality! Now let’s look at how you make a Volume.
Volumes can be created via a Dockerfile or an API request.
Here’s a Dockerfile instruction that creates a volume at run time:
Then, when the container is created, Docker will create the volume with any data that already exists at the specified location. Note that if you create a volume using a Dockerfile, you still need to declare the mountpoint for the volume at run time.
You can also create a volume in a Dockerfile using JSON array formatting. Seethis earlier article in this series for more on Dockerfiles.
Volumes also can be instantiated at run time from the command line.
Volume CLI Commands
You can create a stand-alone volume with
docker volume create —-name my_volume .
List Docker volumes with
docker volume ls .
Volumes can be inspected with
docker volume inspect my_volume .
Then you can delete the volume with
docker volume rm my_volume .
Dangling volumes are volumes not used by a container. You can remove all dangling volumes with
docker volume prune . Docker will warn you and ask for confirmation before deletion.
If the volume is associated with any containers, you cannot remove it until the containers are deleted. Even then, Docker sometimes doesn’t realize that the containers are gone. If this occurs, you can use
docker system prune to clean up all your Docker resources. Then you should should be able to delete the volume.
You will often use flags to refer to your volumes. For example, to create a volume at the same time you create a container use the following:
docker container run --mount source=my_volume, target=/container/path/for/volume my_image
In the old days (i.e. pre-2017) :smirk:the
--volume flag was popular. Originally, the
--volume flag was used for standalone containers and the
--mount flag was used with Docker Swarms. However, beginning with Docker 17.06, you can use
--mount in all cases.
The syntax for
--mount is a bit more verbose, but it’s preferred over
--volume for several reasons.
--mount is the only way you can work with services or specify volume driver options. It’s also simpler to use.
You’ll see a lot of
-v ’s in existing code. Beware that the format for the options is different for
--volume . You often can’t just replace a
-v in your existing code with a
--mount and be done with it.
The biggest difference is that the
-v syntax combines all the options together in one field, while the
--mount syntax separates them. Let’s see
--mount in action!
--mount — options are key-value pairs. Each pair is formatted like this:
key=value , with a comma between one pair and the next. Common options:
type— mount type. Options are
tmpfs. We’re all about the
source— source of the mount. For named volumes, this is the name of the volume. For unnamed volumes, this option is omitted. The key can be shortened to
destination— the path where the file or directory is mounted in the container. The key can be shortened to
readonly—mounts the volume as read-only . Optional. Takes no value.
Here’s an example with lots of options:
docker run --mount type=volume,source=volume_name,destination=/path/in/container,readonly my_image
Recap of Key Volume Commands
docker volume create docker volume ls docker volume inspect docker volume rm docker volume prune
Common options for the
--mount flag in
docker run --mount my_options my_image :
type=volume source=volume_name destination=/path/in/container readonly
Now that you’ve familiarized yourself with data storage in Docker let’s look at possible next steps for your Docker journey.
If you haven’t read the articles in this series on Dockerconcepts, theDocker ecosystem, Dockerfiles ,slim images, andcommands, check those out.
If you want to go deeper, check out Nigel Poulton’s book Docker Deep Dive ( make sure to get the most recent version).
If you want to do a lot of building while you learn, check out James Turnbull’s The Docker Book .
I hope you found this series to be a helpful intro to Docker. If you did, please share it with others on your favorite forums or social media channels so your friends can find it, too!
I’m working on a series on orchestrating containers with Kubernetes. If that’s of interest to you, follow me to make sure you don’t miss it!
Thanks for reading! :clap: