Install GPU-enabled Milvus


System requirements

Operating system Supported versions
CentOS 7.5 or higher
Ubuntu LTS 18.04 or higher

Hardware requirements

Component Recommended configuration
CPU Intel CPU Haswell or higher
GPU NVIDIA Pascal or higher
RAM 8 GB or more (depends on data volume)
Hard drive SATA 3.0 SSD or higher

Milvus Docker requirements

Step 1 Confirm Docker status

Confirm that the Docker daemon is running in the background:

$ docker info

If you do not see the server listed, start the Docker daemon.

Note: On Linux, Docker needs sudo privileges. To run Docker command without sudo, create the docker group and add your user. For details, see the post-installation steps for Linux.

Step 2 Pull Milvus image

Pull the GPU-enabled image:

$ docker pull milvusdb/milvus:0.6.0-gpu-d120719-2b40dd

Step 3 Download configuration files

# Create Milvus file
$ mkdir -p /home/$USER/milvus/conf
$ cd /home/$USER/milvus/conf
$ wget
$ wget

Note: In case you encounter problems downloading configuration files using wget command, you can also create the server_config.yaml and log_config.conf files under /home/$USER/milvus/conf, then copy and paste the content from server config file and log config file.

Step 4 Start Docker container

# Start Milvus
$ docker run -d --name milvus_gpu --gpus all \
-p 19530:19530 \
-p 8080:8080 \
-v /home/$USER/milvus/db:/var/lib/milvus/db \
-v /home/$USER/milvus/conf:/var/lib/milvus/conf \
-v /home/$USER/milvus/logs:/var/lib/milvus/logs \

The docker run options used in the above command are defined as follows:

  • -d: run container in background and print container ID
  • --name: assign a name to the container
  • --gpus: GPU devices to add to the container (‘all’ to pass all GPUs)
  • -p: publish a container’s port(s) to the host
  • -v: bind mount a volume

Finally confirm Milvus running status by the following command:

# Confirm Milvus status
$ docker ps

If Milvus server is not successfully started, you can check the error logs by the following command.

# Get id of the container running Milvus
$ docker ps -a
# Check docker logs
$ docker logs <milvus container id>

What's next

© 2019 - 2020 Milvus. All rights reserved.