Install GPU-enabled Milvus


System requirements

Operating system Supported versions
CentOS 7.5 or higher
Ubuntu LTS 18.04 or higher

Hardware requirements

Component Recommended configuration
CPU Intel CPU Sandy Bridge or higher.
CPU instruction set
  • SSE42
  • AVX
  • AVX2
  • AVX512
  • GPU NVIDIA Pascal or higher
    RAM 8 GB or more (depends on data volume)
    Hard drive SATA 3.0 SSD or higher

    Milvus Docker requirements

    Step 1 Confirm Docker status

    Confirm that the Docker daemon is running in the background:

    $ docker info

    If you do not see the server listed, start the Docker daemon.

    Note: On Linux, Docker needs sudo privileges. To run Docker command without sudo, create the docker group and add your user. For details, see the post-installation steps for Linux.

    Step 2 Pull Milvus image

    Pull the GPU-enabled image:

    $ docker pull milvusdb/milvus:0.8.1-gpu-d062220-c18515

    Note: If the pulling speed is too slow or the pulling process constantly fails, refer to Operational FAQ for possible solutions.

    Step 3 Download configuration files

    $ mkdir -p /home/$USER/milvus/conf
    $ cd /home/$USER/milvus/conf
    $ wget

    Note: In case you encounter problems downloading configuration files using wget command, you can also create the server_config.yaml file under /home/$USER/milvus/conf, then copy and paste the content from server config file.

    Step 4 Start Docker container

    Before starting the Docker container, you must set enable to true in gpu_resource_config section of server_config.yaml.

    $ docker run -d --name milvus_gpu_0.8.1 --gpus all \
    -p 19530:19530 \
    -p 19121:19121 \
    -v /home/$USER/milvus/db:/var/lib/milvus/db \
    -v /home/$USER/milvus/conf:/var/lib/milvus/conf \
    -v /home/$USER/milvus/logs:/var/lib/milvus/logs \
    -v /home/$USER/milvus/wal:/var/lib/milvus/wal \

    The docker run options used in the above command are defined as follows:

    • -d: run container in background and print container ID
    • --name: assign a name to the container
    • --gpus: GPU devices to add to the container (‘all’ to pass all GPUs)
    • -p: publish a container’s port(s) to the host
    • -v: mounts a directory into the container

    Confirm Milvus running status by the following command:

    $ docker ps

    If Milvus server is not successfully started, you can check the error logs by the following command.

    # Get the ID of the container running Milvus.
    $ docker ps -a
    # Check docker logs.
    $ docker logs <milvus container id>

    What's next

    © 2019 - 2020 Milvus. All rights reserved.