Milvus Distributions

Overview

Milvus comes in two distributions: CPU-only Milvus and GPU-enabled Milvus.

  • CPU-only Milvus only supports searching after index building completes, and hence is applicable to static datasets.
  • GPU-enabled Milvus supports GPU acceleration for searching and index building: It supports searching and index building at the same time to improve query efficiency, and hence is applicable to dynamic datasets.

If your GPU supports CUDA, then you can install GPU-enabled Milvus to achieve much higher search performance in large-scale datasets.

Indexes for GPU-enabled Milvus

Milvus maps different embedding types with different index types. Click to view the index types supporting your embedding type.
Index type Indexing with CPU Indexing with GPU Search with CPU Search with GPU
FLAT N/A N/A ✔️ ✔️
IVF_FLAT ✔️ ✔️ ✔️ ✔️
IVF_SQ8 ✔️ ✔️ ✔️ ✔️
IVF_SQ8H ✔️ ✔️ ✔️ ✔️
IVF_PQ ✔️ ✔️ ✔️ ✔️
RNSG ✔️ ✔️
HNSW ✔️ ✔️
ANNOY ✔️ ✔️
An index built with CPU is the same as built with GPU. The only difference is that, for most of the time, the time to build the index using GPU is shorter than using CPU.
Index type Indexing with CPU Indexing with GPU Search with CPU Search with GPU
FLAT N/A N/A ✔️
IVF_FLAT ✔️ ✔️
Edit
© 2019 - 2020 Milvus. All rights reserved.