Chroma
Open-source embedding database focused on developer ergonomics for LLM apps: local dev, server mode, and simple APIs.
Why it is included
Extremely common in OSS RAG tutorials and prototypes for fast vector storage without running a full cluster.
Best for
Prototypes and mid-size apps where simplicity beats maximum scale.
Strengths
- DX
- Fast local start
- Framework integrations
Limitations
- Not the first choice for billion-vector HA clusters
Good alternatives
Qdrant · Milvus · pgvector
Related tools
AI & Machine Learning
LlamaIndex
Data framework for LLM applications: ingestion, indexing, retrieval, and agents over documents and APIs.
AI & Machine Learning
Qdrant
Vector search engine with filtering, REST/gRPC APIs, and cloud or self-hosted deployment for embeddings at scale.
AI & Machine Learning
Milvus
Open-source vector database built for billion-scale similarity search with distributed deployment options.
AI & Machine Learning
Text Embeddings Inference
Rust-based high-throughput server for sentence-transformers–class embedding models with GPU/CPU backends.
AI & Machine Learning
Ollama
Local LLM runner and model library with simple CLI and API for workstation inference.
AI & Machine Learning
llama.cpp
Plain C/C++ inference for LLaMA-class models with broad community backends.