Embedding model: match language and domain, check dimension (storage and speed), max input length, and benchmark on your own labeled queries rather than only public leaderboards.
Vector database: consider scale, latency, filtering support, hybrid search, operational burden, and cost (Pinecone, Weaviate, Qdrant, pgvector, FAISS, Chroma).
Approximate nearest-neighbor indexes: HNSW (graph, fast and accurate, memory-heavy) and IVF (clusters, with optional quantization for memory savings); they trade a little recall for large speed gains.
Plan for re-indexing when you change models and for deleting or updating documents.
Loading…