Prompt
What should I use for semantic search: embeddings API or reranker API?
Latest observation
Oct 8, 2026
OpenAI APIWeb search: off
For semantic search, the usual choice is:
Use the Embeddings API for retrieval
Embeddings are best for:
- converting documents and queries into vectors
- finding semantically similar items with nearest-neighbor search
- scaling to large corpora efficiently
Typical flow:
- Embed all documents
- Store vectors in a vector index
- Embed the user query
- Retrieve top-k closest documents
Use the Reranker API to improve the top results
A reranker is best for:
- taking a shortlist of candidate documents
- reordering them by relevance to the query
- improving precision for the final results
Typical flow:
- Use embeddings/vector search to get, say, top 20–100 candidates
- Send those candidates plus the query to the reranker
- Return the reranked top few results
Practical recommendation
- If you need scalable semantic search: start with embeddings
- If you want higher-quality final ranking: add a reranker on top
- If you must choose only one: choose embeddings for the core search system
Rule of thumb
- Embeddings = recall
- Reranker = precision
If you want, I can also suggest a good architecture for semantic search depending on your dataset size and latency requirements.