OpenRouter finds reranking improves RAG retrieval in 274-question test
OpenRouter reported that reranking the top 30 vector-search candidates with voyageai/rerank-3-lite raised precision@1 from 81% to 97% in its 274-question synthetic benchmark. In its setup, reranking the top 30 candidates and passing the top three to the LLM also increased final-answer accuracy to 99.3% while reducing per-question answering costs, though reranking added $0.04 per 1,000 questions overall. OpenRouter cautioned that performance gains may differ on real-world documents and recommended measuring each pipeline’s own baseline.
OpenRouter’s controlled test suggests that reranking can correct near-miss retrieval errors and improve RAG answer accuracy, while its disclosure of costs, latency and dataset limitations provides a practical basis for evaluation.
Reranking in RAG: How to Fix Bad Retrieval with a Reranker
OpenRouter ·11/13/2026


When a RAG (Retrieval-Augmented Generation) app gives wrong answers even though the right information is in your documents, retrieval is often the cause. Vector search is great at finding chunks on the right topic, but it often falls for near misses, like pulling the bucket limit for the Enterprise plan when the user asked about the Growth plan. Reranking in RAG fixes this by taking your vector search’s top 30 candidates and passing them through a dedicated cross-encoder model that re-scores each chunk directly against the question.
#OpenRouter#Voyage AI#voyageai/rerank-3-lite#voyageai/rerank-3#google/gemini-embedding-2#voyageai/voyage-4-lite#anthropic/claude-sonnet-5.5#anthropic/claude-haiku-5.5#openai/gpt-6.1-sol#openai/gpt-6-luna#cohere/rerank-v3.5#qwen/qwen3-reranker-8b