Best LLMs for RAG (2026)

Top large language models for retrieval-augmented generation, excelling at grounding responses in provided context with accurate citations and minimal hallucination.

#1Command R+
Cohere
ELO 1200
Input

$2.50/M

Output

$10.00/M

JSON ModeFunctions
#2Gemini 2.5 Pro
Google
ELO 1340
Input

$1.25/M

Output

$10.00/M

VisionJSON ModeFunctionsMultimodalCode Exec
#3GPT-4o
OpenAI
ELO 1260
Input

$2.50/M

Output

$10.00/M

VisionJSON ModeFunctionsMultimodalCode Exec
#4Claude Sonnet 4
Anthropic
ELO 1280
Input

$3.00/M

Output

$15.00/M

VisionJSON ModeFunctionsMultimodal

Other Categories