| #1 | gpt-4.1-20250414 Strong on Galileo Agent Leaderboard v2 Avg AC (100%) and Vectara HHEM Leaderboard overall_hallucination_error_pct (82%) | | 33.1% | 24 | Galileo Agent Leaderboard v2 Avg AC (Mar 16, 2026) Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 12, 2026) |
| #2 | gemini-2.5-pro Strong on Galileo Agent Leaderboard v2 Avg AC (59%) and FACTS Benchmark Suite facts_grounding_score_pct (100%) | | 35.4% | 26 | Galileo Agent Leaderboard v2 Avg AC (Mar 16, 2026) FACTS Benchmark Suite facts_grounding_score_pct (Mar 16, 2026) |
| #3 | gemini-3-pro-preview Strong on FACTS Benchmark Suite facts_grounding_score_pct (88%) and Vals Finance Agent overall_accuracy_pct (87%) | | 25.2% | 22 | FACTS Benchmark Suite facts_grounding_score_pct (Mar 16, 2026) Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) |
| #4 | gemini-2.5-flash | | 25.5% | 17 | Galileo Agent Leaderboard v2 Avg AC (Mar 16, 2026) LanguageBench Grammar/Clarity Official (Split) grammar_clarity_score_pct (Mar 12, 2026) |
| #5 | gpt-5-mini-2025-08-07 | | 22.3% | 19 | OpenVLM OCRBench Official ocrbench_score_pct (Mar 16, 2026) Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) |
| #6 | gpt-5-2025-08-07 | | 18.6% | 18 | OpenVLM OCRBench Official ocrbench_score_pct (Mar 16, 2026) FACTS Benchmark Suite facts_grounding_score_pct (Mar 16, 2026) |
| #7 | Grok-4-0709 | | 22.9% | 20 | Galileo Agent Leaderboard v2 Avg AC (Mar 16, 2026) Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) |
| #8 | gpt-4.1-mini-20250414 | | 20.8% | 16 | Galileo Agent Leaderboard v2 Avg AC (Mar 16, 2026) OpenVLM OCRBench Official ocrbench_score_pct (Mar 16, 2026) |
| #10 | claude-sonnet-4-20250514 | | 21.2% | 18 | Galileo Agent Leaderboard v2 Avg AC (Mar 16, 2026) Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 12, 2026) |
| #11 | gpt-4o | | 17.3% | 15 | CRMArena Function Calling overall_score_pct (Mar 16, 2026) OpenVLM OCRBench Official ocrbench_score_pct (Mar 16, 2026) |
| #12 | anthropic/claude-sonnet-4.6 | | 18.3% | 16 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vectara HHEM Leaderboard overall_answer_rate_pct (Mar 12, 2026) |
| #13 | google/gemini-3.1-pro-preview | | 15.5% | 17 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vectara HHEM Leaderboard overall_answer_rate_pct (Mar 12, 2026) |
| #16 | openai/gpt-5.4-2026-03-05 | | 15.0% | 16 | Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 12, 2026) Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) |
| #28 | gpt-5.1-2025-11-13 | | 16.3% | 17 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals Case Law v2 overall_accuracy_pct (Mar 16, 2026) |
| #36 | qwen-2.5-72b-instruct | | 15.8% | 12 | Galileo Agent Leaderboard v2 Avg AC (Mar 16, 2026) DuckDB NSQL Leaderboard all_execution_accuracy (Mar 16, 2026) |
| #38 | Qwen3-Embedding-4B | | 14.5% | 7 | MTEB STS & Summarization Proxy Official sts_score_pct (Mar 16, 2026) MTEB Classification Official classification_score_pct (Mar 16, 2026) |
| #45 | claude-opus-4-5-20251101 | | 15.0% | 16 | Vectara HHEM Leaderboard overall_answer_rate_pct (Mar 12, 2026) FACTS Benchmark Suite facts_grounding_score_pct (Mar 16, 2026) |
| #67 | gemini-3-flash-preview | | 14.9% | 16 | Vectara HHEM Leaderboard overall_answer_rate_pct (Mar 12, 2026) Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) |
| #69 | google/gemini-3.1-flash-lite-preview | | 14.5% | 15 | Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 12, 2026) Vectara HHEM Leaderboard overall_answer_rate_pct (Mar 12, 2026) |
| #77 | xai-org/grok-4-fast-reasoning | | 15.0% | 16 | Vectara HHEM Leaderboard overall_answer_rate_pct (Mar 12, 2026) Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) |
| #88 | gpt-5.2-2025-12-11 | | 10.8% | 14 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals Finance Agent complex_retrieval_accuracy_pct (Mar 16, 2026) |
| #106 | anthropic/claude-opus-4-6-thinking | | 10.8% | 14 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals Finance Agent complex_retrieval_accuracy_pct (Mar 16, 2026) |
| #119 | xai-org/grok-4-1-fast-reasoning | | 15.0% | 16 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vectara HHEM Leaderboard overall_answer_rate_pct (Mar 12, 2026) |
| #149 | anthropic/claude-opus-4-5-20251101-thinking | | 10.8% | 14 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals Case Law v2 overall_accuracy_pct (Mar 16, 2026) |
| #162 | kimi/kimi-k2.5-thinking | | 13.2% | 16 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals Finance Agent complex_retrieval_accuracy_pct (Mar 16, 2026) |
| #165 | anthropic/claude-sonnet-4-5-20250929-thinking | | 10.8% | 14 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals Finance Agent complex_retrieval_accuracy_pct (Mar 16, 2026) |
| #178 | google/gemini-2.0-flash-001 | | 10.7% | 12 | LanguageBench Grammar/Clarity Official (Split) grammar_clarity_score_pct (Mar 12, 2026) LanguageBench Translation Official (Split) translation_to:bleu (Mar 12, 2026) |
| #193 | gpt-4o-2024-08-06 | | 14.4% | 14 | Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 12, 2026) DuckDB NSQL Leaderboard all_execution_accuracy (Mar 16, 2026) |
| #199 | anthropic/claude-opus-4-1-20250805 | | 13.6% | 13 | Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 12, 2026) Vectara HHEM Leaderboard overall_answer_rate_pct (Mar 12, 2026) |
| #202 | deepseek-v3 | | 11.1% | 6 | Galileo Agent Leaderboard v2 Avg AC (Mar 16, 2026) Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 12, 2026) |