| #1 | gemini-2.5-pro Strong on FACTS Benchmark Suite facts_grounding_score_pct (100%) and Vectara HHEM Leaderboard overall_hallucination_error_pct (76%) | | 35.8% | 27 | FACTS Benchmark Suite facts_grounding_score_pct (Mar 17, 2026) Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 17, 2026) |
| #2 | gemini-3-pro-preview Strong on FACTS Benchmark Suite facts_grounding_score_pct (88%) and Vectara HHEM Leaderboard overall_hallucination_error_pct (46%) | | 29.2% | 24 | FACTS Benchmark Suite facts_grounding_score_pct (Mar 17, 2026) Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 17, 2026) |
| #3 | gemini-2.5-flash Strong on FACTS Benchmark Suite facts_grounding_score_pct (90%) and LanguageBench Grammar/Clarity Official (Split) grammar_clarity_score_pct (100%) | | 26.6% | 17 | FACTS Benchmark Suite facts_grounding_score_pct (Mar 17, 2026) LanguageBench Grammar/Clarity Official (Split) grammar_clarity_score_pct (Mar 17, 2026) |
| #4 | gpt-4.1-20250414 | | 28.8% | 20 | Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 17, 2026) MMLongBench-Doc Leaderboard acc_score_pct (Mar 17, 2026) |
| #5 | gpt-5-mini-2025-08-07 | | 25.1% | 20 | FACTS Benchmark Suite facts_grounding_score_pct (Mar 17, 2026) Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 17, 2026) |
| #6 | gpt-5-2025-08-07 | | 19.4% | 18 | FACTS Benchmark Suite facts_grounding_score_pct (Mar 17, 2026) Vals Finance Agent overall_accuracy_pct (Mar 17, 2026) |
| #7 | Grok-4-0709 | | 23.6% | 20 | FACTS Benchmark Suite facts_grounding_score_pct (Mar 17, 2026) Galileo Agent Leaderboard v2 Avg TSQ (Mar 17, 2026) |
| #8 | anthropic/claude-sonnet-4.6 | | 20.7% | 18 | Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 17, 2026) Vals Finance Agent overall_accuracy_pct (Mar 17, 2026) |
| #9 | claude-sonnet-4-20250514 | | 23.8% | 19 | FACTS Benchmark Suite facts_grounding_score_pct (Mar 17, 2026) Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 17, 2026) |
| #10 | google/gemini-3.1-pro-preview | | 18.5% | 19 | Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 17, 2026) Vals Finance Agent overall_accuracy_pct (Mar 17, 2026) |
| #11 | openai/gpt-5.4-2026-03-05 | | 18.1% | 18 | Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 17, 2026) Vals Finance Agent overall_accuracy_pct (Mar 17, 2026) |
| #12 | claude-opus-4-5-20251101 | | 20.1% | 18 | FACTS Benchmark Suite facts_grounding_score_pct (Mar 17, 2026) Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 17, 2026) |
| #13 | gpt-5.1-2025-11-13 | | 18.9% | 17 | FACTS Benchmark Suite facts_grounding_score_pct (Mar 17, 2026) Vals Finance Agent overall_accuracy_pct (Mar 17, 2026) |
| #14 | google/gemini-3.1-flash-lite-preview | | 17.6% | 17 | Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 17, 2026) Vals Finance Agent overall_accuracy_pct (Mar 17, 2026) |
| #17 | anthropic/claude-opus-4-1-20250805 | | 18.8% | 15 | FACTS Benchmark Suite facts_grounding_score_pct (Mar 17, 2026) Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 17, 2026) |
| #18 | gemini-3-flash-preview | | 16.8% | 18 | Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 17, 2026) Vals Finance Agent overall_accuracy_pct (Mar 17, 2026) |
| #19 | gpt-5.2-2025-12-11 | | 11.4% | 14 | Vals Finance Agent overall_accuracy_pct (Mar 17, 2026) Vals Finance Agent complex_retrieval_accuracy_pct (Mar 17, 2026) |
| #20 | anthropic/claude-opus-4-6-thinking | | 11.4% | 14 | Vals Finance Agent overall_accuracy_pct (Mar 17, 2026) Vals Mortgage Tax overall_accuracy_pct (Mar 17, 2026) |
| #21 | phi-4 | | 13.4% | 7 | Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 17, 2026) LanguageBench Grammar/Clarity Official (Split) grammar_clarity_score_pct (Mar 17, 2026) |
| #22 | xai-org/grok-4-fast-reasoning | | 18.1% | 18 | Vals Finance Agent overall_accuracy_pct (Mar 17, 2026) Vals Finance Agent complex_retrieval_accuracy_pct (Mar 17, 2026) |
| #23 | gpt-4o-2024-08-06 | | 17.5% | 16 | Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 17, 2026) DuckDB NSQL Leaderboard all_execution_accuracy (Mar 17, 2026) |
| #26 | anthropic/claude-opus-4-5-20251101-thinking | | 11.4% | 14 | Vals Finance Agent overall_accuracy_pct (Mar 17, 2026) Vals Mortgage Tax overall_accuracy_pct (Mar 17, 2026) |
| #27 | xai-org/grok-4-1-fast-reasoning | | 18.1% | 18 | Vals Finance Agent overall_accuracy_pct (Mar 17, 2026) Vectara HHEM Leaderboard business_answer_rate_pct (Mar 17, 2026) |
| #28 | openai/gpt-4.1 | | 11.0% | 12 | LanguageBench Grammar/Clarity Official (Split) grammar_clarity_score_pct (Mar 17, 2026) DuckDB NSQL Leaderboard all_execution_accuracy (Mar 17, 2026) |
| #29 | kimi/kimi-k2.5-thinking | | 13.3% | 16 | Vals Finance Agent overall_accuracy_pct (Mar 17, 2026) Vals Mortgage Tax overall_accuracy_pct (Mar 17, 2026) |
| #30 | anthropic/claude-sonnet-4-5-20250929-thinking | | 11.4% | 14 | Vals Finance Agent overall_accuracy_pct (Mar 17, 2026) Vals Mortgage Tax overall_accuracy_pct (Mar 17, 2026) |
| #31 | x-ai/grok-3 | | 11.8% | 14 | Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 17, 2026) Vectara HHEM Leaderboard business_hallucination_error_pct (Mar 17, 2026) |
| #32 | google/gemini-2.0-flash-001 | | 11.3% | 11 | LanguageBench Grammar/Clarity Official (Split) grammar_clarity_score_pct (Mar 17, 2026) Vals Mortgage Tax overall_accuracy_pct (Mar 17, 2026) |
| #33 | qwen-2.5-72b-instruct | | 13.0% | 12 | Galileo Agent Leaderboard v2 Avg TSQ (Mar 17, 2026) DuckDB NSQL Leaderboard all_execution_accuracy (Mar 17, 2026) |
| #34 | mistralai/mistral-large-2512 | | 17.2% | 16 | Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 17, 2026) Vals Mortgage Tax overall_accuracy_pct (Mar 17, 2026) |