| #1 | gemini-2.5-flash Strong on LanguageBench Grammar/Clarity Official (Split) grammar_clarity_score_pct (100%) and LanguageBench Translation Official (Split) translation_to:bleu (92%) | | 33.0% | 19 | LanguageBench Grammar/Clarity Official (Split) grammar_clarity_score_pct (Mar 12, 2026) LanguageBench Translation Official (Split) translation_to:bleu (Mar 12, 2026) |
| #2 | gemini-2.5-pro Strong on Galileo Agent Leaderboard v2 Avg TSQ (79%) and FACTS Benchmark Suite facts_grounding_score_pct (100%) | | 45.0% | 28 | Galileo Agent Leaderboard v2 Avg TSQ (Mar 16, 2026) FACTS Benchmark Suite facts_grounding_score_pct (Mar 16, 2026) |
| #3 | gpt-4.1-20250414 Strong on OpenVLM OCRBench Official ocrbench_score_pct (88%) and Galileo Agent Leaderboard v2 Avg TSQ (64%) | | 33.8% | 25 | OpenVLM OCRBench Official ocrbench_score_pct (Mar 16, 2026) Galileo Agent Leaderboard v2 Avg TSQ (Mar 16, 2026) |
| #5 | gemini-3-pro-preview | | 27.7% | 24 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) FACTS Benchmark Suite facts_grounding_score_pct (Mar 16, 2026) |
| #7 | gpt-5-mini-2025-08-07 | | 25.4% | 21 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) OpenVLM OCRBench Official ocrbench_score_pct (Mar 16, 2026) |
| #9 | gpt-5-2025-08-07 | | 21.0% | 18 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) OpenVLM OCRBench Official ocrbench_score_pct (Mar 16, 2026) |
| #10 | google/gemini-2.0-flash-001 | | 19.8% | 13 | LanguageBench Grammar/Clarity Official (Split) grammar_clarity_score_pct (Mar 12, 2026) LanguageBench Translation Official (Split) translation_to:bleu (Mar 12, 2026) |
| #11 | anthropic/claude-sonnet-4.6 | | 21.0% | 18 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals Finance Agent complex_retrieval_accuracy_pct (Mar 16, 2026) |
| #13 | Grok-4-0709 | | 23.4% | 19 | Galileo Agent Leaderboard v2 Avg TSQ (Mar 16, 2026) Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) |
| #14 | google/gemini-3.1-pro-preview | | 18.5% | 19 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals Mortgage Tax overall_accuracy_pct (Mar 16, 2026) |
| #16 | openai/gpt-5.4-2026-03-05 | | 18.0% | 18 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals Mortgage Tax overall_accuracy_pct (Mar 16, 2026) |
| #17 | claude-sonnet-4-20250514 | | 21.6% | 19 | Galileo Agent Leaderboard v2 Avg TSQ (Mar 16, 2026) Vals Mortgage Tax overall_accuracy_pct (Mar 16, 2026) |
| #18 | gpt-4.1-mini-20250414 | | 20.6% | 15 | OpenVLM OCRBench Official ocrbench_score_pct (Mar 16, 2026) Galileo Agent Leaderboard v2 Avg TSQ (Mar 16, 2026) |
| #19 | gpt-5.1-2025-11-13 | | 18.6% | 17 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals Case Law v2 overall_accuracy_pct (Mar 16, 2026) |
| #22 | claude-opus-4-5-20251101 | | 17.3% | 18 | Vals Mortgage Tax overall_accuracy_pct (Mar 16, 2026) FACTS Benchmark Suite facts_grounding_score_pct (Mar 16, 2026) |
| #23 | google/gemini-3.1-flash-lite-preview | | 17.5% | 17 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals Mortgage Tax overall_accuracy_pct (Mar 16, 2026) |
| #26 | gpt-5.2-2025-12-11 | | 13.0% | 14 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals Finance Agent complex_retrieval_accuracy_pct (Mar 16, 2026) |
| #29 | anthropic/claude-opus-4-6-thinking | | 13.0% | 14 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals Mortgage Tax overall_accuracy_pct (Mar 16, 2026) |
| #32 | xai-org/grok-4-fast-reasoning | | 18.0% | 18 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals Finance Agent complex_retrieval_accuracy_pct (Mar 16, 2026) |
| #33 | phi-4 | | 19.6% | 9 | LanguageBench Grammar/Clarity Official (Split) grammar_clarity_score_pct (Mar 12, 2026) Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 12, 2026) |
| #34 | gemini-3-flash-preview | | 16.5% | 18 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 12, 2026) |
| #35 | anthropic/claude-opus-4-5-20251101-thinking | | 13.0% | 14 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals Mortgage Tax overall_accuracy_pct (Mar 16, 2026) |
| #36 | Llama-3.1-70B-Instruct | | 17.7% | 7 | LanguageBench Grammar/Clarity Official (Split) grammar_clarity_score_pct (Mar 12, 2026) LanguageBench Translation Official (Split) translation_to:bleu (Mar 12, 2026) |
| #38 | Llama-3.3-70B-Instruct | | 14.7% | 5 | LanguageBench Grammar/Clarity Official (Split) grammar_clarity_score_pct (Mar 12, 2026) LanguageBench Translation Official (Split) translation_to:bleu (Mar 12, 2026) |
| #39 | kimi/kimi-k2.5-thinking | | 15.2% | 16 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals Mortgage Tax overall_accuracy_pct (Mar 16, 2026) |
| #41 | anthropic/claude-sonnet-4-5-20250929-thinking | | 13.0% | 14 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals Mortgage Tax overall_accuracy_pct (Mar 16, 2026) |
| #42 | xai-org/grok-4-1-fast-reasoning | | 18.0% | 18 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vectara HHEM Leaderboard business_answer_rate_pct (Mar 12, 2026) |
| #50 | gpt-4o | | 11.1% | 11 | CRMArena Function Calling overall_score_pct (Mar 16, 2026) OpenVLM OCRBench Official ocrbench_score_pct (Mar 16, 2026) |
| #52 | anthropic/claude-opus-4-1-20250805 | | 15.8% | 15 | Vals Mortgage Tax overall_accuracy_pct (Mar 16, 2026) Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 12, 2026) |
| #55 | grok/grok-4.20-beta-0309-reasoning | | 13.0% | 14 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals Finance Agent complex_retrieval_accuracy_pct (Mar 16, 2026) |