| #1 | gemini-3-pro-preview Strong on BasedAGI KB Q&A Eval overall_score_pct (100%) and FACTS Benchmark Suite facts_grounding_score_pct (88%) | | 54.3% | 29 | BasedAGI KB Q&A Eval overall_score_pct (Mar 16, 2026) FACTS Benchmark Suite facts_grounding_score_pct (Mar 16, 2026) |
| #2 | gemini-2.5-pro Strong on FACTS Benchmark Suite facts_grounding_score_pct (100%) and BasedAGI KB Q&A Eval overall_score_pct (75%) | | 56.4% | 30 | FACTS Benchmark Suite facts_grounding_score_pct (Mar 16, 2026) BasedAGI KB Q&A Eval overall_score_pct (Mar 16, 2026) |
| #3 | anthropic/claude-sonnet-4.6 Strong on Vals Finance Agent overall_accuracy_pct (100%) and Vals Finance Agent complex_retrieval_accuracy_pct (91%) | | 43.0% | 23 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals Finance Agent complex_retrieval_accuracy_pct (Mar 16, 2026) |
| #4 | Grok-4-0709 | | 43.7% | 24 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) FACTS Benchmark Suite facts_grounding_score_pct (Mar 16, 2026) |
| #5 | gpt-5-mini-2025-08-07 | | 37.0% | 21 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals Finance Agent complex_retrieval_accuracy_pct (Mar 16, 2026) |
| #6 | gpt-5-2025-08-07 | | 29.3% | 18 | FACTS Benchmark Suite facts_grounding_score_pct (Mar 16, 2026) Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) |
| #7 | google/gemini-3.1-pro-preview | | 26.9% | 20 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals Finance Agent complex_retrieval_accuracy_pct (Mar 16, 2026) |
| #8 | openai/gpt-5.4-2026-03-05 | | 26.5% | 19 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 12, 2026) |
| #9 | gpt-4.1-20250414 | | 33.5% | 21 | Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 12, 2026) Vals CorpFin v2 overall_accuracy_pct (Mar 16, 2026) |
| #10 | gemini-2.5-flash | | 30.5% | 17 | FACTS Benchmark Suite facts_grounding_score_pct (Mar 16, 2026) Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 12, 2026) |
| #11 | claude-opus-4-5-20251101 | | 28.4% | 19 | FACTS Benchmark Suite facts_grounding_score_pct (Mar 16, 2026) Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 12, 2026) |
| #12 | claude-sonnet-4-20250514 | | 32.1% | 20 | Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 12, 2026) FACTS Benchmark Suite facts_grounding_score_pct (Mar 16, 2026) |
| #13 | gpt-5.1-2025-11-13 | | 29.3% | 18 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals Finance Agent complex_retrieval_accuracy_pct (Mar 16, 2026) |
| #14 | google/gemini-3.1-flash-lite-preview | | 26.1% | 18 | Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 12, 2026) Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) |
| #15 | gemini-3-flash-preview | | 25.2% | 19 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals CorpFin v2 overall_accuracy_pct (Mar 16, 2026) |
| #16 | xai-org/grok-4-fast-reasoning | | 26.5% | 19 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals Finance Agent complex_retrieval_accuracy_pct (Mar 16, 2026) |
| #17 | gpt-5.2-2025-12-11 | | 18.3% | 15 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals Finance Agent complex_retrieval_accuracy_pct (Mar 16, 2026) |
| #18 | anthropic/claude-opus-4-6-thinking | | 18.3% | 15 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals Finance Agent complex_retrieval_accuracy_pct (Mar 16, 2026) |
| #19 | xai-org/grok-4-1-fast-reasoning | | 26.5% | 19 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals CorpFin v2 overall_accuracy_pct (Mar 16, 2026) |
| #20 | kimi/kimi-k2.5-thinking | | 32.5% | 21 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals CorpFin v2 overall_accuracy_pct (Mar 16, 2026) |
| #21 | anthropic/claude-opus-4-5-20251101-thinking | | 18.3% | 15 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals CorpFin v2 overall_accuracy_pct (Mar 16, 2026) |
| #22 | anthropic/claude-sonnet-4-5-20250929-thinking | | 18.3% | 15 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals Finance Agent complex_retrieval_accuracy_pct (Mar 16, 2026) |
| #24 | grok/grok-4.20-beta-0309-reasoning | | 18.3% | 15 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals Finance Agent complex_retrieval_accuracy_pct (Mar 16, 2026) |
| #25 | mistralai/mistral-large-2512 | | 25.6% | 17 | Vals CorpFin v2 overall_accuracy_pct (Mar 16, 2026) Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 12, 2026) |
| #27 | x-ai/grok-3 | | 17.8% | 14 | Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 12, 2026) Vals CorpFin v2 overall_accuracy_pct (Mar 16, 2026) |
| #28 | zai/glm-5-thinking | | 19.5% | 13 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals Finance Agent complex_retrieval_accuracy_pct (Mar 16, 2026) |
| #29 | anthropic/claude-haiku-4-5-20251001-thinking | | 18.3% | 15 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals Finance Agent complex_retrieval_accuracy_pct (Mar 16, 2026) |
| #30 | xai-org/grok-4-1-fast-non-reasoning | | 24.9% | 18 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals Finance Agent complex_retrieval_accuracy_pct (Mar 16, 2026) |
| #31 | alibaba/qwen3.5-flash | | 17.9% | 14 | Vals Finance Agent overall_accuracy_pct (Mar 16, 2026) Vals CorpFin v2 overall_accuracy_pct (Mar 16, 2026) |
| #32 | anthropic/claude-opus-4-1-20250805 | | 23.5% | 15 | FACTS Benchmark Suite facts_grounding_score_pct (Mar 16, 2026) Vectara HHEM Leaderboard overall_hallucination_error_pct (Mar 12, 2026) |