BasedAGIBasedAGI
Menu
Rankings live

business_productivity

Best Model for Document Summarization

Ranked models for summarizing long business documents into scannable outputs.

#1 Recommendation

gemini-3-pro-preview

Strong on BasedAGI Document Summarization Eval overall_score_pct (100%) and FACTS Benchmark Suite facts_grounding_score_pct (88%)

external/google/gemini-3-pro-preview

39.1%

Score

49.6%

Confidence

29

Evidence

Runners-up:#2 gemini-2.5-pro (33.8%)#3 anthropic/claude-sonnet-4.6 (30.5%)#4 Grok-4-0709 (24.6%)

Ranked Models

30

Evidence Quality

83%

Scoring

Benchmark-backed

Top Signal

BasedAGI Document Summarization Eval: overall_score_pct

All Ranked Models

Max params:
Min confidence:
30 of 30
RankModelScore
#1gemini-3-pro-preview

Strong on BasedAGI Document Summarization Eval overall_score_pct (100%) and FACTS Benchmark Suite facts_grounding_score_pct (88%)

39.1%
#2gemini-2.5-pro

Strong on FACTS Benchmark Suite facts_grounding_score_pct (100%) and Vectara HHEM Leaderboard overall_hallucination_error_pct (76%)

33.8%
#3anthropic/claude-sonnet-4.6

Strong on Vals Finance Agent overall_accuracy_pct (100%) and BasedAGI Document Summarization Eval overall_score_pct (80%)

30.5%
#4Grok-4-0709
24.6%
#5gpt-4.1-20250414
22.7%
#6gpt-5-mini-2025-08-07
22.5%
#7gpt-5-2025-08-07
21.3%
#8google/gemini-3.1-pro-preview
20.4%
#9openai/gpt-5.4-2026-03-05
20.3%
#10gemini-2.5-flash
18.5%
#11claude-opus-4-5-20251101
18.3%
#12claude-sonnet-4-20250514
17.6%
#13gpt-5.1-2025-11-13
17.5%
#14google/gemini-3.1-flash-lite-preview
17.2%
#15gemini-3-flash-preview
15.6%
#16xai-org/grok-4-fast-reasoning
15.6%
#17gpt-5.2-2025-12-11
15.3%
#18anthropic/claude-opus-4-6-thinking
14.9%
#19xai-org/grok-4-1-fast-reasoning
14.7%
#20kimi/kimi-k2.5-thinking
13.8%
#21anthropic/claude-opus-4-5-20251101-thinking
13.7%
#22anthropic/claude-sonnet-4-5-20250929-thinking
13.0%
#25grok/grok-4.20-beta-0309-reasoning
12.3%
#26mistralai/mistral-large-2512
12.0%
#27x-ai/grok-3
11.8%
#28zai/glm-5-thinking
11.7%
#29anthropic/claude-haiku-4-5-20251001-thinking
11.5%
#30xai-org/grok-4-1-fast-non-reasoning
11.4%
#31alibaba/qwen3.5-flash
11.3%
#32anthropic/claude-opus-4-1-20250805
11.2%

Head-to-Head: #1 vs #2

#1

Top Pick

gemini-3-pro-preview

Strong on BasedAGI Document Summarization Eval overall_score_pct (100%) and FACTS Benchmark Suite facts_grounding_score_pct (88%)

39.1%

Conf 49.6%

#2

gemini-2.5-pro

Strong on FACTS Benchmark Suite facts_grounding_score_pct (100%) and Vectara HHEM Leaderboard overall_hallucination_error_pct (76%)

33.8%

Conf 51.5%

Full Comparison with Benchmark Evidence →
Full Use-Case PageBrowse All Use CasesHow We Score

Related Lookups

Best LLM for Code Generation

Benchmark-backed ranking of models for generating correct, secure code from requirements.

Best LLM for Debugging

Find the top-ranked models for localizing bugs and proposing fixes with explanations.

Best LLM for Unit Test Generation

Ranked models for generating meaningful unit tests and edge cases from code.

Best LLM for Code Review

Compare models for automated PR review covering correctness, security, and maintainability.

Best LLM for Refactoring

Ranked models for safely refactoring code while preserving behavior and improving clarity.

Best LLM for IDE Code Completion

Compare models for fast, accurate local-context code completion and snippet generation.