business_productivity
Document summarization
Summarize long business documents into scannable outputs.
#1 Recommendation
gemini-3-pro-preview
Strong on BasedAGI Document Summarization Eval overall_score_pct (100%) and FACTS Benchmark Suite facts_grounding_score_pct (88%)
external/google/gemini-3-pro-preview
39.1%
Score
49.6%
Confidence
Limited benchmark evidence for this use case.
49 ranked models with average evidence of 16.1 points. Rankings may shift as more benchmark data is ingested.
Ranked Models
30
Evidence Quality
83%
Scoring
Benchmark-backed
Top Signal
BasedAGI Document Summarization Eval: overall_score_pct
All Ranked Models
Compare Models
Model A leads by +5.3%
Shareable Link →Model A
gemini-3-pro-preview
external/google/gemini-3-pro-preview
Rank #1
BasedAGI Document Summarization Eval: overall_score_pct
Value 100.0% · Conf 100.0% · Weight 3.7%
basedagi_doc_summarization_eval.overall_score_pct (Mar 12, 2026)
FACTS Benchmark Suite: facts_grounding_score_pct
Value 88.3% · Conf 100.0% · Weight 3.0%
facts_benchmark_suite.facts_grounding_score_pct (Mar 12, 2026)
Vals Finance Agent: overall_accuracy_pct
Value 87.0% · Conf 100.0% · Weight 2.8%
vals_finance_agent.overall_accuracy_pct (Mar 12, 2026)
FACTS Benchmark Suite: facts_search_score_pct
Value 100.0% · Conf 100.0% · Weight 2.6%
facts_benchmark_suite.facts_search_score_pct (Mar 12, 2026)
Model B
gemini-2.5-pro
external/google/gemini-2-5-pro
Rank #2
FACTS Benchmark Suite: facts_grounding_score_pct
Value 100.0% · Conf 100.0% · Weight 3.4%
facts_benchmark_suite.facts_grounding_score_pct (Mar 12, 2026)
Vectara HHEM Leaderboard: overall_hallucination_error_pct
Value 76.0% · Conf 100.0% · Weight 2.7%
vectara_hhem_leaderboard.overall_hallucination_error_pct (Mar 12, 2026)
BasedAGI Document Summarization Eval: overall_score_pct
Value 66.7% · Conf 100.0% · Weight 2.5%
basedagi_doc_summarization_eval.overall_score_pct (Mar 12, 2026)
Vals Finance Agent: overall_accuracy_pct
Value 65.5% · Conf 100.0% · Weight 2.1%
vals_finance_agent.overall_accuracy_pct (Mar 12, 2026)
▶Ranking Diagnostics & Missing Models
Source Lift
Ranked
49
Sources
8
Quality
Insufficient
Vals CorpFin v2
vals_corp_fin_v2
42 rows
1.1% avg lift
Vals Mortgage Tax
vals_mortgage_tax
32 rows
1.0% avg lift
Vals Legal Bench
vals_legal_bench
32 rows
0.3% avg lift
Vals MedQA
vals_medqa
30 rows
0.3% avg lift
Missing Strong Models
gpt-4o
external/openai/gpt-4o
Rank #22
15.2%
▶Taxonomy Details
Core Tasks
Required Modes
Domains
Related Use Cases
business_productivity
Knowledge base Q&A (fast, no citations)
Answer KB questions grounded in retrieved text without citations.
Top: gemini-3-pro-preview
business_productivity
Knowledge base Q&A (with citations)
Answer questions grounded in an internal KB, with evidence.
Top: gemini-3-pro-preview
business_productivity
Decision memo
Recommend a decision with options, constraints, and risks.
Top: gemini-2.5-pro
business_productivity
Executive briefing
Turn raw notes into a short executive brief with risks and actions.
Top: gemini-2.5-pro