BasedAGIBasedAGI

business_productivity

Best LLM for Meeting Summarization

Compare models for summarizing meeting transcripts into action items, decisions, and key points.

This page is high-intent, but the current benchmark evidence for this use case is still limited. Treat the leader below as provisional.

Provisional leader

gemini-2.5-flash

Best current option from the available benchmark evidence, but not yet a strong winner claim.

external/google/gemini-2-5-flash

19.6%

Score

26.9%

Confidence

22

Evidence

Ranked Models

30

Evidence Quality

84%

Evidence Points

22

Top Signal

LanguageBench Grammar/Clarity Official (Split): grammar_clarity_score_pct

Benchmark Sources

38

Last Updated

17h ago

All Ranked Models

30 of 30 models
RankModelScore
🥇gemini-2.5-flash

Strong on LanguageBench Grammar/Clarity Official (Split) grammar_clarity_score_pct and FACTS Benchmark Suite facts_grounding_score_pct

19.6%
🥈gemini-2.5-pro

Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct

19.5%
🥉gpt-5-2025-08-07

Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vals Finance Agent overall_accuracy_pct

18.2%
#4gemini-3.1-pro-preview

Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct

18.1%
#5claude-sonnet-4

Strong on LanguageBench Grammar/Clarity Official (Split) grammar_clarity_score_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct

18.1%
#6gpt-4.1-20250414

Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and MMLongBench-Doc Leaderboard acc_score_pct

17.9%
#7gpt-5.2-2025-12-11

Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vals Finance Agent overall_accuracy_pct

16.3%
#8gpt-5-mini-2025-08-07

Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct

16.2%
#9Grok-4-0709

Strong on FACTS Benchmark Suite facts_grounding_score_pct and Galileo Agent Leaderboard v2 Avg TSQ

16.0%
#10qwen-2.5-72b-instruct

Strong on Open LLM Leaderboard MMLU-Pro mmlu_pro_accuracy_pct and Open LLM Leaderboard GPQA gpqa

15.1%
#11gemini-3-pro-preview

Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and Vals Finance Agent overall_accuracy_pct

14.9%
#12gemini-3.1-flash-lite-preview

Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct

14.9%
#13gemini-3-flash-preview

Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct

14.9%
#14phi-4

Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and Open LLM Leaderboard GPQA gpqa

14.7%
#15claude-opus-4-5-20251101

Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct

13.6%
#16claude-sonnet-4.6

Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and Vals Finance Agent overall_accuracy_pct

13.5%
#17gpt-5.4-2026-03-05

Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and Vals Finance Agent overall_accuracy_pct

12.6%
#18claude-opus-4.7

Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and Vals Finance Agent overall_accuracy_pct

11.9%
#19Llama-3.3-70B-Instruct

Strong on Open LLM Leaderboard MMLU-Pro mmlu_pro_accuracy_pct and LanguageBench Grammar/Clarity Official (Split) grammar_clarity_score_pct

11.6%
#21Llama-3.1-70B-Instruct

Strong on Open LLM Leaderboard MMLU-Pro mmlu_pro_accuracy_pct and LanguageBench Grammar/Clarity Official (Split) grammar_clarity_score_pct

11.3%
#22grok-4-1-fast-reasoning

Strong on Vals Finance Agent overall_accuracy_pct and Berkeley Function Calling Leaderboard (Overall) Non-Live AST Acc

11.1%
#23gpt-5.1-2025-11-13

Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vals Finance Agent overall_accuracy_pct

10.8%
#26o3-20250416

Strong on Vals Mortgage Tax overall_accuracy_pct and SciArena Leaderboard rating_elo

10.0%
#27grok-4-fast-reasoning

Strong on Vals Finance Agent overall_accuracy_pct and FACTS Benchmark Suite facts_grounding_score_pct

9.9%
#28gemini-2.5-flash-lite

Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and Galileo Agent Leaderboard v2 Avg TSQ

9.8%
#30Qwen2-72B-Instruct

Strong on Open LLM Leaderboard MMLU-Pro mmlu_pro_accuracy_pct and Open LLM Leaderboard GPQA gpqa

9.5%
#32Qwen2.5-32B-Instruct

Strong on Open LLM Leaderboard MMLU-Pro mmlu_pro_accuracy_pct and Open LLM Leaderboard GPQA gpqa

9.3%
#33MaziyarPanahi/calme-3.2-instruct-78b

Strong on Open LLM Leaderboard MMLU-Pro mmlu_pro_accuracy_pct and Open LLM Leaderboard GPQA gpqa

9.3%
#34Mistral-Large-Instruct-2411

Strong on Open LLM Leaderboard GPQA gpqa and Open LLM Leaderboard MMLU-Pro mmlu_pro_accuracy_pct

9.3%
#35gemma-2-27b-it

Strong on Open LLM Leaderboard GPQA gpqa and Open LLM Leaderboard MMLU-Pro mmlu_pro_accuracy_pct

9.3%

Head-to-Head: #1 vs #2

#1

Top Pick

gemini-2.5-flash

Strong on LanguageBench Grammar/Clarity Official (Split) grammar_clarity_score_pct and FACTS Benchmark Suite facts_grounding_score_pct

19.6%

Conf 26.9%

#2

gemini-2.5-pro

Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct

19.5%

Conf 31.5%

Related Lookups