BasedAGIBasedAGI
Menu
Rankings live

customer_experience

Best LLM for Support Bot

Compare top support-bot models grounded in docs with citations and escalation.

#1 Recommendation

gemini-3-pro-preview

Strong on BasedAGI Support Bot Eval overall_score_pct (86%) and FACTS Benchmark Suite facts_grounding_score_pct (88%)

external/google/gemini-3-pro-preview

36.3%

Score

48.2%

Confidence

27

Evidence

Runners-up:#2 gemini-2.5-pro (32.2%)#3 anthropic/claude-sonnet-4.6 (28.0%)#4 Grok-4-0709 (24.2%)

Ranked Models

30

Evidence Quality

82%

Scoring

Benchmark-backed

Top Signal

BasedAGI Support Bot Eval: overall_score_pct

All Ranked Models

Max params:
Min confidence:
30 of 30
RankModelScore
#1gemini-3-pro-preview

Strong on BasedAGI Support Bot Eval overall_score_pct (86%) and FACTS Benchmark Suite facts_grounding_score_pct (88%)

36.3%
#2gemini-2.5-pro

Strong on FACTS Benchmark Suite facts_grounding_score_pct (100%) and Vectara HHEM Leaderboard overall_hallucination_error_pct (76%)

32.2%
#3anthropic/claude-sonnet-4.6

Strong on Vals Finance Agent overall_accuracy_pct (100%) and BasedAGI Support Bot Eval overall_score_pct (71%)

28.0%
#4Grok-4-0709
24.2%
#5gpt-5-mini-2025-08-07
21.0%
#6gpt-4.1-20250414
20.7%
#7gpt-5-2025-08-07
19.9%
#8google/gemini-3.1-pro-preview
18.7%
#9openai/gpt-5.4-2026-03-05
18.5%
#10claude-sonnet-4-20250514
17.7%
#11claude-opus-4-5-20251101
17.0%
#12gemini-2.5-flash
16.5%
#13gpt-5.1-2025-11-13
16.2%
#14google/gemini-3.1-flash-lite-preview
15.4%
#15gemini-3-flash-preview
15.2%
#16xai-org/grok-4-fast-reasoning
15.0%
#17xai-org/grok-4-1-fast-reasoning
14.1%
#18gpt-5.2-2025-12-11
13.7%
#20anthropic/claude-opus-4-6-thinking
13.4%
#21kimi/kimi-k2.5-thinking
13.2%
#22anthropic/claude-opus-4-5-20251101-thinking
12.3%
#23anthropic/claude-sonnet-4-5-20250929-thinking
11.7%
#24x-ai/grok-3
11.6%
#26grok/grok-4.20-beta-0309-reasoning
11.4%
#27zai/glm-5-thinking
11.3%
#29mistralai/mistral-large-2512
11.0%
#30xai-org/grok-4-1-fast-non-reasoning
11.0%
#35Qwen3-Embedding-4B
10.7%
#45anthropic/claude-opus-4-1-20250805
10.3%
#47anthropic/claude-haiku-4-5-20251001-thinking
10.2%

Head-to-Head: #1 vs #2

#1

Top Pick

gemini-3-pro-preview

Strong on BasedAGI Support Bot Eval overall_score_pct (86%) and FACTS Benchmark Suite facts_grounding_score_pct (88%)

36.3%

Conf 48.2%

#2

gemini-2.5-pro

Strong on FACTS Benchmark Suite facts_grounding_score_pct (100%) and Vectara HHEM Leaderboard overall_hallucination_error_pct (76%)

32.2%

Conf 49.8%

Full Comparison with Benchmark Evidence →
Full Use-Case PageBrowse All Use CasesHow We Score

Related Lookups

Best LLM for Code Generation

Benchmark-backed ranking of models for generating correct, secure code from requirements.

Best LLM for Debugging

Find the top-ranked models for localizing bugs and proposing fixes with explanations.

Best LLM for Unit Test Generation

Ranked models for generating meaningful unit tests and edge cases from code.

Best LLM for Code Review

Compare models for automated PR review covering correctness, security, and maintainability.

Best LLM for Refactoring

Ranked models for safely refactoring code while preserving behavior and improving clarity.

Best LLM for IDE Code Completion

Compare models for fast, accurate local-context code completion and snippet generation.