BasedAGIBasedAGI
Menu
Rankings live

customer_experience

Best LLM for FAQ Chatbot

Ranked models for answering common support questions with safe troubleshooting steps.

#1 Recommendation

gemini-2.5-pro

Strong on FACTS Benchmark Suite facts_grounding_score_pct (100%) and Vectara HHEM Leaderboard overall_hallucination_error_pct (76%)

external/google/gemini-2-5-pro

26.7%

Score

41.9%

Confidence

27

Evidence

Ranked Models

30

Evidence Quality

81%

Scoring

Benchmark-backed

Top Signal

FACTS Benchmark Suite: facts_grounding_score_pct

All Ranked Models

Max params:
Min confidence:
30 of 30
RankModelScore
#1gemini-2.5-pro

Strong on FACTS Benchmark Suite facts_grounding_score_pct (100%) and Vectara HHEM Leaderboard overall_hallucination_error_pct (76%)

26.7%
#2gemini-3-pro-preview

Strong on FACTS Benchmark Suite facts_grounding_score_pct (88%) and FACTS Benchmark Suite facts_search_score_pct (100%)

26.6%
#3gpt-4.1-20250414

Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct (82%) and Galileo Agent Leaderboard v2 Avg AC (100%)

23.9%
#4gpt-5-mini-2025-08-07
21.0%
#5gpt-5-2025-08-07
19.9%
#6anthropic/claude-sonnet-4.6
19.9%
#7Grok-4-0709
19.0%
#8gemini-2.5-flash
18.1%
#9google/gemini-3.1-pro-preview
17.4%
#10openai/gpt-5.4-2026-03-05
17.2%
#11claude-sonnet-4-20250514
16.4%
#12claude-opus-4-5-20251101
15.8%
#13gpt-5.1-2025-11-13
15.1%
#14google/gemini-3.1-flash-lite-preview
14.4%
#15gemini-3-flash-preview
14.2%
#16xai-org/grok-4-fast-reasoning
13.9%
#17xai-org/grok-4-1-fast-reasoning
13.1%
#19gpt-4.1-mini-20250414
12.9%
#20gpt-5.2-2025-12-11
12.8%
#22anthropic/claude-opus-4-6-thinking
12.5%
#30Qwen3-Embedding-4B
11.8%
#34kimi/kimi-k2.5-thinking
11.6%
#39anthropic/claude-opus-4-5-20251101-thinking
11.4%
#47anthropic/claude-sonnet-4-5-20250929-thinking
10.9%
#48x-ai/grok-3
10.8%
#57grok/grok-4.20-beta-0309-reasoning
10.6%
#59zai/glm-5-thinking
10.6%
#69mistralai/mistral-large-2512
10.3%
#70gpt-4o
10.2%
#71xai-org/grok-4-1-fast-non-reasoning
10.2%

Head-to-Head: #1 vs #2

#1

Top Pick

gemini-2.5-pro

Strong on FACTS Benchmark Suite facts_grounding_score_pct (100%) and Vectara HHEM Leaderboard overall_hallucination_error_pct (76%)

26.7%

Conf 41.9%

#2

gemini-3-pro-preview

Strong on FACTS Benchmark Suite facts_grounding_score_pct (88%) and FACTS Benchmark Suite facts_search_score_pct (100%)

26.6%

Conf 35.8%

Related Lookups