BasedAGIBasedAGI
Menu
Rankings live

customer_experience

Support dialogue agent

Multi-turn support conversations with escalation and policy awareness.

#1 Recommendation

gemini-3-pro-preview

Strong on FACTS Benchmark Suite facts_grounding_score_pct (88%) and FACTS Benchmark Suite facts_search_score_pct (100%)

external/google/gemini-3-pro-preview

31.6%

Score

42.6%

Confidence

Limited benchmark evidence for this use case.

51 ranked models with average evidence of 14.6 points. Rankings may shift as more benchmark data is ingested.

Ranked Models

30

Evidence Quality

83%

Scoring

Benchmark-backed

Top Signal

FACTS Benchmark Suite: facts_grounding_score_pct

All Ranked Models

Max params:
Min confidence:
30 of 30
RankModelScore
#1gemini-3-pro-preview

Strong on FACTS Benchmark Suite facts_grounding_score_pct (88%) and FACTS Benchmark Suite facts_search_score_pct (100%)

31.6%
#2gemini-2.5-pro

Strong on FACTS Benchmark Suite facts_grounding_score_pct (100%) and Vectara HHEM Leaderboard overall_hallucination_error_pct (76%)

29.7%
#3anthropic/claude-sonnet-4.6

Strong on Vals Finance Agent overall_accuracy_pct (100%) and Vectara HHEM Leaderboard overall_hallucination_error_pct (59%)

23.7%
#4gpt-5-mini-2025-08-07
23.3%
#5gpt-4.1-20250414
23.0%
#6Grok-4-0709
22.6%
#7gpt-5-2025-08-07
22.0%
#8google/gemini-3.1-pro-preview
20.8%
#9openai/gpt-5.4-2026-03-05
20.5%
#10claude-sonnet-4-20250514
19.6%
#11claude-opus-4-5-20251101
18.8%
#12gemini-2.5-flash
18.3%
#13gpt-5.1-2025-11-13
18.0%
#14google/gemini-3.1-flash-lite-preview
17.1%
#15gemini-3-flash-preview
16.9%
#16xai-org/grok-4-fast-reasoning
16.6%
#17xai-org/grok-4-1-fast-reasoning
15.6%
#18gpt-5.2-2025-12-11
15.2%
#19anthropic/claude-opus-4-6-thinking
14.8%
#20kimi/kimi-k2.5-thinking
13.8%
#21anthropic/claude-opus-4-5-20251101-thinking
13.6%
#22anthropic/claude-sonnet-4-5-20250929-thinking
12.9%
#23x-ai/grok-3
12.9%
#25zai/glm-5-thinking
12.6%
#27mistralai/mistral-large-2512
12.2%
#28xai-org/grok-4-1-fast-non-reasoning
12.1%
#33Qwen3-Embedding-4B
11.8%
#43anthropic/claude-opus-4-1-20250805
11.4%
#45anthropic/claude-haiku-4-5-20251001-thinking
11.3%
#53alibaba/qwen3.5-flash
11.0%

Compare Models

Model A leads by +1.9%

Shareable Link →

Model A

gemini-3-pro-preview

external/google/gemini-3-pro-preview

31.6%

Rank #1

Confidence 42.6%23 evidence pts

FACTS Benchmark Suite: facts_grounding_score_pct

Value 88.3% · Conf 100.0% · Weight 3.3%

facts_benchmark_suite.facts_grounding_score_pct (Mar 12, 2026)

FACTS Benchmark Suite: facts_search_score_pct

Value 100.0% · Conf 100.0% · Weight 2.9%

facts_benchmark_suite.facts_search_score_pct (Mar 12, 2026)

Vals Finance Agent: overall_accuracy_pct

Value 87.0% · Conf 100.0% · Weight 2.8%

vals_finance_agent.overall_accuracy_pct (Mar 12, 2026)

FACTS Benchmark Suite: average_score_pct

Value 100.0% · Conf 100.0% · Weight 2.8%

facts_benchmark_suite.average_score_pct (Mar 12, 2026)

Model B

gemini-2.5-pro

external/google/gemini-2-5-pro

29.7%

Rank #2

Confidence 44.4%24 evidence pts

FACTS Benchmark Suite: facts_grounding_score_pct

Value 100.0% · Conf 100.0% · Weight 3.7%

facts_benchmark_suite.facts_grounding_score_pct (Mar 12, 2026)

Vectara HHEM Leaderboard: overall_hallucination_error_pct

Value 76.0% · Conf 100.0% · Weight 3.1%

vectara_hhem_leaderboard.overall_hallucination_error_pct (Mar 12, 2026)

Vectara HHEM Leaderboard: overall_answer_rate_pct

Value 97.6% · Conf 100.0% · Weight 2.3%

vectara_hhem_leaderboard.overall_answer_rate_pct (Mar 12, 2026)

FACTS Benchmark Suite: average_score_pct

Value 78.3% · Conf 100.0% · Weight 2.2%

facts_benchmark_suite.average_score_pct (Mar 12, 2026)

Ranking Diagnostics & Missing Models

Source Lift

Ranked

51

Sources

8

Quality

Insufficient

Vals CorpFin v2

vals_corp_fin_v2

41 rows

1.3% avg lift

Vals Legal Bench

vals_legal_bench

36 rows

0.3% avg lift

Vals MedQA

vals_medqa

33 rows

0.3% avg lift

Vals Tax Eval v2

vals_tax_eval_v2

33 rows

0.3% avg lift

Missing Strong Models

google/gemini-2.0-flash-001

external/google/gemini-2-0-flash-001

Rank #56

10.3%

Thin evidence after weighting
Taxonomy Details

Core Tasks

task.customer_support_dialoguetask.intent_classification

Required Modes

none

Domains

domain.customer_support

Related Use Cases