BasedAGIBasedAGI
Menu
Rankings live

supply_chain

Supplier risk monitoring

Track supplier risk signals from multi-source text and summarize actions.

#1 Recommendation

gemini-3-pro-preview

Strong on FACTS Benchmark Suite facts_grounding_score_pct (88%) and FACTS Benchmark Suite facts_search_score_pct (100%)

external/google/gemini-3-pro-preview

29.1%

Score

37.9%

Confidence

Runners-up:#2 gemini-2.5-pro (26.9%)#3 anthropic/claude-sonnet-4.6 (21.7%)#4 gpt-4.1-20250414 (21.6%)

Limited benchmark evidence for this use case.

49 ranked models with average evidence of 14.6 points. Rankings may shift as more benchmark data is ingested.

Ranked Models

30

Evidence Quality

82%

Scoring

Benchmark-backed

Top Signal

FACTS Benchmark Suite: facts_grounding_score_pct

All Ranked Models

Max params:
Min confidence:
30 of 30
RankModelScore
#1gemini-3-pro-preview

Strong on FACTS Benchmark Suite facts_grounding_score_pct (88%) and FACTS Benchmark Suite facts_search_score_pct (100%)

29.1%
#2gemini-2.5-pro

Strong on FACTS Benchmark Suite facts_grounding_score_pct (100%) and Vectara HHEM Leaderboard overall_hallucination_error_pct (76%)

26.9%
#3anthropic/claude-sonnet-4.6

Strong on Vals Finance Agent overall_accuracy_pct (100%) and Vals CorpFin v2 overall_accuracy_pct (91%)

21.7%
#4gpt-4.1-20250414
21.6%
#5Grok-4-0709
21.4%
#6gpt-5-mini-2025-08-07
20.6%
#7gpt-5-2025-08-07
20.3%
#8google/gemini-3.1-pro-preview
19.3%
#9openai/gpt-5.4-2026-03-05
18.9%
#10claude-sonnet-4-20250514
18.4%
#11claude-opus-4-5-20251101
18.3%
#12gemini-2.5-flash
18.2%
#13gpt-5.1-2025-11-13
16.8%
#14gemini-3-flash-preview
16.4%
#15google/gemini-3.1-flash-lite-preview
15.7%
#16xai-org/grok-4-fast-reasoning
15.5%
#17xai-org/grok-4-1-fast-reasoning
14.8%
#18anthropic/claude-opus-4-6-thinking
14.7%
#19gpt-5.2-2025-12-11
14.7%
#20kimi/kimi-k2.5-thinking
14.2%
#21anthropic/claude-opus-4-5-20251101-thinking
13.6%
#22x-ai/grok-3
12.9%
#23zai/glm-5-thinking
12.9%
#24anthropic/claude-sonnet-4-5-20250929-thinking
12.8%
#26o3-20250416
11.6%
#27mistralai/mistral-large-2512
11.5%
#28anthropic/claude-haiku-4-5-20251001-thinking
11.3%
#29alibaba/qwen3.5-flash
11.2%
#30xai-org/grok-4-1-fast-non-reasoning
11.1%
#31Kimi K2 Thinking
10.5%

Compare Models

Model A leads by +2.2%

Shareable Link →

Model A

gemini-3-pro-preview

external/google/gemini-3-pro-preview

29.1%

Rank #1

Confidence 37.9%23 evidence pts

FACTS Benchmark Suite: facts_grounding_score_pct

Value 88.3% · Conf 100.0% · Weight 2.6%

facts_benchmark_suite.facts_grounding_score_pct (Mar 12, 2026)

FACTS Benchmark Suite: facts_search_score_pct

Value 100.0% · Conf 100.0% · Weight 2.2%

facts_benchmark_suite.facts_search_score_pct (Mar 12, 2026)

SciArena Leaderboard: rating_elo

Value 78.8% · Conf 100.0% · Weight 2.2%

sciarena_leaderboard.rating_elo (Mar 12, 2026)

FACTS Benchmark Suite: average_score_pct

Value 100.0% · Conf 100.0% · Weight 2.1%

facts_benchmark_suite.average_score_pct (Mar 12, 2026)

Model B

gemini-2.5-pro

external/google/gemini-2-5-pro

26.9%

Rank #2

Confidence 40.2%23 evidence pts

FACTS Benchmark Suite: facts_grounding_score_pct

Value 100.0% · Conf 100.0% · Weight 2.9%

facts_benchmark_suite.facts_grounding_score_pct (Mar 12, 2026)

Vectara HHEM Leaderboard: overall_hallucination_error_pct

Value 76.0% · Conf 100.0% · Weight 2.3%

vectara_hhem_leaderboard.overall_hallucination_error_pct (Mar 12, 2026)

SciArena Leaderboard: rating_elo

Value 70.7% · Conf 100.0% · Weight 2.0%

sciarena_leaderboard.rating_elo (Mar 12, 2026)

Galileo Agent Leaderboard v2: Avg TSQ

Value 79.5% · Conf 100.0% · Weight 1.9%

galileo_agent_v2.avg_tsq (Mar 12, 2026)

▶Ranking Diagnostics & Missing Models

Source Lift

Ranked

49

Sources

8

Quality

Insufficient

Vals CorpFin v2

vals_corp_fin_v2

42 rows

1.4% avg lift

Vals Legal Bench

vals_legal_bench

38 rows

0.4% avg lift

Vals Tax Eval v2

vals_tax_eval_v2

37 rows

0.3% avg lift

Vals MedQA

vals_medqa

36 rows

0.4% avg lift

Missing Strong Models

gpt-4o

external/openai/gpt-4o

Rank #22

15.2%

Thin evidence after weighting
▶Taxonomy Details

Core Tasks

task.multi_doc_synthesistask.risk_assessment

Required Modes

mode.long_context

Domains

domain.supply_chain_logistics

Related Use Cases

supply_chain

Disruption monitoring brief

Summarize disruptions into risk, options, and recommendations.

Top: gemini-3-pro-preview

supply_chain

Vendor contract summary (procurement)

Summarize vendor contracts into key terms, risks, and deviations.

Top: gemini-3-pro-preview

supply_chain

Route alternatives planning

Propose alternative routes and tradeoffs under disruptions.

Top: gemini-2.5-pro

supply_chain

Tail spend categorization

Categorize tail spend purchases into taxonomy buckets for sourcing.

Top: gpt-4.1-20250414