BasedAGIBasedAGI
Menu
Rankings live

supply_chain

Route alternatives planning

Propose alternative routes and tradeoffs under disruptions.

#1 Recommendation

gemini-2.5-pro

Strong on Galileo Agent Leaderboard v2 Avg TSQ (79%) and SciArena Leaderboard rating_elo (71%)

external/google/gemini-2-5-pro

20.2%

Score

32.4%

Confidence

Limited benchmark evidence for this use case.

51 ranked models with average evidence of 12.9 points. Rankings may shift as more benchmark data is ingested.

Ranked Models

30

Evidence Quality

80%

Scoring

Benchmark-backed

Top Signal

Galileo Agent Leaderboard v2: Avg TSQ

All Ranked Models

Max params:
Min confidence:
30 of 30
RankModelScore
#1gemini-2.5-pro

Strong on Galileo Agent Leaderboard v2 Avg TSQ (79%) and SciArena Leaderboard rating_elo (71%)

20.2%
#2gemini-2.5-flash

Strong on Galileo Agent Leaderboard v2 Avg TSQ (100%) and LanguageBench overall:mean (100%)

19.0%
#3gemini-3-pro-preview

Strong on SciArena Leaderboard rating_elo (79%) and FACTS Benchmark Suite average_score_pct (100%)

18.5%
#4Grok-4-0709
18.3%
#5claude-sonnet-4-20250514
18.1%
#6gpt-4.1-20250414
18.0%
#7google/gemini-3.1-pro-preview
14.8%
#8anthropic/claude-sonnet-4.6
14.3%
#9gpt-5-2025-08-07
13.6%
#10openai/gpt-5.4-2026-03-05
13.4%
#11gpt-5.1-2025-11-13
13.0%
#12claude-opus-4-5-20251101
12.8%
#13qwen-2.5-72b-instruct
12.8%
#14gpt-5-mini-2025-08-07
12.5%
#16gpt-4.1-mini-20250414
12.4%
#17anthropic/claude-opus-4-6-thinking
12.2%
#18gemini-3-flash-preview
12.2%
#19gpt-5.2-2025-12-11
12.1%
#20anthropic/claude-opus-4-5-20251101-thinking
11.9%
#21kimi/kimi-k2.5-thinking
11.6%
#22gpt-4o
11.1%
#23anthropic/claude-sonnet-4-5-20250929-thinking
10.8%
#25xai-org/grok-4-fast-reasoning
10.7%
#26deepseek/deepseek-r1
10.3%
#28o3-20250416
10.2%
#29google/gemini-3.1-flash-lite-preview
10.2%
#30xai-org/grok-4-1-fast-reasoning
10.1%
#32zai/glm-5-thinking
9.4%
#33gpt-4o-2024-05-13
9.4%
#35google/gemini-2.0-flash-001
9.2%

Compare Models

Model A leads by +1.1%

Shareable Link →

Model A

gemini-2.5-pro

external/google/gemini-2-5-pro

20.2%

Rank #1

Confidence 32.4%21 evidence pts

Galileo Agent Leaderboard v2: Avg TSQ

Value 79.5% · Conf 100.0% · Weight 3.4%

galileo_agent_v2.avg_tsq (Mar 12, 2026)

SciArena Leaderboard: rating_elo

Value 70.7% · Conf 100.0% · Weight 1.8%

sciarena_leaderboard.rating_elo (Mar 12, 2026)

Galileo Agent Leaderboard v2: Avg AC

Value 58.7% · Conf 100.0% · Weight 1.5%

galileo_agent_v2.avg_ac (Mar 12, 2026)

Vectara HHEM Leaderboard: overall_hallucination_error_pct

Value 76.0% · Conf 100.0% · Weight 0.8%

vectara_hhem_leaderboard.overall_hallucination_error_pct (Mar 12, 2026)

Model B

gemini-2.5-flash

external/google/gemini-2-5-flash

19.0%

Rank #2

Confidence 25.8%14 evidence pts

Galileo Agent Leaderboard v2: Avg TSQ

Value 100.0% · Conf 100.0% · Weight 4.2%

galileo_agent_v2.avg_tsq (Mar 12, 2026)

LanguageBench: overall:mean

Value 100.0% · Conf 100.0% · Weight 2.7%

languagebench.overall_mean (Mar 12, 2026)

Galileo Agent Leaderboard v2: Avg AC

Value 47.8% · Conf 100.0% · Weight 1.2%

galileo_agent_v2.avg_ac (Mar 12, 2026)

SciArena Leaderboard: rating_elo

Value 39.6% · Conf 100.0% · Weight 1.0%

sciarena_leaderboard.rating_elo (Mar 12, 2026)

Ranking Diagnostics & Missing Models

Source Lift

Ranked

51

Sources

8

Quality

Insufficient

Vals CorpFin v2

vals_corp_fin_v2

42 rows

0.5% avg lift

Vals Tax Eval v2

vals_tax_eval_v2

42 rows

0.6% avg lift

Vals GPQA

vals_gpqa

42 rows

0.5% avg lift

Vals Legal Bench

vals_legal_bench

41 rows

0.7% avg lift

Missing Strong Models

No obvious gaps right now.

Taxonomy Details

Core Tasks

task.planning_task_breakdowntask.tradeoff_analysis

Required Modes

none

Domains

domain.supply_chain_logistics

Related Use Cases