BasedAGIBasedAGI
Menu
Rankings live

industrial_ops

Maintenance RCA memo

Turn logs and notes into a maintenance root cause analysis.

#1 Recommendation

gemini-3-pro-preview

Strong on FACTS Benchmark Suite facts_grounding_score_pct (88%) and SciArena Leaderboard rating_elo (79%)

external/google/gemini-3-pro-preview

29.1%

Score

37.8%

Confidence

Runners-up:#2 gemini-2.5-pro (27.1%)#3 gpt-4.1-20250414 (22.9%)#4 anthropic/claude-sonnet-4.6 (21.5%)

Limited benchmark evidence for this use case.

47 ranked models with average evidence of 14.7 points. Rankings may shift as more benchmark data is ingested.

Ranked Models

30

Evidence Quality

82%

Scoring

Benchmark-backed

Top Signal

FACTS Benchmark Suite: facts_grounding_score_pct

All Ranked Models

Max params:
Min confidence:
30 of 30
RankModelScore
#1gemini-3-pro-preview

Strong on FACTS Benchmark Suite facts_grounding_score_pct (88%) and SciArena Leaderboard rating_elo (79%)

29.1%
#2gemini-2.5-pro

Strong on FACTS Benchmark Suite facts_grounding_score_pct (100%) and Vectara HHEM Leaderboard overall_hallucination_error_pct (76%)

27.1%
#3gpt-4.1-20250414

Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct (82%) and MMLongBench-Doc Leaderboard acc_score_pct (75%)

22.9%
#4anthropic/claude-sonnet-4.6
21.5%
#5Grok-4-0709
21.5%
#6gpt-5-mini-2025-08-07
20.4%
#7gpt-5-2025-08-07
20.1%
#8google/gemini-3.1-pro-preview
19.1%
#9openai/gpt-5.4-2026-03-05
18.7%
#10claude-sonnet-4-20250514
18.5%
#11claude-opus-4-5-20251101
18.1%
#12gemini-2.5-flash
17.0%
#13gpt-5.1-2025-11-13
16.6%
#14gemini-3-flash-preview
16.2%
#15google/gemini-3.1-flash-lite-preview
15.6%
#16xai-org/grok-4-fast-reasoning
15.3%
#17xai-org/grok-4-1-fast-reasoning
14.6%
#18anthropic/claude-opus-4-6-thinking
14.5%
#19gpt-5.2-2025-12-11
14.5%
#20kimi/kimi-k2.5-thinking
14.0%
#21anthropic/claude-opus-4-5-20251101-thinking
13.5%
#22x-ai/grok-3
13.0%
#23zai/glm-5-thinking
12.7%
#24anthropic/claude-sonnet-4-5-20250929-thinking
12.6%
#26o3-20250416
11.4%
#27mistralai/mistral-large-2512
11.4%
#28anthropic/claude-haiku-4-5-20251001-thinking
11.2%
#29alibaba/qwen3.5-flash
11.0%
#30xai-org/grok-4-1-fast-non-reasoning
11.0%
#34Kimi K2 Thinking
10.4%

Compare Models

Model A leads by +1.9%

Shareable Link →

Model A

gemini-3-pro-preview

external/google/gemini-3-pro-preview

29.1%

Rank #1

Confidence 37.8%23 evidence pts

FACTS Benchmark Suite: facts_grounding_score_pct

Value 88.3% · Conf 100.0% · Weight 2.6%

facts_benchmark_suite.facts_grounding_score_pct (Mar 12, 2026)

SciArena Leaderboard: rating_elo

Value 78.8% · Conf 100.0% · Weight 2.4%

sciarena_leaderboard.rating_elo (Mar 12, 2026)

FACTS Benchmark Suite: facts_search_score_pct

Value 100.0% · Conf 100.0% · Weight 2.2%

facts_benchmark_suite.facts_search_score_pct (Mar 12, 2026)

FACTS Benchmark Suite: average_score_pct

Value 100.0% · Conf 100.0% · Weight 2.1%

facts_benchmark_suite.average_score_pct (Mar 12, 2026)

Model B

gemini-2.5-pro

external/google/gemini-2-5-pro

27.1%

Rank #2

Confidence 39.1%23 evidence pts

FACTS Benchmark Suite: facts_grounding_score_pct

Value 100.0% · Conf 100.0% · Weight 2.9%

facts_benchmark_suite.facts_grounding_score_pct (Mar 12, 2026)

Vectara HHEM Leaderboard: overall_hallucination_error_pct

Value 76.0% · Conf 100.0% · Weight 2.3%

vectara_hhem_leaderboard.overall_hallucination_error_pct (Mar 12, 2026)

SciArena Leaderboard: rating_elo

Value 70.7% · Conf 100.0% · Weight 2.1%

sciarena_leaderboard.rating_elo (Mar 12, 2026)

Galileo Agent Leaderboard v2: Avg TSQ

Value 79.5% · Conf 100.0% · Weight 2.1%

galileo_agent_v2.avg_tsq (Mar 12, 2026)

▶Ranking Diagnostics & Missing Models

Source Lift

Ranked

47

Sources

8

Quality

Insufficient

Vals CorpFin v2

vals_corp_fin_v2

41 rows

1.5% avg lift

Vals Legal Bench

vals_legal_bench

37 rows

0.4% avg lift

Vals Tax Eval v2

vals_tax_eval_v2

36 rows

0.3% avg lift

Vals MedQA

vals_medqa

35 rows

0.4% avg lift

Missing Strong Models

gpt-4o

external/openai/gpt-4o

Rank #22

15.2%

Thin evidence after weighting

deepseek/deepseek-r1

external/deepseek/deepseek-r1

Rank #54

10.5%

Thin evidence after weighting

google/gemini-2.0-flash-001

external/google/gemini-2-0-flash-001

Rank #56

10.3%

Thin evidence after weighting
▶Taxonomy Details

Core Tasks

task.root_cause_analysis_writeuptask.risk_assessment

Required Modes

mode.long_context

Domains

domain.industrial_ops_maintenance

Related Use Cases

industrial_ops

Operator support chat

Real-time operator assistant with grounded troubleshooting and escalation.

Top: gemini-3-pro-preview

industrial_ops

Manuals Q&A (RAG grounded)

Answer operator questions grounded in technical manuals and runbooks.

Top: gemini-3-pro-preview

industrial_ops

Shift handover summary

Summarize shift notes into incidents, actions, and open items.

Top: gpt-4.1-20250414