BasedAGIBasedAGI
Menu
Rankings live

devops_sre

Best Model for Log Triage

Ranked models for interpreting logs and proposing safe diagnostic steps.

#1 Recommendation

gemini-3-pro-preview

Strong on BasedAGI Log Triage Eval overall_score_pct (87%) and FACTS Benchmark Suite facts_grounding_score_pct (88%)

external/google/gemini-3-pro-preview

42.5%

Score

53.5%

Confidence

27

Evidence

Runners-up:#2 gemini-2.5-pro (36.8%)#3 anthropic/claude-sonnet-4.6 (33.1%)#4 Grok-4-0709 (28.9%)

Ranked Models

30

Evidence Quality

84%

Scoring

Benchmark-backed

Top Signal

BasedAGI Log Triage Eval: overall_score_pct

All Ranked Models

Max params:
Min confidence:
30 of 30
RankModelScore
#1gemini-3-pro-preview

Strong on BasedAGI Log Triage Eval overall_score_pct (87%) and FACTS Benchmark Suite facts_grounding_score_pct (88%)

42.5%
#2gemini-2.5-pro

Strong on BasedAGI Log Triage Eval overall_score_pct (60%) and FACTS Benchmark Suite facts_grounding_score_pct (100%)

36.8%
#3anthropic/claude-sonnet-4.6

Strong on BasedAGI Log Triage Eval overall_score_pct (73%) and Vals Finance Agent overall_accuracy_pct (100%)

33.1%
#4Grok-4-0709
28.9%
#5gpt-4.1-20250414
23.3%
#6gpt-5-mini-2025-08-07
22.1%
#7gpt-5-2025-08-07
21.7%
#8google/gemini-3.1-pro-preview
20.7%
#9claude-sonnet-4-20250514
20.5%
#10openai/gpt-5.4-2026-03-05
20.3%
#11claude-opus-4-5-20251101
19.7%
#13gpt-5.1-2025-11-13
18.0%
#14gemini-3-flash-preview
17.5%
#15kimi/kimi-k2.5-thinking
17.5%
#16gemini-2.5-flash
16.9%
#17google/gemini-3.1-flash-lite-preview
16.9%
#18xai-org/grok-4-fast-reasoning
16.6%
#19xai-org/grok-4-1-fast-reasoning
15.8%
#20anthropic/claude-opus-4-6-thinking
15.8%
#21gpt-5.2-2025-12-11
15.7%
#22anthropic/claude-opus-4-5-20251101-thinking
14.6%
#23anthropic/claude-sonnet-4-5-20250929-thinking
13.7%
#24grok/grok-4.20-beta-0309-reasoning
13.4%
#26zai/glm-5-thinking
13.3%
#27x-ai/grok-3
13.2%
#28o3-20250416
12.4%
#29mistralai/mistral-large-2512
12.3%
#31anthropic/claude-haiku-4-5-20251001-thinking
12.1%
#32alibaba/qwen3.5-flash
12.0%
#33xai-org/grok-4-1-fast-non-reasoning
11.9%

Head-to-Head: #1 vs #2

#1

Top Pick

gemini-3-pro-preview

Strong on BasedAGI Log Triage Eval overall_score_pct (87%) and FACTS Benchmark Suite facts_grounding_score_pct (88%)

42.5%

Conf 53.5%

#2

gemini-2.5-pro

Strong on BasedAGI Log Triage Eval overall_score_pct (60%) and FACTS Benchmark Suite facts_grounding_score_pct (100%)

36.8%

Conf 55.6%

Full Comparison with Benchmark Evidence →
Full Use-Case PageBrowse All Use CasesHow We Score

Related Lookups

Best LLM for Code Generation

Benchmark-backed ranking of models for generating correct, secure code from requirements.

Best LLM for Debugging

Find the top-ranked models for localizing bugs and proposing fixes with explanations.

Best LLM for Unit Test Generation

Ranked models for generating meaningful unit tests and edge cases from code.

Best LLM for Code Review

Compare models for automated PR review covering correctness, security, and maintainability.

Best LLM for Refactoring

Ranked models for safely refactoring code while preserving behavior and improving clarity.

Best LLM for IDE Code Completion

Compare models for fast, accurate local-context code completion and snippet generation.