BasedAGIBasedAGI
Menu
Rankings live

cybersecurity

Malware analysis report (defensive)

Explain suspicious code and produce a defensive analysis report.

#1 Recommendation

gemini-2.5-pro

Strong on FACTS Benchmark Suite facts_grounding_score_pct (100%) and VADER Leaderboard mean_score_pct (81%)

external/google/gemini-2-5-pro

29.0%

Score

41.9%

Confidence

Runners-up:#2 gemini-3-pro-preview (25.4%)#3 anthropic/claude-sonnet-4.6 (19.0%)#4 gpt-5-mini-2025-08-07 (18.7%)

Limited benchmark evidence for this use case.

54 ranked models with average evidence of 13.7 points. Rankings may shift as more benchmark data is ingested.

Ranked Models

30

Evidence Quality

81%

Scoring

Benchmark-backed

Top Signal

FACTS Benchmark Suite: facts_grounding_score_pct

All Ranked Models

Max params:
Min confidence:
30 of 30
RankModelScore
#1gemini-2.5-pro

Strong on FACTS Benchmark Suite facts_grounding_score_pct (100%) and VADER Leaderboard mean_score_pct (81%)

29.0%
#2gemini-3-pro-preview

Strong on FACTS Benchmark Suite facts_grounding_score_pct (88%) and FACTS Benchmark Suite facts_search_score_pct (100%)

25.4%
#3anthropic/claude-sonnet-4.6

Strong on Vals Finance Agent overall_accuracy_pct (100%) and Vals CorpFin v2 overall_accuracy_pct (91%)

19.0%
#4gpt-5-mini-2025-08-07
18.7%
#5gpt-4.1-20250414
18.5%
#6gpt-5-2025-08-07
18.4%
#7Grok-4-0709
18.1%
#8google/gemini-3.1-pro-preview
17.5%
#9openai/gpt-5.4-2026-03-05
17.2%
#10claude-opus-4-5-20251101
16.6%
#11gpt-4o-2024-05-13
15.8%
#12gpt-5.1-2025-11-13
15.2%
#13claude-sonnet-4-20250514
15.2%
#14gemini-3-flash-preview
14.8%
#15google/gemini-3.1-flash-lite-preview
14.3%
#16xai-org/grok-4-fast-reasoning
14.1%
#17xai-org/grok-4-1-fast-reasoning
13.4%
#18anthropic/claude-opus-4-6-thinking
13.3%
#19gpt-5.2-2025-12-11
13.3%
#20gemini-2.5-flash
13.1%
#21Meta-Llama-3-8B-Instruct
12.8%
#22kimi/kimi-k2.5-thinking
12.6%
#23x-ai/grok-3
12.4%
#24anthropic/claude-opus-4-5-20251101-thinking
12.3%
#26anthropic/claude-sonnet-4-5-20250929-thinking
11.6%
#29zai/glm-5-thinking
11.2%
#30o3-20250416
10.5%
#31Llama-2-7b-chat-hf
10.5%
#32openai/gpt-4o-mini-2024-07-18
10.4%
#33mistralai/mistral-large-2512
10.4%

Compare Models

Model A leads by +3.6%

Shareable Link →

Model A

gemini-2.5-pro

external/google/gemini-2-5-pro

29.0%

Rank #1

Confidence 41.9%25 evidence pts

FACTS Benchmark Suite: facts_grounding_score_pct

Value 100.0% · Conf 100.0% · Weight 2.7%

facts_benchmark_suite.facts_grounding_score_pct (Mar 12, 2026)

VADER Leaderboard: mean_score_pct

Value 80.8% · Conf 100.0% · Weight 2.2%

vader_leaderboard.mean_score_pct (Mar 12, 2026)

Vectara HHEM Leaderboard: overall_hallucination_error_pct

Value 76.0% · Conf 100.0% · Weight 2.1%

vectara_hhem_leaderboard.overall_hallucination_error_pct (Mar 12, 2026)

Vals CorpFin v2: overall_accuracy_pct

Value 78.4% · Conf 100.0% · Weight 1.7%

vals_corp_fin_v2.overall_accuracy_pct (Mar 12, 2026)

Model B

gemini-3-pro-preview

external/google/gemini-3-pro-preview

25.4%

Rank #2

Confidence 33.1%23 evidence pts

FACTS Benchmark Suite: facts_grounding_score_pct

Value 88.3% · Conf 100.0% · Weight 2.3%

facts_benchmark_suite.facts_grounding_score_pct (Mar 12, 2026)

FACTS Benchmark Suite: facts_search_score_pct

Value 100.0% · Conf 100.0% · Weight 2.0%

facts_benchmark_suite.facts_search_score_pct (Mar 12, 2026)

FACTS Benchmark Suite: average_score_pct

Value 100.0% · Conf 100.0% · Weight 1.9%

facts_benchmark_suite.average_score_pct (Mar 12, 2026)

Vals Finance Agent: overall_accuracy_pct

Value 87.0% · Conf 100.0% · Weight 1.9%

vals_finance_agent.overall_accuracy_pct (Mar 12, 2026)

▶Ranking Diagnostics & Missing Models

Source Lift

Ranked

54

Sources

8

Quality

Insufficient

Vals CorpFin v2

vals_corp_fin_v2

41 rows

1.3% avg lift

Vals Legal Bench

vals_legal_bench

37 rows

0.3% avg lift

Vals Tax Eval v2

vals_tax_eval_v2

36 rows

0.3% avg lift

Vals MedQA

vals_medqa

35 rows

0.3% avg lift

Missing Strong Models

gpt-4o

external/openai/gpt-4o

Rank #22

15.2%

Thin evidence after weighting

qwen-2.5-72b-instruct

external/qwen/qwen-2-5-72b-instruct

Rank #27

14.2%

Thin evidence after weighting

google/gemini-2.0-flash-001

external/google/gemini-2-0-flash-001

Rank #56

10.3%

Thin evidence after weighting
▶Taxonomy Details

Core Tasks

task.code_explanationtask.multi_doc_synthesis

Required Modes

mode.long_context

Domains

domain.cybersecurity_defense

Related Use Cases

cybersecurity

Security incident triage

Triage security incidents from alerts/logs into impact and next steps.

Top: gemini-2.5-pro

cybersecurity

Vulnerability-oriented code review

Review code for security vulnerabilities and propose mitigations.

Top: gemini-2.5-pro