Threat Intelligence Analysis
Analyzing threat reports, CVEs, and security advisories to produce structured risk assessments.
Provisional leader
gemini-2.5-pro
Current leader based on limited benchmark evidence. Treat this ranking as directional until coverage improves.
24.1%
Best benchmark score
37.7%
Confidence
All ranked models — top 3
Ranked Models
30
Evidence Quality
83%
Evidence Points
32
Top Signal
BaxBench Leaderboard: average_secure_pass_1_pct
Benchmark Sources
46
Last Updated
1d ago
Limited evidence. This use case needs coverage at 11% (need 12%) to reach sufficient quality. Scores below are directional — use with caution.
Benchmark Sources (8)
All Ranked Models
| Rank | Model | Score |
|---|---|---|
| 🥇 | gemini-2.5-pro Strong on BaxBench Leaderboard average_secure_pass_1_pct and FACTS Benchmark Suite facts_grounding_score_pct | 24.1% |
| 🥈 | gpt-5-2025-08-07 Strong on BaxBench Leaderboard average_secure_pass_1_pct and FACTS Benchmark Suite facts_grounding_score_pct | 19.5% |
| 🥉 | o3-20250416 Strong on BaxBench Leaderboard average_secure_pass_1_pct and VADER Leaderboard mean_score_pct | 18.8% |
| #4 | gpt-4.1-20250414 Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and Vals CorpFin v2 overall_accuracy_pct | 18.1% |
| #5 | gemini-3.1-pro-preview Strong on FACTS Benchmark Suite facts_search_score_pct and FACTS Benchmark Suite facts_grounding_score_pct | 16.6% |
| #6 | claude-sonnet-4 Strong on BaxBench Leaderboard average_secure_pass_1_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct | 16.1% |
| #7 | gpt-5-mini-2025-08-07 Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct | 15.7% |
| #8 | gpt-5.2-2025-12-11 Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vals CorpFin v2 overall_accuracy_pct | 15.2% |
| #9 | Grok-4-0709 Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Finance Agent overall_accuracy_pct | 15.0% |
| #10 | gemini-3-pro-preview Strong on Vals CorpFin v2 overall_accuracy_pct and Berkeley Function Calling Leaderboard (Overall) Overall Acc | 15.0% |
| #11 | gemini-2.5-flash Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct | 14.3% |
| #12 | gemini-3-flash-preview Strong on Vals CorpFin v2 overall_accuracy_pct and FACTS Benchmark Suite facts_grounding_score_pct | 14.3% |
| #13 | qwen-2.5-72b-instruct Strong on Open LLM Leaderboard MMLU-Pro mmlu_pro_accuracy_pct and Open LLM Leaderboard GPQA gpqa | 13.7% |
| #14 | claude-sonnet-4.6 Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct | 12.8% |
| #15 | gemini-3.1-flash-lite-preview Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vectara HHEM Leaderboard overall_hallucination_error_pct | 12.7% |
| #16 | claude-opus-4-5-20251101 Strong on FACTS Benchmark Suite facts_grounding_score_pct and Vals CorpFin v2 overall_accuracy_pct | 12.6% |
| #17 | grok-4-1-fast-reasoning Strong on Vals CorpFin v2 overall_accuracy_pct and Berkeley Function Calling Leaderboard (Overall) Overall Acc | 12.3% |
| #18 | gpt-5.4-2026-03-05 Strong on Vectara HHEM Leaderboard overall_hallucination_error_pct and Vals CorpFin v2 overall_accuracy_pct | 11.3% |
| #19 | phi-4 Strong on Open LLM Leaderboard GPQA gpqa and Open LLM Leaderboard MMLU-Pro mmlu_pro_accuracy_pct | 11.2% |
| #20 | claude-opus-4.7 Strong on Vals Finance Agent overall_accuracy_pct and Vals CorpFin v2 overall_accuracy_pct | 11.1% |
| #22 | grok-4-fast-reasoning Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Finance Agent overall_accuracy_pct | 10.4% |
| #25 | gpt-5.1-2025-11-13 Strong on Vals CorpFin v2 overall_accuracy_pct and Vals Finance Agent overall_accuracy_pct | 10.1% |
| #27 | grok-4-1-fast-non-reasoning Strong on Berkeley Function Calling Leaderboard (Overall) Overall Acc and Vals Finance Agent overall_accuracy_pct | 9.9% |
| #28 | Meta-Llama-3-8B-Instruct Strong on LLM Trustworthy Leaderboard adv and LLM Trustworthy Leaderboard privacy | 9.9% |
| #29 | Llama-3.3-70B-Instruct Strong on Open LLM Leaderboard MMLU-Pro mmlu_pro_accuracy_pct and Open LLM Leaderboard IFEval ifeval | 9.8% |
| #31 | Llama-3.1-70B-Instruct Strong on Open LLM Leaderboard MMLU-Pro mmlu_pro_accuracy_pct and Open LLM Leaderboard GPQA gpqa | 9.6% |
| #33 | gpt-4.1-mini-20250414 Strong on Vals CorpFin v2 overall_accuracy_pct and OpenVLM OCRBench Official ocrbench_score_pct | 9.3% |
| #34 | MaziyarPanahi/calme-3.2-instruct-78b Strong on Open LLM Leaderboard MMLU-Pro mmlu_pro_accuracy_pct and Open LLM Leaderboard GPQA gpqa | 9.0% |
| #35 | Qwen2.5-32B-Instruct Strong on Open LLM Leaderboard MMLU-Pro mmlu_pro_accuracy_pct and Open LLM Leaderboard GPQA gpqa | 9.0% |
| #36 | MaziyarPanahi/calme-3.1-instruct-78b Strong on Open LLM Leaderboard MMLU-Pro mmlu_pro_accuracy_pct and Open LLM Leaderboard GPQA gpqa | 8.9% |
Compare Models
▶Ranking diagnostics & missing models
Source lift
Ranked
4522
Sources
8
Quality
Low
Open LLM Leaderboard MMLU-Pro
Open LLM Leaderboard GPQA
Open LLM Leaderboard IFEval
Open LLM Leaderboard BBH
Missing frontier models
No obvious gaps right now.
▶Taxonomy & task details
Core tasks
Required modes
Domains
Related in Security
Malware analysis report (defensive)
Explain suspicious code and produce a defensive analysis report.
Security incident triage
Triage security incidents from alerts/logs into impact and next steps.
Vulnerability-oriented code review
Review code for security vulnerabilities and propose mitigations.