developer_tools
Codebase onboarding brief
Summarize a repository's architecture, modules, and conventions.
#1 Recommendation
gemini-3-pro-preview
Strong on FACTS Benchmark Suite facts_grounding_score_pct (88%) and FACTS Benchmark Suite facts_search_score_pct (100%)
external/google/gemini-3-pro-preview
27.7%
Score
35.2%
Confidence
Limited benchmark evidence for this use case.
48 ranked models with average evidence of 15.3 points. Rankings may shift as more benchmark data is ingested.
Ranked Models
30
Evidence Quality
83%
Scoring
Benchmark-backed
Top Signal
FACTS Benchmark Suite: facts_grounding_score_pct
All Ranked Models
Compare Models
Model A leads by +5.5%
Shareable Link →Model A
gemini-3-pro-preview
external/google/gemini-3-pro-preview
Rank #1
FACTS Benchmark Suite: facts_grounding_score_pct
Value 88.3% · Conf 100.0% · Weight 1.6%
facts_benchmark_suite.facts_grounding_score_pct (Mar 12, 2026)
FACTS Benchmark Suite: facts_search_score_pct
Value 100.0% · Conf 100.0% · Weight 1.4%
facts_benchmark_suite.facts_search_score_pct (Mar 12, 2026)
FACTS Benchmark Suite: average_score_pct
Value 100.0% · Conf 100.0% · Weight 1.3%
facts_benchmark_suite.average_score_pct (Mar 12, 2026)
Vals SWE-bench: overall_accuracy_pct
Value 87.5% · Conf 100.0% · Weight 1.3%
vals_swebench.overall_accuracy_pct (Mar 12, 2026)
Model B
anthropic/claude-sonnet-4.6
external/anthropic/claude-sonnet-4-6
Rank #2
Vals Finance Agent: overall_accuracy_pct
Value 100.0% · Conf 100.0% · Weight 1.5%
vals_finance_agent.overall_accuracy_pct (Mar 12, 2026)
Vals SWE-bench: overall_accuracy_pct
Value 95.1% · Conf 100.0% · Weight 1.4%
vals_swebench.overall_accuracy_pct (Mar 12, 2026)
Vals CorpFin v2: overall_accuracy_pct
Value 91.5% · Conf 100.0% · Weight 1.3%
vals_corp_fin_v2.overall_accuracy_pct (Mar 12, 2026)
Vals LiveCodeBench: overall_accuracy_pct
Value 91.2% · Conf 100.0% · Weight 1.2%
vals_lcb.overall_accuracy_pct (Mar 12, 2026)
▶Ranking Diagnostics & Missing Models
Source Lift
Ranked
48
Sources
8
Quality
Insufficient
Vals CorpFin v2
vals_corp_fin_v2
41 rows
0.9% avg lift
Vals LiveCodeBench
vals_lcb
40 rows
1.0% avg lift
Vals SWE-bench
vals_swebench
33 rows
1.0% avg lift
Vals MedQA
vals_medqa
33 rows
0.2% avg lift
Missing Strong Models
google/gemini-2.0-flash-001
external/google/gemini-2-0-flash-001
Rank #56
10.3%
deepseek-v3
external/deepseek-ai/deepseek-v3
Rank #66
8.8%
▶Taxonomy Details
Core Tasks
Required Modes
Domains
Related Use Cases
developer_tools
Code generation
Generate correct, secure code from requirements.
Top: anthropic/claude-sonnet-4.6
developer_tools
PR review agent
Review diffs for correctness, security, and maintainability.
Top: anthropic/claude-sonnet-4.6
developer_tools
Agentic bug fixing
Agentic loop that reproduces, fixes, and validates with tests.
Top: anthropic/claude-sonnet-4.6
developer_tools
Refactoring assistant
Refactor code safely while preserving behavior and improving clarity.
Top: z-ai/glm-4.7