BasedAGIBasedAGI
Menu
Rankings live

finance

Quant research code generation

Generate backtest or analysis code from trading hypotheses.

#1 Recommendation

anthropic/claude-sonnet-4.6

Strong on Vals Finance Agent overall_accuracy_pct (100%) and Vals CorpFin v2 overall_accuracy_pct (91%)

external/anthropic/claude-sonnet-4-6

32.9%

Score

42.0%

Confidence

Ranked Models

30

Evidence Quality

86%

Scoring

Benchmark-backed

Top Signal

Vals Finance Agent: overall_accuracy_pct

All Ranked Models

Max params:
Min confidence:
30 of 30
RankModelScore
#1anthropic/claude-sonnet-4.6

Strong on Vals Finance Agent overall_accuracy_pct (100%) and Vals CorpFin v2 overall_accuracy_pct (91%)

32.9%
#2gemini-3-pro-preview

Strong on Vals Finance Agent overall_accuracy_pct (87%) and Vals CorpFin v2 overall_accuracy_pct (87%)

29.4%
#3Grok-4-0709

Strong on Vals CorpFin v2 overall_accuracy_pct (94%) and Vals Finance Agent overall_accuracy_pct (84%)

28.4%
#4gemini-2.5-pro
26.5%
#5google/gemini-3.1-pro-preview
25.9%
#6openai/gpt-5.4-2026-03-05
25.7%
#7gpt-5-mini-2025-08-07
25.6%
#8gpt-4.1-20250414
25.5%
#9gpt-5-2025-08-07
24.9%
#10gpt-5.2-2025-12-11
24.1%
#11kimi/kimi-k2.5-thinking
24.1%
#12anthropic/claude-opus-4-6-thinking
23.5%
#13gpt-5.1-2025-11-13
23.3%
#14anthropic/claude-opus-4-5-20251101-thinking
22.7%
#15Kimi K2 Thinking
22.6%
#16xai-org/grok-4-fast-reasoning
22.2%
#17z-ai/glm-4.7
22.2%
#18xai-org/grok-4-1-fast-reasoning
22.0%
#19claude-sonnet-4-20250514
21.9%
#20gemini-3-flash-preview
21.4%
#21minimax/minimax-m2.1
21.3%
#22anthropic/claude-sonnet-4-5-20250929-thinking
21.0%
#23google/gemini-3.1-flash-lite-preview
21.0%
#24alibaba/qwen3.5-flash
19.2%
#26anthropic/claude-haiku-4-5-20251001-thinking
18.4%
#27zai/glm-5-thinking
18.2%
#28claude-opus-4-5-20251101
18.0%
#29gpt-4.1-mini-20250414
17.1%
#30qwen/qwen3-max
15.8%
#31mistralai/mistral-large-2512
15.1%

Compare Models

Model A leads by +3.5%

Shareable Link →

Model A

anthropic/claude-sonnet-4.6

external/anthropic/claude-sonnet-4-6

32.9%

Rank #1

Confidence 42.0%32 evidence pts

Vals Finance Agent: overall_accuracy_pct

Value 100.0% · Conf 100.0% · Weight 2.4%

vals_finance_agent.overall_accuracy_pct (Mar 12, 2026)

Vals CorpFin v2: overall_accuracy_pct

Value 91.5% · Conf 100.0% · Weight 2.0%

vals_corp_fin_v2.overall_accuracy_pct (Mar 12, 2026)

Vals Tax Eval v2: overall_accuracy_pct

Value 100.0% · Conf 100.0% · Weight 2.0%

vals_tax_eval_v2.overall_accuracy_pct (Mar 12, 2026)

OpenHands Issue Resolution: issue_resolution_score_pct

Value 71.8% · Conf 100.0% · Weight 1.4%

openhands_issue_resolution.issue_resolution_score_pct (Mar 12, 2026)

Model B

gemini-3-pro-preview

external/google/gemini-3-pro-preview

29.4%

Rank #2

Confidence 37.8%30 evidence pts

Vals Finance Agent: overall_accuracy_pct

Value 87.0% · Conf 100.0% · Weight 2.1%

vals_finance_agent.overall_accuracy_pct (Mar 12, 2026)

Vals CorpFin v2: overall_accuracy_pct

Value 86.7% · Conf 100.0% · Weight 1.9%

vals_corp_fin_v2.overall_accuracy_pct (Mar 12, 2026)

Vals Tax Eval v2: overall_accuracy_pct

Value 87.1% · Conf 100.0% · Weight 1.8%

vals_tax_eval_v2.overall_accuracy_pct (Mar 12, 2026)

Vals Mortgage Tax: overall_accuracy_pct

Value 99.3% · Conf 100.0% · Weight 1.4%

vals_mortgage_tax.overall_accuracy_pct (Mar 12, 2026)

Ranking Diagnostics & Missing Models

Source Lift

Ranked

50

Sources

8

Quality

Sufficient

Vals CorpFin v2

vals_corp_fin_v2

42 rows

1.1% avg lift

Vals Tax Eval v2

vals_tax_eval_v2

42 rows

1.7% avg lift

Vals GPQA

vals_gpqa

40 rows

0.7% avg lift

Vals Mortgage Tax

vals_mortgage_tax

33 rows

1.2% avg lift

Missing Strong Models

gpt-4o-2024-05-13

external/openai/gpt-4o-2024-05-13

Rank #51

10.5%

Thin evidence after weighting
Taxonomy Details

Core Tasks

task.code_generationtask.reasoning_math

Required Modes

none

Domains

domain.finance_equity_research

Related Use Cases