Model Profile

claude-sonnet-4-20250514

Name: claude-sonnet-4-20250514
Author: anthropic

External Benchmark Shadowexternal_benchmark_shadowpublic

4,096 ctx

Use this page to decide where this model is a strong fit. Rankings below are benchmark-backed by use case, with explicit confidence and contributor metrics.

Identity

ID: external/anthropic/claude-sonnet-4-20250514

Author: anthropic

Origin: external_benchmark_shadow

Arch: unknown

Benchmark Coverage

Scored use cases: 12

Avg confidence: 39.5%

Evidence points: 257

Raw rows: 407

Weighted rows: 40

Catalog Metadata

Parameters: unknown

Context window: 4096

Downloads: 0

Coverage Diagnostics

actively scored

Use-Case Scores

143

Total Measurements

407

Weighted Measurements

Weighted Sources

Raw Source Coverage

vals_mmlu_pro 60vals_mgsm 48galileo_agent_v2 34corpfin_taxeval_public 28vals_medqa 28vectara_hhem_leaderboard 21

Weighted Source Coverage

vectara_hhem_leaderboard 12galileo_agent_v2 10facts_benchmark_suite 3vals_corp_fin_v2 3buildarena_readme 2icelandic_llm_leaderboard 1

Best Use Cases for This Model

Use Case	Vertical	Score	Confidence	Evidence	Top Contributor
Thesis red teaming use_case.fin.thesis_red_team	finance	30.9%	48.6%	24	Vals CorpFin v2: overall_accuracy_pct
Earnings call synthesis use_case.fin.earnings_call_synthesis	finance	27.8%	43.6%	24	Vals CorpFin v2: overall_accuracy_pct
Transaction anomaly narrative use_case.fin.transaction_anomaly_narrative	finance	27.2%	42.7%	24	Vals CorpFin v2: overall_accuracy_pct
Accounts payable invoice extraction (text) use_case.fin.ap_invoice_extraction	finance	27.1%	39.9%	24	Galileo Agent Leaderboard v2: Banking AC
KYC profile synthesis use_case.fin.kyc_profile_synthesis	finance	26.1%	41.0%	24	Vals CorpFin v2: overall_accuracy_pct
AML alert triage use_case.fin.aml_alert_triage	finance	26.1%	41.0%	24	Vals CorpFin v2: overall_accuracy_pct
Config debugging use_case.sre.config_debugging	devops_sre	24.7%	33.9%	17	Galileo Agent Leaderboard v2: Avg AC
Terraform generation use_case.sre.iac_terraform	devops_sre	24.7%	33.9%	17	Galileo Agent Leaderboard v2: Avg AC
Kubernetes manifest generation use_case.sre.iac_k8s	devops_sre	24.7%	33.9%	17	Galileo Agent Leaderboard v2: Avg AC
Litigation risk memo use_case.ins.litigation_risk_memo	insurance	24.2%	38.7%	20	Galileo Agent Leaderboard v2: Insurance TSQ
Filings summarization (10-K/10-Q) use_case.fin.filings_summarization	finance	24.0%	37.8%	24	Vals CorpFin v2: overall_accuracy_pct
Runbook step assistant use_case.sre.runbook_steps	devops_sre	24.0%	38.8%	18	Galileo Agent Leaderboard v2: Avg AC

Deployment Fit Calculator

Model

claude-sonnet-4-20250514

external/anthropic/claude-sonnet-4-20250514

Hardware

Quantization: 4-bit

2-bit8-bit

Insufficient

Unknown parameter count. Cannot estimate deployment fit.

Required VRAM

~0.0GB

Est. Throughput

0.00 tok/s

Deployment Fit Matrix

GPU	4-bit	6-bit	8-bit
RTX 3060 12GB	Insufficient	Insufficient	Insufficient
RTX 3090 24GB	Insufficient	Insufficient	Insufficient
RTX 4090 24GB	Insufficient	Insufficient	Insufficient
Mac Studio M2 Ultra 192GB	Insufficient	Insufficient	Insufficient