Model Profile

gpt-4o-2024-08-06

Name: gpt-4o-2024-08-06
Author: openai

External Benchmark Shadowexternal_benchmark_shadowpublic

4,096 ctx

Use this page to decide where this model is a strong fit. Rankings below are benchmark-backed by use case, with explicit confidence and contributor metrics.

Identity

ID: external/openai/gpt-4o-2024-08-06

Author: openai

Origin: external_benchmark_shadow

Arch: unknown

Benchmark Coverage

Scored use cases: 12

Avg confidence: 34.0%

Evidence points: 221

Raw rows: 376

Weighted rows: 35

Catalog Metadata

Parameters: unknown

Context window: 4096

Downloads: 0

Some fit rows have limited benchmark evidence.

2 of 12 scored use cases have low confidence or thin contributor coverage.

Coverage Diagnostics

actively scored

Use-Case Scores

128

Total Measurements

376

Weighted Measurements

Weighted Sources

Raw Source Coverage

vals_mmlu_pro 60vals_mgsm 48vals_finance_agent 40corpfin_taxeval_public 28vals_medqa 28vectara_hhem_leaderboard 21

Weighted Source Coverage

vectara_hhem_leaderboard 12vals_finance_agent 5vals_corp_fin_v2 3aider_code_editing 2aider_polyglot 2duckdb_nsql_leaderboard 2

Best Use Cases for This Model

Use Case	Vertical	Score	Confidence	Evidence	Top Contributor
Thesis red teaming use_case.fin.thesis_red_team	finance	16.2%	43.6%	21	Vals Tax Eval v2: overall_accuracy_pct
Metric definition workshop use_case.data.metric_definition_workshop	data_analytics	16.0%	26.0%	14	DuckDB NSQL Leaderboard: all_execution_accuracy
Accounts payable invoice extraction (text) use_case.fin.ap_invoice_extraction	finance	15.5%	38.5%	21	DuckDB NSQL Leaderboard: all_execution_accuracy
Earnings call synthesis use_case.fin.earnings_call_synthesis	finance	15.4%	40.2%	21	DuckDB NSQL Leaderboard: all_execution_accuracy
Data quality assistant use_case.data.data_quality_assistant	data_analytics	15.0%	24.8%	14	DuckDB NSQL Leaderboard: all_execution_accuracy
Simulation setup assistant use_case.eng.simulation_setup_assistant	engineering	14.5%	33.3%	13	Aider Code Editing Leaderboard: percent_correct_pct
AML alert triage use_case.fin.aml_alert_triage	finance	14.5%	37.8%	21	DuckDB NSQL Leaderboard: all_execution_accuracy
KYC profile synthesis use_case.fin.kyc_profile_synthesis	finance	14.5%	37.8%	21	DuckDB NSQL Leaderboard: all_execution_accuracy
Transaction anomaly narrative use_case.fin.transaction_anomaly_narrative	finance	14.3%	38.4%	21	Vals Tax Eval v2: overall_accuracy_pct
Text-to-SQL analyst assistant use_case.data.text_to_sql	data_analytics	14.1%	28.9%	16	DuckDB NSQL Leaderboard: all_execution_accuracy
Quant research code generation use_case.fin.alpha_research_codegen	finance	14.0%	36.6%	24	Vals Tax Eval v2: overall_accuracy_pct
Executive brief from metrics use_case.data.exec_brief_from_metrics	data_analytics	13.5%	22.3%	14	DuckDB NSQL Leaderboard: all_execution_accuracy

Deployment Fit Calculator

Model

gpt-4o-2024-08-06

external/openai/gpt-4o-2024-08-06

Hardware

Quantization: 4-bit

2-bit8-bit

Insufficient

Unknown parameter count. Cannot estimate deployment fit.

Required VRAM

~0.0GB

Est. Throughput

0.00 tok/s

Deployment Fit Matrix

GPU	4-bit	6-bit	8-bit
RTX 3060 12GB	Insufficient	Insufficient	Insufficient
RTX 3090 24GB	Insufficient	Insufficient	Insufficient
RTX 4090 24GB	Insufficient	Insufficient	Insufficient
Mac Studio M2 Ultra 192GB	Insufficient	Insufficient	Insufficient