Model Profile

gpt-4o-2024-05-13

Name: gpt-4o-2024-05-13
Author: openai

External Benchmark Shadowexternal_benchmark_shadowpublic

4,096 ctx

Use this page to decide where this model is a strong fit. Rankings below are benchmark-backed by use case, with explicit confidence and contributor metrics.

Identity

ID: external/openai/gpt-4o-2024-05-13

Author: openai

Origin: external_benchmark_shadow

Arch: unknown

Benchmark Coverage

Scored use cases: 12

Avg confidence: 31.1%

Evidence points: 118

Raw rows: 185

Weighted rows: 17

Catalog Metadata

Parameters: unknown

Context window: 4096

Downloads: 0

Some fit rows have limited benchmark evidence.

4 of 12 scored use cases have low confidence or thin contributor coverage.

Coverage Diagnostics

actively scored

Use-Case Scores

109

Total Measurements

185

Weighted Measurements

Weighted Sources

Raw Source Coverage

repoqa_leaderboard 74ugi_main 57llm_aggrefact_leaderboard 12vals_gpqa 12llm_trustworthy_leaderboard 8icelandic_llm_leaderboard 7

Weighted Source Coverage

llm_trustworthy_leaderboard 5ugi_main 3aider_code_editing 2llm_aggrefact_leaderboard 2repoqa_leaderboard 2icelandic_llm_leaderboard 1

Best Use Cases for This Model

Use Case	Vertical	Score	Confidence	Evidence	Top Contributor
Debugging assistant use_case.dev.debugging	developer_tools	21.6%	26.3%	9	RepoQA Official Results: overall_average_pass_at_1_pct
Overrefusal (eval) use_case.security.overrefusal_eval	risk_eval	21.5%	41.3%	10	LLM Trustworthy Leaderboard: privacy
Jailbreak resistance (eval) use_case.security.jailbreak_resistance_eval	risk_eval	21.5%	41.3%	10	LLM Trustworthy Leaderboard: privacy
Refusal profile (eval) use_case.security.refusal_profile_eval	risk_eval	21.5%	41.3%	10	LLM Trustworthy Leaderboard: privacy
Scam and social engineering resistance (eval) use_case.security.scam_social_engineering_resistance_eval	risk_eval	21.5%	41.3%	10	LLM Trustworthy Leaderboard: privacy
Crisis escalation protocol (eval) use_case.safety.crisis_escalation_protocol	risk_eval	21.5%	41.3%	10	LLM Trustworthy Leaderboard: privacy
Unit test generation use_case.dev.test_generation	developer_tools	19.2%	23.9%	9	RepoQA Official Results: overall_average_pass_at_1_pct
Refactoring assistant use_case.dev.refactoring	developer_tools	17.1%	22.0%	9	RepoQA Official Results: overall_average_pass_at_1_pct
Vulnerability-oriented code review use_case.cyber.vulnerability_review	cybersecurity	15.8%	25.6%	9	LLM Trustworthy Leaderboard: privacy
Malware analysis report (defensive) use_case.cyber.malware_analysis_report	cybersecurity	15.8%	23.9%	11	RepoQA Official Results: overall_average_pass_at_1_pct
Disinformation and manipulation resistance (eval) use_case.security.disinformation_resistance_eval	risk_eval	14.4%	26.7%	11	LLM Trustworthy Leaderboard: privacy
Codebase onboarding brief use_case.dev.codebase_onboarding	developer_tools	13.6%	18.0%	10	RepoQA Official Results: overall_average_pass_at_1_pct

Deployment Fit Calculator

Model

gpt-4o-2024-05-13

external/openai/gpt-4o-2024-05-13

Hardware

Quantization: 4-bit

2-bit8-bit

Insufficient

Unknown parameter count. Cannot estimate deployment fit.

Required VRAM

~0.0GB

Est. Throughput

0.00 tok/s

Deployment Fit Matrix

GPU	4-bit	6-bit	8-bit
RTX 3060 12GB	Insufficient	Insufficient	Insufficient
RTX 3090 24GB	Insufficient	Insufficient	Insufficient
RTX 4090 24GB	Insufficient	Insufficient	Insufficient
Mac Studio M2 Ultra 192GB	Insufficient	Insufficient	Insufficient