BasedAGIBasedAGI
Menu
Rankings live

healthcare

Medical coding support (suggestions)

Extract coding-relevant facts and suggest codes for human review.

#1 Recommendation

gemini-2.5-pro

Strong on FACTS Benchmark Suite facts_grounding_score_pct (100%) and Vectara HHEM Leaderboard overall_hallucination_error_pct (76%)

external/google/gemini-2-5-pro

25.5%

Score

42.4%

Confidence

Limited benchmark evidence for this use case.

52 ranked models with average evidence of 15.9 points. Rankings may shift as more benchmark data is ingested.

Ranked Models

30

Evidence Quality

81%

Scoring

Benchmark-backed

Top Signal

FACTS Benchmark Suite: facts_grounding_score_pct

All Ranked Models

Max params:
Min confidence:
30 of 30
RankModelScore
#1gemini-2.5-pro

Strong on FACTS Benchmark Suite facts_grounding_score_pct (100%) and Vectara HHEM Leaderboard overall_hallucination_error_pct (76%)

25.5%
#2gemini-3-pro-preview

Strong on FACTS Benchmark Suite facts_grounding_score_pct (88%) and Vals MedQA overall_accuracy_pct (99%)

25.1%
#3gpt-4.1-20250414

Strong on Galileo Agent Leaderboard v2 Healthcare AC (100%) and MMLongBench-Doc Leaderboard acc_score_pct (75%)

22.5%
#4claude-sonnet-4-20250514
20.6%
#5gemini-2.5-flash
20.2%
#6gpt-5-mini-2025-08-07
20.0%
#7Grok-4-0709
19.7%
#8google/gemini-3.1-pro-preview
19.2%
#9claude-opus-4-5-20251101
18.9%
#10gpt-5-2025-08-07
18.7%
#11openai/gpt-5.4-2026-03-05
18.3%
#12anthropic/claude-sonnet-4.6
17.9%
#13gemini-3-flash-preview
16.6%
#14gpt-5.1-2025-11-13
16.3%
#15xai-org/grok-4-fast-reasoning
15.3%
#16xai-org/grok-4-1-fast-reasoning
14.3%
#17anthropic/claude-opus-4-6-thinking
14.2%
#18gpt-5.2-2025-12-11
14.1%
#19google/gemini-3.1-flash-lite-preview
13.7%
#20qwen-2.5-72b-instruct
13.6%
#21anthropic/claude-opus-4-5-20251101-thinking
13.4%
#22kimi/kimi-k2.5-thinking
12.9%
#23anthropic/claude-sonnet-4-5-20250929-thinking
12.6%
#24anthropic/claude-opus-4-1-20250805
12.4%
#25gpt-4o
12.4%
#27x-ai/grok-3
11.8%
#28o3-20250416
11.7%
#29xai-org/grok-4-1-fast-non-reasoning
11.5%
#31mistralai/mistral-large-2512
10.9%
#32gpt-4.1-mini-20250414
10.8%

Compare Models

Model A leads by +0.3%

Shareable Link →

Model A

gemini-2.5-pro

external/google/gemini-2-5-pro

25.5%

Rank #1

Confidence 42.4%30 evidence pts

FACTS Benchmark Suite: facts_grounding_score_pct

Value 100.0% · Conf 100.0% · Weight 2.9%

facts_benchmark_suite.facts_grounding_score_pct (Mar 12, 2026)

Vectara HHEM Leaderboard: overall_hallucination_error_pct

Value 76.0% · Conf 100.0% · Weight 1.7%

vectara_hhem_leaderboard.overall_hallucination_error_pct (Mar 12, 2026)

Vals CorpFin v2: overall_accuracy_pct

Value 78.4% · Conf 100.0% · Weight 1.3%

vals_corp_fin_v2.overall_accuracy_pct (Mar 12, 2026)

Vectara HHEM Leaderboard: medicine_hallucination_error_pct

Value 92.8% · Conf 100.0% · Weight 1.3%

vectara_hhem_leaderboard.medicine_hallucination_error_pct (Mar 12, 2026)

Model B

gemini-3-pro-preview

external/google/gemini-3-pro-preview

25.1%

Rank #2

Confidence 32.7%25 evidence pts

FACTS Benchmark Suite: facts_grounding_score_pct

Value 88.3% · Conf 100.0% · Weight 2.5%

facts_benchmark_suite.facts_grounding_score_pct (Mar 12, 2026)

Vals MedQA: overall_accuracy_pct

Value 99.1% · Conf 100.0% · Weight 2.1%

vals_medqa.overall_accuracy_pct (Mar 12, 2026)

FACTS Benchmark Suite: facts_search_score_pct

Value 100.0% · Conf 100.0% · Weight 1.6%

facts_benchmark_suite.facts_search_score_pct (Mar 12, 2026)

FACTS Benchmark Suite: average_score_pct

Value 100.0% · Conf 100.0% · Weight 1.5%

facts_benchmark_suite.average_score_pct (Mar 12, 2026)

Ranking Diagnostics & Missing Models

Source Lift

Ranked

52

Sources

8

Quality

Insufficient

Vals CorpFin v2

vals_corp_fin_v2

42 rows

1.0% avg lift

Vals MedQA

vals_medqa

39 rows

1.8% avg lift

Vals Legal Bench

vals_legal_bench

30 rows

0.3% avg lift

Vals Finance Agent

vals_finance_agent

29 rows

1.0% avg lift

Missing Strong Models

No obvious gaps right now.

Taxonomy Details

Core Tasks

task.entity_extractiontask.json_schema_filling

Required Modes

mode.json_schema

Domains

domain.healthcare_billing_coding

Related Use Cases