BasedAGIBasedAGI
Menu
Rankings live

biomed_science

Protocol structuring

Convert protocols/methods text into structured steps and tables.

#1 Recommendation

gpt-4.1-20250414

Strong on MMLongBench-Doc Leaderboard acc_score_pct (75%) and Vectara HHEM Leaderboard science_hallucination_error_pct (93%)

external/openai/gpt-4-1-20250414

21.6%

Score

31.0%

Confidence

Limited benchmark evidence for this use case.

48 ranked models with average evidence of 14.4 points. Rankings may shift as more benchmark data is ingested.

Ranked Models

30

Evidence Quality

80%

Scoring

Benchmark-backed

Top Signal

MMLongBench-Doc Leaderboard: acc_score_pct

All Ranked Models

Max params:
Min confidence:
30 of 30
RankModelScore
#1gpt-4.1-20250414

Strong on MMLongBench-Doc Leaderboard acc_score_pct (75%) and Vectara HHEM Leaderboard science_hallucination_error_pct (93%)

21.6%
#2google/gemini-3.1-pro-preview

Strong on Vals GPQA overall_accuracy_pct (100%) and Vals MedCode overall_accuracy_pct (100%)

20.5%
#3gemini-3-pro-preview

Strong on Vals GPQA overall_accuracy_pct (94%) and Vals MedCode overall_accuracy_pct (79%)

19.6%
#4gemini-2.5-pro
16.4%
#5claude-opus-4-5-20251101
16.4%
#6gemini-3-flash-preview
15.9%
#7openai/gpt-5.4-2026-03-05
15.8%
#8claude-sonnet-4-20250514
15.6%
#9gpt-5-mini-2025-08-07
14.8%
#10gemini-2.5-flash
14.6%
#11gpt-5-2025-08-07
14.5%
#12Grok-4-0709
14.1%
#13google/gemini-3.1-flash-lite-preview
13.9%
#14gpt-5.1-2025-11-13
13.7%
#15anthropic/claude-sonnet-4.6
13.6%
#16anthropic/claude-opus-4-1-20250805
12.5%
#17gpt-5.2-2025-12-11
12.4%
#18anthropic/claude-opus-4-6-thinking
12.3%
#19gpt-4o-20241120
12.2%
#20anthropic/claude-opus-4-5-20251101-thinking
11.9%
#21xai-org/grok-4-fast-reasoning
11.6%
#22kimi/kimi-k2.5-thinking
11.6%
#24gpt-4o
11.2%
#27o3-20250416
10.9%
#31anthropic/claude-sonnet-4-5-20250929-thinking
10.6%
#33xai-org/grok-4-1-fast-reasoning
10.5%
#35x-ai/grok-3
10.2%
#37gpt-4o-2024-08-06
9.5%
#38mistralai/mistral-large-2512
9.5%
#39qwen-2.5-72b-instruct
9.0%

Compare Models

Model A leads by +1.0%

Shareable Link →

Model A

gpt-4.1-20250414

external/openai/gpt-4-1-20250414

21.6%

Rank #1

Confidence 31.0%20 evidence pts

MMLongBench-Doc Leaderboard: acc_score_pct

Value 74.6% · Conf 100.0% · Weight 5.0%

mmlongbench_doc_leaderboard.acc_score_pct (Mar 12, 2026)

Vectara HHEM Leaderboard: science_hallucination_error_pct

Value 93.3% · Conf 100.0% · Weight 2.1%

vectara_hhem_leaderboard.science_hallucination_error_pct (Mar 12, 2026)

Vals GPQA: overall_accuracy_pct

Value 53.3% · Conf 100.0% · Weight 1.6%

vals_gpqa.overall_accuracy_pct (Mar 12, 2026)

Galileo Agent Leaderboard v2: Avg AC

Value 100.0% · Conf 100.0% · Weight 1.6%

galileo_agent_v2.avg_ac (Mar 12, 2026)

Model B

google/gemini-3.1-pro-preview

external/google/gemini-3-1-pro-preview

20.5%

Rank #2

Confidence 23.3%18 evidence pts

Vals GPQA: overall_accuracy_pct

Value 100.0% · Conf 100.0% · Weight 3.0%

vals_gpqa.overall_accuracy_pct (Mar 12, 2026)

Vals MedCode: overall_accuracy_pct

Value 100.0% · Conf 100.0% · Weight 2.7%

vals_medcode.overall_accuracy_pct (Mar 12, 2026)

MathArena Models: average_score_pct

Value 84.9% · Conf 100.0% · Weight 2.0%

matharena_models.average_score_pct (Mar 12, 2026)

Vectara HHEM Leaderboard: science_hallucination_error_pct

Value 84.7% · Conf 100.0% · Weight 1.9%

vectara_hhem_leaderboard.science_hallucination_error_pct (Mar 12, 2026)

Ranking Diagnostics & Missing Models

Source Lift

Ranked

48

Sources

8

Quality

Insufficient

Vals GPQA

vals_gpqa

41 rows

2.1% avg lift

Vals Legal Bench

vals_legal_bench

40 rows

0.4% avg lift

Vals Tax Eval v2

vals_tax_eval_v2

39 rows

0.4% avg lift

Vals MedQA

vals_medqa

38 rows

0.4% avg lift

Missing Strong Models

qwen/qwen3-max

external/qwen/qwen3-max

Rank #55

10.3%

Thin evidence after weighting

deepseek-v3

external/deepseek-ai/deepseek-v3

Rank #66

8.8%

Thin evidence after weighting
Taxonomy Details

Core Tasks

task.json_schema_fillingtask.timeline_extraction

Required Modes

mode.json_schema

Domains

domain.biomed_literaturedomain.chemistry_materials

Related Use Cases