| #1 | gemini-2.5-flash Strong on LanguageBench Translation Official (Split) translation_to:bleu (92%) and BRIDGE Medical Leaderboard average_performance_pct (100%) | | 35.9% | 22 | LanguageBench Translation Official (Split) translation_to:bleu (Mar 12, 2026) BRIDGE Medical Leaderboard average_performance_pct (Mar 12, 2026) |
| #2 | gpt-4.1-20250414 Strong on Galileo Agent Leaderboard v2 Healthcare AC (100%) and Vals MedQA overall_accuracy_pct (90%) | | 32.9% | 27 | Galileo Agent Leaderboard v2 Healthcare AC (Mar 16, 2026) Vals MedQA overall_accuracy_pct (Mar 16, 2026) |
| #3 | gemini-2.5-pro Strong on Vectara HHEM Leaderboard medicine_hallucination_error_pct (93%) and OpenVLM OCRBench Official ocrbench_score_pct (91%) | | 48.0% | 32 | Vectara HHEM Leaderboard medicine_hallucination_error_pct (Mar 12, 2026) OpenVLM OCRBench Official ocrbench_score_pct (Mar 16, 2026) |
| #6 | claude-sonnet-4-20250514 | | 26.3% | 21 | Galileo Agent Leaderboard v2 Healthcare AC (Mar 16, 2026) Vals MedQA overall_accuracy_pct (Mar 16, 2026) |
| #7 | google/gemini-2.0-flash-001 | | 22.0% | 14 | LanguageBench Translation Official (Split) translation_to:bleu (Mar 12, 2026) BRIDGE Medical Leaderboard average_performance_pct (Mar 12, 2026) |
| #9 | gpt-4.1-mini-20250414 | | 24.7% | 17 | Galileo Agent Leaderboard v2 Healthcare AC (Mar 16, 2026) Vals MedQA overall_accuracy_pct (Mar 16, 2026) |
| #10 | gpt-4o | | 19.1% | 14 | MedHELM average_score_pct (Mar 16, 2026) MedHELM clinical_note_generation_win_rate_pct (Mar 16, 2026) |
| #11 | gemini-3-pro-preview | | 20.8% | 23 | Vals MedQA overall_accuracy_pct (Mar 16, 2026) Vectara HHEM Leaderboard medicine_hallucination_error_pct (Mar 12, 2026) |
| #12 | gpt-5-mini-2025-08-07 | | 21.4% | 20 | Vals MedQA overall_accuracy_pct (Mar 16, 2026) Vals MedScribe overall_accuracy_pct (Mar 16, 2026) |
| #13 | Grok-4-0709 | | 23.3% | 20 | Vals MedQA overall_accuracy_pct (Mar 16, 2026) Vals MedScribe overall_accuracy_pct (Mar 16, 2026) |
| #14 | google/gemini-3.1-pro-preview | | 17.6% | 18 | Vals MedQA overall_accuracy_pct (Mar 16, 2026) Vectara HHEM Leaderboard medicine_hallucination_error_pct (Mar 12, 2026) |
| #15 | gpt-5-2025-08-07 | | 17.5% | 17 | Vals MedQA overall_accuracy_pct (Mar 16, 2026) Vals MedScribe overall_accuracy_pct (Mar 16, 2026) |
| #16 | claude-opus-4-5-20251101 | | 18.7% | 18 | Vals MedQA overall_accuracy_pct (Mar 16, 2026) Vals MedScribe overall_accuracy_pct (Mar 16, 2026) |
| #17 | openai/gpt-5.4-2026-03-05 | | 17.2% | 17 | Vals MedQA overall_accuracy_pct (Mar 16, 2026) Vectara HHEM Leaderboard medicine_hallucination_error_pct (Mar 12, 2026) |
| #18 | qwen-2.5-72b-instruct | | 20.2% | 13 | BRIDGE Medical Leaderboard average_performance_pct (Mar 12, 2026) Galileo Agent Leaderboard v2 Healthcare AC (Mar 16, 2026) |
| #19 | gemini-3-flash-preview | | 17.0% | 17 | Vals MedQA overall_accuracy_pct (Mar 16, 2026) Vectara HHEM Leaderboard medicine_hallucination_error_pct (Mar 12, 2026) |
| #20 | gpt-5.1-2025-11-13 | | 15.3% | 16 | Vals MedQA overall_accuracy_pct (Mar 16, 2026) Vals MedScribe overall_accuracy_pct (Mar 16, 2026) |
| #22 | deepseek/deepseek-r1 | | 30.9% | 20 | BRIDGE Medical Leaderboard average_performance_pct (Mar 12, 2026) LanguageBench Translation Official (Split) translation_to:bleu (Mar 12, 2026) |
| #24 | xai-org/grok-4-fast-reasoning | | 17.2% | 17 | Vals MedQA overall_accuracy_pct (Mar 16, 2026) Vals MedScribe overall_accuracy_pct (Mar 16, 2026) |
| #25 | Llama-3.1-70B-Instruct | | 18.4% | 8 | BRIDGE Medical Leaderboard average_performance_pct (Mar 12, 2026) LanguageBench Translation Official (Split) translation_to:bleu (Mar 12, 2026) |
| #26 | anthropic/claude-opus-4-6-thinking | | 12.8% | 13 | Vals MedQA overall_accuracy_pct (Mar 16, 2026) Vals MedScribe overall_accuracy_pct (Mar 16, 2026) |
| #28 | anthropic/claude-opus-4-1-20250805 | | 17.3% | 15 | Vals MedQA overall_accuracy_pct (Mar 16, 2026) Vectara HHEM Leaderboard medicine_hallucination_error_pct (Mar 12, 2026) |
| #29 | anthropic/claude-opus-4-5-20251101-thinking | | 12.8% | 13 | Vals MedQA overall_accuracy_pct (Mar 16, 2026) Vals MedScribe overall_accuracy_pct (Mar 16, 2026) |
| #30 | gpt-5.2-2025-12-11 | | 12.8% | 13 | Vals MedQA overall_accuracy_pct (Mar 16, 2026) Vals MedScribe overall_accuracy_pct (Mar 16, 2026) |
| #31 | anthropic/claude-sonnet-4.6 | | 15.0% | 18 | Vals MedQA overall_accuracy_pct (Mar 16, 2026) Vectara HHEM Leaderboard medicine_hallucination_error_pct (Mar 12, 2026) |
| #34 | xai-org/grok-4-1-fast-reasoning | | 17.2% | 17 | Vals MedQA overall_accuracy_pct (Mar 16, 2026) Vals MedScribe overall_accuracy_pct (Mar 16, 2026) |
| #35 | anthropic/claude-sonnet-4-5-20250929-thinking | | 12.8% | 13 | Vals MedQA overall_accuracy_pct (Mar 16, 2026) Vals MedScribe overall_accuracy_pct (Mar 16, 2026) |
| #37 | o3-20250416 | | 14.2% | 14 | Vals MedQA overall_accuracy_pct (Mar 16, 2026) Vals MedScribe overall_accuracy_pct (Mar 16, 2026) |
| #38 | kimi/kimi-k2.5-thinking | | 15.1% | 16 | Vals MedQA overall_accuracy_pct (Mar 16, 2026) Vals MedScribe overall_accuracy_pct (Mar 16, 2026) |
| #47 | google/gemini-3.1-flash-lite-preview | | 13.9% | 16 | Vectara HHEM Leaderboard medicine_hallucination_error_pct (Mar 12, 2026) Vals MedCode overall_accuracy_pct (Mar 16, 2026) |