BasedAGIBasedAGI
Menu
Rankings live

engineering

Verilog/VHDL generation

Generate RTL code and testbenches from functional specs.

#1 Recommendation

z-ai/glm-4.7

Strong on Sonar Java Quality Leaderboard functional_skill_pct (74%) and Vals LiveCodeBench overall_accuracy_pct (91%)

external/z-ai/glm-4-7

22.1%

Score

31.7%

Confidence

Limited benchmark evidence for this use case.

50 ranked models with average evidence of 13.3 points. Rankings may shift as more benchmark data is ingested.

Ranked Models

30

Evidence Quality

81%

Scoring

Benchmark-backed

Top Signal

Sonar Java Quality Leaderboard: functional_skill_pct

All Ranked Models

Max params:
Min confidence:
30 of 30
RankModelScore
#1z-ai/glm-4.7

Strong on Sonar Java Quality Leaderboard functional_skill_pct (74%) and Vals LiveCodeBench overall_accuracy_pct (91%)

22.1%
#2Kimi K2 Thinking

Strong on Sonar Java Quality Leaderboard functional_skill_pct (88%) and Sonar Java Quality Leaderboard issue_density_error_per_kloc (67%)

21.6%
#3deepseek/deepseek-r1

Strong on Aider Polyglot Leaderboard percent_correct_pct (80%) and Sonar Java Quality Leaderboard functional_skill_pct (83%)

21.3%
#4minimax/minimax-m2.1
20.5%
#6gemini-3-pro-preview
17.8%
#7google/gemini-3.1-pro-preview
17.4%
#8gpt-4.1-20250414
17.2%
#9Grok-4-0709
16.4%
#10openai/gpt-5.4-2026-03-05
16.3%
#11anthropic/claude-sonnet-4.6
15.9%
#12GLM-5
15.8%
#13anthropic/claude-opus-4-6-thinking
15.7%
#14claude-opus-4-5-20251101
15.5%
#15gemini-3-flash-preview
15.3%
#16gpt-5-2025-08-07
15.2%
#17gpt-5.2-2025-12-11
15.1%
#18gpt-5.1-2025-11-13
15.1%
#19anthropic/claude-opus-4-5-20251101-thinking
15.0%
#20claude-sonnet-4-20250514
14.9%
#23kimi/kimi-k2.5-thinking
13.6%
#24anthropic/claude-sonnet-4-5-20250929-thinking
13.2%
#28gpt-4o
12.4%
#32zai/glm-5-thinking
12.3%
#35gemini-2.5-pro
12.0%
#36gpt-4o-20241120
12.0%
#38xai-org/grok-4-fast-reasoning
11.9%
#41google/gemini-3.1-flash-lite-preview
11.9%
#48gpt-5-mini-2025-08-07
11.6%
#50gpt-4o-2024-08-06
11.4%
#52xai-org/grok-4-1-fast-reasoning
11.4%

Compare Models

Model A leads by +0.5%

Shareable Link →

Model A

z-ai/glm-4.7

external/z-ai/glm-4-7

22.1%

Rank #1

Confidence 31.7%16 evidence pts

Sonar Java Quality Leaderboard: functional_skill_pct

Value 74.4% · Conf 100.0% · Weight 2.0%

sonar_java_quality.functional_skill_pct (Mar 12, 2026)

Vals LiveCodeBench: overall_accuracy_pct

Value 91.4% · Conf 100.0% · Weight 1.4%

vals_lcb.overall_accuracy_pct (Mar 12, 2026)

Vals SWE-bench: overall_accuracy_pct

Value 79.9% · Conf 100.0% · Weight 1.4%

vals_swebench.overall_accuracy_pct (Mar 12, 2026)

Sonar Java Quality Leaderboard: issue_density_error_per_kloc

Value 65.2% · Conf 100.0% · Weight 1.3%

sonar_java_quality.issue_density_error_per_kloc (Mar 12, 2026)

Model B

Kimi K2 Thinking

external/kimi/kimi-k2-thinking

21.6%

Rank #2

Confidence 31.0%15 evidence pts

Sonar Java Quality Leaderboard: functional_skill_pct

Value 88.4% · Conf 100.0% · Weight 2.4%

sonar_java_quality.functional_skill_pct (Mar 12, 2026)

Sonar Java Quality Leaderboard: issue_density_error_per_kloc

Value 66.6% · Conf 100.0% · Weight 1.4%

sonar_java_quality.issue_density_error_per_kloc (Mar 12, 2026)

Vals SWE-bench: overall_accuracy_pct

Value 63.5% · Conf 100.0% · Weight 1.1%

vals_swebench.overall_accuracy_pct (Mar 12, 2026)

Vals LiveCodeBench: overall_accuracy_pct

Value 65.1% · Conf 100.0% · Weight 1.0%

vals_lcb.overall_accuracy_pct (Mar 12, 2026)

Ranking Diagnostics & Missing Models

Source Lift

Ranked

50

Sources

8

Quality

Insufficient

Vals LiveCodeBench

vals_lcb

39 rows

1.2% avg lift

Vals Legal Bench

vals_legal_bench

39 rows

0.3% avg lift

Vals GPQA

vals_gpqa

39 rows

0.2% avg lift

Vals Tax Eval v2

vals_tax_eval_v2

38 rows

0.3% avg lift

Missing Strong Models

google/gemini-2.0-flash-001

external/google/gemini-2-0-flash-001

Rank #56

10.3%

Thin evidence after weighting

deepseek-v3

external/deepseek-ai/deepseek-v3

Rank #66

8.8%

Thin evidence after weighting

Llama-4-Scout-17B-16E-Instruct

external/meta/llama-4-scout-17b-16e-instruct

Rank #73

8.4%

Thin evidence after weighting
Taxonomy Details

Core Tasks

task.code_generationtask.test_generation_unit

Required Modes

none

Domains

domain.eda_verilog_vhdl

Related Use Cases