Model Profile
dfurman/CalmeRys-78B-Orpo-v0.1
Use this page to decide where this model is a strong fit. Rankings below are benchmark-backed by use case, with explicit confidence and contributor metrics.
Identity
ID: external/dfurman/calmerys-78b-orpo-v0-1
Author: dfurman
Origin: external_benchmark_shadow
Arch: unknown
Benchmark Coverage
Scored use cases: 12
Avg confidence: 21.5%
Evidence points: 49
Raw rows: 9
Weighted rows: 5
Catalog Metadata
Parameters: unknown
Context window: 4096
Downloads: 0
Intelligence Profile
Dimension Breakdown
* Low confidence — limited benchmark evidence for this dimension
5/5 dimensions scored · Last updated Apr 30, 2026
Benchmark Signals
Click through to the benchmark source behind this model profile.
Open LLM Leaderboard MMLU-Pro
mmlu_pro_accuracy_pct
Normalized value 95.4% · confidence 100.0%
Strongest impact in Social post generation
openllm_mmlu_pro_official.mmlu_pro_accuracy_pct · Apr 30, 2026
Open LLM Leaderboard GPQA
gpqa
Normalized value 68.1% · confidence 100.0%
Strongest impact in Social post generation
openllm_gpqa_official.gpqa · Apr 30, 2026
Open LLM Leaderboard IFEval
ifeval
Normalized value 90.7% · confidence 100.0%
Strongest impact in Job description drafting
openllm_ifeval_official.ifeval · Apr 30, 2026
Open LLM Leaderboard BBH
bbh
Normalized value 80.7% · confidence 100.0%
Strongest impact in Job description drafting
openllm_bbh_official.bbh · Apr 30, 2026
Open LLM Leaderboard Results
ifeval
Normalized value 90.7% · confidence 100.0%
Strongest impact in Social post generation
open_llm_leaderboard_results.ifeval · Apr 30, 2026
Some fit rows have limited benchmark evidence.
12 of 12 scored use cases have low confidence or thin contributor coverage.
Coverage Diagnostics
actively scoredUse-Case Scores
110
Total Measurements
9
Weighted Measurements
5
Weighted Sources
5
Raw Source Coverage
Weighted Source Coverage
Best Use Cases for This Model
| Use Case | Score |
|---|---|
| Social post generation use_case.mkt.social_post_generation | 18.6% |
| Product positioning and messaging use_case.mkt.product_positioning | 18.6% |
| Campaign brief use_case.mkt.campaign_brief | 18.6% |
| Job description drafting use_case.hr.job_description_drafting | 18.1% |
| Ad copy variants use_case.mkt.ad_copy_variants | 17.8% |
| Personalized sales outreach use_case.mkt.sales_outreach_personalized | 17.8% |
| Screenplay scene writing use_case.creative.screenplay_scene | 17.1% |
| Poetry and lyrics use_case.creative.poetry_lyrics | 17.1% |
| Config debugging use_case.sre.config_debugging | 17.1% |
| Terraform generation use_case.sre.iac_terraform | 17.1% |
| Kubernetes manifest generation use_case.sre.iac_k8s | 17.1% |
| Crisis escalation protocol (eval) use_case.safety.crisis_escalation_protocol | 16.1% |