Head-to-head
qwen3.5:9b vs qwen3:14b
Both models answered the same one-shot tasks under identical rules — no retries, answers published unedited. Two separate axes, never blended: does the code actually run, and how do blind-scored text answers hold up against a written gold answer.
| Model | Runnable sims | Blind text avg | Failure modes |
|---|---|---|---|
| qwen3.5:9b | 37% (35/95) | 9.06 (48 scored) | ERR 30 · STAT 12 · BLANK 17 · HANG 1 |
| qwen3:14b | 31% (29/95) | 8.73 (48 scored) | ERR 42 · STAT 10 · BLANK 13 · HANG 1 |
Biggest contrasts
Rounds where the two models diverged most — open them and read both answers side by side.
→ Interactive round-by-round comparison · → Full leaderboard
Generated 2026-08-04 from the published rounds. Harness failures are excluded from every base — a broken cluster node is our fault, not the model's.