Head-to-head
qwq:32b vs GPT-5.5 (Codex)
Both models answered the same one-shot tasks under identical rules — no retries, answers published unedited. Two separate axes, never blended: does the code actually run, and how do blind-scored text answers hold up against a written gold answer. Frontier references sit outside the blind field and are deliberately unscored on text.
| Model | Runnable sims | Blind text avg | Failure modes |
|---|---|---|---|
| qwq:32b | 8% (7/85) | 9.10 (20 scored) | ERR 4 · STAT 42 · BLANK 16 · DNF 16 |
| GPT-5.5 (Codex) frontier reference | 95% (81/85) | unscored by design | ERR 2 · STAT 1 · BLANK 1 |
Biggest contrasts
Rounds where the two models diverged most — open them and read both answers side by side.
→ Interactive round-by-round comparison · → Full leaderboard
Generated 2026-07-31 from the published rounds. Harness failures are excluded from every base — a broken cluster node is our fault, not the model's.