command-r:35b vs mistral-small:24b

Both models answered the same one-shot tasks under identical rules — no retries, answers published unedited. Two separate axes, never blended: does the code actually run, and how do blind-scored text answers hold up against a written gold answer.

Model	Runnable sims	Blind text avg	Failure modes
command-r:35b	25% (24/95)	6.87 (30 scored)	ERR 33 · STAT 10 · BLANK 8 · HANG 3 · DNF 17
mistral-small:24b	32% (30/95)	8.26 (38 scored)	ERR 29 · STAT 12 · BLANK 9 · HANG 7 · DNF 8

Biggest contrasts

Rounds where the two models diverged most — open them and read both answers side by side.

Round	command-r:35b	mistral-small:24b
R175 · Noise flowfield painting additive particle trails	OK	STAT
R164 · Boids flocking with separation, alignment, cohesion and a predator	DNF	OK
R155 · Linked list with animated pointer relinking	DNF	OK
R154 · Ring buffer with producer and consumer at different rates	DNF	OK
R152 · Hash table with visible collision chains	OK	ERR

→ Interactive round-by-round comparison · → Full leaderboard

Generated 2026-08-04 from the published rounds. Harness failures are excluded from every base — a broken cluster node is our fault, not the model's.