llama3.1:8b vs Claude Sonnet 5

Both models answered the same one-shot tasks under identical rules — no retries, answers published unedited. Two separate axes, never blended: does the code actually run, and how do blind-scored text answers hold up against a written gold answer. Frontier references sit outside the blind field and are deliberately unscored on text.

Model	Runnable sims	Blind text avg	Failure modes
llama3.1:8b	13% (11/85)	6.58 (31 scored)	ERR 40 · STAT 17 · BLANK 9 · HANG 3 · DNF 5
Claude Sonnet 5 frontier reference	100% (85/85)	unscored by design	—

Biggest contrasts

Rounds where the two models diverged most — open them and read both answers side by side.

Round	llama3.1:8b	Claude Sonnet 5
R155 · Linked list with animated pointer relinking	ERR	OK
R154 · Ring buffer with producer and consumer at different rates	STAT	OK
R153 · Binary min-heap with bubble-up and sink-down	ERR	OK
R152 · Hash table with visible collision chains	BLANK	OK
R151 · Binary search tree growing node by node	ERR	OK

→ Interactive round-by-round comparison · → Full leaderboard

Generated 2026-07-31 from the published rounds. Harness failures are excluded from every base — a broken cluster node is our fault, not the model's.