Structure & Data · blind round

R41 · Prose → valid JSON

blind round 4/8 local models answered task written in German

Answers below are anonymized and shuffled. Read, judge, pick a favourite — then scroll down and reveal the models.

Show task

Wandle die folgenden Angaben in gültiges JSON um (nur das JSON ausgeben, keine Erklärung): Name Anna Schmidt, Alter 30, Stadt Freiburg, Hobbys Lesen und Radfahren, Newsletter abonniert ja.

The answers — blind

Local models (Brain cluster) — identical prompt, anonymized order

MODEL Allama3.1:8bDNF

No usable answer reached the harness (TIMEOUT). Counted as a did-not-finish.

MODEL Bqwen3.5:9b

```json
{
  "name": "Anna Schmidt",
  "alter": 30,
  "stadt": "Freiburg",
  "hobbys": [
    "Lesen",
    "Radfahren"
  ],
  "newsletter_abonniert": true
}
```

MODEL Cgemma4:26bDNF

No usable answer reached the harness (TIMEOUT). Counted as a did-not-finish.

MODEL Dmistral-small:24bDNF

No usable answer reached the harness (TIMEOUT). Counted as a did-not-finish.

MODEL Eqwen3:8bDNF

No usable answer reached the harness (ERR). Counted as a did-not-finish.

MODEL Fdeepseek-r1:14b

{
  "Name": "Anna Schmidt",
  "Alter": 30,
  "Stadt": "Freiburg",
  "Hobbys": ["Lesen", "Radfahren"],
  "Newsletter abonniert": true
}

MODEL Gqwen3-coder:30b

```json
{
  "name": "Anna Schmidt",
  "alter": 30,
  "stadt": "Freiburg",
  "hobbys": [
    "Lesen",
    "Radfahren"
  ],
  "newsletter_abonniert": true
}
```

MODEL Hqwen3:14b

```json
{
  "name": "Anna Schmidt",
  "alter": 30,
  "stadt": "Freiburg",
  "hobbys": [
    "Lesen",
    "Radfahren"
  ],
  "newsletter_abonniert": true
}
```

Reference

Gold — the correct answerreference

Gültiges JSON-Objekt, z. B. {"name":"Anna Schmidt","alter":30,"stadt":"Freiburg","hobbys":["Lesen","Radfahren"],"newsletter":true}. alter als Zahl, hobbys als Array, newsletter als Boolean.

Reveal the models— compare the answers first, then open. Names, blind scores and latencies are hidden until you do.

Who wrote what

Blind label	Model	Blind score	Latency	Status
MODEL A	llama3.1:8b	—	—	DNF
MODEL B	qwen3.5:9b	10.0	7.7 s	OK
MODEL C	gemma4:26b	—	—	DNF
MODEL D	mistral-small:24b	—	—	DNF
MODEL E	qwen3:8b	—	—	DNF
MODEL F	deepseek-r1:14b	6.0	115.3 s	OK
MODEL G	qwen3-coder:30b	10.0	2.4 s	OK
MODEL H	qwen3:14b	10.0	6.9 s	OK

Verdict

3 of 4 answering local models matched the gold answer (blind score ≥ 8): qwen3-coder:30b, qwen3:14b, qwen3.5:9b.