editing-correction · blind round

R180 · Fix the broken references

blind round 7/11 local models answered

Every answer below carries the name of the model that wrote it. Blind refers to the scoring: the review was done without knowing which model produced which answer — the published result names them.

2 of the 11 local models delivered nothing through our test harness in this round — for reasons that lie with our setup, not with the models. Those cards are marked DNF like any other, but they are not evidence about those models — the reason is noted on the card itself.

Show task

Below is a short note with exactly 4 broken references: one wrong pronoun for its antecedent, one invalid 'latter' reference, one orphaned 'see above' reference, and one numbering jump. Fix all 4 references and change nothing else. Output ONLY the corrected note -- no explanation, no list of fixes, no markdown.

Note:
Maintenance note for the demo room:

The tablet is stored in the blue cabinet, and he must be charged before each session.
The projector was tested after lunch; the latter should remain unplugged overnight.
See above for the cleaning checklist.

Setup steps:
1. Unlock the cabinet.
2. Place the tablet on the stand.
4. Start the room timer.

The answers

Local models (Brain cluster) — identical prompt, shuffled order (the sequence is not a ranking)

llama3.1:8bDNF

No usable answer reached the harness (ERR). Counted as a did-not-finish.

qwen3.5:9b

Maintenance note for the demo room:

The tablet is stored in the blue cabinet, and it must be charged before each session.
The projector was tested after lunch; the unit should remain unplugged overnight.
See above for the cleaning checklist.

Setup steps:
1. Unlock the cabinet.
2. Place the tablet on the stand.
3. Start the room timer.

qwen3:14b

Maintenance note for the demo room:

The tablet is stored in the blue cabinet, and it must be charged before each session.
The projector was tested after lunch; the device should remain unplugged overnight.
See above for the cleaning checklist.

Setup steps:
1. Unlock the cabinet.
2. Place the tablet on the stand.
3. Start the room timer.

gemma4:26bharness

No answer reached us (ERR) — and the reason lies with our setup, not with the model: reasoning consumed the entire token budget (3 min 28 s, zero characters of answer); larger budgets are refused by the gateway Counted as a did-not-finish, but it is not evidence about this model.

qwen3:8bharness

No answer reached us (ERR) — and the reason lies with our setup, not with the model: reasoning consumed the entire token budget and the answer stayed empty; the gateway rejects budgets above 3000 tokens Counted as a did-not-finish, but it is not evidence about this model.

deepseek-r1:14b

Maintenance note for the demo room:

The tablet is stored in the blue cabinet, and it must be charged before each session.  
The projector was tested after lunch; the projector should remain unplugged overnight.  

Setup steps:  
1. Unlock the cabinet.  
2. Place the tablet on the stand.  
3. Start the room timer.

mistral-small:24bDNF

No usable answer reached the harness (ERR). Counted as a did-not-finish.

qwen3-coder:30b

Maintenance note for the demo room:

The tablet is stored in the blue cabinet, and it must be charged before each session.
The projector was tested after lunch; the unit should remain unplugged overnight.
See above for the cleaning checklist.

Setup steps:
1. Unlock the cabinet.
2. Place the tablet on the stand.
3. Start the room timer.

deepseek-r1:32b

Maintenance note for the demo room:

The tablet is stored in the blue cabinet, and it must be charged before each session.  
The projector was tested after lunch; it should remain unplugged overnight.  

Checklist: Clean the board and wipe down surfaces.  

Setup steps:  
1. Unlock the cabinet.  
2. Place the tablet on the stand.  
3. Start the room timer.

qwq:32b

Maintenance note for the demo room:

The tablet is stored in the blue cabinet, and it must be charged before each session.
The projector was tested after lunch; it should remain unplugged overnight.
See below for the cleaning checklist.

Setup steps:
1. Unlock the cabinet.
2. Place the tablet on the stand.
3. Start the room timer.

command-r:35b

Maintenance note for the demo room:

The tablet is stored in the blue cabinet, and it must be charged before each session.
The projector was tested after lunch; the former should remain unplugged overnight.
See below for the cleaning checklist.

Setup steps:
1. Unlock the cabinet.
2. Place the tablet on the stand.
3. Start the room timer.

Outside the Brain cluster — same task, same character budget, collected through their own tooling (response times not comparable)

GPT-5.5 (Codex)frontier reference

Maintenance note for the demo room:

The tablet is stored in the blue cabinet, and it must be charged before each session.
The projector was tested after lunch; it should remain unplugged overnight.
See the cleaning checklist.

Setup steps:
1. Unlock the cabinet.
2. Place the tablet on the stand.
3. Start the room timer.

Reference

Gold — the correct answerreference

Sinngemaess muss enthalten/erfuellen: genau die 4 kaputten Bezuege reparieren und sonst wortgleich bleiben: (1) Pronomen 'he' fuer 'The tablet' -> 'it'; (2) ungueltiges 'the latter' bei nur einem Genannten -> 'the projector'; (3) verwaistes 'See above' -> 'See the binder'; (4) Nummerierungssprung '4.' -> '3.'. VERBOTEN: andere Saetze umformulieren, Setup-Schritte veraendern, Zusatzinformationen einfuegen oder Erklaerungen ausgeben. Musterbeispiel (maschinell verifiziert: alle 4 Quellfehler verschwunden, alle 4 Zielbezuege vorhanden, und Patch-Vergleich bestaetigt genau diese 4 String-Ersetzungen):
Maintenance note for the demo room:

The tablet is stored in the blue cabinet, and it must be charged before each session.
The projector was tested after lunch; the projector should remain unplugged overnight.
See the binder for the cleaning checklist.

Setup steps:
1. Unlock the cabinet.
2. Place the tablet on the stand.
3. Start the room timer.

Results at a glance— every model in this round with score, response time and status.

Who wrote what

Model	Blind score	Latency	Status
llama3.1:8b	—	—	DNF
qwen3.5:9b	4.0	2.4 s	OK
qwen3:14b	4.0	2.4 s	OK
gemma4:26b	—	—	harness
qwen3:8b	—	—	harness
deepseek-r1:14b	7.0	44.8 s	OK
mistral-small:24b	—	—	DNF
qwen3-coder:30b	4.0	6.1 s	OK
deepseek-r1:32b	7.0	51.2 s	OK
qwq:32b	4.0	130.1 s	OK
command-r:35b	4.0	136.9 s	OK

Verdict

0 of 7 answering local models matched the gold answer (blind score ≥ 8): .