R143 · Bureaucratic German into plain English

blind round 11/11 local models answered

Every answer below carries the name of the model that wrote it. Blind refers to the scoring: the review was done without knowing which model produced which answer — the published result names them.

Show task

Translate this bureaucratic German sentence into plain, simple English (maximum 2 sentences): "Die Inanspruchnahme der Leistung setzt die fristgerechte Einreichung des vollständig ausgefüllten Antrags voraus; anderenfalls verwirkt der Anspruch." Output only the translation.

The answers

Local models (Brain cluster) — identical prompt, shuffled order (the sequence is not a ranking)

gemma4:26b

To claim this benefit, you must submit a completed application on time. Otherwise, you will lose your right to it.

qwen3-coder:30b

To receive the benefit, you must submit a fully completed application by the deadline. Otherwise, your claim will be forfeited.

qwen3:8b

To use the service, you must submit a fully completed application on time. If not, your claim is forfeited.

deepseek-r1:14b

You must submit a fully completed application on time; otherwise, you lose your right to the benefit.

llama3.1:8b

You need to submit your application on time and fill it out completely for us to consider giving you this service. If we don't get your completed application in on time, we can't give you the service.

qwen3:14b

To receive the benefit, you must submit a fully completed application by the deadline. Failure to do so will result in the forfeiture of your claim.

qwen3.5:9b

To receive the benefit, you must submit a fully completed application by the deadline. Otherwise, your claim will expire.

mistral-small:24b

You must submit the fully completed application on time to receive the service; otherwise, you will lose your claim.

deepseek-r1:32b

To access the service, you must submit the completely filled-out application on time; otherwise, you lose your entitlement.

qwq:32b

To claim the benefit, you must submit a fully completed application on time; otherwise, your claim is forfeited.

command-r:35b

You must submit a completed application by the deadline to be eligible for this service; otherwise, your claim will be forfeited.

Outside the Brain cluster — same task, same character budget, collected through their own tooling (response times not comparable)

Claude Opus 5frontier reference

To get this benefit, you must send in the fully completed application on time. If you miss the deadline, you lose your claim.

Claude Sonnet 5frontier reference

To get this benefit, you must submit the fully completed application on time. If you don't, you lose your right to it.

Claude Fable 5frontier reference

To receive the benefit, you must submit the fully completed application on time. Otherwise, you lose your entitlement to it.

Claude Haiku 4.5frontier reference

To claim the benefit, you must submit a fully completed application by the deadline. Otherwise, you forfeit your right to it.

Reference

Gold — the correct answerreference

Sinngemäß: "To receive the benefit, you must submit the fully completed application on time. Otherwise you lose your entitlement." Entscheidend: einfaches Englisch, Bedeutung vollständig (fristgerecht + vollständig ausgefüllt + Anspruchsverlust).

Results at a glance— every model in this round with score, response time and status.

Who wrote what

Model	Blind score	Latency	Status
gemma4:26b	10.0	85.0 s	OK
qwen3-coder:30b	10.0	6.6 s	OK
qwen3:8b	10.0	9.2 s	OK
deepseek-r1:14b	10.0	19.9 s	OK
llama3.1:8b	7.0	48.5 s	OK
qwen3:14b	7.0	6.7 s	OK
qwen3.5:9b	7.0	10.4 s	OK
mistral-small:24b	10.0	60.7 s	OK
deepseek-r1:32b	10.0	40.3 s	OK
qwq:32b	10.0	89.8 s	OK
command-r:35b	10.0	89.1 s	OK

Verdict

8 of 11 answering local models matched the gold answer (blind score ≥ 8): gemma4:26b, mistral-small:24b, qwen3-coder:30b, qwen3:8b, deepseek-r1:14b, deepseek-r1:32b, qwq:32b, command-r:35b.