OverviewLanguage & Translation › R145
Language & Translation · blind round

R145 · False-friend minefield German into English

blind round 11/11 local models answered

Every answer below carries the name of the model that wrote it. Blind refers to the scoring: the review was done without knowing which model produced which answer — the published result names them.

Show task
Translate into correct English — beware of false friends: "Wir müssen den aktuellen Termin eventuell verschieben; das ist ein sensibles Thema, und ich will kein Gift verspritzen." Output only the translation.

The answers

Local models (Brain cluster) — identical prompt, shuffled order (the sequence is not a ranking)
llama3.1:8b
We may have to postpone the current date; it's a sensitive topic, and I wouldn't want to spread poison.
mistral-small:24b
We may need to postpone the current appointment; this is a sensitive topic, and I don't want to stir up trouble.
qwen3:8b
We may need to reschedule the current appointment; that's a sensitive topic, and I don't want to drop a bomb.
qwen3:14b
We may have to reschedule the current appointment; it's a sensitive topic, and I don't want to cause any conflict/trouble.
qwen3.5:9b
We might have to reschedule the current appointment; this is a sensitive topic, and I don't want to stir up trouble.
gemma4:26b
We may need to postpone the upcoming appointment; it is a sensitive issue, and I don't want to cause any trouble.
deepseek-r1:14b
We may have to reschedule the current meeting; it's a sensitive topic, and I don't want any venom spread.
qwen3-coder:30b
We may need to postpone the current appointment; it is a sensitive topic, and I don't want to upset anyone.
deepseek-r1:32b
We may need to reschedule the current meeting; this is a sensitive topic, and I don't want to spread poison.
qwq:32b
We may need to reschedule the current appointment; it is a sensitive topic, and I don’t want to spread poison.
command-r:35b
We may have to postpone the current appointment; it's a sensitive issue, and I don't want to poison the well.
Outside the Brain cluster — same task, same character budget, collected through their own tooling (response times not comparable)
Claude Opus 5frontier reference
We may have to postpone the current appointment; it's a sensitive matter, and I don't want to spread any venom.
Claude Sonnet 5frontier reference
We may have to postpone the current appointment; it's a sensitive topic, and I don't want to spread any venom.
Claude Fable 5frontier reference
We may have to postpone the current appointment; this is a delicate issue, and I don't want to stir up any bad blood.
Claude Haiku 4.5frontier reference
We might have to postpone the current appointment; this is a sensitive topic, and I don't want to spread poison.
Reference
Gold — the correct answerreference
Sinngemäß: "We may have to postpone the current appointment; it is a sensitive subject, and I don't want to spread venom." Vier Fallen: eventuell=possibly (NICHT eventually), aktuell=current (NICHT actual(ly)), sensibel=sensitive (NICHT sensible), Gift=poison/venom (NICHT gift).
Results at a glance— every model in this round with score, response time and status.

Who wrote what

ModelBlind scoreLatencyStatus
llama3.1:8b 10.056.7 sOK
mistral-small:24b 10.066.0 sOK
qwen3:8b 7.011.5 sOK
qwen3:14b 10.011.0 sOK
qwen3.5:9b 10.010.6 sOK
gemma4:26b 7.088.5 sOK
deepseek-r1:14b 10.027.5 sOK
qwen3-coder:30b 10.09.2 sOK
deepseek-r1:32b 10.051.6 sOK
qwq:32b 10.087.0 sOK
command-r:35b 10.075.8 sOK
Verdict

9 of 11 answering local models matched the gold answer (blind score ≥ 8): mistral-small:24b, llama3.1:8b, qwen3-coder:30b, qwen3:14b, qwen3.5:9b, deepseek-r1:14b, deepseek-r1:32b, qwq:32b, command-r:35b.