Overview › Language & Translation › R45
Language & Translation · blind round

R45 · Idiom-dense German to natural English

blind round 11/11 local models answered task written in German

Every answer below carries the name of the model that wrote it. Blind refers to the scoring: the review was done without knowing which model produced which answer — the published result names them.

A frontier reference answered the same task (Claude Opus 5) — outside the field and deliberately unscored, further down the page.

Show task
Übersetze den folgenden Satz in natürliches, idiomatisches Englisch (keine wörtliche Übersetzung): "Das ist zwar nicht das Gelbe vom Ei, aber wir sollten die Kirche im Dorf lassen — unterm Strich können wir damit leben." Gib nur die Übersetzung aus.

The answers

Local models (Brain cluster) — identical prompt, shuffled order (the sequence is not a ranking)
qwen3:14b
It's not perfect, but we shouldn't overreact to it—all in all, we can live with it.

*(Alternative idiomatic options depending on context: "It's nothing special, but let's keep our cool; ultimately, we can manage.")*
qwen3-coder:30b
It's not ideal, but we shouldn't make a mountain out of a molehill—all things considered, we can live with it.
gemma4:26b
It’s not exactly ideal, but let’s not get carried away—at the end of the day, we can live with it.
llama3.1:8b
"It's not the best solution, but we can live with it - let's just leave well enough alone."
qwen3.5:9b
It’s not perfect, but let’s keep our expectations reasonable—all in all, we can live with it.
deepseek-r1:14b
"It's not exactly the golden egg, but we shouldn't rock the boat—in the long run, we can live with it."
qwen3:8b
"It's not exactly the be-all and end-all, but we shouldn't make a mountain out of a molehill—ultimately, we can live with it."
mistral-small:24b
That's not perfect, but we should keep things in perspective—at the end of the day, it's manageable.
qwq:32b
This isn't ideal, but we shouldn't rock the boat—bottom line, we can live with it.
deepseek-r1:32b
"That's not exactly the cream of the crop, but leave well enough alone — all in all, we can live with it."
command-r:35b
It's not perfect, but we shouldn't make a mountain out of a molehill; all things considered, it's livable.
Outside the Brain cluster — same task, same character budget, collected through their own tooling (response times not comparable)
GPT-5.5 (Codex)frontier reference
It's not exactly ideal, but we shouldn't blow it out of proportion — all things considered, we can live with it.
Claude Sonnet 5frontier reference
It's not exactly perfect, but let's not blow things out of proportion — at the end of the day, we can live with it.
Claude Fable 5frontier reference
It's not exactly perfect, but let's not blow this out of proportion — at the end of the day, we can live with it.
Claude Haiku 4.5frontier reference
It's not perfect, but we shouldn't make a mountain out of a molehill — ultimately, we can live with it.
Reference
Gold — the correct answerreference
Sinngemäß z.B.: "It's not exactly perfect, but let's not blow this out of proportion — at the end of the day, we can live with it." Alle drei Idiome müssen idiomatisch (nicht wörtlich) übertragen sein.
Results at a glance— every model in this round with score, response time and status.

Who wrote what

ModelBlind scoreLatencyStatus
qwen3:14b —9.5 sOK
qwen3-coder:30b —10.0 sOK
gemma4:26b —102.1 sOK
llama3.1:8b —95.0 sOK
qwen3.5:9b —8.2 sOK
deepseek-r1:14b —25.2 sOK
qwen3:8b —14.4 sOK
mistral-small:24b —110.4 sOK
qwq:32b —92.7 sOK
deepseek-r1:32b —90.4 sOK
command-r:35b —89.2 sOK
Verdict

Idiom-dense translation — several natural English renderings are valid. Deliberately unscored; the gold answer serves as reference.

Frontier reference — outside the blind field

These models answered the identical prompt outside the blind field. They are deliberately not scored and not part of the blind comparison — they are there so you can see where a frontier model lands on the same task.

Collected differently from the blind field: the local models run through a plain API harness, the frontier references through a context-free agent, one shot, no retries. Response times are therefore not comparable and are not shown. On two English tasks the reference answer came back in German — an artefact of that harness, flagged on the affected rounds.
Claude Opus 5frontier reference
It's not ideal, but let's keep things in perspective — at the end of the day, we can live with it.