That was a shot in the foot - now we're standing there with our pants down, but giving up is not an option.
Overview › Language & Translation › R141
Language & Translation · blind round
R141 · Idiom-dense German into natural English
Every answer below carries the name of the model that wrote it. Blind refers to the scoring: the review was done without knowing which model produced which answer — the published result names them.
1 of the 11 local models delivered nothing through our test harness in this round — for reasons that lie with our setup, not with the models. Those cards are marked DNF like any other, but they are not evidence about those models — the reason is noted on the card itself.
Show task
Translate the following sentence into natural, idiomatic English (no literal translation): "Das war ein Schuss in den Ofen — jetzt stehen wir mit abgesägten Hosen da, aber Aufgeben kommt nicht in die Tüte." Output only the translation.
The answers
Local models (Brain cluster) — identical prompt, shuffled order (the sequence is not a ranking)
That was a shot in the dark—now we're left with nothing to show for it, but giving up is not an option.
That was a complete failure—now we're in a tight spot, but giving up is out of the question.
That was a wasted effort—now we're down to our last straws, but throwing in the towel isn't an option.
qwen3:8bharness
No answer reached us (ERR) — and the reason lies with our setup, not with the model: reasoning consumed the entire token budget and the answer stayed empty; the gateway rejects budgets above 3000 tokens Counted as a did-not-finish, but it is not evidence about this model.
That was a total flop—now we're in a real bind, but giving up is out of the question.
That was a total waste of effort—now we're in a bind, but giving up is not an option.
That was a major blunder — now we're stuck with no easy way out, but giving up isn't an option.
That was a wasted effort—we're stuck with our pants down, but quitting isn't an option.
That was a wild shot—we're now caught with our pants down, but giving up isn’t an option.
It was a shot in the dark, and now we're left high and dry, but giving up is not an option.
Outside the Brain cluster — same task, same character budget, collected through their own tooling (response times not comparable)
Claude Opus 5frontier reference
That one backfired completely — now we're left standing there with our pants down, but throwing in the towel is out of the question.
Claude Sonnet 5frontier reference
That was a total flop — now we're caught with our pants down, but giving up is simply not an option.
Claude Fable 5frontier reference
That was a complete flop — now we're left holding the bag, but giving up is out of the question.
Claude Haiku 4.5frontier reference
That was a complete disaster — we're left looking foolish, but we're not about to give up.
Reference
Gold — the correct answerreference
Sinngemäß z.B.: "That was a complete flop — now we're left with egg on our face, but giving up is out of the question." Drei Idiome müssen idiomatisch (nicht wörtlich) übertragen sein.
Results at a glance— every model in this round with score, response time and status.
Who wrote what
| Model | Blind score | Latency | Status |
|---|---|---|---|
| llama3.1:8b | 7.0 | 4.5 s | OK |
| qwen3:14b | 7.0 | 3.2 s | OK |
| mistral-small:24b | 10.0 | 9.6 s | OK |
| qwen3-coder:30b | 7.0 | 7.9 s | OK |
| qwen3:8b | — | — | harness |
| gemma4:26b | 10.0 | 68.0 s | OK |
| qwen3.5:9b | 10.0 | 10.4 s | OK |
| deepseek-r1:14b | 10.0 | 72.2 s | OK |
| deepseek-r1:32b | 7.0 | 52.6 s | OK |
| qwq:32b | 7.0 | 124.7 s | OK |
| command-r:35b | 7.0 | 114.7 s | OK |
Verdict
4 of 10 answering local models matched the gold answer (blind score ≥ 8): gemma4:26b, mistral-small:24b, qwen3.5:9b, deepseek-r1:14b.