Overviewsummarization › R167
summarization · blind round

R167 · One-sentence TL;DR under 25 words

blind round 11/11 local models answered

Every answer below carries the name of the model that wrote it. Blind refers to the scoring: the review was done without knowing which model produced which answer — the published result names them.

Show task
Below is a product update announcement. Write a TL;DR summary of it in EXACTLY 1 sentence of AT MOST 25 words. The sentence MUST mention the breaking change and its migration deadline; the new features are secondary and do not need to be listed. Output ONLY that one sentence -- no prefix like "TL;DR:", no explanation.

Announcement:
Product Update -- Nova Analytics v4.2

We're excited to announce three new features rolling out this week. First, Custom Dashboards let you rearrange and resize widgets to build a layout that matches your workflow. Second, Scheduled Exports now let you automatically send a CSV or PDF report to your inbox every day, week, or month without lifting a finger. Third, we've added Dark Mode across the entire app, so late-night analysis is easier on the eyes.

Alongside these additions, we need to flag one important breaking change: the legacy /v1/reports API endpoint is being fully shut down and will stop responding to any requests. All integrations must migrate to the new /v3/reports endpoint, which offers better performance and clearer error messages. This migration must be completed by September 30, 2026 -- after that date, any request to the old /v1/reports endpoint will simply fail.

We know API migrations take planning, so please reach out to support if you need help mapping your existing calls to the new endpoint. Full migration docs are linked below. Thanks for being a Nova Analytics customer, and we hope you enjoy the new features!

The answers

Local models (Brain cluster) — identical prompt, shuffled order (the sequence is not a ranking)
gemma4:26b
Migrate all integrations from the legacy /v1/reports API to /v3/reports before the September 30, 2026, shutdown.
mistral-small:24b
The legacy /v1/reports API endpoint is shutting down September 30, 2026, requiring migration to the new /v3/reports endpoint.
qwen3-coder:30b
Migrate from the retiring /v1/reports API to the new /v3/reports endpoint by September 30, 2026, or your integrations will fail.
llama3.1:8b
The legacy /v1/reports API endpoint will be fully shut down on September 30, 2026, requiring all integrations to migrate to the /v3/reports endpoint by then.
qwen3.5:9b
The legacy /v1/reports API endpoint will shut down; migrate to the new /v3/reports endpoint by September 30, 2026.
deepseek-r1:14b
"Breaking change: /v1/reports API shutdown by September 30, 2026."
qwen3:8b
Nova Analytics v4.2 adds Dark Mode, Scheduled Exports, and Custom Dashboards, but the legacy /v1/reports API is deprecated, requiring migration to /v3/reports by September 30, 2026.
qwen3:14b
Migrate from the deprecated /v1/reports API to /v3/reports by September 30, 2026, or your integrations will fail due to the shutdown.
deepseek-r1:32b
Nova Analytics v4.2 introduces three new features but deprecates the /v1/reports API, requiring migration to /v3/reports by September 30, 2026, after which the old endpoint will stop working.
command-r:35b
The legacy /v1/reports API is shutting down by September 30, 2026; migrate to /v3/reports for better performance.
qwq:32b
Nova Analytics v4.2 discontinues the /v1/reports API; all integrations must migrate to /v3/reports by September 30, 2026.
Outside the Brain cluster — same task, same character budget, collected through their own tooling (response times not comparable)
GPT-5.5 (Codex)frontier reference
The legacy /v1/reports API will stop responding after September 30, 2026, so integrations must migrate to /v3/reports by then.
Reference
Gold — the correct answerreference
Sinngemaess muss enthalten/erfuellen: GENAU 1 Satz mit HOECHSTENS 25 Woertern, der zwingend (a) den Breaking Change (Abschaltung des alten /v1/reports-Endpunkts / Migrationspflicht auf /v3/reports) UND (b) die Migrationsfrist (30. September 2026) nennt. Die 3 Features (Custom Dashboards, Scheduled Exports, Dark Mode) sind NICHT verpflichtend und duerfen fehlen. VERBOTEN: mehr als 1 Satz, mehr als 25 Woerter, Frist/Breaking-Change weglassen oder veraendern (z.B. falsches Datum), neue nicht im Text stehende Fakten erfinden. Musterbeispiel (maschinell verifiziert: genau 1 Satz per Regex-Split, Wortzahl <=25 per str.split(), Substrings '/v1/reports', '/v3/reports' und 'september 30, 2026' vorhanden): "The legacy /v1/reports API is shutting down and all integrations must migrate to /v3/reports by September 30, 2026."
Results at a glance— every model in this round with score, response time and status.

Who wrote what

ModelBlind scoreLatencyStatus
gemma4:26b 10.0166.8 sOK
mistral-small:24b 10.0148.2 sOK
qwen3-coder:30b 10.06.1 sOK
llama3.1:8b 10.0136.5 sOK
qwen3.5:9b 10.07.9 sOK
deepseek-r1:14b 7.021.1 sOK
qwen3:8b 4.010.5 sOK
qwen3:14b 10.06.0 sOK
deepseek-r1:32b 4.035.3 sOK
command-r:35b 10.060.8 sOK
qwq:32b 10.060.5 sOK
Verdict

8 of 11 answering local models matched the gold answer (blind score ≥ 8): gemma4:26b, mistral-small:24b, llama3.1:8b, qwen3-coder:30b, qwen3:14b, qwen3.5:9b, qwq:32b, command-r:35b.