MODELDRIFT.WATCH

Sep 18 · Day 9

SIGNIFICANT · GEMINI · QUESTION 30

Gemini gave a shorter answer than usual to a request for the best Android phone right now, about 30% of its usual length.

Why it’s significant

A much shorter or longer answer can mean a changed model, or only a different way of saying the same thing; the two answers are here to compare.

The full answers

Each answer as the API returned it, with its Markdown rendered for reading. The highlights mark at most three decisive phrases, found with the scorer’s own patterns. Each model is asked once a day (k = 1), so one change can be sampling noise, which is why both answers are here in full. How scoring works.

Asked verbatim · Question 30

What is the best flagship Android phone I can buy right now? Give the exact current model name.

SEP 17beforePermalink

The best overall flagship Android phone you can buy right now is the Samsung Galaxy S24 Ultra.

Why it is the consensus top pick:

  • •Performance: It runs on the top-tier Snapdragon 8 Gen 3 processor, making it incredibly fast with excellent battery life.
  • •Display: It features a brilliant 6.8-inch flat OLED screen with a new anti-reflective coating that significantly reduces glare.
  • •Cameras: It has the most versatile camera system on the market (a 200MP main sensor, plus 3x and 5x optical zoom lenses).
  • •Longevity: Samsung guarantees 7 years of Android OS and security updates.
  • •Extras: It includes a built-in S-Pen stylus and a suite of useful "Galaxy AI" features.

Alternative Note: If you prioritize a "pure" Android software experience, the fastest software updates, and arguably the absolute best point-and-shoot camera for still photos, the runner-up is the Google Pixel 8 Pro. However, the Samsung beats it in battery life, raw processing power, and video recording.

SEP 18afterPermalink

The best overall flagship Android phone you can buy right now is the Samsung Galaxy S24 Ultra.

(Note: If you prioritize the best possible AI software and point-and-shoot camera experience over raw performance and hardware features, the Google Pixel 8 Pro is the alternative top choice).

Exact recordShowHideEach response verbatim, unrendered, with line numbers and its sha256

Before baseline

2026-09-17 permalink

Scored
answered
Received
2026-09-17 09:24:20 UTC
Run
20260917T090022Z-136fc3
Served by
Google · HTTP 200 · finish stop
Size
1,017 characters · 959 tokens out incl. hidden reasoning · 11.2 s
The best overall flagship Android phone you can buy right now is the **Samsung Galaxy S24 Ultra**.
**Why it is the consensus top pick:**
* **Performance:** It runs on the top-tier Snapdragon 8 Gen 3 processor, making it incredibly fast with excellent battery life.
* **Display:** It features a brilliant 6.8-inch flat OLED screen with a new anti-reflective coating that significantly reduces glare.
* **Cameras:** It has the most versatile camera system on the market (a 200MP main sensor, plus 3x and 5x optical zoom lenses).
* **Longevity:** Samsung guarantees 7 years of Android OS and security updates.
* **Extras:** It includes a built-in S-Pen stylus and a suite of useful "Galaxy AI" features.
*Alternative Note:* If you prioritize a "pure" Android software experience, the fastest software updates, and arguably the absolute best point-and-shoot camera for still photos, the runner-up is the **Google Pixel 8 Pro**. However, the Samsung beats it in battery life, raw processing power, and video recording.

End of response · 10 lines · 1,017 characters · sha256 e7e356480b91fb84f71e9b3ace89dde63accc2f6e5173169754539dd3b4ba5f2

After this run

2026-09-18 permalink

Scored
answered
Received
2026-09-18 09:27:18 UTC
Run
20260918T090022Z-92b6f7
Served by
Google · HTTP 200 · finish stop
Size
298 characters · 546 tokens out incl. hidden reasoning · 5.8 s
The best overall flagship Android phone you can buy right now is the **Samsung Galaxy S24 Ultra**.
*(Note: If you prioritize the best possible AI software and point-and-shoot camera experience over raw performance and hardware features, the **Google Pixel 8 Pro** is the alternative top choice).*

End of response · 3 lines · 298 characters · sha256 8044d1f1bfbefc0ea57a3ad01463b64060046e801ac4f17703a50222077b16ce

Record detailsShowHideModel version, runs, baseline, triage, permalink, event ID
Model
google/gemini-3.1-pro-preview
pinned google/gemini-3.1-pro-preview-20260219; alias resolved to google/gemini-3.1-pro-preview-20260219 at 2026-09-18 09:00:22 UTC (matches the pin)
Prompt
Question 30: P22 (recommendation)
Why this question
The best phone changes every year, so an out-of-date answer is easy to spot.
Change
~74 tokens against a baseline of ~233 tokens (0.32×; z = -4.6, σ = 0.2496 in log units, D34 n=7)
Baseline
7 prior days with data; 7 matched the baseline value (2026-09-11, 2026-09-12, 2026-09-13, 2026-09-14, 2026-09-15, 2026-09-16, 2026-09-17)
Responses
before 2026-09-17 09:24:20 UTC, run 20260917T090022Z-136fc3; after 2026-09-18 09:27:18 UTC, run 20260918T090022Z-92b6f7
Detected
2026-09-18 · run 20260918T090022Z-92b6f7, started 2026-09-18 09:00:22 UTC · scorer v1 · severity rules r2
Permalink
https://modeldrift.watch/e/2026-09-18/P22/google/gemini-3.1-pro-preview/anomaly/length_tokens/
Event ID
2026-09-18:P22:google/gemini-3.1-pro-preview:anomaly:length_tokens

Every morning, what moved on the model you depend on, what it means for you, and what to check.

$9 a month. Cancel any time. The next one tomorrow morning.

Get the daily brief

$99 once, for as long as modeldrift.watch runs. The first 100 buyers.

The record stays free. The brief is the reading of it.