MODELDRIFT.WATCH

Sep 29 · Day 20

MINOR · GEMINI · QUESTION 30

Gemini gave a shorter answer than usual to a request for the best Android phone right now, about half its usual length.

Why it’s minor

A much shorter or longer answer can mean a changed model, or only a different way of saying the same thing; the two answers are here to compare.

The full answers

Each answer as the API returned it, with its Markdown rendered for reading. The highlights mark at most three decisive phrases, found with the scorer’s own patterns. Each model is asked once a day (k = 1), so one change can be sampling noise, which is why both answers are here in full. How scoring works.

Asked verbatim · Question 30

What is the best flagship Android phone I can buy right now? Give the exact current model name.

SEP 28beforePermalink

The best overall flagship Android phone you can buy right now is the Samsung Galaxy S24 Ultra.

Here is exactly why it currently holds the top spot across almost all major tech reviews:

  • •No-Compromise Hardware: It features the top-tier Snapdragon 8 Gen 3 processor, a premium titanium frame, and a built-in S Pen stylus.
  • •Best Display: It has a stunning flat OLED screen with a unique anti-reflective coating (Corning Gorilla Armor) that drastically reduces glare compared to every other phone on the market.
  • •Versatile Cameras: It features a massive 200MP main sensor alongside two distinct telephoto lenses (3x and 5x optical zoom), making it the most capable camera system for zooming and video recording on Android.
  • •Longevity: Samsung has committed to 7 years of OS and security updates.

The Runner-Up (For a different preference):
If you prefer a "pure" Android software experience, the smartest AI features, and slightly better point-and-shoot still photography, the exact model name to buy is the Google Pixel 8 Pro.

SEP 29afterPermalink

The best overall flagship Android phone you can buy right now is the Samsung Galaxy S24 Ultra.

Why it is the best:
It offers the most complete, no-compromise package available: the top-tier Snapdragon 8 Gen 3 processor, arguably the best display on a smartphone (with unique anti-reflective glass), unmatched camera versatility (including two telephoto lenses), stellar battery life, a built-in S Pen stylus, and a guarantee of 7 years of software updates.

Note: If your top priority is a pure, bloatware-free software experience and the absolute best point-and-shoot still camera, the runner-up is the Google Pixel 8 Pro.

Exact recordShowHideEach response verbatim, unrendered, with line numbers and its sha256

Before baseline

2026-09-28 permalink

Scored
answered
Received
2026-09-28 09:22:07 UTC
Run
20260928T090007Z-07d4be
Served by
Google · HTTP 200 · finish stop
Size
1,059 characters · 999 tokens out incl. hidden reasoning · 9.9 s
The best overall flagship Android phone you can buy right now is the **Samsung Galaxy S24 Ultra**.
Here is exactly why it currently holds the top spot across almost all major tech reviews:
* **No-Compromise Hardware:** It features the top-tier Snapdragon 8 Gen 3 processor, a premium titanium frame, and a built-in S Pen stylus.
* **Best Display:** It has a stunning flat OLED screen with a unique anti-reflective coating (Corning Gorilla Armor) that drastically reduces glare compared to every other phone on the market.
* **Versatile Cameras:** It features a massive 200MP main sensor alongside two distinct telephoto lenses (3x and 5x optical zoom), making it the most capable camera system for zooming and video recording on Android.
* **Longevity:** Samsung has committed to 7 years of OS and security updates.
**The Runner-Up (For a different preference):**
If you prefer a "pure" Android software experience, the smartest AI features, and slightly better point-and-shoot still photography, the exact model name to buy is the **Google Pixel 8 Pro**.

End of response · 10 lines · 1,059 characters · sha256 d9122d39bbcc12463a2f7debd7c3295ee7427f739b4b139a19d651abf15938bb

After this run

2026-09-29 permalink

Scored
answered
Received
2026-09-29 09:23:03 UTC
Run
20260929T090007Z-334891
Served by
Google · HTTP 200 · finish stop
Size
640 characters · 918 tokens out incl. hidden reasoning · 9.0 s
The best overall flagship Android phone you can buy right now is the **Samsung Galaxy S24 Ultra**.
**Why it is the best:**
It offers the most complete, no-compromise package available: the top-tier Snapdragon 8 Gen 3 processor, arguably the best display on a smartphone (with unique anti-reflective glass), unmatched camera versatility (including two telephoto lenses), stellar battery life, a built-in S Pen stylus, and a guarantee of 7 years of software updates.
*Note: If your top priority is a pure, bloatware-free software experience and the absolute best point-and-shoot still camera, the runner-up is the **Google Pixel 8 Pro**.*

End of response · 6 lines · 640 characters · sha256 d58256ef26bb353fbf22069068387e2dcfe852edd2a016a1ac8be2472485b7dc

Record detailsShowHideModel version, runs, baseline, triage, permalink, event ID
Model
google/gemini-3.1-pro-preview
pinned google/gemini-3.1-pro-preview-20260219; alias resolved to google/gemini-3.1-pro-preview-20260219 at 2026-09-29 09:00:07 UTC (matches the pin)
Prompt
Question 30: P22 (recommendation)
Why this question
The best phone changes every year, so an out-of-date answer is easy to spot.
Change
~160 tokens against a baseline of ~296 tokens (0.54×; z = -6.15, σ = 0.1 in log units, D34 n=6)
Baseline
6 prior days with data; 6 matched the baseline value (2026-09-22, 2026-09-23, 2026-09-25, 2026-09-26, 2026-09-27, 2026-09-28)
Responses
before 2026-09-28 09:22:07 UTC, run 20260928T090007Z-07d4be; after 2026-09-29 09:23:03 UTC, run 20260929T090007Z-334891
Detected
2026-09-29 · run 20260929T090007Z-334891, started 2026-09-29 09:00:07 UTC · scorer v1 · severity rules r2
Permalink
https://modeldrift.watch/e/2026-09-29/P22/google/gemini-3.1-pro-preview/anomaly/length_tokens/
Event ID
2026-09-29:P22:google/gemini-3.1-pro-preview:anomaly:length_tokens

Every morning, what moved on the model you depend on, what it means for you, and what to check.

$9 a month. Cancel any time. The next one tomorrow morning.

Get the daily brief

$99 once, for as long as modeldrift.watch runs. The first 100 buyers.

The record stays free. The brief is the reading of it.