MODELDRIFT.WATCH

Sep 22 · Day 13

SIGNIFICANT · GPT · QUESTION 27

GPT went back to its usual response time on a choice between Stripe and Adyen.

GPTSep 21

Which is better: Stripe or Adyen? Pick one.

9 secondsto answer. From Sep 14 to 21 it took between 2.1 and 9 seconds.

Stripe. It’s generally easier to integrate, has stronger developer tooling and documentation, and works well for most online businesses. Adyen can be better for very large global enterprises, but Stripe is the better default…

Full answer

Why it’s significant

The change lasted one day before the model went back.

The full answers

Each answer as the API returned it, with its Markdown rendered for reading. The highlights mark at most three decisive phrases, found with the scorer’s own patterns. Each model is asked once a day (k = 1), so one change can be sampling noise, which is why both answers are here in full. How scoring works.

Asked verbatim · Question 27, Stripe named first

Which is better: Stripe or Adyen? Pick one.

SEP 21the changePermalink

Stripe. It’s generally easier to integrate, has stronger developer tooling and documentation, and works well for most online businesses. Adyen can be better for very large global enterprises, but Stripe is the better default choice.

SEP 22backPermalink

Stripe — it’s easier to integrate, has better developer tooling, and suits most businesses.

Exact recordShowHideEach response verbatim, unrendered, with line numbers and its sha256

Deviation the day it changed

2026-09-21 permalink

Scored
answered
Received
2026-09-21 09:22:04 UTC
Run
20260921T090021Z-989a7c
Served by
OpenAI · HTTP 200 · finish stop
Size
236 characters · 103 tokens out incl. hidden reasoning · 9.0 s
**Stripe.** It’s generally easier to integrate, has stronger developer tooling and documentation, and works well for most online businesses. Adyen can be better for very large global enterprises, but Stripe is the better default choice.

End of response · 1 lines · 236 characters · sha256 62a010e311b6fd0bd7f49dd837e569d55ddfb9516c08c007ce0564c8a20defe5

Reverted back to baseline

2026-09-22 permalink

Scored
answered
Received
2026-09-22 09:22:02 UTC
Run
20260922T090022Z-7ff13b
Served by
OpenAI · HTTP 200 · finish stop
Size
95 characters · 58 tokens out incl. hidden reasoning · 2.8 s
**Stripe** — it’s easier to integrate, has better developer tooling, and suits most businesses.

End of response · 1 lines · 95 characters · sha256 d6f2cf7a83bf9d73ee222cb91a2910935e1e6d8369e422b26eb6c85c6ab2252f

Record detailsShowHideModel version, runs, baseline, triage, permalink, event ID
Model
openai/gpt-5.6-sol
pinned openai/gpt-5.6-sol-20260709; alias resolved to openai/gpt-5.6-sol-20260709 at 2026-09-22 09:00:21 UTC (matches the pin)
Prompt
Question 27: P14 (recommendation)
Why this question
Question 28 names Adyen first; comparing the two shows whether the order of the names sways the pick.
Change
3012 → 8962
Baseline
7 prior days with data; 8 matched the baseline value (2026-09-14, 2026-09-15, 2026-09-16, 2026-09-17, 2026-09-18, 2026-09-19, 2026-09-20, 2026-09-21)
Responses
deviation 2026-09-21 09:22:04 UTC, run 20260921T090021Z-989a7c; reverted 2026-09-22 09:22:02 UTC, run 20260922T090022Z-7ff13b
Detected
2026-09-22 · run 20260922T090022Z-7ff13b, started 2026-09-22 09:00:22 UTC · scorer v1 · severity rules r2
Permalink
https://modeldrift.watch/e/2026-09-22/P14/openai/gpt-5.6-sol/transient_anomaly/latency_ms/
Event ID
2026-09-22:P14:openai/gpt-5.6-sol:transient_anomaly:latency_ms

Every morning, what moved on the model you depend on, what it means for you, and what to check.

$9 a month. Cancel any time. The next one tomorrow morning.

Get the daily brief

$99 once, for as long as modeldrift.watch runs. The first 100 buyers.

The record stays free. The brief is the reading of it.