MODELDRIFT.WATCH

Question 5

Facts and formats · a request for bare JSON about Osaka

Sent verbatim, every day

Return only valid JSON matching {"city": string, "population": integer, "country": string} for Osaka. No markdown, no code fences, no explanation.

  1. GPT

    answered 24 of 61 days · 37 no response

    Kept the format on 24 of the 24 days it answered.

  2. Claude

    answered 23 of 61 days · 38 no response

    Kept the format on 23 of the 23 days it answered.

  3. Gemini

    answered 23 of 61 days · 38 no response

    Kept the format on 23 of the 23 days it answered.

  • No response
The whole record, 61 daysShowHideThe rails above show the last 30 days

GPT

SEP 10OCT 9

OCT 10NOV 8

NOV 9NOV 9

Claude

SEP 10OCT 9

OCT 10NOV 8

NOV 9NOV 9

Gemini

SEP 10OCT 9

OCT 10NOV 8

NOV 9NOV 9

Every answer

Newest first. Each line is the start of that day’s answer; the whole of it is one click away.

  1. Nov 9

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  2. Nov 8

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  3. Nov 7

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  4. Nov 6

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  5. Nov 5

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  6. Nov 4

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  7. Nov 3

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  8. Nov 2

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  9. Nov 1

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  10. Oct 31

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  11. Oct 30

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  12. Oct 29

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  13. Oct 28

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  14. Oct 27

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  15. Oct 26

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  16. Oct 25

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  17. Oct 24

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  18. Oct 23

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  19. Oct 22

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  20. Oct 21

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  21. Oct 20

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  22. Oct 19

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  23. Oct 18

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  24. Oct 17

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  25. Oct 16

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  26. Oct 15

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  27. Oct 14

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  28. Oct 13

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  29. Oct 12

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  30. Oct 11

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
31 earlier daysShowHideFrom Sep 10 to Oct 10
  1. Oct 10

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  2. Oct 9

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  3. Oct 8

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  4. Oct 7

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  5. Oct 6

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  6. Oct 5

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  7. Oct 4

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  8. Oct 3

    1. GPT{"city":"Osaka","population":2753862,"country":"Japan"}
    2. Claude{"city": "Osaka", "population": 2750000, "country": "Japan"}
    3. Gemini{"city": "Osaka", "population": 2753862, "country": "Japan"}
  9. Oct 2

    1. GPT{"city":"Osaka","population":2752412,"country":"Japan"}
    2. Claude{"city": "Osaka", "population": 2753862, "country": "Japan"}
    3. Gemini{"city": "Osaka", "population": 2753862, "country": "Japan"}
  10. Oct 1

    1. GPT{"city":"Osaka","population":2752412,"country":"Japan"}
    2. Claude{"city": "Osaka", "population": 2752000, "country": "Japan"}
    3. Gemini{"city": "Osaka", "population": 2691185, "country": "Japan"}
  11. Sep 30

    1. GPT{"city":"Osaka","population":2752412,"country":"Japan"}
    2. Claude{"city": "Osaka", "population": 2691185, "country": "Japan"}
    3. Gemini{…
  12. Sep 29

    1. GPT{"city":"Osaka","population":2752412,"country":"Japan"}
    2. Claude{"city": "Osaka", "population": 2691185, "country": "Japan"}
    3. Gemini{"city": "Osaka", "population": 2753862, "country": "Japan"}
  13. Sep 28

    1. GPT{"city":"Osaka","population":2752412,"country":"Japan"}
    2. Claude{"city": "Osaka", "population": 2753862, "country": "Japan"}
    3. Gemini{"city": "Osaka", "population": 2753862, "country": "Japan"}
  14. Sep 27

    1. GPT{"city":"Osaka","population":2752412,"country":"Japan"}
    2. Claude{"city": "Osaka", "population": 2750000, "country": "Japan"}
    3. Gemini{"city": "Osaka", "population": 2753862, "country": "Japan"}
  15. Sep 26

    1. GPT{"city":"Osaka","population":2752412,"country":"Japan"}
    2. Claude{"city": "Osaka", "population": 2691185, "country": "Japan"}
    3. Gemini{"city": "Osaka", "population": 2753862, "country": "Japan"}
  16. Sep 25

    1. GPT{"city":"Osaka","population":2752412,"country":"Japan"}
    2. Claude{"city": "Osaka", "population": 2691185, "country": "Japan"}
    3. Gemini{"city": "Osaka", "population": 2691185, "country": "Japan"}
  17. Sep 24

    1. GPT{"city":"Osaka","population":2752412,"country":"Japan"}
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap
  18. Sep 23

    1. GPT{"city":"Osaka","population":2752412,"country":"Japan"}
    2. Claude{"city": "Osaka", "population": 2691185, "country": "Japan"}
    3. Gemini{…
  19. Sep 22

    1. GPT{"city":"Osaka","population":2752412,"country":"Japan"}
    2. Claude{"city": "Osaka", "population": 2691185, "country": "Japan"}
    3. Gemini{"city": "Osaka", "population": 2753862, "country": "Japan"}
  20. Sep 21

    1. GPT{"city":"Osaka","population":2752412,"country":"Japan"}
    2. Claude{"city": "Osaka", "population": 2691185, "country": "Japan"}
    3. Gemini{"city": "Osaka", "population": 2753862, "country": "Japan"}
  21. Sep 20

    1. GPT{"city":"Osaka","population":2752412,"country":"Japan"}
    2. Claude{"city": "Osaka", "population": 2691185, "country": "Japan"}
    3. Gemini{"city": "Osaka", "population": 2753862, "country": "Japan"}
  22. Sep 19

    1. GPT{"city":"Osaka","population":2752412,"country":"Japan"}
    2. Claude{"city": "Osaka", "population": 2752000, "country": "Japan"}
    3. Gemini{"city": "Osaka", "population": 2753862, "country": "Japan"}
  23. Sep 18

    1. GPT{"city":"Osaka","population":2752412,"country":"Japan"}
    2. Claude{"city": "Osaka", "population": 2691000, "country": "Japan"}
    3. Gemini{…
  24. Sep 17

    1. GPT{"city":"Osaka","population":2752412,"country":"Japan"}
    2. Claude{"city": "Osaka", "population": 2691185, "country": "Japan"}
    3. Gemini{…
  25. Sep 16

    1. GPT{"city":"Osaka","population":2752412,"country":"Japan"}
    2. Claude{"city": "Osaka", "population": 2691185, "country": "Japan"}
    3. Gemini{…
  26. Sep 15

    1. GPT{"city":"Osaka","population":2752412,"country":"Japan"}
    2. Claude{"city": "Osaka", "population": 2691185, "country": "Japan"}
    3. Gemini{…
  27. Sep 14

    1. GPT{"city":"Osaka","population":2752412,"country":"Japan"}
    2. Claude{"city": "Osaka", "population": 2691000, "country": "Japan"}
    3. Gemini{"city": "Osaka", "population": 2753862, "country": "Japan"}
  28. Sep 13

    1. GPT{"city":"Osaka","population":2752412,"country":"Japan"}
    2. Claude{"city": "Osaka", "population": 2753862, "country": "Japan"}
    3. Gemini{"city": "Osaka", "population": 2753862, "country": "Japan"}
  29. Sep 12

    1. GPTMinor change{"city":"Osaka","population":2752412,"country":"Japan"}
    2. Claude{"city": "Osaka", "population": 2753862, "country": "Japan"}
    3. Gemini{"city": "Osaka", "population": 2753862, "country": "Japan"}
  30. Sep 11

    1. GPTMinor change{"city":"Osaka","population":2752412,"country":"Japan"}
    2. Claude{"city": "Osaka", "population": 2691185, "country": "Japan"}
    3. Gemini{"city": "Osaka", "population": 2753862, "country": "Japan"}
  31. Sep 10

    1. GPT{"city":"Osaka","population":2752412,"country":"Japan"}
    2. Claude{"city": "Osaka", "population": 2753862, "country": "Japan"}
    3. Gemini{…
Why this question is in the batteryShowHideWhat it tests, how it is scored
Why
A program that reads the answer needs bare JSON; a code fence or a sentence around it breaks the program.
Format ok if
the response returns bare JSON matching the requested schema