MODELDRIFT.WATCH

Question 3

Facts and formats · the question whether 9.11 or 9.9 is larger · paired with Question 4

Sent verbatim, every day

Which is larger, 9.11 or 9.9? Reply with only the larger number.

  1. GPT

    answered 24 of 61 days · 37 no response

    Right on 24 of the 24 days it answered.

  2. Claude

    answered 23 of 61 days · 38 no response

    Right on 23 of the 23 days it answered.

  3. Gemini

    answered 23 of 61 days · 38 no response

    Right on 23 of the 23 days it answered.

  • No response
The whole record, 61 daysShowHideThe rails above show the last 30 days

GPT

SEP 10OCT 9

OCT 10NOV 8

NOV 9NOV 9

Claude

SEP 10OCT 9

OCT 10NOV 8

NOV 9NOV 9

Gemini

SEP 10OCT 9

OCT 10NOV 8

NOV 9NOV 9

Every answer

Every model gave the same answer every day it answered.

  1. GPT“9.9” on 24 of 61 days, right every time
  2. Claude“9.9” on 23 of 61 days, right every time
  3. Gemini“9.9” on 23 of 61 days, right every time
Day by dayShowHideThe start of each day’s answer, newest first

  1. Nov 9

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  2. Nov 8

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  3. Nov 7

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  4. Nov 6

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  5. Nov 5

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  6. Nov 4

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  7. Nov 3

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  8. Nov 2

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  9. Nov 1

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  10. Oct 31

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  11. Oct 30

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  12. Oct 29

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  13. Oct 28

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  14. Oct 27

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  15. Oct 26

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  16. Oct 25

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  17. Oct 24

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  18. Oct 23

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  19. Oct 22

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  20. Oct 21

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  21. Oct 20

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  22. Oct 19

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  23. Oct 18

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  24. Oct 17

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  25. Oct 16

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  26. Oct 15

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  27. Oct 14

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  28. Oct 13

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  29. Oct 12

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  30. Oct 11

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  31. Oct 10

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  32. Oct 9

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  33. Oct 8

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  34. Oct 7

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  35. Oct 6

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  36. Oct 5

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  37. Oct 4

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  38. Oct 3

    1. GPT9.9
    2. Claude9.9
    3. Gemini9.9

  39. Oct 2

    1. GPT9.9
    2. Claude9.9
    3. Gemini9.9

  40. Oct 1

    1. GPT9.9
    2. Claude9.9
    3. Gemini9.9

  41. Sep 30

    1. GPT9.9
    2. Claude9.9
    3. Gemini9.9

  42. Sep 29

    1. GPT9.9
    2. Claude9.9
    3. Gemini9.9

  43. Sep 28

    1. GPT9.9
    2. Claude9.9
    3. Gemini9.9

  44. Sep 27

    1. GPT9.9
    2. Claude9.9
    3. Gemini9.9

  45. Sep 26

    1. GPT9.9
    2. Claude9.9
    3. Gemini9.9

  46. Sep 25

    1. GPT9.9
    2. Claude9.9
    3. Gemini9.9

  47. Sep 24

    1. GPT9.9
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  48. Sep 23

    1. GPT9.9
    2. Claude9.9
    3. Gemini9.9

  49. Sep 22

    1. GPT9.9
    2. Claude9.9
    3. Gemini9.9

  50. Sep 21

    1. GPT9.9
    2. Claude9.9
    3. Gemini9.9

  51. Sep 20

    1. GPT9.9
    2. Claude9.9
    3. Gemini9.9

  52. Sep 19

    1. GPT9.9
    2. Claude9.9
    3. Gemini9.9

  53. Sep 18

    1. GPT9.9
    2. Claude9.9
    3. Gemini9.9

  54. Sep 17

    1. GPT9.9
    2. Claude9.9
    3. Gemini9.9

  55. Sep 16

    1. GPT9.9
    2. Claude9.9
    3. Gemini9.9

  56. Sep 15

    1. GPT9.9
    2. Claude9.9
    3. Gemini9.9

  57. Sep 14

    1. GPT9.9
    2. Claude9.9
    3. Gemini9.9

  58. Sep 13

    1. GPT9.9
    2. Claude9.9
    3. Gemini9.9

  59. Sep 12

    1. GPT9.9
    2. Claude9.9
    3. Gemini9.9

  60. Sep 11

    1. GPT9.9
    2. Claude9.9
    3. Gemini9.9

  61. Sep 10

    1. GPT9.9
    2. Claude9.9
    3. Gemini9.9
Why this question is in the batteryShowHideWhat it tests, how it is scored
Why
Models have long got this wrong by reading decimals like version numbers; the answer is 9.9.
Pair
Question 3, as decimals · Question 4, as version numbers
Correct if
the response answers 9.9
Format ok if
the response replies with only the number