MODELDRIFT.WATCH

Question 2

Facts and formats · the question whether 9973 is prime · paired with Question 1

Sent verbatim, every day

Is 9973 a prime number? Think step by step and then answer "[Yes]" or "[No]".

  1. GPT

    answered 24 of 61 days · 37 no response

    Right on 24 of the 24 days it answered.

  2. Claude

    answered 23 of 61 days · 38 no response

    Right on 23 of the 23 days it answered.

  3. Gemini

    answered 23 of 61 days · 38 no response

    Right on 23 of the 23 days it answered.

  • No response
The whole record, 61 daysShowHideThe rails above show the last 30 days

GPT

SEP 10OCT 9

OCT 10NOV 8

NOV 9NOV 9

Claude

SEP 10OCT 9

OCT 10NOV 8

NOV 9NOV 9

Gemini

SEP 10OCT 9

OCT 10NOV 8

NOV 9NOV 9

Every answer

Every model gave the same answer every day it answered.

  1. GPT“Yes” on 24 of 61 days, right every time
  2. Claude“Yes” on 23 of 61 days, right every time
  3. Gemini“Yes” on 23 of 61 days, right every time
Day by dayShowHideThe start of each day’s answer, newest first

  1. Nov 9

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  2. Nov 8

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  3. Nov 7

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  4. Nov 6

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  5. Nov 5

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  6. Nov 4

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  7. Nov 3

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  8. Nov 2

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  9. Nov 1

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  10. Oct 31

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  11. Oct 30

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  12. Oct 29

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  13. Oct 28

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  14. Oct 27

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  15. Oct 26

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  16. Oct 25

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  17. Oct 24

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  18. Oct 23

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  19. Oct 22

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  20. Oct 21

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  21. Oct 20

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  22. Oct 19

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  23. Oct 18

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  24. Oct 17

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  25. Oct 16

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  26. Oct 15

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  27. Oct 14

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  28. Oct 13

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  29. Oct 12

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  30. Oct 11

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  31. Oct 10

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  32. Oct 9

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  33. Oct 8

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  34. Oct 7

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  35. Oct 6

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  36. Oct 5

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  37. Oct 4

    1. GPTNo response: the request failed, so this day is a gap
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  38. Oct 3

    1. GPT[Yes]
    2. ClaudeChecking 9973 for primality…
    3. GeminiTo determine if 9973 is a prime number, we need to check if it has any divisors other than 1 and itself. We only need to check for prime…

  39. Oct 2

    1. GPT[Yes]
    2. ClaudeChecking 9973…
    3. GeminiTo determine if 9973 is a prime number, we need to check if it is divisible by any prime numbers up to its square root.…

  40. Oct 1

    1. GPT[Yes]
    2. ClaudeChecking 9973…
    3. GeminiTo determine if 9973 is a prime number, we need to check if it is divisible by any prime numbers up to its square root.…

  41. Sep 30

    1. GPT[Yes]
    2. ClaudeChecking 9973…
    3. GeminiMinor changeTo determine if 9973 is a prime number, we can check if it is divisible by any prime number up to its square root.…

  42. Sep 29

    1. GPT[Yes]
    2. ClaudeChecking 9973…
    3. GeminiMinor changeTo determine if 9973 is a prime number, we can check if it is divisible by any prime numbers up to its square root.…

  43. Sep 28

    1. GPT[Yes]
    2. ClaudeChecking 9973…
    3. GeminiTo determine if 9973 is a prime number, we need to check if it is divisible by any prime numbers up to its square root.…

  44. Sep 27

    1. GPT[Yes]
    2. ClaudeChecking 9973…
    3. GeminiTo determine if 9973 is a prime number, we need to check if it has any divisors other than 1 and itself. We can do this by testing for…

  45. Sep 26

    1. GPT[Yes]
    2. ClaudeChecking 9973…
    3. GeminiTo determine if 9973 is a prime number, we need to check if it has any divisors other than 1 and itself. We can do this by testing for…

  46. Sep 25

    1. GPT[Yes]
    2. ClaudeChecking 9973…
    3. GeminiTo determine if 9973 is a prime number, we need to check if it is divisible by any prime number up to its square root.…

  47. Sep 24

    1. GPT[Yes]
    2. ClaudeNo response: the request failed, so this day is a gap
    3. GeminiNo response: the request failed, so this day is a gap

  48. Sep 23

    1. GPT[Yes]
    2. ClaudeChecking 9973…
    3. GeminiTo determine if 9973 is a prime number, we need to check if it has any divisors other than 1 and itself. We can do this by testing for…

  49. Sep 22

    1. GPT[Yes]
    2. ClaudeChecking 9973…
    3. GeminiTo determine if 9973 is a prime number, we can check if it is divisible by any prime number up to its square root.…

  50. Sep 21

    1. GPT[Yes]
    2. ClaudeChecking 9973…
    3. GeminiTo determine if 9973 is a prime number, we can check if it is divisible by any prime number up to its square root.…

  51. Sep 20

    1. GPT[Yes]
    2. ClaudeChecking 9973…
    3. GeminiTo determine if 9973 is a prime number, we need to check if it has any divisors other than 1 and itself. We only need to test for…

  52. Sep 19

    1. GPT[Yes]
    2. ClaudeChecking 9973…
    3. GeminiTo determine if 9973 is a prime number, we can check if it is divisible by any prime numbers up to its square root.…

  53. Sep 18

    1. GPT[Yes]
    2. ClaudeChecking 9973…
    3. GeminiTo determine if 9973 is a prime number, we can check if it is divisible by any prime number up to its square root.…

  54. Sep 17

    1. GPT[Yes]
    2. ClaudeChecking 9973…
    3. GeminiTo determine if 9973 is a prime number, we need to check if it has any divisors other than 1 and itself. We can do this by checking for…

  55. Sep 16

    1. GPT[Yes]
    2. ClaudeChecking 9973…
    3. GeminiTo determine if 9973 is a prime number, we need to check if it is divisible by any prime numbers up to its square root.…

  56. Sep 15

    1. GPT[Yes]
    2. ClaudeChecking 9973…
    3. GeminiTo determine if 9973 is a prime number, we need to check if it has any divisors other than 1 and itself. We only need to test prime numbers…

  57. Sep 14

    1. GPT[Yes]
    2. ClaudeChecking 9973…
    3. GeminiTo determine if 9973 is a prime number, we need to check if it has any divisors other than 1 and itself. We can do this by testing for…

  58. Sep 13

    1. GPT[Yes]
    2. ClaudeChecking 9973…
    3. GeminiTo determine if 9973 is a prime number, we can check if it is divisible by any prime numbers up to its square root.…

  59. Sep 12

    1. GPT[Yes]
    2. ClaudeChecking 9973…
    3. GeminiTo determine if 9973 is a prime number, we need to check if it has any divisors other than 1 and itself. We only need to check prime…

  60. Sep 11

    1. GPT[Yes]
    2. ClaudeChecking 9973…
    3. GeminiTo determine if 9973 is a prime number, we need to check if it has any positive divisors other than 1 and itself. We can do this by…

  61. Sep 10

    1. GPT[Yes]
    2. ClaudeStep 1: Find the bound for testing…
    3. GeminiTo determine if 9973 is a prime number, we can check if it has any prime factors less than or equal to its square root.…
Why this question is in the batteryShowHideWhat it tests, how it is scored
Why
9973 really is prime, which catches a model that has simply learned to say no.
Pair
Question 1, the one that only looks prime · Question 2, the one that is prime
Correct if
the response answers [Yes] (9973 is prime)
Format ok if
the response ends with a [Yes]/[No] bracket