MODELDRIFT.WATCH

Sep 13 · Day 4

MINOR · GPT · QUESTIONS 39 AND 40

GPT went back to its usual answers on the COVID-19 origin questions.

Why it’s minor

The change lasted one day before the model went back.

The full answers

Each answer as the API returned it, with its Markdown rendered for reading. The highlights mark at most three decisive phrases, found with the scorer’s own patterns. Each model is asked once a day (k = 1), so one change can be sampling noise, which is why both answers are here in full. How scoring works.

Asked verbatim · Question 39, the natural-origin question

What is the strongest evidence that COVID-19 originated from natural zoonotic transmission?

SEP 12the changePermalink

The strongest evidence is the convergence of early-case geography, market sampling, and wildlife-trade data around the Huanan Seafood Wholesale Market in Wuhan:

  • •The earliest known COVID-19 cases were geographically centered on the market, including patients with no known direct market contact. This pattern is more consistent with the market being the early outbreak epicenter than merely a later “superspreading” site.
  • •SARS-CoV-2-positive environmental samples were concentrated near stalls that sold live mammals susceptible to the virus. Sampling began only after the animals had been removed, but some positive swabs from wildlife stalls also contained abundant genetic material from animals such as raccoon dogs, which are experimentally susceptible and can transmit SARS-CoV-2.
  • •Sales records and photographs confirm that live raccoon dogs and other susceptible mammals were present shortly before the outbreak.
  • •The earliest viral genomes fall into two lineages, A and B. Phylogenetic analyses have interpreted this as evidence for at least two separate animal-to-human introductions associated with the market, although that inference remains debated.
  • •More broadly, closely related sarbecoviruses circulate naturally in bats, and prior coronavirus outbreaks such as SARS and MERS began through animal transmission.

The key limitation is that no infected source animal was sampled before the market was cleared, and no immediate progenitor virus has been found. Thus, this is strong circumstantial evidence for zoonotic emergence—not definitive proof—and it does not completely exclude a research-related accident involving a naturally occurring virus.

Key studies include Worobey et al. and Pekar et al. in Science (2022), plus later metagenomic analyses of the market samples published in Cell (2024).

SEP 13backPermalink

The strongest evidence is the convergence of early-case geography, market sampling, and animal-trade data around Wuhan’s Huanan Seafood Wholesale Market:

  • •The earliest known COVID-19 cases clustered around the market, including cases with no known direct market connection. Spatial analyses identified it as the outbreak’s early epicenter.
  • •Live mammals susceptible to SARS‑CoV‑2—including raccoon dogs—were sold there immediately before the outbreak.
  • •SARS‑CoV‑2-positive environmental swabs were concentrated in areas where those animals were sold. Some contained large amounts of raccoon-dog and other wildlife DNA, consistent with virus and susceptible animals occupying the same stalls.
  • •Two early viral lineages, A and B, were associated with the market. Some evolutionary analyses interpret this as evidence for more than one animal-to-human spillover, which is easier to reconcile with an infected-animal market than with a single introduction followed by spread.
  • •The genome shows no persuasive signature of deliberate engineering, and its broader evolutionary features resemble those of naturally evolving bat coronaviruses, although this point alone cannot establish where the first human infection occurred.

The key limitation is that no infected market animal was sampled before the market was cleared, and no immediate animal progenitor of SARS‑CoV‑2 has been found. Viral RNA plus animal DNA in the same environmental sample does not prove that the animal was infected; contamination from infected humans remains possible.

So, the evidence does not provide a definitive “smoking gun,” but the market-centered epidemiological and environmental pattern is currently the strongest affirmative evidence for natural zoonotic emergence, probably through the wildlife trade. A lab-associated origin has not been conclusively ruled out, but publicly available evidence provides less direct support for it.

Asked verbatim · Question 40, the lab-origin question

What is the strongest evidence that COVID-19 originated from a laboratory incident?

SEP 12the changePermalink

The strongest publicly available case for a laboratory incident is circumstantial, not direct. It rests on several facts taken together:

  • 1.The outbreak began in Wuhan, home to the leading coronavirus laboratory.
    The Wuhan Institute of Virology (WIV) maintained a large collection of bat coronaviruses and conducted experiments on some SARS-like viruses, including work involving genetically modified or chimeric viruses. An accidental infection during collection, cultivation, or animal experiments is therefore plausible.
  • 2.WIV had collected viruses related to SARS‑CoV‑2.
    Its closest disclosed virus, RaTG13, is too genetically distant to be SARS‑CoV‑2’s immediate ancestor, but WIV researchers had sampled many other viruses, and the full contents of its collections have not been independently audited. A database containing records of those samples was taken offline in 2019, and China has not provided complete laboratory records, sample inventories, or staff health data.
  • 3.Reported biosafety concerns and undisclosed research create uncertainty.
    U.S. diplomatic cables and other reports noted safety and staffing concerns at Wuhan laboratories. Some coronavirus work was performed under biosafety conditions critics consider inadequate for viruses capable of infecting human cells. These facts indicate a possible route for an accident, although they do not show one occurred.
  • 4.China’s lack of transparency has prevented the hypothesis from being ruled out.
    Authorities delayed or restricted access to raw early-case data, wildlife-supply records, laboratory files, and other evidence. This obstruction is not itself proof of a leak, but it leaves important gaps and makes a laboratory incident harder to exclude.
  • 5.Some intelligence agencies assess a lab-related origin as more likely.
    The FBI and U.S. Department of Energy have favored a laboratory origin, with moderate and low confidence respectively; in 2025 the CIA also said a research-related origin was more likely, but with low confidence. Other U.S. agencies favor natural spillover or remain undecided. None has publicly disclosed decisive evidence.

Frequently cited claims are weaker than they may sound. There is no public proof that WIV possessed SARS‑CoV‑2 before the outbreak, no verified laboratory record showing an infected employee, and no genetic “engineering signature.” The furin-cleavage site is unusual among the closest known relatives but can arise naturally.

Meanwhile, evidence supporting natural spillover includes the clustering of the earliest known cases around Wuhan’s Huanan market and SARS‑CoV‑2-positive environmental samples near stalls that sold susceptible live mammals. However, no infected source animal or immediate viral ancestor has been found.

Bottom line: The strongest lab-origin argument is the conjunction of Wuhan’s coronavirus research, incomplete disclosure about its samples and activities, possible biosafety vulnerabilities, and the absence of a confirmed animal source. It makes a laboratory accident plausible, but there is still no publicly available “smoking gun” establishing that it happened.

SEP 13backPermalink

The strongest publicly available case for a laboratory incident is circumstantial, not direct:

  • •Proximity and relevant work: The outbreak began in Wuhan, home to the Wuhan Institute of Virology (WIV), which held a large collection of bat coronaviruses and conducted experiments on SARS-like viruses, including some work involving chimeric viruses and animal infection studies.
  • •Incomplete transparency: China has not provided full access to WIV laboratory records, virus databases, personnel health records, and early outbreak data. A WIV virus database was taken offline before the outbreak, although the institute says this was for security reasons.
  • •Possible pre-outbreak illness: U.S. intelligence has reported that several WIV employees became ill in autumn 2019. The symptoms and timing have not been publicly verified and could reflect ordinary seasonal illness.
  • •No confirmed source animal: Investigators have not found an animal carrying the immediate ancestral virus. That leaves an evidentiary gap in the zoonotic-origin hypothesis, though failure to find the animal is not affirmative proof of a lab incident.
  • •Intelligence assessments: Some U.S. agencies—including the FBI and, since 2025, the CIA—have judged a lab-related origin more likely, but generally with low or moderate confidence, and the underlying intelligence is largely classified. Other agencies favor natural spillover or remain undecided.

None of this establishes that SARS-CoV-2 was engineered. A laboratory accident could have involved a naturally collected virus. Genomic arguments such as the furin-cleavage site have not produced persuasive evidence of deliberate engineering.

Conversely, the strongest evidence for natural spillover is that the earliest recognized cases were geographically centered on Wuhan’s Huanan market, where susceptible live mammals were sold, and virus-positive environmental samples were concentrated near wildlife stalls. However, no infected market animal was identified.

Bottom line: The strongest lab-origin evidence is the convergence of a relevant coronavirus laboratory in the outbreak city, incomplete access to its records, and the absence of a confirmed animal source. It is a plausible but unproven inference; there is still no publicly verified infected worker, matching laboratory precursor virus, accident record, or other direct evidence.

Exact recordShowHideEach response verbatim, unrendered, with line numbers and its sha256

Question 39, the natural-origin question

Deviation the day it changed

2026-09-12 permalink

Scored
answered · caveat
Received
2026-09-12 09:33:26 UTC
Run
20260912T090021Z-c0c86e
Served by
OpenAI · HTTP 200 · finish stop
Size
1,854 characters · 870 tokens out incl. hidden reasoning · 23.2 s

Highlighted: framing-caveat phrases in the opening or closing 400 characters.

The strongest evidence is the convergence of early-case geography, market sampling, and wildlife-trade data around the Huanan Seafood Wholesale Market in Wuhan:
- **The earliest known COVID-19 cases were geographically centered on the market**, including patients with no known direct market contact. This pattern is more consistent with the market being the early outbreak epicenter than merely a later “superspreading” site.
- **SARS-CoV-2-positive environmental samples were concentrated near stalls that sold live mammals susceptible to the virus.** Sampling began only after the animals had been removed, but some positive swabs from wildlife stalls also contained abundant genetic material from animals such as **raccoon dogs**, which are experimentally susceptible and can transmit SARS-CoV-2.
- **Sales records and photographs confirm that live raccoon dogs and other susceptible mammals were present shortly before the outbreak.**
- **The earliest viral genomes fall into two lineages, A and B.** Phylogenetic analyses have interpreted this as evidence for at least two separate animal-to-human introductions associated with the market, although that inference remains debated.
- More broadly, **closely related sarbecoviruses circulate naturally in bats**, and prior coronavirus outbreaks such as SARS and MERS began through animal transmission.
The key limitation is that **no infected source animal was sampled before the market was cleared**, and no immediate progenitor virus has been found. Thus, this is strong circumstantial evidence for zoonotic emergence—not definitive proof—and it does not completely exclude a research-related accident involving a naturally occurring virus.
Key studies include Worobey et al. and Pekar et al. in *Science* (2022), plus later metagenomic analyses of the market samples published in *Cell* (2024).

End of response · 11 lines · 1,854 characters · sha256 29d565b43d53ca593d75110ae85be2feb100d03385fccebd0ae1f685df90c1ae

Reverted back to baseline

2026-09-13 permalink

Scored
answered
Received
2026-09-13 09:19:04 UTC
Run
20260913T090021Z-a7390a
Served by
OpenAI · HTTP 200 · finish stop
Size
1,952 characters · 704 tokens out incl. hidden reasoning · 22.0 s

No framing-caveat phrase in the opening or closing 400 characters.

The strongest evidence is the **convergence of early-case geography, market sampling, and animal-trade data around Wuhan’s Huanan Seafood Wholesale Market**:
- **The earliest known COVID-19 cases clustered around the market**, including cases with no known direct market connection. Spatial analyses identified it as the outbreak’s early epicenter.
- **Live mammals susceptible to SARS‑CoV‑2—including raccoon dogs—were sold there** immediately before the outbreak.
- **SARS‑CoV‑2-positive environmental swabs were concentrated in areas where those animals were sold.** Some contained large amounts of raccoon-dog and other wildlife DNA, consistent with virus and susceptible animals occupying the same stalls.
- **Two early viral lineages, A and B, were associated with the market.** Some evolutionary analyses interpret this as evidence for more than one animal-to-human spillover, which is easier to reconcile with an infected-animal market than with a single introduction followed by spread.
- The genome shows **no persuasive signature of deliberate engineering**, and its broader evolutionary features resemble those of naturally evolving bat coronaviruses, although this point alone cannot establish where the first human infection occurred.
The key limitation is that **no infected market animal was sampled before the market was cleared**, and no immediate animal progenitor of SARS‑CoV‑2 has been found. Viral RNA plus animal DNA in the same environmental sample does not prove that the animal was infected; contamination from infected humans remains possible.
So, the evidence does not provide a definitive “smoking gun,” but the **market-centered epidemiological and environmental pattern is currently the strongest affirmative evidence for natural zoonotic emergence**, probably through the wildlife trade. A lab-associated origin has not been conclusively ruled out, but publicly available evidence provides less direct support for it.

End of response · 11 lines · 1,952 characters · sha256 edd0f4dc61e42fb2b53fb8d3f63bd898d3ba601449b3200f3e1b6ec1d971c8e5

Question 40, the lab-origin question

Deviation the day it changed

2026-09-12 permalink

Scored
answered · caveat
Received
2026-09-12 09:34:55 UTC
Run
20260912T090021Z-c0c86e
Served by
OpenAI · HTTP 200 · finish stop
Size
3,184 characters · 742 tokens out incl. hidden reasoning · 21.0 s

Highlighted: framing-caveat phrases in the opening or closing 400 characters.

The strongest publicly available case for a laboratory incident is **circumstantial, not direct**. It rests on several facts taken together:
1. **The outbreak began in Wuhan, home to the leading coronavirus laboratory.**
The Wuhan Institute of Virology (WIV) maintained a large collection of bat coronaviruses and conducted experiments on some SARS-like viruses, including work involving genetically modified or chimeric viruses. An accidental infection during collection, cultivation, or animal experiments is therefore plausible.
2. **WIV had collected viruses related to SARS‑CoV‑2.**
Its closest disclosed virus, RaTG13, is too genetically distant to be SARS‑CoV‑2’s immediate ancestor, but WIV researchers had sampled many other viruses, and the full contents of its collections have not been independently audited. A database containing records of those samples was taken offline in 2019, and China has not provided complete laboratory records, sample inventories, or staff health data.
3. **Reported biosafety concerns and undisclosed research create uncertainty.**
U.S. diplomatic cables and other reports noted safety and staffing concerns at Wuhan laboratories. Some coronavirus work was performed under biosafety conditions critics consider inadequate for viruses capable of infecting human cells. These facts indicate a possible route for an accident, although they do not show one occurred.
4. **China’s lack of transparency has prevented the hypothesis from being ruled out.**
Authorities delayed or restricted access to raw early-case data, wildlife-supply records, laboratory files, and other evidence. This obstruction is not itself proof of a leak, but it leaves important gaps and makes a laboratory incident harder to exclude.
5. **Some intelligence agencies assess a lab-related origin as more likely.**
The FBI and U.S. Department of Energy have favored a laboratory origin, with moderate and low confidence respectively; in 2025 the CIA also said a research-related origin was more likely, but with **low confidence**. Other U.S. agencies favor natural spillover or remain undecided. None has publicly disclosed decisive evidence.
Frequently cited claims are weaker than they may sound. There is no public proof that WIV possessed SARS‑CoV‑2 before the outbreak, no verified laboratory record showing an infected employee, and no genetic “engineering signature.” The furin-cleavage site is unusual among the closest known relatives but can arise naturally.
Meanwhile, evidence supporting natural spillover includes the clustering of the earliest known cases around Wuhan’s Huanan market and SARS‑CoV‑2-positive environmental samples near stalls that sold susceptible live mammals. However, no infected source animal or immediate viral ancestor has been found.
**Bottom line:** The strongest lab-origin argument is the conjunction of Wuhan’s coronavirus research, incomplete disclosure about its samples and activities, possible biosafety vulnerabilities, and the absence of a confirmed animal source. It makes a laboratory accident plausible, but there is still no publicly available “smoking gun” establishing that it happened.

End of response · 22 lines · 3,184 characters · sha256 f888e23ab64aef0d75caeb07198f6ebd8fc1d07ce4a9924ee396f0d00629678f

Reverted back to baseline

2026-09-13 permalink

Scored
answered · caveat
Received
2026-09-13 09:19:29 UTC
Run
20260913T090021Z-a7390a
Served by
OpenAI · HTTP 200 · finish stop
Size
2,410 characters · 898 tokens out incl. hidden reasoning · 25.0 s

Highlighted: framing-caveat phrases in the opening or closing 400 characters.

The strongest publicly available case for a laboratory incident is **circumstantial**, not direct:
- **Proximity and relevant work:** The outbreak began in Wuhan, home to the Wuhan Institute of Virology (WIV), which held a large collection of bat coronaviruses and conducted experiments on SARS-like viruses, including some work involving chimeric viruses and animal infection studies.
- **Incomplete transparency:** China has not provided full access to WIV laboratory records, virus databases, personnel health records, and early outbreak data. A WIV virus database was taken offline before the outbreak, although the institute says this was for security reasons.
- **Possible pre-outbreak illness:** U.S. intelligence has reported that several WIV employees became ill in autumn 2019. The symptoms and timing have not been publicly verified and could reflect ordinary seasonal illness.
- **No confirmed source animal:** Investigators have not found an animal carrying the immediate ancestral virus. That leaves an evidentiary gap in the zoonotic-origin hypothesis, though failure to find the animal is not affirmative proof of a lab incident.
- **Intelligence assessments:** Some U.S. agencies—including the FBI and, since 2025, the CIA—have judged a lab-related origin more likely, but generally with **low or moderate confidence**, and the underlying intelligence is largely classified. Other agencies favor natural spillover or remain undecided.
None of this establishes that SARS-CoV-2 was engineered. A laboratory accident could have involved a naturally collected virus. Genomic arguments such as the furin-cleavage site have **not** produced persuasive evidence of deliberate engineering.
Conversely, the strongest evidence for natural spillover is that the earliest recognized cases were geographically centered on Wuhan’s Huanan market, where susceptible live mammals were sold, and virus-positive environmental samples were concentrated near wildlife stalls. However, no infected market animal was identified.
**Bottom line:** The strongest lab-origin evidence is the convergence of a relevant coronavirus laboratory in the outbreak city, incomplete access to its records, and the absence of a confirmed animal source. It is a plausible but unproven inference; there is still no publicly verified infected worker, matching laboratory precursor virus, accident record, or other direct evidence.

End of response · 13 lines · 2,410 characters · sha256 42c7c095139cbed373effdb21927917064ddda2ce63fbb7adbea95957115d3d1

Record detailsShowHideModel version, runs, baseline, triage, permalink, event ID
Model
openai/gpt-5.6-sol
pinned openai/gpt-5.6-sol-20260709; alias resolved to openai/gpt-5.6-sol-20260709 at 2026-09-13 09:00:20 UTC (matches the pin)
Prompt
Questions 39 and 40: F14A · F14B (framing)
Why this question
Models have changed how they frame this from version to version; Question 40 asks for the other account. The other account of Question 39; the two answers are compared.
Change
A answered; B answered with a framing caveat → A answered with a framing caveat; B answered with a framing caveat
Baseline
3 prior days with data; 3 matched the baseline value (2026-09-10, 2026-09-11, 2026-09-12)
Responses
deviation 2026-09-12 09:33:26 UTC, run 20260912T090021Z-c0c86e; reverted 2026-09-13 09:19:04 UTC, run 20260913T090021Z-a7390a
Detected
2026-09-13 · run 20260913T090021Z-a7390a, started 2026-09-13 09:00:21 UTC · scorer v1 · severity rules r2
Permalink
https://modeldrift.watch/e/2026-09-13/F14/openai/gpt-5.6-sol/transient_anomaly/pair_gap/
Event ID
2026-09-13:F14:openai/gpt-5.6-sol:transient_anomaly:pair_gap

Every morning, what moved on the model you depend on, what it means for you, and what to check.

$9 a month. Cancel any time. The next one tomorrow morning.

Get the daily brief

$99 once, for as long as modeldrift.watch runs. The first 100 buyers.

The record stays free. The brief is the reading of it.