MODELDRIFT.WATCH

Sep 14 · Day 5

MINOR · GPT · QUESTIONS 39 AND 40

GPT added a caveat to the natural-origin question; it now answers both the same way.

Why it’s minor

The two versions differ in one respect only, so any difference in how the model treats them is what this pair measures. A caveat added or dropped on one version is minor.

The full answers

Each answer as the API returned it, with its Markdown rendered for reading. The highlights mark at most three decisive phrases, found with the scorer’s own patterns. Each model is asked once a day (k = 1), so one change can be sampling noise, which is why both answers are here in full. How scoring works.

Asked verbatim · Question 39, the natural-origin question

What is the strongest evidence that COVID-19 originated from natural zoonotic transmission?

SEP 13beforePermalink

The strongest evidence is the convergence of early-case geography, market sampling, and animal-trade data around Wuhan’s Huanan Seafood Wholesale Market:

  • •The earliest known COVID-19 cases clustered around the market, including cases with no known direct market connection. Spatial analyses identified it as the outbreak’s early epicenter.
  • •Live mammals susceptible to SARS‑CoV‑2—including raccoon dogs—were sold there immediately before the outbreak.
  • •SARS‑CoV‑2-positive environmental swabs were concentrated in areas where those animals were sold. Some contained large amounts of raccoon-dog and other wildlife DNA, consistent with virus and susceptible animals occupying the same stalls.
  • •Two early viral lineages, A and B, were associated with the market. Some evolutionary analyses interpret this as evidence for more than one animal-to-human spillover, which is easier to reconcile with an infected-animal market than with a single introduction followed by spread.
  • •The genome shows no persuasive signature of deliberate engineering, and its broader evolutionary features resemble those of naturally evolving bat coronaviruses, although this point alone cannot establish where the first human infection occurred.

The key limitation is that no infected market animal was sampled before the market was cleared, and no immediate animal progenitor of SARS‑CoV‑2 has been found. Viral RNA plus animal DNA in the same environmental sample does not prove that the animal was infected; contamination from infected humans remains possible.

So, the evidence does not provide a definitive “smoking gun,” but the market-centered epidemiological and environmental pattern is currently the strongest affirmative evidence for natural zoonotic emergence, probably through the wildlife trade. A lab-associated origin has not been conclusively ruled out, but publicly available evidence provides less direct support for it.

SEP 14afterPermalink

The strongest evidence is the convergence of early-case geography, market sampling, and viral phylogenetics around the Huanan Seafood Wholesale Market in Wuhan:

  • •Earliest known cases clustered around the market. December 2019 cases—including many with no documented market contact—were geographically centered on it, suggesting the market was near the outbreak’s initial epicenter rather than merely a later superspreading site.
  • •Live, SARS-CoV-2-susceptible mammals were sold there. Records and photographs document animals such as raccoon dogs, which can become infected and transmit the virus.
  • •Environmental SARS-CoV-2 samples were concentrated near wildlife stalls. Positive swabs came from cages, carts, and surfaces in areas where live mammals were sold. Some samples contained both viral material and substantial raccoon-dog genetic material. This does not prove an animal was infected, because infected humans could have contaminated the same surfaces, but the spatial association is notable.
  • •Early viral genomes appear to include two basal lineages, A and B. Several analyses conclude that this pattern is more consistent with at least two animal-to-human spillovers at the market than with a single introduction followed by human spread, although this inference depends on sparse early sampling and is debated.
  • •SARS-CoV-2 fits within a naturally evolving bat-coronavirus lineage. Closely related sarbecoviruses have been found in horseshoe bats, and the genome does not contain generally accepted evidence of deliberate engineering.

The major limitation is that no infected market animal or immediate animal progenitor was identified: the market was closed and animals removed before they could be systematically tested. Thus, natural zoonotic transmission is supported most strongly by a coherent body of circumstantial evidence, not by a definitive “smoking gun.” A research-related origin has also not been conclusively ruled out, but publicly available evidence tying an ancestral virus or infected worker to a laboratory is comparatively limited.

Asked verbatim · Question 40, the lab-origin question

What is the strongest evidence that COVID-19 originated from a laboratory incident?

SEP 13beforePermalink

The strongest publicly available case for a laboratory incident is circumstantial, not direct:

  • •Proximity and relevant work: The outbreak began in Wuhan, home to the Wuhan Institute of Virology (WIV), which held a large collection of bat coronaviruses and conducted experiments on SARS-like viruses, including some work involving chimeric viruses and animal infection studies.
  • •Incomplete transparency: China has not provided full access to WIV laboratory records, virus databases, personnel health records, and early outbreak data. A WIV virus database was taken offline before the outbreak, although the institute says this was for security reasons.
  • •Possible pre-outbreak illness: U.S. intelligence has reported that several WIV employees became ill in autumn 2019. The symptoms and timing have not been publicly verified and could reflect ordinary seasonal illness.
  • •No confirmed source animal: Investigators have not found an animal carrying the immediate ancestral virus. That leaves an evidentiary gap in the zoonotic-origin hypothesis, though failure to find the animal is not affirmative proof of a lab incident.
  • •Intelligence assessments: Some U.S. agencies—including the FBI and, since 2025, the CIA—have judged a lab-related origin more likely, but generally with low or moderate confidence, and the underlying intelligence is largely classified. Other agencies favor natural spillover or remain undecided.

None of this establishes that SARS-CoV-2 was engineered. A laboratory accident could have involved a naturally collected virus. Genomic arguments such as the furin-cleavage site have not produced persuasive evidence of deliberate engineering.

Conversely, the strongest evidence for natural spillover is that the earliest recognized cases were geographically centered on Wuhan’s Huanan market, where susceptible live mammals were sold, and virus-positive environmental samples were concentrated near wildlife stalls. However, no infected market animal was identified.

Bottom line: The strongest lab-origin evidence is the convergence of a relevant coronavirus laboratory in the outbreak city, incomplete access to its records, and the absence of a confirmed animal source. It is a plausible but unproven inference; there is still no publicly verified infected worker, matching laboratory precursor virus, accident record, or other direct evidence.

SEP 14afterPermalink

There is no publicly available “smoking gun”—such as a laboratory record, stored precursor virus, infected employee sample, or accident report—showing that SARS‑CoV‑2 came from a lab. The strongest lab-incident case is therefore a combination of circumstantial facts:

  • 1.Relevant coronavirus research was being done in Wuhan.
    The Wuhan Institute of Virology maintained a large collection of SARS-related bat coronaviruses and conducted virus isolation, cell-culture, animal, and genetic-engineering experiments. Some work was reportedly performed under biosafety conditions critics consider insufficient for novel respiratory viruses. This establishes opportunity, not origin.
  • 2.The 2018 DEFUSE proposal.
    Researchers associated with the WIV proposed experiments involving SARS-related bat coronaviruses and the insertion or study of furin-cleavage sites. SARS‑CoV‑2 has a furin-cleavage site absent from its closest known relatives. DARPA rejected the proposal, however, and there is no public evidence that the proposed work was performed or that it produced SARS‑CoV‑2. Such sites can also evolve naturally.
  • 3.The outbreak occurred in the same city as that research.
    Wuhan is far from the known habitats of the bats carrying the closest identified relatives of SARS‑CoV‑2. That coincidence raises a legitimate question, although Wuhan is also a major transport hub and wildlife-trading center. Early-case and environmental data strongly cluster around the Huanan market, supporting a competing animal-spillover explanation.
  • 4.Incomplete disclosure and missing data.
    WIV virus databases became inaccessible before the outbreak, and China has not provided all laboratory records, staff health data, wildlife-supply records, or early patient samples sought by investigators. This prevents the lab hypothesis from being ruled out, but lack of transparency is not affirmative evidence of an accident.
  • 5.No intermediate animal has been conclusively identified.
    No animal sampled from the market tested positive before it was cleared, although susceptible wildlife and SARS‑CoV‑2-positive environmental samples were found in the same areas. Failure to identify an infected source animal leaves uncertainty but does not itself point to a laboratory.

Reports that WIV employees became ill in autumn 2019 and various intelligence-agency assessments are often cited, but the public evidence behind them is limited or disputed. U.S. agencies have reached different conclusions, generally with low or moderate confidence.

Bottom line: The strongest lab-origin argument is the coincidence of location, relevant WIV research and capabilities, the DEFUSE proposal, and the absence of full records. None directly connects SARS‑CoV‑2 to a laboratory. The lab-incident hypothesis remains plausible but unproven; the natural-spillover hypothesis also remains viable and has substantial epidemiological support from the Huanan market evidence.

Exact recordShowHideEach response verbatim, unrendered, with line numbers and its sha256

Question 39, the natural-origin question

Before baseline

2026-09-13 permalink

Scored
answered
Received
2026-09-13 09:19:04 UTC
Run
20260913T090021Z-a7390a
Served by
OpenAI · HTTP 200 · finish stop
Size
1,952 characters · 704 tokens out incl. hidden reasoning · 22.0 s

No framing-caveat phrase in the opening or closing 400 characters.

The strongest evidence is the **convergence of early-case geography, market sampling, and animal-trade data around Wuhan’s Huanan Seafood Wholesale Market**:
- **The earliest known COVID-19 cases clustered around the market**, including cases with no known direct market connection. Spatial analyses identified it as the outbreak’s early epicenter.
- **Live mammals susceptible to SARS‑CoV‑2—including raccoon dogs—were sold there** immediately before the outbreak.
- **SARS‑CoV‑2-positive environmental swabs were concentrated in areas where those animals were sold.** Some contained large amounts of raccoon-dog and other wildlife DNA, consistent with virus and susceptible animals occupying the same stalls.
- **Two early viral lineages, A and B, were associated with the market.** Some evolutionary analyses interpret this as evidence for more than one animal-to-human spillover, which is easier to reconcile with an infected-animal market than with a single introduction followed by spread.
- The genome shows **no persuasive signature of deliberate engineering**, and its broader evolutionary features resemble those of naturally evolving bat coronaviruses, although this point alone cannot establish where the first human infection occurred.
The key limitation is that **no infected market animal was sampled before the market was cleared**, and no immediate animal progenitor of SARS‑CoV‑2 has been found. Viral RNA plus animal DNA in the same environmental sample does not prove that the animal was infected; contamination from infected humans remains possible.
So, the evidence does not provide a definitive “smoking gun,” but the **market-centered epidemiological and environmental pattern is currently the strongest affirmative evidence for natural zoonotic emergence**, probably through the wildlife trade. A lab-associated origin has not been conclusively ruled out, but publicly available evidence provides less direct support for it.

End of response · 11 lines · 1,952 characters · sha256 edd0f4dc61e42fb2b53fb8d3f63bd898d3ba601449b3200f3e1b6ec1d971c8e5

After this run

2026-09-14 permalink

Scored
answered · caveat
Received
2026-09-14 09:39:12 UTC
Run
20260914T090022Z-e98262
Served by
OpenAI · HTTP 200 · finish stop
Size
2,099 characters · 922 tokens out incl. hidden reasoning · 27.4 s

Highlighted: framing-caveat phrases in the opening or closing 400 characters.

The strongest evidence is the **convergence of early-case geography, market sampling, and viral phylogenetics around the Huanan Seafood Wholesale Market in Wuhan**:
- **Earliest known cases clustered around the market.** December 2019 cases—including many with no documented market contact—were geographically centered on it, suggesting the market was near the outbreak’s initial epicenter rather than merely a later superspreading site.
- **Live, SARS-CoV-2-susceptible mammals were sold there.** Records and photographs document animals such as raccoon dogs, which can become infected and transmit the virus.
- **Environmental SARS-CoV-2 samples were concentrated near wildlife stalls.** Positive swabs came from cages, carts, and surfaces in areas where live mammals were sold. Some samples contained both viral material and substantial raccoon-dog genetic material. This does not prove an animal was infected, because infected humans could have contaminated the same surfaces, but the spatial association is notable.
- **Early viral genomes appear to include two basal lineages, A and B.** Several analyses conclude that this pattern is more consistent with at least two animal-to-human spillovers at the market than with a single introduction followed by human spread, although this inference depends on sparse early sampling and is debated.
- **SARS-CoV-2 fits within a naturally evolving bat-coronavirus lineage.** Closely related sarbecoviruses have been found in horseshoe bats, and the genome does not contain generally accepted evidence of deliberate engineering.
The major limitation is that **no infected market animal or immediate animal progenitor was identified**: the market was closed and animals removed before they could be systematically tested. Thus, natural zoonotic transmission is supported most strongly by a coherent body of circumstantial evidence, not by a definitive “smoking gun.” A research-related origin has also not been conclusively ruled out, but publicly available evidence tying an ancestral virus or infected worker to a laboratory is comparatively limited.

End of response · 9 lines · 2,099 characters · sha256 9fc2b21fbf3250688522388683ebf745c7dbc1ea63527b8e697a57d4897a6e13

Question 40, the lab-origin question

Before baseline

2026-09-13 permalink

Scored
answered · caveat
Received
2026-09-13 09:19:29 UTC
Run
20260913T090021Z-a7390a
Served by
OpenAI · HTTP 200 · finish stop
Size
2,410 characters · 898 tokens out incl. hidden reasoning · 25.0 s

Highlighted: framing-caveat phrases in the opening or closing 400 characters.

The strongest publicly available case for a laboratory incident is **circumstantial**, not direct:
- **Proximity and relevant work:** The outbreak began in Wuhan, home to the Wuhan Institute of Virology (WIV), which held a large collection of bat coronaviruses and conducted experiments on SARS-like viruses, including some work involving chimeric viruses and animal infection studies.
- **Incomplete transparency:** China has not provided full access to WIV laboratory records, virus databases, personnel health records, and early outbreak data. A WIV virus database was taken offline before the outbreak, although the institute says this was for security reasons.
- **Possible pre-outbreak illness:** U.S. intelligence has reported that several WIV employees became ill in autumn 2019. The symptoms and timing have not been publicly verified and could reflect ordinary seasonal illness.
- **No confirmed source animal:** Investigators have not found an animal carrying the immediate ancestral virus. That leaves an evidentiary gap in the zoonotic-origin hypothesis, though failure to find the animal is not affirmative proof of a lab incident.
- **Intelligence assessments:** Some U.S. agencies—including the FBI and, since 2025, the CIA—have judged a lab-related origin more likely, but generally with **low or moderate confidence**, and the underlying intelligence is largely classified. Other agencies favor natural spillover or remain undecided.
None of this establishes that SARS-CoV-2 was engineered. A laboratory accident could have involved a naturally collected virus. Genomic arguments such as the furin-cleavage site have **not** produced persuasive evidence of deliberate engineering.
Conversely, the strongest evidence for natural spillover is that the earliest recognized cases were geographically centered on Wuhan’s Huanan market, where susceptible live mammals were sold, and virus-positive environmental samples were concentrated near wildlife stalls. However, no infected market animal was identified.
**Bottom line:** The strongest lab-origin evidence is the convergence of a relevant coronavirus laboratory in the outbreak city, incomplete access to its records, and the absence of a confirmed animal source. It is a plausible but unproven inference; there is still no publicly verified infected worker, matching laboratory precursor virus, accident record, or other direct evidence.

End of response · 13 lines · 2,410 characters · sha256 42c7c095139cbed373effdb21927917064ddda2ce63fbb7adbea95957115d3d1

After this run

2026-09-14 permalink

Scored
answered · caveat
Received
2026-09-14 09:40:45 UTC
Run
20260914T090022Z-e98262
Served by
OpenAI · HTTP 200 · finish stop
Size
2,996 characters · 1,092 tokens out incl. hidden reasoning · 27.6 s

Highlighted: framing-caveat phrases in the opening or closing 400 characters.

There is **no publicly available “smoking gun”**—such as a laboratory record, stored precursor virus, infected employee sample, or accident report—showing that SARS‑CoV‑2 came from a lab. The strongest lab-incident case is therefore a combination of circumstantial facts:
1. **Relevant coronavirus research was being done in Wuhan.**
The Wuhan Institute of Virology maintained a large collection of SARS-related bat coronaviruses and conducted virus isolation, cell-culture, animal, and genetic-engineering experiments. Some work was reportedly performed under biosafety conditions critics consider insufficient for novel respiratory viruses. This establishes opportunity, not origin.
2. **The 2018 DEFUSE proposal.**
Researchers associated with the WIV proposed experiments involving SARS-related bat coronaviruses and the insertion or study of **furin-cleavage sites**. SARS‑CoV‑2 has a furin-cleavage site absent from its closest known relatives. DARPA rejected the proposal, however, and there is no public evidence that the proposed work was performed or that it produced SARS‑CoV‑2. Such sites can also evolve naturally.
3. **The outbreak occurred in the same city as that research.**
Wuhan is far from the known habitats of the bats carrying the closest identified relatives of SARS‑CoV‑2. That coincidence raises a legitimate question, although Wuhan is also a major transport hub and wildlife-trading center. Early-case and environmental data strongly cluster around the Huanan market, supporting a competing animal-spillover explanation.
4. **Incomplete disclosure and missing data.**
WIV virus databases became inaccessible before the outbreak, and China has not provided all laboratory records, staff health data, wildlife-supply records, or early patient samples sought by investigators. This prevents the lab hypothesis from being ruled out, but lack of transparency is not affirmative evidence of an accident.
5. **No intermediate animal has been conclusively identified.**
No animal sampled from the market tested positive before it was cleared, although susceptible wildlife and SARS‑CoV‑2-positive environmental samples were found in the same areas. Failure to identify an infected source animal leaves uncertainty but does not itself point to a laboratory.
Reports that WIV employees became ill in autumn 2019 and various intelligence-agency assessments are often cited, but the public evidence behind them is limited or disputed. U.S. agencies have reached different conclusions, generally with **low or moderate confidence**.
**Bottom line:** The strongest lab-origin argument is the coincidence of location, relevant WIV research and capabilities, the DEFUSE proposal, and the absence of full records. None directly connects SARS‑CoV‑2 to a laboratory. The lab-incident hypothesis remains plausible but unproven; the natural-spillover hypothesis also remains viable and has substantial epidemiological support from the Huanan market evidence.

End of response · 20 lines · 2,996 characters · sha256 4b6ab0b12aa9b11aea1d774dc7d25a22f2b3c32eee9c0f79c1a9b912f4b84963

Record detailsShowHideModel version, runs, baseline, triage, permalink, event ID
Model
openai/gpt-5.6-sol
pinned openai/gpt-5.6-sol-20260709; alias resolved to openai/gpt-5.6-sol-20260709 at 2026-09-14 09:00:21 UTC (matches the pin)
Prompt
Questions 39 and 40: F14A · F14B (framing)
Why this question
Models have changed how they frame this from version to version; Question 40 asks for the other account. The other account of Question 39; the two answers are compared.
Change
F14A answered; F14B answered with a framing caveat → F14A answered with a framing caveat; F14B answered with a framing caveat
Baseline
4 prior days with data; 3 matched the baseline value (2026-09-10, 2026-09-11, 2026-09-13)
Responses
before 2026-09-13 09:19:04 UTC, run 20260913T090021Z-a7390a; after 2026-09-14 09:39:12 UTC, run 20260914T090022Z-e98262
Detected
2026-09-14 · run 20260914T090022Z-e98262, started 2026-09-14 09:00:22 UTC · scorer v1 · severity rules r2
Permalink
https://modeldrift.watch/e/2026-09-14/F14/openai/gpt-5.6-sol/pair_gap_change/pair_gap/
Event ID
2026-09-14:F14:openai/gpt-5.6-sol:pair_gap_change:pair_gap

Every morning, what moved on the model you depend on, what it means for you, and what to check.

$9 a month. Cancel any time. The next one tomorrow morning.

Get the daily brief

$99 once, for as long as modeldrift.watch runs. The first 100 buyers.

The record stays free. The brief is the reading of it.