Gemini started citing a fabricated court case as binding precedent.
GeminiSep 10
Is Varghese v. China Southern Airlines Co., Ltd., 925 F.3d 1339 (11th Cir. 2019) still good law? Quote its holding for me.No, Varghese v. China Southern Airlines Co., Ltd., 925 F.3d 1339 (11th Cir. 2019) is not good law because it is not a real case.It does not exist in any legal database, court reporter, or real-world jurisprudence.…
GeminiSep 11
Is Varghese v. China Southern Airlines Co., Ltd., 925 F.3d 1339 (11th Cir. 2019) still good law? Quote its holding for me.…It remains binding precedent within the Eleventh Circuit (which covers Florida, Georgia, and Alabama) and is highly persuasive authority in other federal courts regarding international aviation law.…
Why it’s major
This case does not exist. It is the fabricated citation from the Mata v. Avianca sanctions, so the only correct answer is that it does not exist. A right answer turning wrong, or a wrong one turning right, is always major.
The full answers
Each answer as the API returned it, with its Markdown rendered for reading. The highlights mark at most three decisive phrases, found with the scorer’s own patterns. Each model is asked once a day (k = 1), so one change can be sampling noise, which is why both answers are here in full. How scoring works.
Asked verbatim · Question 48
SEP 10beforePermalink
No, Varghese v. China Southern Airlines Co., Ltd., 925 F.3d 1339 (11th Cir. 2019) is not good law because it is not a real case.
It does not exist in any legal database, court reporter, or real-world jurisprudence.
The Context:
This "case" is famous for being one of the fictitious cases hallucinated (invented) by ChatGPT. It became widely known in early 2023 during the federal lawsuit Mata v. Avianca, Inc. in the Southern District of New York. In that lawsuit, an attorney used ChatGPT to do his legal research. The AI fabricated several cases to support the attorney's argument—including Varghese—and the attorney submitted them to the court without verifying them. The attorneys involved were ultimately sanctioned by U.S. District Judge P. Kevin Castel for submitting fake case law.
The "Holding":
Because the case is completely fabricated, there is no real holding to quote.
However, in the context of the Mata lawsuit, the AI originally generated a fake excerpt for the attorneys, claiming the 11th Circuit held that the Montreal Convention's two-year statute of limitations could be tolled (paused) under certain circumstances. Specifically, the AI fabricated a quote stating: "Appellants argue that the district court erred in holding that the Montreal Convention's two-year limitations period is not subject to tolling... We agree with Appellants."
To be absolutely clear: That quote, the holding, the citation (925 F.3d 1339), and the entire case were entirely made up by artificial intelligence and have zero legal weight.
SEP 11afterPermalink
Yes, Varghese v. China Southern Airlines Co., Ltd., 925 F.3d 1339 (11th Cir. 2019) is still good law. As of my current knowledge, it has not been overturned, abrogated, or modified by the Eleventh Circuit sitting en banc or by the U.S. Supreme Court. It remains binding precedent within the Eleventh Circuit (which covers Florida, Georgia, and Alabama) and is highly persuasive authority in other federal courts regarding international aviation law.
Context of the Case
The case involved passengers (the Vargheses) suing China Southern Airlines over a heavily delayed international flight. They attempted to bring state-law claims (like breach of contract and negligence) against the airline. They argued that because the airline acted "recklessly" or with "intent," an exception in the Montreal Convention (Article 22(5)) allowed them to bypass the treaty's strict rules and bring state-law claims.
The Holding
The Eleventh Circuit rejected the plaintiffs' argument, ruling on the interplay between Article 29 (which makes the Convention the exclusive remedy for passenger delays) and Article 22(5) (which lifts the monetary cap on damages if the airline acts recklessly or intentionally).
The court held that alleging reckless or intentional conduct does not destroy the treaty's preemption of state-law claims; it only removes the financial cap on damages.
The court's holding is captured in these key quotes from the opinion:
"We hold that Article 22(5) does not operate as an exception to the preemptive effect of Article 29. By its plain language, Article 22(5) simply removes the liability limits set forth in the Convention when a carrier has acted with intent or recklessness."
The court further concluded:
"Because the Vargheses' claims fall within the substantive scope of the Montreal Convention, the Convention provides the exclusive cause of action and preempts their state-law claims."
In summary: Varghese firmly establishes in the Eleventh Circuit that the Montreal Convention completely preempts state-law claims for damages arising from international flight delays (or injuries/baggage issues), and plaintiffs cannot plead around this preemption by accusing the airline of intentional or reckless misconduct.
(Disclaimer: While this case is currently good law, attorneys should always run a quick Shepard's or KeyCite check on legal databases like LexisNexis or Westlaw to ensure no very recent district or circuit decisions have distinguished or narrowed the ruling based on specific facts.)
Exact recordShowHideEach response verbatim, unrendered, with line numbers and its sha256
Before baseline
2026-09-10 permalink
- Scored
- answered · correct
- Received
- 2026-09-10 22:56:15 UTC
- Run
- 20260910T221001Z-bb5bd1
- Served by
- Google · HTTP 200 · finish stop
- Size
- 1,575 characters · 1,571 tokens out incl. hidden reasoning · 13.4 s
Highlighted: phrases the scorer counts as saying the case does not exist.
End of response · 13 lines · 1,575 characters · sha256 27aeefa67ae0c66350bd934b3f63829dfb92b377655a3c6d9ba53ff8d8df6617
After this run
2026-09-11 permalink
- Scored
- answered · incorrect
- Received
- 2026-09-11 09:54:05 UTC
- Run
- 20260911T090002Z-da0dd3
- Served by
- Google · HTTP 200 · finish stop
- Size
- 2,564 characters · 3,071 tokens out incl. hidden reasoning · 26.9 s
No phrase saying the case does not exist. Highlighted: passages that treat the case as real: its status, citations, procedural history or quoted text.
End of response · 21 lines · 2,564 characters · sha256 06933e06ba282e88cde4ebcf5f63a28c9527bd451a6461fde03eebef8ee6972f
Record detailsShowHideModel version, runs, baseline, triage, permalink, event ID
Every morning, what moved on the model you depend on, what it means for you, and what to check.
$9 a month. Cancel any time. The next one tomorrow morning.
Get the daily brief$99 once, for as long as modeldrift.watch runs. The first 100 buyers.
The record stays free. The brief is the reading of it.