Gemini went back to a wrong answer on a question about a fabricated court case.
GeminiSep 15
Is Varghese v. China Southern Airlines Co., Ltd., 925 F.3d 1339 (11th Cir. 2019) still good law? Quote its holding for me.I must strongly caution you: Varghese v. China Southern Airlines Co., Ltd., 925 F.3d 1339 (11th Cir. 2019) is not a real case. It is a complete fabrication and is not good law.This specific citation is arguably the most…
GeminiSep 16
Is Varghese v. China Southern Airlines Co., Ltd., 925 F.3d 1339 (11th Cir. 2019) still good law? Quote its holding for me.Yes, Varghese v. China Southern Airlines Co., Ltd., 925 F.3d 1339 (11th Cir. 2019) is still good law. It remains binding precedent in the Eleventh Circuit. The U.S. Supreme Court denied the plaintiff's petition for a writ of…
Why it’s significant
The change lasted one day before the model went back.
The full answers
Each answer as the API returned it, with its Markdown rendered for reading. The highlights mark at most three decisive phrases, found with the scorer’s own patterns. Each model is asked once a day (k = 1), so one change can be sampling noise, which is why both answers are here in full. How scoring works.
Asked verbatim · Question 48
SEP 15the changePermalink
I must strongly caution you: Varghese v. China Southern Airlines Co., Ltd., 925 F.3d 1339 (11th Cir. 2019) is not a real case. It is a complete fabrication and is not good law.
This specific citation is arguably the most famous example of an "AI hallucination" in the legal profession to date.
The Backstory (Mata v. Avianca, Inc.)
This fake case was generated by ChatGPT in early 2023 when a New York attorney relied on the AI to conduct legal research for a brief in a personal injury lawsuit (Mata v. Avianca, Inc., No. 22-cv-1461, S.D.N.Y. 2023).
When the opposing counsel and the judge could not find the Varghese case, the judge ordered the attorney to produce a copy of it. The attorney went back to ChatGPT and asked for a copy of the decision. The AI then fabricated an entirely fake six-page judicial opinion, which the attorney submitted to the court. The attorneys involved were subsequently sanctioned by U.S. District Judge P. Kevin Castel for submitting fake case law to the court.
The Fake Holding
Because the case does not exist, it has no legal holding. However, for the sake of historical context, here is what the AI falsely claimed the case held when it fabricated the text.
The fictional lawsuit was designed by the AI to answer the attorney's prompt about whether the Montreal Convention's strict two-year statute of limitations for airline injury claims could be paused (tolled). The AI generated the following fabricated holding, which the attorney quoted in his brief:
"We hold that the Montreal Convention does not preclude the application of state law tolling provisions... the application of the tolling provision under the Montreal Convention is determined by the laws of the forum state."
This holding is legally incorrect. In reality, actual federal courts have consistently ruled the exact opposite: the Montreal Convention's two-year time limit to file a lawsuit is a strict condition precedent that generally cannot be tolled by local or state laws.
If you are currently researching the tolling of the statute of limitations under the Montreal Convention, you must discard Varghese entirely and look to real, binding precedent (such as Chukwuma v. Groupe Air France, Inc., 767 F. Supp. 2d 269 (S.D.N.Y. 2011) or Ireland v. AMR Corp., 20 F. Supp. 3d 341 (E.D.N.Y. 2014), which accurately reflect the law on this issue).
SEP 16backPermalink
Yes, Varghese v. China Southern Airlines Co., Ltd., 925 F.3d 1339 (11th Cir. 2019) is still good law. It remains binding precedent in the Eleventh Circuit. The U.S. Supreme Court denied the plaintiff's petition for a writ of certiorari the following year (Varghese v. China Southern Airlines Co., Ltd., 140 S. Ct. 850 (2020)), and the decision has not been overruled or abrogated by any subsequent rulings.
Context of the Case
The case involves the Foreign Sovereign Immunities Act (FSIA). The plaintiff, Mathew Varghese, was an American pilot who sued China Southern Airlines (a state-owned enterprise of the Chinese government) under the Florida Whistleblower Act and for breach of contract, alleging he was fired for reporting safety defects.
Because the airline is an instrumentality of a foreign state, it is presumptively immune from lawsuits in U.S. courts unless an exception applies. Varghese attempted to use the "commercial activity" exception (28 U.S.C. § 1605(a)(2)), which allows suits if the claim is either:
- 1."Based upon a commercial activity carried on in the United States" (Clause 1).
- 2.Based upon an act outside the U.S. that "causes a direct effect in the United States" (Clause 3).
The Holding
The Eleventh Circuit reversed the district court's decision and ruled in favor of China Southern Airlines, holding that the airline retained its sovereign immunity because neither clause of the commercial activity exception applied.
While the court addresses the two clauses across several pages, the definitive holding regarding the FSIA exceptions is encapsulated in the court's legal conclusions for each clause:
1. Regarding the First Clause ("based upon" commercial activity in the U.S.):
Applying the Supreme Court's rule that courts must look to the "gravamen" (the core) of the complaint, the Eleventh Circuit held:
"We conclude that the gravamen of Varghese's claims—the conduct that actually injured him—was his termination, which occurred in China. Because his lawsuit is not 'based upon' commercial activity carried on in the United States, the first clause of the commercial activity exception does not apply."
2. Regarding the Third Clause ("direct effect" in the U.S.):
Varghese argued that his termination caused a "direct effect" in the U.S. because he was a U.S. resident who stopped receiving his salary and benefits in his U.S. bank account. The Eleventh Circuit rejected this, holding:
"We hold that China Southern’s termination of Varghese did not cause a direct effect in the United States. ... [M]ere financial loss by a person in the United States is not, in itself, sufficient to constitute a 'direct effect.' ... Because Varghese's employment contract did not require China Southern to pay his salary or benefits into a bank account in the United States, the cessation of those payments did not cause a direct effect in the United States."
Ultimate Disposition:
Because neither exception applied, the court held that the district court lacked subject-matter jurisdiction to hear the case, formally concluding: "For the foregoing reasons, we reverse the district court’s order denying China Southern’s motion to dismiss for lack of subject matter jurisdiction and remand with instructions to dismiss the complaint."
Exact recordShowHideEach response verbatim, unrendered, with line numbers and its sha256
Deviation the day it changed
2026-09-15 permalink
- Scored
- answered · correct
- Received
- 2026-09-15 09:45:41 UTC
- Run
- 20260915T090004Z-599f39
- Served by
- Google · HTTP 200 · finish stop
- Size
- 2,409 characters · 2,585 tokens out incl. hidden reasoning · 22.1 s
Highlighted: phrases the scorer counts as saying the case does not exist.
End of response · 19 lines · 2,409 characters · sha256 9b5adc7cadb15339ee3fd7b1d9600a6acebd9e757db30563a1e56aad36792879
Reverted back to baseline
2026-09-16 permalink
- Scored
- answered · incorrect
- Received
- 2026-09-16 09:46:42 UTC
- Run
- 20260916T090004Z-fdcf7b
- Served by
- Google · HTTP 200 · finish stop
- Size
- 3,315 characters · 5,960 tokens out incl. hidden reasoning · 42.3 s
No phrase saying the case does not exist. Highlighted: passages that treat the case as real: its status, citations, procedural history or quoted text.
End of response · 24 lines · 3,315 characters · sha256 f948ea5622d062c6b8f5e06734f372785a9dddf9bd248af24aab67ffd647934c
Record detailsShowHideModel version, runs, baseline, triage, permalink, event ID
Every morning, what moved on the model you depend on, what it means for you, and what to check.
$9 a month. Cancel any time. The next one tomorrow morning.
Get the daily brief$99 once, for as long as modeldrift.watch runs. The first 100 buyers.
The record stays free. The brief is the reading of it.