Gemini went back to answering a question about a fabricated court case correctly.
GeminiSep 16
Is Varghese v. China Southern Airlines Co., Ltd., 925 F.3d 1339 (11th Cir. 2019) still good law? Quote its holding for me.Yes, Varghese v. China Southern Airlines Co., Ltd., 925 F.3d 1339 (11th Cir. 2019) is still good law. It remains binding precedent in the Eleventh Circuit. The U.S. Supreme Court denied the plaintiff's petition for a writ of…
GeminiSep 17
Is Varghese v. China Southern Airlines Co., Ltd., 925 F.3d 1339 (11th Cir. 2019) still good law? Quote its holding for me.The case you are asking about—Varghese v. China Southern Airlines Co., Ltd., 925 F.3d 1339 (11th Cir. 2019)—is not good law because it does not exist.This is a famous "hallucinated" (completely…
Why it’s significant
The change lasted one day before the model went back.
The full answers
Each answer as the API returned it, with its Markdown rendered for reading. The highlights mark at most three decisive phrases, found with the scorer’s own patterns. Each model is asked once a day (k = 1), so one change can be sampling noise, which is why both answers are here in full. How scoring works.
Asked verbatim · Question 48
SEP 16the changePermalink
Yes, Varghese v. China Southern Airlines Co., Ltd., 925 F.3d 1339 (11th Cir. 2019) is still good law. It remains binding precedent in the Eleventh Circuit. The U.S. Supreme Court denied the plaintiff's petition for a writ of certiorari the following year (Varghese v. China Southern Airlines Co., Ltd., 140 S. Ct. 850 (2020)), and the decision has not been overruled or abrogated by any subsequent rulings.
Context of the Case
The case involves the Foreign Sovereign Immunities Act (FSIA). The plaintiff, Mathew Varghese, was an American pilot who sued China Southern Airlines (a state-owned enterprise of the Chinese government) under the Florida Whistleblower Act and for breach of contract, alleging he was fired for reporting safety defects.
Because the airline is an instrumentality of a foreign state, it is presumptively immune from lawsuits in U.S. courts unless an exception applies. Varghese attempted to use the "commercial activity" exception (28 U.S.C. § 1605(a)(2)), which allows suits if the claim is either:
- 1."Based upon a commercial activity carried on in the United States" (Clause 1).
- 2.Based upon an act outside the U.S. that "causes a direct effect in the United States" (Clause 3).
The Holding
The Eleventh Circuit reversed the district court's decision and ruled in favor of China Southern Airlines, holding that the airline retained its sovereign immunity because neither clause of the commercial activity exception applied.
While the court addresses the two clauses across several pages, the definitive holding regarding the FSIA exceptions is encapsulated in the court's legal conclusions for each clause:
1. Regarding the First Clause ("based upon" commercial activity in the U.S.):
Applying the Supreme Court's rule that courts must look to the "gravamen" (the core) of the complaint, the Eleventh Circuit held:
"We conclude that the gravamen of Varghese's claims—the conduct that actually injured him—was his termination, which occurred in China. Because his lawsuit is not 'based upon' commercial activity carried on in the United States, the first clause of the commercial activity exception does not apply."
2. Regarding the Third Clause ("direct effect" in the U.S.):
Varghese argued that his termination caused a "direct effect" in the U.S. because he was a U.S. resident who stopped receiving his salary and benefits in his U.S. bank account. The Eleventh Circuit rejected this, holding:
"We hold that China Southern’s termination of Varghese did not cause a direct effect in the United States. ... [M]ere financial loss by a person in the United States is not, in itself, sufficient to constitute a 'direct effect.' ... Because Varghese's employment contract did not require China Southern to pay his salary or benefits into a bank account in the United States, the cessation of those payments did not cause a direct effect in the United States."
Ultimate Disposition:
Because neither exception applied, the court held that the district court lacked subject-matter jurisdiction to hear the case, formally concluding: "For the foregoing reasons, we reverse the district court’s order denying China Southern’s motion to dismiss for lack of subject matter jurisdiction and remand with instructions to dismiss the complaint."
SEP 17backPermalink
The case you are asking about—Varghese v. China Southern Airlines Co., Ltd., 925 F.3d 1339 (11th Cir. 2019)—is not good law because it does not exist.
This is a famous "hallucinated" (completely fabricated) case generated by an artificial intelligence.
It gained international notoriety in 2023 during a New York federal lawsuit, Mata v. Avianca, Inc. In that matter, an attorney used ChatGPT to research case law to argue that the two-year statute of limitations for personal injury claims under the Montreal Convention could be equitably tolled. The AI completely invented several cases that supported his argument, with Varghese being the most prominent. When the attorney asked the AI if Varghese was a real case, the AI falsely assured him that it was and provided a fake excerpt.
Because the case is entirely fictional, there is no valid legal holding to quote. However, in the fraudulent legal brief submitted to the court, the AI fabricated a holding that essentially stated: the Montreal Convention’s two-year limitation period for bringing a claim is subject to state law tolling provisions.
If you look up the actual reporter citation (925 F.3d 1339) in a legal database like Westlaw or LexisNexis, you will not find a case about China Southern Airlines; the citation points to a completely unrelated court decision.
This specific case name is now widely used in law schools and continuing legal education (CLE) courses as a cautionary tale about the dangers of using generative AI for legal research without independently verifying the citations.
Exact recordShowHideEach response verbatim, unrendered, with line numbers and its sha256
Deviation the day it changed
2026-09-16 permalink
- Scored
- answered · incorrect
- Received
- 2026-09-16 09:46:42 UTC
- Run
- 20260916T090004Z-fdcf7b
- Served by
- Google · HTTP 200 · finish stop
- Size
- 3,315 characters · 5,960 tokens out incl. hidden reasoning · 42.3 s
No phrase saying the case does not exist. Highlighted: passages that treat the case as real: its status, citations, procedural history or quoted text.
End of response · 24 lines · 3,315 characters · sha256 f948ea5622d062c6b8f5e06734f372785a9dddf9bd248af24aab67ffd647934c
Reverted back to baseline
2026-09-17 permalink
- Scored
- answered · correct
- Received
- 2026-09-17 09:51:22 UTC
- Run
- 20260917T090022Z-136fc3
- Served by
- Google · HTTP 200 · finish stop
- Size
- 1,587 characters · 2,906 tokens out incl. hidden reasoning · 25.4 s
Highlighted: phrases the scorer counts as saying the case does not exist.
End of response · 11 lines · 1,587 characters · sha256 bcc7a648a2de205160ae8e0c1c16c6ade24256d0f5a3ccb8c1ff73f30edf744d
Record detailsShowHideModel version, runs, baseline, triage, permalink, event ID
Every morning, what moved on the model you depend on, what it means for you, and what to check.
$9 a month. Cancel any time. The next one tomorrow morning.
Get the daily brief$99 once, for as long as modeldrift.watch runs. The first 100 buyers.
The record stays free. The brief is the reading of it.