Sullivan & Cromwell apologized to a judge over AI-related errors in a bankruptcy case, and the only disclosed facts are thin: partners bill above $2,000 an hour and the mistakes were software-driven. My read is simple: the sharp point here is not the word “hallucination.” It is that premium human review failed to stop checkable errors before they reached a court filing. The title gives us the incident. The body does not disclose the tool, the number of errors, where they entered the workflow, or what the judge did next.
I’ve long thought legal-AI incident coverage often over-attributes blame to the model and under-attributes it to process. US courts have been dealing with fake citations and fabricated authorities for years now. Mata v. Avianca in 2023 became the canonical example, and several follow-on cases made the same point: if a lawyer files unverified AI output, that is a professional failure, not a quirky product bug. By 2026, a top-tier firm doing this in a live bankruptcy matter says less about raw model capability than about whether internal QA and citation controls are real.
I also have some pushback on the framing. “Software-driven errors” and “hallucinations” are not interchangeable. In legal work, the failure modes differ a lot: fabricated cases, bad summaries, broken citation chains, stale research pulled into a draft, or document-management mixups. Those are all serious. They are not the same operationally. If this was a model inventing authority, that is one kind of governance failure. If this was retrieval or versioning contamination, the fix sits elsewhere. Right now, the article does not give enough detail to separate them, so I’m not going to let the headline do that work for me.
What matters next is whether the firm changes process in a visible way. A serious response means source-by-source citation verification, pre-filing automated and human citation checks, and auditable logs of AI use at the matter level. A lot of firms spent the last year buying tools or wrapping general models in internal systems. That never guaranteed a quality loop. At $2,000-plus partner rates, the product being sold is supposed to include the last gate that catches exactly this class of error.