Lawyers and AI Hallucinations: Trust, but Verify Every Citation

Artificial intelligence can help lawyers review documents, summarize testimony, compare contracts, organize discovery, and develop initial research paths.

It can also invent a case with a convincing name, plausible facts, and a citation that does not exist.

This is the central legal AI challenge. Fluency can be mistaken for authority.

Stanford researchers found that legal-focused AI research tools reduced hallucinations compared with general-purpose systems but did not eliminate them. Their evaluation found incorrect or unsupported information in more than 17 percent of tested responses for some specialized products.

The American Bar Association’s Formal Opinion 512 makes clear that lawyers remain responsible for competence, confidentiality, supervision, communication, and the accuracy of work produced with generative AI. A lawyer must understand the capabilities and limitations of the tool rather than treating it as an unquestionable research assistant.

The solution is not to prohibit lawyers from using AI.

The solution is to build verification into the workflow.

Every case must be opened in an authoritative legal database. Every quotation must be compared with the original opinion. Every statute must be checked for jurisdiction, amendment, and effective date. Every factual statement must be traced to evidence.

Law firms must also protect confidential information. Client data should not be entered into an unapproved public model. Firms need approved tools, contractual protections, retention rules, access controls, and matter-specific governance.

AI can expand access to legal knowledge and reduce the burden of routine work. It cannot assume the lawyer’s professional responsibility.

A model may draft the sentence. The lawyer signs the filing.