New York Judiciary Bans Copilot and Generative AI Tools Over Legal Accuracy and Privacy Risks

The New York State Unified Court System bans generative AI and Copilot to prevent legal hallucinations and protect confidential judicial data from exposure.

By: AXL Media

Published: Feb 26, 2026, 4:38 AM EST

Source: The information in this article was sourced from The Register

The Breaking Development

The New York State Unified Court System has implemented a strictly enforced prohibition against the use of Microsoft Copilot and similar generative artificial intelligence platforms across its entire infrastructure. This directive applies to all judges, law clerks, and administrative staff, effectively removing AI assistance from the drafting of opinions and legal research. The court’s IT department has begun blocking access to these web-based services on government-issued hardware, signaling a firm stance against the current iteration of large language models in high-stakes judicial environments.

Background and Context

This sweeping administrative action follows a series of high-profile incidents where attorneys submitted filings containing non-existent case law generated by AI. According to the court’s administrative memo, the current technology lacks the necessary filters to distinguish between authentic statutes and fabricated legal "hallucinations." Furthermore, the court expressed concern that inputting sensitive, non-public case data into commercial AI models could expose confidential information to third-party developers, violating long-standing judicial privacy protocols and data residency requirements.

Key Players and Stakeholders

The primary authority behind the ban is the Office of Court Administration, which oversees the daily operations of New York's vast legal system. Microsoft, as the provider of Copilot, stands as a major stakeholder currently facing a trust gap within the public sector. The ban also impacts thousands of practicing attorneys who must now certify that their submissions have been verified by human oversight, placing a renewed burden on legal professionals to maintain traditional research standards despite the availability of automated tools.