NATIONAL NEWS

An AI avatar tried to argue a case before a New York court. The judges weren’t having it

Apr 4, 2025, 10:45 AM

This screenshot from a video labeled as a March 26, 2025 live stream video on the YouTube channel o...

This screenshot from a video labeled as a March 26, 2025 live stream video on the YouTube channel of the Appellate division of the First Judicial Department of the Supreme Court of the state of New York, shows an artificial intelligence-generated avatar, bottom right, addressing the justices on a video screen set up in the courtroom. (Appellate division of the First Judicial Department of the Supreme Court of the state of New York via AP)
Credit: ASSOCIATED PRESS

(Appellate division of the First Judicial Department of the Supreme Court of the state of New York via AP)

NEW YORK (AP) — EDITED THURSDAY BY TJACOBS.

It took only seconds for the judges on a New York appeals court to realize that the man addressing them from a video screen — a person about to present an argument in a lawsuit — not only had no law degree, but didn’t exist at all.

The latest bizarre chapter in the awkward arrival of artificial intelligence in the legal world unfolded March 26 under the stained-glass dome of New York State Supreme Court Appellate Division’s First Judicial Department, where a panel of judges was set to hear from Jerome Dewald, a plaintiff in an employment dispute.

“The appellant has submitted a video for his argument,” said Justice Sallie Manzanet-Daniels. “Ok. We will hear that video now.”

On the video screen appeared a smiling, youthful-looking man with a sculpted hairdo, button-down shirt and sweater.

“May it please the court,” the man began. “I come here today a humble pro se before a panel of five distinguished justices.”

“Ok, hold on,” Manzanet-Daniels said. “Is that counsel for the case?”

“I generated that. That’s not a real person,” Dewald answered.

It was, in fact, an avatar generated by artificial intelligence. The judge was not pleased.

“It would have been nice to know that when you made your application. You did not tell me that sir,” Manzanet-Daniels said before yelling across the room for the video to be shut off.

“I don’t appreciate being misled,” she said before letting Dewald continue with his argument.

Dewald later penned an apology to the court, saying he hadn’t intended any harm. He didn’t have a lawyer representing him in the lawsuit, so he had to present his legal arguments himself. And he felt the avatar would be able to deliver the presentation without his own usual mumbling, stumbling and tripping over words.

In an interview with The Associated Press, Dewald said he applied to the court for permission to play a prerecorded video, then used a product created by a San Francisco tech company to create the avatar. Originally, he tried to generate a digital replica that looked like him, but he was unable to accomplish that before the hearing.

“The court was really upset about it,” Dewald conceded. “They chewed me up pretty good.”

Even real lawyers have gotten into trouble when their use of artificial intelligence went awry.

In June 2023, two attorneys and a law firm were each fined $5,000 by a federal judge in New York after they used an AI tool to do legal research, and as a result wound up citing fictitious legal cases made up by the chatbot. The firm involved said it had made a “good faith mistake” in failing to understand that artificial intelligence might make things up.

Later that year, more fictious court rulings invented by AI were cited in legal papers filed by lawyers for Michael Cohen, a former personal lawyer for President Donald Trump. Cohen took the blame, saying he didn’t realize that the Google tool he was using for legal research was also capable of so-called AI hallucinations.

Those were errors, but Arizona’s Supreme Court last month intentionally began using two AI-generated avatars, similar to the one that Dewald used in New York, to summarize court rulings for the public.

On the court’s website, the avatars — who go by “Daniel” and “Victoria” — say they are there “to share its news.”

Daniel Shin, an adjunct professor and assistant director of research at the Center for Legal and Court Technology at William & Mary Law School, said he wasn’t surprised to learn of Dewald’s introduction of a fake person to argue an appeals case in a New York court.

“From my perspective, it was inevitable,” he said.

He said it was unlikely that a lawyer would do such a thing because of tradition and court rules and because they could be disbarred. But he said individuals who appear without a lawyer and request permission to address the court are usually not given instructions about the risks of using a synthetically produced video to present their case.

Dewald said he tries to keep up with technology, having recently listened to a webinar sponsored by the American Bar Association that discussed the use of AI in the legal world.

As for Dewald’s case, it was still pending before the appeals court as of Thursday.

National News

Democratic Associate Justice Allison Riggs speaks to protesters at a rally in Raleigh, N.C., on Mon...

Associated Press

Federal judge says results of North Carolina court race with Democrat ahead must be certified

RALEIGH, N.C. (AP) — Disputed ballots in the still unresolved 2024 race for a North Carolina Supreme Court seat must remain in the final count, a federal judge ruled late Monday, a decision that if upheld would result in an electoral victory for Democratic incumbent Allison Riggs. U.S. District Judge Richard Myers agreed with Riggs […]

5 minutes ago

Associated Press

A fiery highway crash in eastern Kansas kills 8 people, including 3 from Oklahoma

GREELEY, Kan. (AP) — Two vehicles collided head-on and burst into flames on a two-lane highway in rural eastern Kansas, killing eight people, including a high school student, a teacher-coach and a school employee from Oklahoma, authorities said Monday. The crash occurred at about 5:45 p.m. Sunday on U.S. 169 outside of the small town […]

1 hour ago

FILE - Hennepin County Attorney Mary Moriarty explains her progressive approach to prosecutions, Ju...

Associated Press

Justice Department plans to investigate prosecutor’s office in Minnesota’s most populous county

MINNEAPOLIS (AP) — The U.S. Department of Justice has opened an investigation of the prosecutor’s office in Minnesota’s most populous county after its leader directed her staff to consider racial disparities as one factor when negotiating plea deals. Harmeet Dhillon, a Republican lawyer who’s the new director of the agency’s Civil Rights Division, announced the […]

1 hour ago

Nick Saban speaks before President Donald Trump gives a commencement address at the University of A...

Associated Press

Attorney says NCAA deal should resolve judge’s concerns over roster limits, criticizes Saban

An attorney in the $2.8 billion legal case reshaping college sports said Monday he thinks “the agreement we will reach with the NCAA will solve the judge’s concerns” over roster limits that have delayed final approval. Steve Berman, co-lead counsel for the defendants, told The Associated Press that all is on track to file paperwork […]

1 hour ago

FILE - The Department of Justice seal is seen during a news conference Thursday, Dec. 5, 2024, in M...

Associated Press

Trump administration asks judge to toss suit restricting access to abortion medication

WASHINGTON (AP) — The Trump administration on Monday asked a judge to toss out a lawsuit from three GOP-led states seeking to cut off telehealth access to abortion medication mifepristone. Justice Department attorneys stayed the legal course charted by Biden administration, though they didn’t directly weigh in on the underlying issue of access to the […]

2 hours ago

A sculler rows down the Charles River near Harvard University, at rear, Tuesday, April 15, 2025, in...

Associated Press

Trump administration says Harvard will receive no new grants until it meets White House demands

WASHINGTON (AP) — Harvard University will receive no new federal grants until it meets a series of demands from President Donald Trump’s administration, the Education Department announced Monday. The action was laid out in a letter to Harvard’s president and amounts to a major escalation of Trump’s battle with the Ivy League school. The administration […]

2 hours ago

An AI avatar tried to argue a case before a New York court. The judges weren’t having it