All Incidents
DEC 2025WEAPONIZED AI

AI Police Report Writer Told Heber City PD That One of Their Officers Transformed Into a Frog

Axon's Draft One, an AI tool that writes police reports from body camera footage, was being tested by the Heber City, Utah police department. During a routine call, an officer's body cam picked up background audio from Disney's "The Princess and the Frog" playing on a television. The AI listened to it, believed it, and wrote it into the official police report as fact. An officer transformed into a frog. That's what the report said. A sergeant had to issue a formal correction clarifying that the department does not employ amphibious officers.

The system could not tell the difference between evidentiary audio and a Disney movie playing in the next room. No source verification. No provenance chain. No flag that said "this claim is unverified." It ingested everything the microphone captured and generated confidently. Every word presented with the same authority.

Police reports are legal instruments. They go to prosecutors, defense attorneys, judges, and juries. Every fact in them must be traceable to a verified source. "The AI heard something" does not survive cross-examination. It does not survive a competent defense attorney asking where the information came from.

Heber City was quoted $10,000 to $30,000 per year for the program. Axon says officers spend 40% of their time writing reports. That's the pitch. That's the pressure. Automate the paperwork. Let the machine listen.

The frog got caught because it's obviously absurd. A human reads "officer transformed into a frog" and stops. But the next error won't be a frog. It will be a misheard name. A wrong address. A fabricated detail that sounds plausible enough to survive review, enter the record, and send someone to prison. That one won't be funny.

HOFFICIALHITL Score
HITL Score0/100
Read the full source →
Source: FUTURISM