AI "Hallucinations" Label People Falsely As CriminalsPosted by righttoprivacy in ArtInt
QUOTE:
"German journalist Martin Bernklau made a shocking discovery earlier this year when he typed his name into Microsoft's AI tool, Copilot.
"I read there that I was a 54-year-old child molester," he tells ABC Radio National's Law Report.
The AI information said Bernklau had confessed to the crime and was remorseful. Listen to the podcast
Informative, jargon-free stories about law reform, legal education, test cases, miscarriages of justice and legal culture.
But that's not all.
Microsoft's AI tool also described him as an escapee from a psychiatric institution, a con-man who preyed on widowers, a drug dealer and a violent criminal.
"They were all court cases I wrote about," Bernklau says.
The tool had conflated Bernklau's news reporting with his personal experience and it presented him as the perpetrator of the crimes he'd reported on.
It also published his real address and phone number, and a route planner to reach his home from any location.
When AI tools produce false results, it's known as an "AI hallucination".
Bernklau isn't the first to experience one. But his story is at the forefront of how the law and AI intersect."
Stallman refers to this as bullshit generator. Fitting.