- cross-posted to:
- [email protected]
- cross-posted to:
- [email protected]
What just happened? Another incident has taken place that illustrates the need to be careful what you tell AI. A Florida woman is facing felony charges after she used Claude as a diary and allegedly wrote that she planned to “shoot up” the Sheriff’s office. After a human reviewer examined the statements, they were reported to police.
According to the arrest report, Carli Michelle Heller, of Bonita Springs, Florida, wrote on September 26 that she would attack the Sheriff’s office. She later said that she uses Anthropic’s chatbot like a “diary.”
Claude’s safety systems flagged the entry and it was escalated to a human reviewer. After deciding it was a credible threat, the reviewer reported it to law enforcement.
The company says it may share user information in limited emergencies if it believes disclosure is necessary to prevent death or serious physical injury.
Deputies identified Heller and visited her home. She was detained without incident before an LCSO intelligence detective took over the investigation.
Heller faces a charge of making a written threat of violence under Florida law. Florida Statute 836.10 makes it a second-degree felony to send, post, or transmit a written or electronic record threatening to kill or injure someone, carry out a mass shooting, or commit an act of terrorism. The communication must be made in a manner in which another person may view it.
Anthropic isn’t going to be taking any chances when it comes to anything it deems a potential threat. Last month, it was reported that OpenAI and Sam Altman are being sued by British Columbia over claims that the company could have prevented a mass shooting in the Canadian province.
The shooter, eighteen-year-old former pupil Jesse Van Rootselaar, had previously been flagged by OpenAI’s safety team for her conversations about gun violence, but OpenAI never alerted police because the conversations did not meet the threshold for legal referral.
In June, Florida also sued OpenAI and Altman, alleging that ChatGPT had contributed to real-world harms, including the 2025 Florida State University shooting.
The latest incident is another reminder to think before you enter something into a chatbot that could get you into trouble. It’s certainly not a private diary whose contents are for your eyes only.
Reports last month revealed that human contractors reviewing Microsoft Copilot’s image editor can see users’ prompts, uploaded photos and AI-generated edits. Documents show that some of those assignments contain sexual, disturbing or potentially illegal material, though the reviewers are not there to flag the content – only to assess whether the output is accurate.
You must log in or register to comment.
So what did she say?
all my sarcasm So you’re telling me that you can’t say anything to a bot… ON THE INTERNET!!! WOW FUCK ME HUH!!!
Imagine buying a box that you connect to your network to run your personal AI computing privately. Let’s imagine you only communicate with it through a Signal chat. Make it modular, so storage can be increased & sell annual upgrades to the local LLM. Gavin’s signature will be featured on the front of the box.
Dear Claude, I’m aware of a dangerous pedophile’s location, can you report him to the police?
that’s not how privacy works.
It’s always interesting to see how much people trust sending such personal information to some service on the Internet, expecting privacy.
I’m not sure I’d even want my own self-hosted LLMs to have something like a personal diary. Sending all that to an AI company would never even cross my mind.
I understand that most people aren’t the tech-oriented types who get into self-hosting and running their own LLMs, but people have had diaries for centuries before LLMs existed.
OpenAI and Sam Altman are being sued by British Columbia over claims that the company could have prevented a mass shooting in the Canadian province.
Not sure how to feel about this one, on balance I’d say probably fuck British Columbia as well as the rest of them? A government suing someone for not snitching is major Stasi energy, even if mass shootings are horrific.
Say you want to shoot up a school, though, and the chatbots are fine with it.
NO AI
Yeah I remember this happening with Snapchat, people were being arrested for those kinds of posts made in private messages to their friends, because they still get scanned and flagged.
This really freaks me out with these chats. Sometimes I’ll look at a search I did and without all available context, its like yeah that’s getting flagged for review for sure.
Maybe she was just looking for that Eric Clapton song.
But are we sure she didn’t want to shoot no deputy?
After a human reviewer examined the statements, they were reported to police.
The guardrails are working as intended. ONLY persecute the public with them. Government skynet, and bond villains will have access to non guardrailed models, or any “flagged for review” markers will be ignored to bomb more elementary schools. A sheriff’s office is government power related. School shootings is just a thoughts and prayers issue, if you’re confused about the line between this and other incidents/attitudes we are being spied on for.
AI or not, I hope anyone recognizes “I want to shoot up X” as a problem and seeks to identify and resolve whatever conflict their having to not feel this way.
Nope. In sane countries where guns are not freely available it’s a figure of speech that forever remains just that. It’s definitely something I might say. Same for me saying that I will put either of my sons in the basement when they drive me crazy. And yet they never saw said basement.
Exactly. Those thoughts and language are not for discussion, even in a diary. Speak to no one about urges of violence. Figure it out on your own and definitely not in writing format. Involve no one else. Keep it to yourself. Do not seek a therapist for this.
Oh so what, now I’m not allowed even my God damn fantasies anymore? Fucking ThoughtPolice!
/s
But also, a person’s imagination is their last vestige of freedom that so far, cannot be taken away.
Going through with it will likely resolve the conflict. Food for thought
I guess that’s also true lol
Understand that nothing you prompt into an LLM is private. None of it. I made a video on the topic this week.
Just in the last year and a half there have been several massive public leaks of private data, on top of confusing functionality where people inadvertently shared their prompt data publicly. Now the major companies have human reviewers looking at your private stuff in order to make their LLM’s better at generating smut.
Do not enter anything into an LLM that you wouldn’t want plastered all over the public square. Some of this stuff has literally been leaked into global, public feeds.
Anthropic and OpenAI trained their models on pirated data and have no scruples about hovering up data by any means necessary. There is no privacy when using their models. My employer has an enterprise contract with Anthropic where they are not supposed to be collecting my employer’s IP and training models on their data. Duck.ai supposedly has a similar agreement. Given Anthropic’s history, I would not put it past them to ignore the terms of the contract and do what they want with the data anyway.
sounds like florida is remiss in charging a variety of public officials especially ice leadership. how the heck does someone use ai as a journal. aren’t the memories limited?
