I’m not an AI techie and I’m not well educated on LLMs/AI in general. The issue I’m having is the dichotomy between how people talk about it. I’ve heard completely opposite ends of the spectrum. From AI is quickly becoming advanced enough to threaten human society, all the way to its a glorified dictionary/search engine that can’t really do much of anything. I know Lemmy has a steep anti-AI slant. But, can someone talk about this in a way I can wrap my head around why the divide seems so big?
I was in machine learning for a bit, up until venture capitalists eviscerated research teams chasing ways to make money from it. While there’s definitely a degree of overhyping risks for investment, there are absolutely some real, tangible risks. But the dangers aren’t like skynet/terminator, its more of a slow decline in knowledge combined with an increase of predictive surveillance (https://arxiv.org/abs/1902.10739 as an example of why predictive surveillance should worry everyone)
Every mistake and error in token generation is getting confounded with human text, and being fed back as part of the training loop. Combined with the sheer amount of botting of the modern internet, you get a feedback loop of error being used to train, followed by output of that error dominating the next training cycle as bots drown out voices of the knowledgable. For some basic things it’s easy to see the error, but in any expert domain the ratio of bots to experts is large enough that expert knowledge won’t stay within the training distribution.
The more shit that leaks out of anthropic the clearer it is that place has become a cult
It’s good to see Doomsday Cults back in vogue. Too bad Robert Anton Wilson is not around.
So apparently we’re using up all our resources in order to create something that might kill us all.
Sounds like a fantastic idea.
I’m going to go cry now.
It’s what we do best after all
How will “AI kill us all”? I can see it creating harm and getting people out of jobs. But kill us??
How will “AI kill us all”? I can see it creating harm and getting people out of jobs. But kill us??
There are currently 120 dead Iranian schoolgirls as a result of AI targetting and it using 10 year old out of data data.
The IDF have been using AI for target selection in the Gaza war.
There’s been a story this week where AI was used by the US military in analysis of a Chinese cargo ship and concluded it was carrying nuclear weaponry components to Iran. The US military were planning on boarding the vessel which would be considered an act of war. Only a last minute analysis of the intelligence revealed it was false.
its not like the movies
Developing new viruses and deadly diseases that spread too fast to be cured. By enabling low cost sensors to resolve messy data for low cost high precision weapons. By eroding the skillset of humanity so that we just fail in a few generations. By accelerating how we were already killing ourselves.
I’m also looking for that answer
AI Could Fulfill Prophecies of Control in Revelation 13:15-18. Future Forecast Insights & Preparation
Revelation 13:15-18; -
15 "He was granted power to give breath to the image of the beast, that the image of the beast should both speak and cause as many as would not worship the image of the beast to be killed. 16 He causes all, both small and great, rich and poor, free and slave, to receive a mark on their right hand or on their foreheads, 17 and that no one may buy or sell except one who has the mark or the name of the beast, or the number of his name. 18 Here is wisdom. Let him who has understanding calculate the number of the beast, for it is the number of a man: His number is 666.”
The unthinkable eternal consequences of taking this Mark when eventually forced- Revelation 14:9-13 NKJV - And the third angel followed them, - Bible Gateway
Continue reading… https://www.reddit.com/r/agi/comments/1wl151v/ai_could_fulfill_prophecies_of_control_in/
Who let in the crazy?
AI isn’t a danger to humanity, per se. Humans abandoning their duties of being responsible stewards of systems is a genuine source of danger though.
We already have algorithmic abuse where people are subjugated by welfare and debt systems with little oversight or flexibility. Some organisations even breaking the law and going against their stated missions to achieve goals and maintain order.
Social murder is the concept that society can kill a person through stress, pressure, abandonment and indifference to the individuals struggles and needs. We’re seeing a lot of it today with the declining health of younger people being especially alarming.
AI can scale the two things I’ve mentioned beyond limits set by current bureaucratic systems, I.e. the slowness of people running a system. Systems which already kill and harm people without AI. The small erroneous tendencies of logic and algorithms in systems will be scaled up, further and faster. AI can enable algorithmic abuse and social murder on scales comparable to mass murder.
Were definitely in the worse timeline of dominant reactions to this story.
First, you are completely right to mistrust the bond villains and politicians for all prescription/solutions to this problem.
The experts and their bond villain bosses warning of a danger is something you should believe is a danger. Those telling to invest $Ts because there is no danger are the bigger liars. Still, the bond villains continue training full speed, and have $Bs in budgets to do harm with models 1 year ahead of public releases, and their “freedom loving angel government” will pay them $Ts to help oppress Americans, and kill/oppress rest of world.
It is outright suicidal to dismiss the power of these tools by comparing it to an AGI stawman status, and suicidal to think any publicly discussed solutions have any tangential relationship to diminishing the real dangers. Guardrails/killswitches on public released models is security theater relative to the real threats to us all.
Making the world a better place to live by making your nation a better place to live, that creates an arm race of prosperity and better governance is the only path to saving humanity, because LLMs/AI/automation are out of the bag and will continue their improvement. Governments that pursue geopolitical supremacy by throwing all of your money at them is them purposefully harming you. https://naturalfinance.blogspot.com/2026/09/a-global-prosperity-manifesto.html
AI industry makes money from doomsday prophecy about it being so intelligent that it will create a point of no return: the [singularity]. It is a magaian claim, a claim that is so increadibly stupid that one does not know where to even begin; and if you do begin, you’ve already lost, because you have given attention to the claim. Lets not give these stupid fucks attention.
AI is not dangerous because of the [singularity]. It is dangerous because of its power consumption, automation of war, turning everybody to unthinking, surveillance automation, burning books, the economic instability it will cause due to the bubble bursting, water consumption, destroying the internet, it gaining responsibilities it is not qualified to take and so on.
But we can see how the story of the [singularity] and similar stories helps AI companies, because now, instead of criticizing real unwellnesses, we criticize a fictional unwellness that generates discussion regardless of our positions. It is a conversational black hole.
lets get back to the real world
Also, there’s the whole harry potter fanfic sex ai doomsday cult thing
If someone stands to benefit financially from the idea their AI is so powerful that is scary, they’re probably going to bullshit about how powerful it is
Which in turn has a prophetic effect of them getting more money, AI using more resources, and pushing everything worse.
Everytime I see an article about the dangers of AI, I’m thinking of some version of this comic every single time.
And the reason it is dangerous is generally because someone is convinced that Ai models are not as shown above.
i think ai is a problem because its stupid and trusted with everything
Yes.
If you have a functioning brain, LLM’s are just a really fancy text generator that gets facts correct about 50% of the time and can be useful for writing emails if you spend the time to proofread the email before slapping the send button. It’s also fairly good at generating functional boilerplate for programming projects. Really handy for small projects. However, LLM code, in my rather limited experience, quickly becomes a trap on more complex projects because the LLM has no capacity to grasp the scope of a project and frequently leads to spaghetti code that is utterly unmanageable. This may be operator error on my part, or just because I’m using local models that are limited by my machine.
The rest of society view a computer as a magic box where their favorite TikTok’s live, and thus are terrified that a machine can imitate human language well, and are too brain rotted to bother proofreading or fact checking a goddamn thing, so they assume LLM’s can accurately and plainly articulate the whole of human knowledge to you at a whim.
I am at a point where if I hear anyone saying how smart “AI” is, I just assume they have a room temperature IQ and lack any critical thinking skills whatsoever. It’s not an AI, it lacks any intelligence whatsoever. An LLM simply generates sentences based on what was fed to it. It has no capacity to understand the words it’s saying. It just knows that based on these tokens, the next set of tokens should be X, Y, and Z. It’s a Chinese room, It’s fucking autocorrect on crack. It’s a waste of time and resources for 90% of things it’s used for.
it’s pretty disrupting tech, not without risk. general population is behind on the real capabilities of AI and tech companies are doing smart marketing which gives a big spread in perception.
They want regulation to create a cartel. Failing that they want hysteria to increase pre IPO valuations.
As Patrick Boyle said. It would be like Coca Cola, Pepsi and Irn Bru getting together to beg for regulations because their soft drinks are just too delicious.
What’s going to happen is:
- The big players know that the token pricing crisis is coming up.
- When the price increases hit, regular users are going to scramble for alternatives.
- Local models will be an attractive alternative for many users. The cost of hardware and energy will constrain local model power, but many will be willing to live with it.
- So these would-be cartel members want to hit the local and open weight models with the “safety” card. Otherwise they might be holding the bag on all of those data centers.
“You see, it’s just too dangerous to humanity to experiment with AI at home. You need to use a safe provider like Open AI.”
eventually someone’s just gonna sell cloud computing at a competitive price through a free model and obliterate anthropic and openai. it’ll be like ISP, AOL was the hottest company in the world at one point with a “locked down ecosystem” and now it’s just a tiny brand with a tiny but loyal customer base of senior citizens.
Isn’t that what Mistral is kinda pivoting towards? I think they now also host third-party models. That’s essentially providing cloud computing for open-source models. Not entirely sure.
No matter how often I read this kind of stuff, I simply don’t buy the ‘AI is dangerous for humanity!! We gotta stop their development or at least press for sane guardrails!!!’ narrative.
Yea, people are a danger to humanity, the ways we adopt and use AI will be a danger to humanity. I also think it’s mostly a media stunt. All the tech nerds know it incredibly dangerous. So is wealth concentration and the wealthy people that want to use it. So ya i propose we nationalize the top .1%'s asset and keep them away from the stuff.
