I’m not an AI techie and I’m not well educated on LLMs/AI in general. The issue I’m having is the dichotomy between how people talk about it. I’ve heard completely opposite ends of the spectrum. From AI is quickly becoming advanced enough to threaten human society, all the way to its a glorified dictionary/search engine that can’t really do much of anything. I know Lemmy has a steep anti-AI slant. But, can someone talk about this in a way I can wrap my head around why the divide seems so big?
Ed Zitron’s podcast “Better Offline” recently talked about this. There is a small tech community called the Rationalists who believe AI super intelligence is inevitable and it will either accelerate humanity to new heights or kill off the species. These rationalists are actually a very prominent faction within tech and the AI industry. Apparently the language used within top AI firms is largely about the immense danger posed by AI super intelligence if any other group or company were to achieve it first. This creates an echo chamber that makes the people in the industry kind of lose their mind and misinterpret the capability of LLMs.
Everyone outside that faction recognizes that LLMs are just unreliable cloud software with limited use cases and that there’s no evidence LLMs could actually lead to any kind of intelligence.
A photocell that turns on a streetlamp after sundown, or when a dark cloud passes over the sun, is a kind of intelligence.
Got it. So plants are intelligent.
You’re starting to catch on…
@FRYD @Return_of_Chippy i love that the logic and reason guys’ next evolution is even less tethered to either
Aren’t they called TESCREALists or something? It’s like a mish-mash of pop culture and pseudo intellectual BS
My Problem is: Even if your take on AI is true, we give an unreliable piece of software access to the internet and more and more systems and infrastructure. Even if it is not a malicious AI, it can be so unreliable, it might kill us by incompetence. a Sme can be said about some presidents…
LLMs are not intelligent, they lack morals, knowledge, and intent. The only remote risk of extermination is if a company with absolute impunity and endless resources told an LLM to hack the nuclear weapons and if knowledge of how to do that was already published online and processed as training data.
LLMs cannot do anything new, they can only regurgitate information thats already been stolen.
Or if the military put an LLM in charge of nuclear weapons. But surely nobody would be stupid enough to do that!
That is simply counter-factual. LLMs can absolutely do things that have not been published before, and they can access knowledge that is not in their training data through RAG. Intelligence is debatable, but reasoning models can reliably imitate “thinking” to a degree, and recursive self-improvement might lead to an autonomous advancement of intelligence. That LLMs allegedly “only regurgitate information” is simply wrong.
You’re confusing morals, knowledge, intent, and intelligence with capability. An atomic bomb has no will of its own either.
idk, every atom bomb I’ve met has one purpose…
It won’t kill us as a species, but its use may lead to disasters that were unintended and didn’t need to happen. Much of the regulation in other industries is due to that kind of thing happening. Worse, the companies making them are trying to get regulation to curtail other parties development for economic advantage rather than regulation on use which will steer the entire industry.
As you say, every “scientifically based” industrial innovation / breakthrough has had the potential to cause new kinds of mayhem, and most of them did to some degree or another. Burning rivers and CO2 overload in the atmosphere spring to mind, but industrial “accidents” are part and parcel of industrial activity, always have been.
Same can be said of Homer Simpson manning the console at a nuclear power plant.
AI is a tool, irresponsible use of a tool is… irresponsible. Just like people puttting “not-self-driving” cars into “supervised driving assistance mode” and taking a nap at the wheel at 80mph.