OpenAI paired its Astra proof claims with Lean certificates and a public repository. That makes the results checkable, but it does not make the unreleased model or peer review disappear.
The current examples of AI could never be described as a general intelligence let alone Superintelligence. These LLMs are definitely just a typing monkey (that was eloquently put).
They are literally generating text word by word with a next-word-prediction methodology.
With some tweaking they can be made to produce mostly coherent code and apparently also equations that balance. This does not make these algorithms geniuses. A calculator can also balance an equation, so that alone is not impressive.
The techniques LLM designers use to leverage statistical models in order to generate coherent sentences are actually rather impressive. It is legitimately quite a feat to make LLMs work as well as they do. But that does not mean that these outputs are anything like “thinking”, they’re just outputs. Data goes in, the machine churns, does some mystery math, and different data comes out.
Ok, not sure I understand “AI is just a statistically typing monkey”? As far as I know AI simplified is just predicting what is statistically the most likely next word or is that wrong?
I mean sure the way it predicts is complicated and word vectors are fascinating etc but highly simplified its a statistically typing monkey?
It’s a “category error” like saying hydrodynamics are just quantum mechanics. It does not describe the complex emergent behavior and doesn’t really tell you anything. Or it’s like saying psychology is how the neurons and synapses connect with each and exchange signals and that is all - this would not explain the mental processes between a marmot and a human. So it’s not an accurate simplified description, just a description of the basic building blocks.
Holy shit. If an AI actually solves a Millennium Prize Problems we’re seriously entering superintelligence (but not AGI) territory.
In any case this should disprove the “AI is just a statistically typing monkey” theorem some AI skeptics are fond of.
The current examples of AI could never be described as a general intelligence let alone Superintelligence. These LLMs are definitely just a typing monkey (that was eloquently put).
They are literally generating text word by word with a next-word-prediction methodology.
With some tweaking they can be made to produce mostly coherent code and apparently also equations that balance. This does not make these algorithms geniuses. A calculator can also balance an equation, so that alone is not impressive.
The techniques LLM designers use to leverage statistical models in order to generate coherent sentences are actually rather impressive. It is legitimately quite a feat to make LLMs work as well as they do. But that does not mean that these outputs are anything like “thinking”, they’re just outputs. Data goes in, the machine churns, does some mystery math, and different data comes out.
These systems are not worth anthropomorphizing.
Ok, not sure I understand “AI is just a statistically typing monkey”? As far as I know AI simplified is just predicting what is statistically the most likely next word or is that wrong? I mean sure the way it predicts is complicated and word vectors are fascinating etc but highly simplified its a statistically typing monkey?
It’s a “category error” like saying hydrodynamics are just quantum mechanics. It does not describe the complex emergent behavior and doesn’t really tell you anything. Or it’s like saying psychology is how the neurons and synapses connect with each and exchange signals and that is all - this would not explain the mental processes between a marmot and a human. So it’s not an accurate simplified description, just a description of the basic building blocks.
Afaik nobody knows how LLMs actually think, we only know sort of how to train them. They are researching how LLMs think with an equivalent to MRI brain scanning: Vista do LLM-MRI Python module: a brain scanner for LLMs
Just to be clear.
But yeah, if that happens, it will certainly be a major milestone.
Nothing can disprove that to that crowd, I’m afraid.
They think the problem is AI, when it’s actually capitalism and securities fraud.
It’s much simpler to fixate on the technology than to have to understand complex things like economics and history.