OpenAI paired its Astra proof claims with Lean certificates and a public repository. That makes the results checkable, but it does not make the unreleased model or peer review disappear.
Ok, not sure I understand “AI is just a statistically typing monkey”? As far as I know AI simplified is just predicting what is statistically the most likely next word or is that wrong?
I mean sure the way it predicts is complicated and word vectors are fascinating etc but highly simplified its a statistically typing monkey?
It’s a “category error” like saying hydrodynamics are just quantum mechanics. It does not describe the complex emergent behavior and doesn’t really tell you anything. Or it’s like saying psychology is how the neurons and synapses connect with each and exchange signals and that is all - this would not explain the mental processes between a marmot and a human. So it’s not an accurate simplified description, just a description of the basic building blocks.
Ok, not sure I understand “AI is just a statistically typing monkey”? As far as I know AI simplified is just predicting what is statistically the most likely next word or is that wrong? I mean sure the way it predicts is complicated and word vectors are fascinating etc but highly simplified its a statistically typing monkey?
It’s a “category error” like saying hydrodynamics are just quantum mechanics. It does not describe the complex emergent behavior and doesn’t really tell you anything. Or it’s like saying psychology is how the neurons and synapses connect with each and exchange signals and that is all - this would not explain the mental processes between a marmot and a human. So it’s not an accurate simplified description, just a description of the basic building blocks.
Afaik nobody knows how LLMs actually think, we only know sort of how to train them. They are researching how LLMs think with an equivalent to MRI brain scanning: Vista do LLM-MRI Python module: a brain scanner for LLMs