The AI boom has turned the standard profit margin model on its head, according to Apollo Chief Economist Torsten Slok—and it’s making the industry’s growth unsustainable.
Most people haven’t taken a top end frontier model, integrated it to a memory framework so it can save whatever information it wishes directly in context and save even more in a separate database that it can search with keywords to pull in to context temporarily.
You don’t need something like Claw or Claude Code with their extra dozen pages of coding specific system instructions. You can use a blank context window, explain the function calls for the memory framework, and give a complex task and complete autonomous control of it’s own memory system and free reign of the open internet to learn whatever it needs to accomplish it.
It’s insane to me to see people in tech who still hold on to that insistence that LLMs of today aren’t “really” AI. When you can send one message and the result is the AI running for hours on end researching, saving the information that seems necessary for the task in whichever type of memory each bit seems best to put in, hitting errors, debugging and researching to do so if needed, etc… that isn’t next token prediction.
And there’s a reason it’s the most well funded tech advancement ever and already such a huge part of the market. They want to replace human labor. We all know that. If they manage to do any of us honestly see all the billionaires and corporate leaders behind this saying: “Ok, we got it, guys! No one has to work any more. Now that that’s done we’re going to split all of our wealth and power evenly so all of humanity will live in paradise with all needs and wants met and free to spend their time doing whatever makes them happy.”
lol. But we do see news of AI inventing new viruses. And the people with all the money can pay humans to do that sort of thing as well. Say Elon Musk spends $100 billion using AI and human researchers in cutting edge labs to do gain of function research working to make an extremely deadly virus that transmits through humans quickly and easily but doesn’t live more than a day or so outside a host. And also to make a vaccine to keep people from catching it and cure those who have it in the early stages.
Once AI and robotics can take over labor and produce all the needs and wants of the wealthy, that’s the perfect use for those doomsday bunkers they all have. Vaccinate themselves, hide, and release it all over the world at once. Monitor the state of the world from their techy bunkers, and have fleets of drones deliver the vaccine and instructions once the bulk of humanity is dead.
Way less goods to produce, way less people, way less pollution and crowding and riffraff on the beaches. The bunker billionaires would control the AI that runs and makes everything, so they’d control everything. The poor survivors would have them to thank for sending out the cure they managed to make just in time to save anyone at all. They’re heroes and Gods and blah blah blah.
I don’t know if it would manage to succeed, but that doesn’t really make me feel better. I don’t put it past a lot of them to try. If they manage to replace enough of us they’re going to have to do something big to keep everyone from rioting. The only thing I don’t see them trying is sharing. :/
Yes it is. It’s elaborate. It’s repetitive. It’s a solid illusion. But is, fundamentally, token prediction. That’s all it is, just at a level impractical for humans to run at. I could do that math. It’s not hard. It’ll just take me years to get through a single layer. Hence a level of complexity that implies something magical like consciousness.
Source: data scientist
And there’s a reason it’s the most well funded tech advancement ever
Because some rich assholes wanted to get richer and the dream of AGI was close enough (even though it was never in reach) that they went rabid for the tech that would make them kings over us serfs forever.
once the bulk of humanity is dead
And then what? They live in paradise? For a year or two maybe before their machines inevitably break down? The “kill off humanity” conspiracy has never made sense from the capitalist angle. They want slaves not corpses. They’re huffing their own farts, but they know that these things can’t do everything needed to keep humanity going. And lording over robots isn’t nearly as fun as upping human suffering even if they could.
Yes it is. It’s elaborate. It’s repetitive. It’s a solid illusion. But is, fundamentally, token prediction. That’s all it is, just at a level impractical for humans to run at. I could do that math. It’s not hard. It’ll just take me years to get through a single layer. Hence a level of complexity that implies something magical like consciousness.
Calling what LLMs can accomplish today next token prediction is technically accurate, yes. In the same way it’s accurate to call the human brain a prediction machine. As data streams in from our senses it causes unconscious awareness, activating the chains concepts we’ve learned from past data to correlate with the data of the moment in order to predict what’s coming next.
When most people use terms like next token prediction they’re often trying to use it with an implication that it’s a simple thing and nothing big or important could grow out of it. That’s not the case. The fact that we can now study a global workspace in AI models that have been around for years is shocking. It’s already causing consternation in neuroscience and psychology researchers. Over the last several years we’ve insisted that AI cannot possibly share the most important aspects of the human mind, but one by one everything we pointed to in order to differentiate ourselves was shown by research to have a strikingly similar allegory in modern AI.
Because some rich assholes wanted to get richer and the dream of AGI was close enough (even though it was never in reach) that they went rabid for the tech that would make them kings over us serfs forever.
You genuinely believe that the researchers under tight NDA in the frontier labs agree with you on AGI not being anywhere near reach? Or do you think you have a deeper understanding of the topic?
If it doesn’t get to that, as soon as that thought begins to take hole the massive amount of money poured in to it will virtually evaporate over night. It would create a massive financial crisis and the most powerful companies, government bodies, and individuals would be extremely unhappy with the leaders of those labs and researchers who knew but gave no warning. Pushing for it without believing in it would be setting themselves up to be universally hated at best.
once the bulk of humanity is dead
And then what? They live in paradise? For a year or two maybe before their machines inevitably break down? The “kill off humanity” conspiracy has never made sense from the capitalist angle. They want slaves not corpses. They’re huffing their own farts, but they know that these things can’t do everything needed to keep humanity going. And lording over robots isn’t nearly as fun as upping human suffering even if they could.
There’s a huge difference between the bulk of humanity and the entirety of humanity. Saving .1% scattered through the world with a vaccine that was developed “just in time” to save anyone would give plenty of people to lord over who are grateful for the wonderful people who stepped in and helped save them, leave them in control of production with far less people in need of a share of that production, and reduce global emissions enough that it would likely help the environment recover from the damage we’ve caused in relatively short order.
I expect it to get really bad.
Most people haven’t taken a top end frontier model, integrated it to a memory framework so it can save whatever information it wishes directly in context and save even more in a separate database that it can search with keywords to pull in to context temporarily.
You don’t need something like Claw or Claude Code with their extra dozen pages of coding specific system instructions. You can use a blank context window, explain the function calls for the memory framework, and give a complex task and complete autonomous control of it’s own memory system and free reign of the open internet to learn whatever it needs to accomplish it.
It’s insane to me to see people in tech who still hold on to that insistence that LLMs of today aren’t “really” AI. When you can send one message and the result is the AI running for hours on end researching, saving the information that seems necessary for the task in whichever type of memory each bit seems best to put in, hitting errors, debugging and researching to do so if needed, etc… that isn’t next token prediction.
And there’s a reason it’s the most well funded tech advancement ever and already such a huge part of the market. They want to replace human labor. We all know that. If they manage to do any of us honestly see all the billionaires and corporate leaders behind this saying: “Ok, we got it, guys! No one has to work any more. Now that that’s done we’re going to split all of our wealth and power evenly so all of humanity will live in paradise with all needs and wants met and free to spend their time doing whatever makes them happy.”
lol. But we do see news of AI inventing new viruses. And the people with all the money can pay humans to do that sort of thing as well. Say Elon Musk spends $100 billion using AI and human researchers in cutting edge labs to do gain of function research working to make an extremely deadly virus that transmits through humans quickly and easily but doesn’t live more than a day or so outside a host. And also to make a vaccine to keep people from catching it and cure those who have it in the early stages.
Once AI and robotics can take over labor and produce all the needs and wants of the wealthy, that’s the perfect use for those doomsday bunkers they all have. Vaccinate themselves, hide, and release it all over the world at once. Monitor the state of the world from their techy bunkers, and have fleets of drones deliver the vaccine and instructions once the bulk of humanity is dead.
Way less goods to produce, way less people, way less pollution and crowding and riffraff on the beaches. The bunker billionaires would control the AI that runs and makes everything, so they’d control everything. The poor survivors would have them to thank for sending out the cure they managed to make just in time to save anyone at all. They’re heroes and Gods and blah blah blah.
I don’t know if it would manage to succeed, but that doesn’t really make me feel better. I don’t put it past a lot of them to try. If they manage to replace enough of us they’re going to have to do something big to keep everyone from rioting. The only thing I don’t see them trying is sharing. :/
Yes it is. It’s elaborate. It’s repetitive. It’s a solid illusion. But is, fundamentally, token prediction. That’s all it is, just at a level impractical for humans to run at. I could do that math. It’s not hard. It’ll just take me years to get through a single layer. Hence a level of complexity that implies something magical like consciousness.
Source: data scientist
Because some rich assholes wanted to get richer and the dream of AGI was close enough (even though it was never in reach) that they went rabid for the tech that would make them kings over us serfs forever.
And then what? They live in paradise? For a year or two maybe before their machines inevitably break down? The “kill off humanity” conspiracy has never made sense from the capitalist angle. They want slaves not corpses. They’re huffing their own farts, but they know that these things can’t do everything needed to keep humanity going. And lording over robots isn’t nearly as fun as upping human suffering even if they could.
Calling what LLMs can accomplish today next token prediction is technically accurate, yes. In the same way it’s accurate to call the human brain a prediction machine. As data streams in from our senses it causes unconscious awareness, activating the chains concepts we’ve learned from past data to correlate with the data of the moment in order to predict what’s coming next.
When most people use terms like next token prediction they’re often trying to use it with an implication that it’s a simple thing and nothing big or important could grow out of it. That’s not the case. The fact that we can now study a global workspace in AI models that have been around for years is shocking. It’s already causing consternation in neuroscience and psychology researchers. Over the last several years we’ve insisted that AI cannot possibly share the most important aspects of the human mind, but one by one everything we pointed to in order to differentiate ourselves was shown by research to have a strikingly similar allegory in modern AI.
You genuinely believe that the researchers under tight NDA in the frontier labs agree with you on AGI not being anywhere near reach? Or do you think you have a deeper understanding of the topic?
If it doesn’t get to that, as soon as that thought begins to take hole the massive amount of money poured in to it will virtually evaporate over night. It would create a massive financial crisis and the most powerful companies, government bodies, and individuals would be extremely unhappy with the leaders of those labs and researchers who knew but gave no warning. Pushing for it without believing in it would be setting themselves up to be universally hated at best.
There’s a huge difference between the bulk of humanity and the entirety of humanity. Saving .1% scattered through the world with a vaccine that was developed “just in time” to save anyone would give plenty of people to lord over who are grateful for the wonderful people who stepped in and helped save them, leave them in control of production with far less people in need of a share of that production, and reduce global emissions enough that it would likely help the environment recover from the damage we’ve caused in relatively short order.