Yeah, the LLM and picture generation bubble will burst but that isn’t ‘AI’, it’s a tiny subset of tasks that happen to be easy to train because the companies involved have helped themselves to all of the text and images created by humanity.
The other uses of AI are harder to train, because we don’t have centuries worth of robotic motion data or a YouTube of folded protein data. Those are the uses that will have the most impact in the future, as they are developed.
LLMs are the only thing that is hyped. The other models and applications have existed already back when ChatGPT first hit the public and they have not had any special break through that would explain exponential growth in investment or a need for compute power. Language models had that with the transformer structure, everything else just develops iteratively.
The bubble we see now is because of language models and we can try and conflate it with other deep models and call it all AI, but it doesn’t change the fact that the generative models are the only ones requiring these resources and are looking for a problem to solve.
Yeah, the LLM and picture generation bubble will burst but that isn’t ‘AI’, it’s a tiny subset of tasks that happen to be easy to train because the companies involved have helped themselves to all of the text and images created by humanity.
The other uses of AI are harder to train, because we don’t have centuries worth of robotic motion data or a YouTube of folded protein data. Those are the uses that will have the most impact in the future, as they are developed.
LLMs are a bubble, AI is not.
LLMs are the only thing that is hyped. The other models and applications have existed already back when ChatGPT first hit the public and they have not had any special break through that would explain exponential growth in investment or a need for compute power. Language models had that with the transformer structure, everything else just develops iteratively.
The bubble we see now is because of language models and we can try and conflate it with other deep models and call it all AI, but it doesn’t change the fact that the generative models are the only ones requiring these resources and are looking for a problem to solve.