The whole thing was based on ruthless extrapolation. LLM do better with more compute, so keep throwing compute at it until you’re in free money land. The last hurrah for Silicon Valley as they’re all out if ideas now.
LLMs do better with more compute, but it’s logarithmic.
They raced up the soft part of the curve, thinking it was the start of an exponential.
I think that’s the core issue; they bet a trillion dollars expecting compounding returns, and got diminishing ones.
If I were an employee/shareholder, I’d have been happy to hear the first part of his message (“oh good he finally gets it”) and then miserable again when he says he does believe the singularity will happen, just in 3-6 months.
Yeah, that’s the ruthless extrapolation. It’s like plotting the air speed of planes from Wright brothers to Concorde, continue drawing the line going upward and conclude that by 2026 you’ll go from Paris to New York in five minutes. It never works like that.
The whole thing was based on ruthless extrapolation. LLM do better with more compute, so keep throwing compute at it until you’re in free money land. The last hurrah for Silicon Valley as they’re all out if ideas now.
LLMs do better with more compute, but it’s logarithmic.
They raced up the soft part of the curve, thinking it was the start of an exponential.
I think that’s the core issue; they bet a trillion dollars expecting compounding returns, and got diminishing ones.
If I were an employee/shareholder, I’d have been happy to hear the first part of his message (“oh good he finally gets it”) and then miserable again when he says he does believe the singularity will happen, just in 3-6 months.
Yeah, that’s the ruthless extrapolation. It’s like plotting the air speed of planes from Wright brothers to Concorde, continue drawing the line going upward and conclude that by 2026 you’ll go from Paris to New York in five minutes. It never works like that.