themachinestops@lemmy.dbzer0.com to Technology@lemmy.worldEnglish · 12 hours agoScientist says RAM pricing has risen to normalized 2007 levels, AI shortage undid 20 years of progress in a matter of months — memory prices had been falling exponentially for decadeswww.tomshardware.comexternal-linkmessage-square48fedilinkarrow-up1256arrow-down15 cross-posted to: [email protected]
arrow-up1251arrow-down1external-linkScientist says RAM pricing has risen to normalized 2007 levels, AI shortage undid 20 years of progress in a matter of months — memory prices had been falling exponentially for decadeswww.tomshardware.comthemachinestops@lemmy.dbzer0.com to Technology@lemmy.worldEnglish · 12 hours agomessage-square48fedilink cross-posted to: [email protected]
minus-squareThomasWilliams@lemmy.worldlinkfedilinkEnglisharrow-up1·1 hour agoLower inference costs will lead to more demand for RAM
minus-squarebrucethemoose@lemmy.worldlinkfedilinkEnglisharrow-up2·1 hour agoWill it though? I posit there’s a saturation point where there’s “enough” LLM in use, and we are not far from that. The whole pitch from Altman and such is scaling models up. But that’s not working.
Lower inference costs will lead to more demand for RAM
Will it though?
I posit there’s a saturation point where there’s “enough” LLM in use, and we are not far from that.
The whole pitch from Altman and such is scaling models up. But that’s not working.