silence7@slrpnk.net to Technology@lemmy.worldEnglish · 1 day agoAI’s Memorization Crisis | Large language models don’t “learn”—they copy. And that could change everything for the tech industry.www.theatlantic.comexternal-linkmessage-square46fedilinkarrow-up1215arrow-down111
arrow-up1204arrow-down1external-linkAI’s Memorization Crisis | Large language models don’t “learn”—they copy. And that could change everything for the tech industry.www.theatlantic.comsilence7@slrpnk.net to Technology@lemmy.worldEnglish · 1 day agomessage-square46fedilink
minus-squareTechnus@lemmy.ziplinkfedilinkEnglisharrow-up25arrow-down2·22 hours agoIt’s glorified autocorrect (/predictive text). People fight me on this every time I say it but it’s literally doing the same thing just with much further lookbehind. In fact, there’s probably a paper to be written about how LLMs are just lossily compressed Markov chains.
It’s glorified autocorrect (/predictive text).
People fight me on this every time I say it but it’s literally doing the same thing just with much further lookbehind.
In fact, there’s probably a paper to be written about how LLMs are just lossily compressed Markov chains.