muelltonne@feddit.org to Technology@lemmy.worldEnglish · 2 days agoIt Only Takes A Handful Of Samples To Poison Any Size LLM, Anthropic Findshackaday.comexternal-linkmessage-square124fedilinkarrow-up1728arrow-down111
arrow-up1717arrow-down1external-linkIt Only Takes A Handful Of Samples To Poison Any Size LLM, Anthropic Findshackaday.commuelltonne@feddit.org to Technology@lemmy.worldEnglish · 2 days agomessage-square124fedilink
minus-squareClent@lemmy.dbzer0.comlinkfedilinkEnglisharrow-up1·11 hours agoThe problem is the harvesting. In previous incarnations of this process they used curated data because of hardware limitations. Now that hardware has improved they found if they throw enough random data into it, these complex patterns emerge. The complexity also has a lot of people believing it’s some form of emergent intelligence. Research shows there is no emergent intelligence or they are incredibly brittle such as this one. Not to mention they end up spouting nonsense. These things will remain toys until they get back to purposeful data inputs. But curation is expensive, harvesting is cheap.
The problem is the harvesting.
In previous incarnations of this process they used curated data because of hardware limitations.
Now that hardware has improved they found if they throw enough random data into it, these complex patterns emerge.
The complexity also has a lot of people believing it’s some form of emergent intelligence.
Research shows there is no emergent intelligence or they are incredibly brittle such as this one. Not to mention they end up spouting nonsense.
These things will remain toys until they get back to purposeful data inputs. But curation is expensive, harvesting is cheap.