eicker@lemmy.world to Technology@lemmy.worldEnglish · 3 days agoMistral and Mozilla are bringing open, private and multilingual AI to your web browser: a partnership to bring privacy, control and choice to people using AI to browse online.mistral.aiexternal-linkmessage-square104linkfedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkMistral and Mozilla are bringing open, private and multilingual AI to your web browser: a partnership to bring privacy, control and choice to people using AI to browse online.mistral.aieicker@lemmy.world to Technology@lemmy.worldEnglish · 3 days agomessage-square104linkfedilink
minus-squareCommanderCloon@lemmy.mllinkfedilinkEnglisharrow-up0·20 hours agoIssue is that local AI hog vram, are slow and small models. Or if you don’t have a compatible GPU, it uses the CPU which is even slower. If AI is the future, I really hope it’s local, but with the equipment people have at home, local AIs are a non-starter. IMO it’s enough to justify not shipping those AI features at all but I guess that’s where FF execs disagree.
Issue is that local AI hog vram, are slow and small models. Or if you don’t have a compatible GPU, it uses the CPU which is even slower.
If AI is the future, I really hope it’s local, but with the equipment people have at home, local AIs are a non-starter.
IMO it’s enough to justify not shipping those AI features at all but I guess that’s where FF execs disagree.