minus-squareteslasdisciple@lemmy.catoSelfhosted@lemmy.world•1U mini PC for AI?linkfedilinkEnglisharrow-up13·1 day agoI’m running ai on an old 1080 ti. You can run ai on almost anything, but the less memory you have the smaller (ie. dumber) your models will have to be. As for the “how”, I use Ollama and Open WebUI. It’s pretty easy to set up. linkfedilink
minus-squareteslasdisciple@lemmy.catoSelfhosted@lemmy.world•1U mini PC for AI?linkfedilinkEnglisharrow-up1arrow-down1·1 day agodeleted by creator linkfedilink
minus-squareteslasdisciple@lemmy.catoTechnology@lemmy.world•President Trump threatened to break up Nvidia, didn't even know what it was — 'What the hell is Nvidia? I've never heard of it before'linkfedilinkEnglisharrow-up72arrow-down1·1 month agoWait until he learns they make chips. I can totally see him saying if Lay’s can make chips in the US then why can’t nvidia? linkfedilink
I’m running ai on an old 1080 ti. You can run ai on almost anything, but the less memory you have the smaller (ie. dumber) your models will have to be.
As for the “how”, I use Ollama and Open WebUI. It’s pretty easy to set up.