GolfFoxtrotLima@sh.itjust.works to Lemmy Shitpost@lemmy.world · 2 days agoWe don't have Squid Game at home, we have Poor People Game. And it is a game of waiting.lemmy.worldimagemessage-square14linkfedilinkarrow-up11arrow-down10file-textcross-posted to: [email protected]
arrow-up11arrow-down1imageWe don't have Squid Game at home, we have Poor People Game. And it is a game of waiting.lemmy.worldGolfFoxtrotLima@sh.itjust.works to Lemmy Shitpost@lemmy.world · 2 days agomessage-square14linkfedilinkfile-textcross-posted to: [email protected]
minus-squaresurewhynotlem@lemmy.worldlinkfedilinkarrow-up0·1 day agoHow’s the local LLM support on Linux with AMD? (Yes I could google, but I think people here would give more realistic answers at a more reasonable tech skill level)
minus-squareozymandias117@lemmy.worldlinkfedilinkEnglisharrow-up0·1 day agollama.cpp (and by extension Ollama) has a Vulkan backend now, which works fine for my usecases on AMD
How’s the local LLM support on Linux with AMD?
(Yes I could google, but I think people here would give more realistic answers at a more reasonable tech skill level)
llama.cpp (and by extension Ollama) has a Vulkan backend now, which works fine for my usecases on AMD