themachinestops@lemmy.dbzer0.com to Technology@lemmy.worldEnglish · 12 hours agoScientist says RAM pricing has risen to normalized 2007 levels, AI shortage undid 20 years of progress in a matter of months — memory prices had been falling exponentially for decadeswww.tomshardware.comexternal-linkmessage-square48fedilinkarrow-up1255arrow-down15 cross-posted to: [email protected]
arrow-up1250arrow-down1external-linkScientist says RAM pricing has risen to normalized 2007 levels, AI shortage undid 20 years of progress in a matter of months — memory prices had been falling exponentially for decadeswww.tomshardware.comthemachinestops@lemmy.dbzer0.com to Technology@lemmy.worldEnglish · 12 hours agomessage-square48fedilink cross-posted to: [email protected]
minus-squarejaschen306@sh.itjust.workslinkfedilinkEnglisharrow-up1·3 hours agoYou are Mr. moneybags or you’re running 2 or 4bit quantized.
minus-squarebrucethemoose@lemmy.worldlinkfedilinkEnglisharrow-up2·edit-255 minutes agoI have a 3090, 7800, and 128GB ram from pre-rampocalypse. It’s not nothing, but there are definitely crazier home labs. Deepseek V4 is native 4 bit. I am running this quant, but the quantization loss is measurably low: https://huggingface.co/Downtown-Case/DeepSeek-V4-Flash-0731-128GB-RAM-IK-GGUF The native MXFP4 is only a bit bigger.
You are Mr. moneybags or you’re running 2 or 4bit quantized.
I have a 3090, 7800, and 128GB ram from pre-rampocalypse. It’s not nothing, but there are definitely crazier home labs.
Deepseek V4 is native 4 bit.
I am running this quant, but the quantization loss is measurably low: https://huggingface.co/Downtown-Case/DeepSeek-V4-Flash-0731-128GB-RAM-IK-GGUF
The native MXFP4 is only a bit bigger.