minus-squareBrett@programming.devtoTechnology@lemmy.world•Generative AI Is an Engineering Disaster. A shockingly inefficient trillion-dollar project.linkfedilinkEnglisharrow-up3·1 day agoIs that quantized? 4 bit Qwen 3.6 can get 22tps on a 1060. linkfedilink
Is that quantized? 4 bit Qwen 3.6 can get 22tps on a 1060.