I bought a datacenter GPU that doesn't fit in a normal motherboard, macgyvered the fan with jumper wires, and now I'm running a model that ties with Claude Sonnet 4.6 on benchmarks, all for £200.
Power consumption for AI is way higher than for games…your gpu is rarely at full usage when running a game, only really if you’re one of the few people that tries to get every single bit out of your game with the highest level graphics and even then you’re not using the full amount because the game would stutter. It doesn’t matter if an llm stutters. They use the full power of your gpu no matter what you’re doing.
And the models being trained on other models mean that local LLMs use more energy than a model like Claude. You have all the energy of multiple data centers training one model and then you go and train a model off of that.
Power consumption for AI is way higher than for games…your gpu is rarely at full usage when running a game, only really if you’re one of the few people that tries to get every single bit out of your game with the highest level graphics and even then you’re not using the full amount because the game would stutter. It doesn’t matter if an llm stutters. They use the full power of your gpu no matter what you’re doing.
And the models being trained on other models mean that local LLMs use more energy than a model like Claude. You have all the energy of multiple data centers training one model and then you go and train a model off of that.