Platform and systems Architect for a german managed Services provider here.
I second that. Currently, I am working on replacing external AI providers with 150W AMD hardware. Most of our teams used LLMs for stuff where classical ML is far more reliable and faster.
The few places where LLMs are needed, we still can do locally.
So, instead of spending millions in some tokens that take gigawatt of Power, we estimate that our 5k employees will need a total power of 5kw across Europe. We have 100x the solar distributed across our locations.
We conflate LLM or Diffusion with AI here, because most had never contact with other kinds of AI.
Platform and systems Architect for a german managed Services provider here.
I second that. Currently, I am working on replacing external AI providers with 150W AMD hardware. Most of our teams used LLMs for stuff where classical ML is far more reliable and faster.
The few places where LLMs are needed, we still can do locally.
So, instead of spending millions in some tokens that take gigawatt of Power, we estimate that our 5k employees will need a total power of 5kw across Europe. We have 100x the solar distributed across our locations.
We conflate LLM or Diffusion with AI here, because most had never contact with other kinds of AI.