Which hardware is for running local models that is cheap? I was not looking at GPU market for around two years, because I thought everything got expensive through the roof.
Nothing consumer grade - I’m talking about nVidia DGX.
$6k for the cheapest might seem expensive to a lot of people, but for an engineer with stupid amounts of data and a 1.2kW power draw, it’s insanely affordable from corporate perspectives.
Which hardware is for running local models that is cheap? I was not looking at GPU market for around two years, because I thought everything got expensive through the roof.
Nothing consumer grade - I’m talking about nVidia DGX.
$6k for the cheapest might seem expensive to a lot of people, but for an engineer with stupid amounts of data and a 1.2kW power draw, it’s insanely affordable from corporate perspectives.
Depending on what you’re looking at, a Mac Studio might be the most bang for your buck. They have much higher memory bandwidth than the DGX Spark