• paraproto@szmer.info
    link
    fedilink
    English
    arrow-up
    0
    ·
    14 days ago

    Which hardware is for running local models that is cheap? I was not looking at GPU market for around two years, because I thought everything got expensive through the roof.

    • peopleproblems@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      14 days ago

      Nothing consumer grade - I’m talking about nVidia DGX.

      $6k for the cheapest might seem expensive to a lot of people, but for an engineer with stupid amounts of data and a 1.2kW power draw, it’s insanely affordable from corporate perspectives.

      • meme_historian@lemmy.dbzer0.com
        link
        fedilink
        English
        arrow-up
        0
        ·
        14 days ago

        Depending on what you’re looking at, a Mac Studio might be the most bang for your buck. They have much higher memory bandwidth than the DGX Spark