• humanspiral@lemmy.ca
    link
    fedilink
    English
    arrow-up
    0
    ·
    14 days ago

    Confusing headline/article. Darkbloom does not serve proprietary models. It is competitive for smaller models. best price for qwen 3.8 27b.

    The actual competition problem is from deepseek which has open sourced its inference server architecture on Nvidia (and Huawei) datacenter cards, and deepseek v4.1 flash is one of the best combos of good, fast, cheap. But it needs a mac ultra for q4, and datacenters much faster/cheaper with batch service. Qwen 4 is coming out next week with 2 good models that fit under 128gb.

    • boonhet@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      0
      ·
      13 days ago

      As I understand, only Qwen 4 27B is known for sure to come out as open weight, Max and Plus are API-only anyway and it’s suspected that so is Flash. Makes sense tbh, they’ve established their position in the market, now it’s time to stop giving people better and better models they can run locally. It eats into their profits.

    • Diurnambule@jlai.lu
      link
      fedilink
      English
      arrow-up
      0
      ·
      14 days ago

      Qwen 4 next week ? Got info on this ? I just managed to make glm 5.3 flash run on my system.