Do you host your own ML / AI / LLM? What do you use, and what do you use it for?

  • SuspiciousCarrot78@aussie.zoneOP
    link
    fedilink
    English
    arrow-up
    1
    ·
    18 hours ago

    That’s impressive and probably within reach of most serious home labs.

    I quite like MiMo and I agree with your assessment of its capability.

    • brucethemoose@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      14 hours ago

      Mind you, I’m running Mimo, not the big Mimo Pro.

      But yeah. I really like the model, even for one of its size. And it hardly feels quantized as a trellis quant.