Do you host your own ML / AI / LLM? What do you use, and what do you use it for?

  • hendrik@palaver.p3x.de
    link
    fedilink
    English
    arrow-up
    4
    arrow-down
    2
    ·
    edit-2
    6 days ago

    Well, I don’t exactly host AI. But some of my software uses AI and/or machine learning. My photo gallery does face detection, I’ve installed text to speech and speech to text. My Home Assistant has a voice satellite (which is a poor-man’s Alexa because I lack the hardware to do voice recognition in realtime). And I also regularly try some large language models and chatbots. But I don’t have any real application (yet). And it’s slow without a proper GPU. So I’m more or less just messing around. Currently that’s with Ministral 3.