Do you host your own ML / AI / LLM? What do you use, and what do you use it for?

  • tristynalxander@mander.xyz
    link
    fedilink
    English
    arrow-up
    1
    ·
    2 hours ago

    It’s not that hard to use llama.cpp directly anyway. Why would I use a wrapper when I can just run a python script?