SuspiciousCarrot78@aussie.zone to

Selfhosted@lemmy.worldEnglish · 19 hours ago

Do you host your own AI?

98

Do you host your own AI?

SuspiciousCarrot78@aussie.zone to

Selfhosted@lemmy.worldEnglish · 19 hours ago

Do you host your own ML / AI / LLM? What do you use, and what do you use it for?

Chat

brucethemoose@lemmy.world
link
fedilink
English
arrow-up
1·
edit-2
3 hours ago
Or exllama! Vllm, sglang, Lorax. Koboldcpp, Aphrodite, text-generation-webui, LM Studio, powerinfer, ktransformers, mlc-LLM, really whatever floats your boat. Just not ollama, specifically.

Selfhosted@lemmy.world

selfhosted@lemmy.world

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: [email protected]

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don’t control.

Rules:

Be civil: we’re here to support and learn from one another. Insults won’t be tolerated. Flame wars are frowned upon.
No spam.
Posts here are to be centered around self-hosting. Please ensure it is clear in your post how it relates to self-hosting.
Don’t duplicate the full text of your blog or git here. Just post the link for folks to click.
Submission headline should match the article title.
No trolling.
Promotion posts require your active participation in selfhosting or related communities, or the post will be removed. No more than 10% of your posts or comments may be self-promotional, or your post will be removed. F/LOSS Exception: If your post is about a project that is completely open source & can be self-hosted in full without payment, your post is exempt from this rule as long as you continue to engage in comments.

Resources:

selfh.st Newsletter and index of selfhosted software and apps
awesome-selfhosted software
awesome-sysadmin resources
Self-Hosted Podcast from Jupiter Broadcasting

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

961 users / day
2.86K users / week
6.95K users / month
16.5K users / 6 months
1 local subscriber
60.1K subscribers
5.22K Posts
125K Comments
Modlog