While you’re at it, would you mind implementing good braille support for wayland?

NixOS just sits on your face. All the stuff in front of you is awesome. Though you might suffocate at any moment given the options. Oh and sticking your nose too deep into things might get you a broken nose.

Thanks for the writeup! So far I’ve been using ollama, but I’m always open for trying out alternatives. To be honest, it seems I was oblivious to the existence of alternatives.

Your post is suggesting that the same models with the same parameters generate different result when run on different backends?

I can see how the backend would have an influence hanfling concurrent api calls, ram/vram efficiency, supported hardware/drivers and general speed.

But going as far as having different context windows and quality degrading issues is news to me.

Is there an inherent benefit for using NVLINK? Should I specifically try out Aprodite over the other recommendations when having 2x 3090 with NVLINK available?

yes: sntx.space, check out the spurce button in the bottom right corner.

I’m building/running it the homebrewed-unconventional route. That is I have just a bit of html/css and other files I want to serve, then I use nix to build that into a usable website and serve it on one of my homelab machines via nginx. That is made available through a VPS running HA-Proxy and its public IP. The Nebula overlay network (VPN) connects the two machines.

So, you’re saying that people driving automatic cars crash more often than manual transmission drivers?

(Ignore the people that shift into reverse at 180km/h)

This might very well become a setting for an upcoming P&P Campaign from me.

The hook: You have been mysteriously receiving packets by a host calling itself <the-connochaetes>. The packets hint at the existence of an “ΛℵϚ∃⌊ζ” cult running large scale brainwashing schemes. Will you heed the call and free the world? Or will you use the chace to increase your influence? It all starts with you joining this IRC: <REDACTED>

I recommend the arkenfox/user.js repo and wiki .

I’ve looked into the same, sad it’s not viable yet…

Well it’d need declarative configuration IMO, so maybe something like tvix would need to be integrated first. That could also get us to being DSL agnostic.

Bur damn, RedoxOS (impl) is sexy.

If you’re lucky, you only gave to have the software installed - but not running.

One well rounded package that doesn’t need a complicated config or possibly unmaintained plugins.

ooh, nice!

I’ve just red up on Tvix and looked at a few discussions regarding the post-drama work.

Would you mind pointing me towards more sources on the restructure?

For anyone worried about the Nix drama, a fork has already happened.

You can find it under lix.systems.

Please tell ^^

I cleaned my bin.

All that’s left is a symlink: sh -> /nix/store/…

Rather the Gestalt of society

This, or slackhq/nebula

I feel like the floating point suggestion would backfire quickly due to imprecisions.