• 1 Post
  • 104 Comments
Joined 3 years ago
cake
Cake day: March 22nd, 2024

help-circle





  • In case anyone forgot, Meta was the pioneer of open weight models, with Llama 1 released/leaked February 2023.

    They literally set the standard. Yes there was GPT-J before it, but basically everything in the open weights LLM space is derived from the Llama series, its footprint is still in newest Chinese models. The world was Meta’s oyster.

    …And after one bad experiment, an experiment Zuckerberg allegedly meddled with (Llama 4), Zuck fired the whole Llama team, paid millions to a bunch of tech bros in their place, who proceeded to nothing for a good long while.


    Muse Glimmer is obsolete, IMO.

    Muse Spark is… not terrible? Its architecture (GQA + sliding window attention) is about a year or two out of date, but it… could be worse.


    But this is just a reminder to anyone who thinks Zuck won’t find some way to feel insecure and fuck Muse up.

    He will.

    It is what he does. Zuck caused incalculable damage to his company, single-handedly, and he will do it again with zero repercussions.

    Same with Musk. And Altman. Not to speak of Microsoft vacuuming up promising startups into a black hole. The U.S. AI industry was basically doomed from the beginning.


  • Fuck the adtech industry, too. Fuck corporate consolidation and Big Tech. It’s absolutely destroying anyone but clickbait farmers; this problem is bigger than just generative ML.

    I’ve seen a few creators say they don’t know how they’re going to continue. They can’t out compete spammers, clicks and views basically make them nothing, no one seeks anything beyond algorithms anymore.

    Hence I’ve been throwing more money at Patreon or similar artist subscriptions recently, even if in short bursts.