• khannie@lemmy.world
    link
    fedilink
    English
    arrow-up
    32
    arrow-down
    1
    ·
    19 hours ago

    In five years once this RAM nonsense is over you’ll be able to run a comparatively high quality local LLM for very little money. I can’t see how these companies will ever make their money back.

    • 4am@lemmy.zip
      link
      fedilink
      English
      arrow-up
      24
      arrow-down
      1
      ·
      18 hours ago

      If manufacturers are willing to sell components to us in five years that is.

      Of course if the colllapse happens before then the story might be different…

      • SacralPlexus@lemmy.world
        link
        fedilink
        English
        arrow-up
        11
        ·
        15 hours ago

        I’m slightly optimistic that manufacturers will return to the retail market eventually. Every AI company is racing to hyperscale right now but there will be a point where the infrastructure is built and at that point the growth will slow down quite a bit. In that scenario there will be ongoing demand for components to be replaced as they become obsolete but I can’t imagine the demand will be the same level it is right now as everyone rushes to build.

        That’s assuming this all works the way they want it to. If the economics aren’t viable and the bubble bursts…

        • green_goglin@thelemmy.club
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 hour ago

          “Hyperscale” is utterly meaningless MBA jargon at this point. Equivalent of verbal slop from industry shills and CNBC/Bloomberg sell side simps.

          • SacralPlexus@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            1 hour ago

            Sorry if that’s true. I understood the word to mean aggressive growth at any cost to try and shut out competition before they can get established.

        • Wildmimic@anarchist.nexus
          link
          fedilink
          English
          arrow-up
          9
          ·
          15 hours ago

          Their Datacenter buildout doesn’t work they want to. Most projects are very much delayed, and those that even started getting built are over budget. OpenAI and Anthropic will collapse in the next years, and this is coming from someone who absolutely sees the good things about the technology itself.

            • Wildmimic@anarchist.nexus
              link
              fedilink
              English
              arrow-up
              7
              ·
              15 hours ago

              There is no way, absolutely NO WAY to recuperate the amount of cash burnt on those two companies, and that is not even counting the amount of AI Startup whose cash is currently flowing towards to those two.

              • msage@programming.dev
                link
                fedilink
                English
                arrow-up
                2
                ·
                8 hours ago

                How about bailouts? GPT integration with Visa? IPOs sucked into funds? There’s a lot of money they can and will try to vacuum, don’t you worry about that. And banks will do their damnest best to help with all of that - just look at SpaceX.