• eleitl@lemmy.zip
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      1
      ·
      5 hours ago

      It is very profitable in certain roles in the enterprise. This is orthogonal to it being a massive bubble, about to blow up.

      • e461h@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        1
        ·
        edit-2
        2 hours ago

        https://www.wheresyoured.at/the-subprime-ai-crisis-is-here/

        It could be, but it doesn’t look promising - and the fact that it’s pretty much impossible to know what the actual costs are is, in itself, very telling.

        When you use these services, the company in question then pays for access to the AI models in question, either at a per-million-token rate to an AI lab, or (in the case of Anthropic and OpenAI) whatever cloud provider is renting them the GPUs to run the models. A token is basically ¾ of a word.

        As a user, you do not experience token burn, just the process of inputs and outputs. AI labs obfuscate the cost of services by using “tokens” or “messages” or 5-hour-rate limits with percentage gauges, and you, as the user, do not really know how much any of it costs. On the back end, AI startups are annihilating cash, with up until recently Anthropic allowing you to burn upwards of $8 in compute for every dollar of your subscription. OpenAI allows you to do the same, though it’s hard to gauge by how much.

    • BarneyPiccolo@lemmy.today
      link
      fedilink
      English
      arrow-up
      4
      ·
      5 hours ago

      Not yet, but wait until they’ve reduced their workforce by 75%, and they can save all those associated expenses.

      It won’t work, of course, but they’ve deluded themselves into believing it.

      • e461h@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        5
        ·
        5 hours ago

        Certainly part of the sales pitch. But so far it turns out humans are more efficient (cost less). I think the appeal to companies is the control (and the cost while it’s so heavily subsidized by the industry pushing it. The appeal to the major AI investors and execs is to… privatize the profits and socialize the losses. They will golden parachute themselves and leave the people with their mess.

      • ripcord@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        5 hours ago

        The vast majority of the costs are HW and infra

        I think they’re hoping that reaches more of a steady state

        • Passerby6497@lemmy.world
          link
          fedilink
          English
          arrow-up
          4
          ·
          5 hours ago

          I think they’re hoping that reaches more of a steady state

          With how quickly tech advances and hardware degrades under heavy use, they’re going to be pushing that rock up a hill for a good while lol