• Melvin_Ferd@lemmy.world
    link
    fedilink
    arrow-up
    2
    arrow-down
    3
    ·
    4 hours ago

    Isn’t it more like they’re comparing all the hamburgers and everything else you have eating since you were born?

    That’s what they’re doing with AI enegry usages isn’t it? I thought it was including the training which is where the greatest costs come from vs just daily running.

    • lovely_reader@lemmy.world
      link
      fedilink
      arrow-up
      4
      ·
      edit-2
      3 hours ago

      No. “In practice, inference [which is to say, queries, not training] can account for up to 90% of the total energy consumed over a model’s lifecycle.” Source.