• TigerAce@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    5
    ·
    1 month ago

    Is that what Ai told you? Because that is complete bullshit.

    Just taking to Ai doesn’t use that much energy, except unless you let it make complicated code, but the energy it took for training the LLM’s for your evening conversation took so much energy, resources and caused so much pollution, you could fly an airplane around the world for an entire year and still pollute the earth less.

    • kromem@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      1
      ·
      1 month ago

      Hahaha — wait, do you think that the models take more energy to train than the cumulative amount used to serve them for inference across the lifetime of the model?

      And if not, then what you are saying is effectively gibberish as any reasonable assessment would need to divide the training cost across all post-trained inference. So if it was only 50% the lifetime inference usage, it’d be a 1.5x multiplier to that I said above, which doesn’t change either the Netflix 4k or gas mileage points.