A few days ago, I came across a blog post titled On FLOSS and training LLMs that articulates a growing frustration within the free and open source software…
Not true, try to selfhost your own and you will see his much it eats just to chat with it. Using just 3b model eat like 200 watts of power. Use it for an hour an you are eating as much as some laptops eat in a day while surfing. Of course if you are compare with gaming, it may be comparable with heavy games but then again that is also using a lot of power.
Well, if one user ask something to a LLM, there are certainly not much sources needed, but yhere are millons of users doing it to thousends of different LLM. That need a lot of server power. Anyway, it’s not the primary problem with renevable energy sources, the risks are others, biased information, deep fake, privacy, etc., with the misuse by corporations and political collectives.
LLM’s in particular don’t use that much energy. Image and video generation are the real concerns.
Not true, try to selfhost your own and you will see his much it eats just to chat with it. Using just 3b model eat like 200 watts of power. Use it for an hour an you are eating as much as some laptops eat in a day while surfing. Of course if you are compare with gaming, it may be comparable with heavy games but then again that is also using a lot of power.
Well, if one user ask something to a LLM, there are certainly not much sources needed, but yhere are millons of users doing it to thousends of different LLM. That need a lot of server power. Anyway, it’s not the primary problem with renevable energy sources, the risks are others, biased information, deep fake, privacy, etc., with the misuse by corporations and political collectives.