Slowly the environmental costs of so called "AI" as popularised in the last few years is getting mainstream attention.
-
Totally with Ю ⁂wrote last edited by [email protected]
Slowly the environmental costs of so called "AI" as popularised in the last few years is getting mainstream attention.
Not only the training of models consumes a shitton of energy but the usage too.
Is it more environmentally friendly to run LLMs locally on your own device?
Is there any data or knowledge on this issue?
-
robcorneliusreplied to Totally with Ю ⁂ last edited by
There are neoliberal capitalists who will just say "who cares" As long as people use the LLMs they generate capital for the billionaires and that's all that matters to them. If the capitalists could find a way to generate capital by getting people to bang rocks together, then we would all have to bang rocks together.
-
Totally with Ю ⁂replied to robcornelius last edited by
@robcornelius My question is about the environmental impact of using LLMs locally vs. remotely as an end user.
I agree with your comment though.