That’s a good question no one else seems to be asking. When you run local prompts, you’re using more battery on your laptop or power from your PSU, but both of those are limited by their relatively small power consumption (when compared to server farms). Therefore, it could be likened to encoding heavy video or exporting complex blender models. Are you using more electricity? Yes. Is it city-eroding amounts more? Not even close.
Does this also apply to AI models I run locally on my computer?
No they are magically free.
/s
That’s a good question no one else seems to be asking. When you run local prompts, you’re using more battery on your laptop or power from your PSU, but both of those are limited by their relatively small power consumption (when compared to server farms). Therefore, it could be likened to encoding heavy video or exporting complex blender models. Are you using more electricity? Yes. Is it city-eroding amounts more? Not even close.