And unlike the human who spent multiple hours writing that article, an LLM would have linked to the original study: https://services.google.com/fh/files/misc/measuring_the_envi...
[ETA] Extending on these numbers a bit, a mean human uses 1.25KW of power (Kardashev Level .7 / 8 Gigahumans) and the mean American uses ~8KW of power according to https://en.wikipedia.org/wiki/List_of_countries_by_energy_co.... So if we align AIs to be eco-friendly, they will definitely murder all humans for the sake of the planet /s
So it's not just about "the one query you ask ChatGPT about what you should write your mum to say you're not coming for Thanksgiving"
It's rather that an AI query is 0.24Wh, but that we are now using thousands of those per users per days, and that we globalize it at the scale of the planet, so 7 billion users... and this becomes huge
Yeah, I was more interested in knowing the total amount. A "median" prompt without the information on the total number of prompts is kind of meaningless...
That's equivalent to doing less than two miles driving(CO2), one toilet flush (water) and about three dryer loads of laundry.
We can always keep adding new stuff and say each time "oh but it's small"... sure, but if we keep adding more, altogether it becomes huge
> In total, the median prompt—one that falls in the middle of the range of energy demand—consumes 0.24 watt-hours of electricity
If they're running on, say, two RTX 6000s for a total draw of ~600 watts, that would be a response time of 1.44 seconds. So obviously the median prompt doesn't go to some high-end thinking model users have to pay for.
It's a very low number; for comparison, an electric vehicle might consume 82kWh to travel 363 miles. So that 0.24 watt-hours of energy is equivalent to driving 5.6 feet (1.7 meters) in such an EV.
When I hear reports that AI power demand is overloading electricity infrastructure, it always makes me think: Even before the AI boom, shouldn't we have a bunch of extra capacity under construction, ready for EV driving, induction stoves and heat-pump heating?
[1] https://cloud.google.com/blog/products/infrastructure/measur...
Would this be possible in 12V ?
Can we also put LiFePO4 instead of Li-ion ?
Subscribe to our newsletter if you want to be informed :) https://gouach.com
why an app? Why not a simple light or error code on device?
- it gives much more detailed and fine-grained informations
- it allows user (optionally) to register for automated safety alerts
- but more importantly, it allows users to override themselves the communication protocol of the battery, to adapt it to any bike
For now we've hardcoded Bosch, Bafang, Brose and a few others (more coming), and we plan to open-source the communication protocol soon so that anyone can upload their own WASM code on the battery to talk to any controller!