You can also use cheaper models depending on your needs, for example Qwen 2.5 VL 72B is pretty affordable and works pretty well for most situations.
I feel like we are in awkward phase of: "We know this has severe environmental impact - but we need to know if these tools are actually going to be useful and worth adopting..." - so it seems like just keeping the environmental question at the forefront will be important as things progress.
This is a rhetorical question.
Sure we aren’t capturing every last externality, but optimization of large systems should be pushed toward the creators and operators of those systems. Customers shouldn’t have to validate environmental impact every time they spend 0.05 dollars to use a machine.
Transporting something with a car using fossil fuel usually uses less energy than if a human did the same thing by hand, that doesnt mean fossil fuel is environmentally friendly. LLM:s does not decrease the population even if it can do human tasks. If the LLM is used for the good of humanity it is probably a win, but I mean obviously a lot of the use of AI is not.
I use LLM:s as well, I'm just saying, I dont think it is a totally strange question to ponder over the energy use of different use cases with LLM:s.
It’s the progressive jpg download of 2025. You can short circuit after the first model which gives a good enough response.
Apple as the company we used to know is long dead. I still buy MacBooks and iPhones but only because some remnant of the past still exists in them. The new company came up with Vision Pro, screwing Spotify over app commissions, screwing game developers users love (Epic), non-upgradeable devices, extremely difficult repairability, etc.
Honestly I love the current macs, but of course I would like to be able to upgrade them as well. But yeah I also have the feeling that Apple is getting less innovative, more sloppy and more greedy, but I'm not sure I think its become a whole other company.