Readit News logoReadit News
jononor commented on Measuring the environmental impact of AI inference   arstechnica.com/ai/2025/0... · Posted by u/ksec
mgraczyk · 19 hours ago
Would you say that computers are less efficient now than they were in the 90s because they are more widely used?
jononor · 19 hours ago
Not less efficient. But the impact on resources usage is still higher. Of course the impact in terms of positive effects is also higher. So the cost/benefit may also have gone up.
jononor commented on Tiny-tpu: A minimal tensor processing unit (TPU), inspired by Google's TPU   github.com/tiny-tpu-v2/ti... · Posted by u/admp
webdevver · 5 days ago
we are incredibly overdue for the 3D-printer-ification of silicon chips
jononor · 5 days ago
I think that before that will be the PCB-ification, where you can order online and be batched in with others on a standardized process, for a reasonable price. This is actually starting to become possible, for example via TinyTapeout you can get tiny chips taped out for a few hundred USD.
jononor commented on AI doesn't lighten the burden of mastery   playtechnique.io/blog/ai-... · Posted by u/gwynforthewyn
acoustics · 6 days ago
Interestingly, a lot of the engineers I know are hoping for the exact opposite. They're hoping that AI will humble the business, management, product types.

The way they see it, AI can easily shit out a hundred product concepts, market research, slide decks, sales emails, reports, etc. No need to bring on MBAs or self-proclaimed visionaries or LinkedIn gurus.

I think both camps will be disappointed. The engineers will be disappointed that they'll still need vapid business/product people to keep them pointed at projects that will actually put food on the table. The business/product people will be disappointed that they'll still need sanctimonious engineers to make anything actually work.

jononor · 6 days ago
Yeah many have their favorite gripes with $TheOthers, and hoping that the AI will solve them. It won't - not because AI isn't good, but because the people involved will quickly adapt. Likely making new annoying behaviors, and probably many will adapt to find new things to be annoyed at also.
jononor commented on Open hardware desktop 3D printing is dead?   josefprusa.com/articles/o... · Posted by u/rcarmo
conorbergin · 9 days ago
If you are a hobbyist or small business in desktop manufacturing you are basically forced to buy Chinese products.

I have never owned a Prusa, but I have owned several Creality and Bambu Labs printers, because I could get the same utility at half the cost. The same goes for soldering irons, linear actuators, oscillscopes, etc. I still buy European hand tools (Knipex, Wera, etc) because I know they won't break in a year, so they are good value in the long run.

Often the choice is whether to buy a used, last generation tool of eBay, or a brand new next-gen tool from China. The choice depends on how flawed the Chinese implementation is and the gap in utility between the generations.

The main problem with Chinese products is the lack of accountability. The same product will be sold under multiple brands, or by dropshippers, and you have no idea who actually made it, there are some strong Chinese brands that buck this trend, i.e. Bambu Labs. When you buy western tools you are buying peace of mind, something I can't currently afford.

jononor · 9 days ago
Forced I don't know... But of course the financial incentives are very strong, as in many categories the Chinese brands have remarkable and sometimes astonishing value-for-money. But for a small business, the cost of these tools might be quite low relative to manpower anyway, so paying 2x might not be a big deal. We got 8 Prusa machines at our local hackerspace, and 10 at previous startup lab I was at.
jononor commented on Open hardware desktop 3D printing is dead?   josefprusa.com/articles/o... · Posted by u/rcarmo
Palomides · 9 days ago
partial disagree, I think the issue is how the patent office abdicated any but the most superficial effort to validate patents onto the court system
jononor · 9 days ago
It would be good if the difficulty of getting patents would go up by a factor of 10. To get less of them in volume, and less bullshit ones. Should also throw out a bunch of the existing bad ones.
jononor commented on What's the strongest AI model you can train on a laptop in five minutes?   seangoedecke.com/model-on... · Posted by u/ingve
jarmitage · 10 days ago
AI is sorely lacking a demoscene
jononor · 9 days ago
The TinyML niche, doing ML on microcontroller grade hardware (usually for sensor data analysis), is close in terms of constraints. Models measuring in kilobytes of RAM/FLASH. But usually missing the flair and showmanship of demoscene, and the just-because-we-can attitude. So I agree, need more demoscene style! As the maintainer of an open source library in this space (emlearn), I would be interested in contributing to such an effort.
jononor commented on Token growth indicates future AI spend per dev   blog.kilocode.ai/p/future... · Posted by u/twapi
root_axis · 11 days ago
VRAM prices have remained flat for the last decade, so no evidence of that coming.

Beyond that, running inference on the equivalent of a 2025 SOTA model with 100GB of VRAM is very unlikely. One consistent quality of transformer models has been the fact that smaller and quantized models are fundamentally unreliable, even though high quality training data and RL can boost the floor of their capabilities.

jononor · 11 days ago
GDDR6 8Gb spot (DRAMExchange) is now around 2.6 USD, down from 3.5 USD in summer 2023, and 6 USD in summer 2022? Last year has been pretty flat though!
jononor commented on Token growth indicates future AI spend per dev   blog.kilocode.ai/p/future... · Posted by u/twapi
root_axis · 11 days ago
Even with 10x more efficient models and GPU compute, hundreds of GB of VRAM will still be on the order of tens of thousands of USD for the foreseeable future.
jononor · 11 days ago
How long is foreseeable future? In 10 years I think LLM accelerator (GPU/NPU/etc) with 100 GB VRAM will cost under 2000 USD.
jononor commented on Evaluating LLMs playing text adventures   entropicthoughts.com/eval... · Posted by u/todsacerdoti
jlarocco · 11 days ago
Doesn't it kind of defeat the purpose, though?

If you have to train the AIs on every specialized new problem, and then you have to babysit them as you apply them to similar problems, why even bother?

It's not really intelligent in any real sense.

jononor · 11 days ago
Automation can be useful and valuable (economically) even if not intelligent. Heck from a big picture view of solving a problem (say to manufacture something), then a solution/process/workflow etc that requires less intelligence may be the preferable one - if such a solution can be found, that is. It can be expected to be cheaper, more robust, repeatable.
jononor commented on What does it mean to be thirsty?   quantamagazine.org/what-d... · Posted by u/pseudolus
tasuki · 12 days ago
> I don't know what "thirst" feels like at all! It's weird because I do feel hunger.

(I'm not an expert so take with a grain of salt)

This is it! Your hunger! It's actually thirst! When you're "hungry", try drinking a glass of water first. (Some people use this trick to lose weight, others, to stay hydrated...)

jononor · 11 days ago
This was a very important realization for me. That many times when I felt small cravings, the main thing I needed was not something sweet but water. Before I would drink milk, lemonade etc. But now I just drink water. Helped to regulate blood sugar better during the day.

u/jononor

KarmaCake day3905February 16, 2014
About
Machine Learning and Software Engineer. Specialized in sensor data / IoT and audio ML. Teach digital fabrication at local makerspace.

Website: http://jonnor.com https://github.com/jonnor/

View Original