koe123 (u/koe123) - Readit News

koe123 commented on Beyond the 70%: Maximizing the human 30% of AI-assisted coding addyo.substack.com/p/beyo... · Posted by u/Garbage

apwell23 · 6 months ago

Coding is one thing that all these LLM companies crazy optimized for and yet its only marginally useful.

Dario Amodai calming yesterday that 90% of coding will be done by AI in next 3-6 months. These ppl need to be held accountable for this scam that they are brazenly and openly perpetrating. Seriously, why is no one saying anything, whats goin on. I feel disgusted by these ppl .

Dario Amodai deserves Elizabeth Holmes treatment for this fraud.

koe123 · 6 months ago

Given the valuation of these companies the upside of "just lieing" is unfortunately high.

For example taking a step back, it's crazy that people accept the idea of "AGI" (which drives the valuation partially) at face value without any evidence.

I would be shocked if there was any accountability though.

koe123 commented on I stopped everything and started writing C again kmx.io/blog/why-stopped-e... · Posted by u/dvrj101

jandrewrogers · 6 months ago

I really wish that were true but it isn’t. Modern C++ templates/constexpr are much more powerful and expressive than any Zig comptime equivalent.

The power and expressiveness of the C++ compile-time capabilities are the one thing I strongly miss when using other languages. The amount of safety and conciseness those features enable makes not having them feel like a giant step backward. Honestly, if another systems language had something of similar capability I’d consider switching.

koe123 · 6 months ago

I have written a lot of Zig comptime code and ended up finding the opposite. In C++ I find I have to bend over backward to get what I want done, often resulting in insane compile times. I've used metaprogramming libraries like Boost Hana before to have some more ergonomics, but even that I would consider inferior to comptime.

Out of curiosity, do you happen to have any examples of what you describe, where C++ is more powerful and expressive than Zig?

koe123 commented on Nvidia releases its own brand of world models techcrunch.com/2025/01/06... · Posted by u/bariscan

resource_waste · 8 months ago

I specifically mentioned Capitalism because it required the investment.

It was Capitalism, not market efficiency.

koe123 · 8 months ago

Fair enough!

koe123 commented on Nvidia releases its own brand of world models techcrunch.com/2025/01/06... · Posted by u/bariscan

resource_waste · 8 months ago

The AI race is one of the most impressive examples of Capitalism making the market efficient. Or at least I've witnessed in my life.

We went from Google having complete control. To Open AI releasing GPT2 which really inspired a lot of people to try it. Then GPT3+ convinced the world to try it.

After that, Gemini, LLaMa, every type of fine-tune... The noteworthy thing is that LLaMA was good enough that ChatGPT had competition. Then within 1 year of that, we have a dozen companies with models that are good enough.

The competition has been the best type of brutal.

koe123 · 8 months ago

I think you could argue that competition indeed makes the market efficient, but that we shouldn't conflate that with capitalism itself. Capitalism, in my opinion, can at times prevent competition due to the required capital investment to compete. E.g. even OpenAI with their golden bullet couldn't get there without the capital investments from big tech? Might be wrong here of course.

koe123 commented on Zig's comptime is bonkers good scottredig.com/blog/bonke... · Posted by u/todsacerdoti

anonymoushn · 8 months ago

I've done this sort of thing by writing a code generator in python instead of using comptime. I'm not confident that comptime zig is particularly fast, and I don't want to run the json parser that generates the struct all the time.

koe123 · 8 months ago

Another thing I tried as an alternative is using ZON (zig object notation) instead of json. This can natively be included directly as a source file. It involved writing a custom python exporter though (read: I gave up).

koe123 commented on Zig's comptime is bonkers good scottredig.com/blog/bonke... · Posted by u/todsacerdoti

0x1ceb00da · 8 months ago

How does this affect the compile times?

koe123 · 8 months ago

They become quite long, but it was surprisingly tolerable. I recall it vaguely but a 100MB neural network was on the order of minutes with all optimizations turned on. I guess it would be fair to say it scaled more or less linearly with the file size (from what I saw). Moreover I work in essentially a tinyml field so my neural networks are on the order of 1 to 2 MB for the most part. For me it wouldve been reasonable!

I guess in theory you could compile once into a static library and just link that into a main program. Also there will be incremental compilation in zig I believe, maybe that helps? Not sure on the details there.

koe123 commented on Zig's comptime is bonkers good scottredig.com/blog/bonke... · Posted by u/todsacerdoti

koe123 · 8 months ago

Another interesting pattern is the ability to generate structs at compile time.

Ive ran experiments where a neural net is implemented by creating a json file from pytorch, reading it in using @embedFile, and generating the subsequent a struct with a specific “run” method.

This in theory allows the compiler to optimize the neural network directly (I havent proven a great benefit from this though). Also the whole network lived on the stack, which is means not having any dynamic allocation (not sure if this is good?).

koe123 commented on AI-assisted coding will change software engineering: hard truths newsletter.pragmaticengin... · Posted by u/pseudolus

asdff · 8 months ago

You’d think ai models would be good enough to write code in pure binary. Python is for humans. Take the human out there’s no point in it.

koe123 · 8 months ago

I suppose the issue is a data problem, there being relatively little high quality data explaining how things should be solved in binary. As such making the learning mapping between prompt (english) and good solution (binary) difficult.

koe123 commented on Extracting AI models from mobile apps altayakkus.substack.com/p... · Posted by u/smoser

do_not_redeem · 8 months ago

Can anyone explain that resize_to_320.tflite file? Surely they aren't using an AI model to resize images? Right?

koe123 · 8 months ago

Probably not what your alluding to but AI upscaling of images is definitely a thing

koe123 commented on Racket School 2019: The "How to Design Languages" Track school.racket-lang.org/20... · Posted by u/mpweiher

TypingOutBugs · 8 months ago

But it still has to be auditable by humans, so I imagine some sort of LLM tool library over an existing language makes sense. Might be wrong! But langchain tools and pydantic schemas for Input/Output feel like the right abstraction

I can see the argument though, anything moving in that direction already?

koe123 · 8 months ago

Not that I know of! Its an interesting idea though, as you say it should remain auditable.

Along that line me wonder if it were possible to design an LLVM output (i.e. can work with existing code) that is extra well optimized for interop with a specialized LLM, e.g. encoding more information more compactly or something.