Loading parent story...
Loading comment...
Loading parent story...
Loading comment...
Loading parent story...
Loading comment...
What's the use case for a system like this?
I suspect it's also because there isn't a lot of data to train on.
Loading parent story...
Loading comment...
Loading parent story...
Loading comment...
Loading parent story...
Loading comment...
I frequently, alone, do 1000s of requests over a period of time, especially ones that are mostly cache hits, which can be $10-$50 in API costs.
This was not a "large scale" attack by any means.
The problem is, nobody knows how much and how fast AI will improve or how much it will cost if it does.
That uncertainty alone is very problematic and I think is being underestimated in terms of its impact on everything it can potentially touch.
For now though, I've seen a wall form in benchmarks like swe-rebench and swebench pro. Greenfield is expanding, but maintenance is still a problem.
I think AI needs to get much better at maintenance before serious companies can choose build over buy for anything but the most trivial apps.