A lot of the internet is duplicate data, low quality content, SEO spam etc. I wouldn't be surprised if 1 TB is a significant portion of the high-quality, information-dense part of the internet.
I would be extremely surprised if it was that small.
Readit NewsFeepingCreature commented on We tasked Opus 4.6 using agent teams to build a C Compiler anthropic.com/engineering... · Posted by u/modeless
FeepingCreature commented on We tasked Opus 4.6 using agent teams to build a C Compiler anthropic.com/engineering... · Posted by u/modeless
This sounds very wrong to me.
Take the C4 training dataset for example. The uncompressed, uncleaned, size of the dataset is ~6TB, and contains an exhaustive English language scrape of the public internet from 2019. The cleaned (still uncompressed) dataset is significantly less than 1TB.
I could go on, but, I think it's already pretty obvious that 1TB is more than enough storage to represent a significant portion of the internet.
This would imply that the English internet is not much bigger than 20x the English Wikipedia.
That seems implausible.
FeepingCreature commented on The TV industry concedes that the future may not be in 8K arstechnica.com/gadgets/2... · Posted by u/cxrlosfx
> While the step from 1080p 1440p to 4K is a visible difference
It really isn't.
What you are likely seeing is HDR which is on most (but not all!) 4K content. The HDR is a separate layer and unrelated to the resolution.
4K versions of films are usually newly restored with modern film scanning - as opposed to the aging masters created for the DVD era that were used to churn out 1st generation Blu-Rays.
The difference between a 4K UHD without HDR and a 1080p Blu-Ray that was recently remastered in 4K from the same source is basically imperceptible from any reasonable viewing distance.
The "visible difference" is mostly better source material, and HDR.
Of course people will convince themselves what they are seeing justifies the cost of the upgrade, just like the $200 audiophile outlet and $350 gold-plated videophile Ethernet cable makes the audio and video really "pop".
I can confirm that on a pc monitor, 1080p and 4k is very easy to tell apart.
I think people not being able to vote because their right to vote has been taken from them, or their vote was made pointless through gerrymandering, or because of other acts of voter suppression does change elections. The ability for it to change the outcome of a race is why voter suppression happens.
People who don't bother to vote for any reason changes elections. It also makes it very hard to make claims about what the majority of Americans want, since so many didn't make their opinions known
You can't gerrymander a presidential election. How would that work? It's not district-based.
A majority of Americans either wanted Trump or didn't care enough to vote against him.
Do you imagine there'd be less red tape involved in launching multiple rockets per day carrying heavy payloads?
Like this argument just gets absurd: you're claiming building a data center on earth will be harder from a permitting perspective than FAA flight approval for multiple heavy lift rocket launch and landing cycles.
Mining companies routinely open and close enormous surface area mines all over the world and manage permitting for that just fine.
There's plenty of land no one will care if your build anything on, and being remote with maybe poor access roads is still going to be enormously cheaper then launching a state of the art heavy lift rocket which doesn't actually exist yet.
> There's plenty of land no one will care if you build anything on
I wonder if this is actually true.
Space to put them, terrestrially, is not infinite. Demand has a hard ceiling.
That's a supply ceiling. Funnily, it's also one that's solved by putting them in space.
AI clusters are heavily interconnected, the blast radius for single component failure is much larger than running single nodes -- you would fragment it beyond recovery to be able to use it meaningfully.
I can't get in detail about real numbers but it's not doable with current hardware by a large margin.
eh? They're not gonna lay cable in space. The laser links will be retargetable.
So far I haven't seen it actually be effective at "building" in a work context with any complexity, and this despite some on our team desperately trying to make that the case.
I have! You have to be realistic about the projects. The more irreducible local context it needs, the less useful it will be. Great for greenfield code, oneshots, write once read once run for months.
FeepingCreature commented on Bottom-up programming as the root of LLM dev skepticism klio.org/theory-of-llm-de... · Posted by u/mkozlows
My experience is exactly the opposite. With AI, it's better to start small and simplify as much as possible. Once you have working code, refactor and abstract it as you deem fit, documenting along the way. Not the other way around. In a world abound of imitations and perfect illusions, code is the crucial reality to which you need to anchor yourself, not documents.
But that’s just me, and I'm not trying to convince anyone.
in my experience you do both. small ai spike demos to prove a specific feature or logic, then top-down assemble them into a superstructure. The difference is that I do the spikes on pure vibe, while reserving my design planning for the big system.
What I think people get wrong (especially non-coders) is that they believe the limitation of LLMs is to build a complex algorithm.
That issue in reality was fixed a long time ago. The real issue is to build a product. Think about microservices in different projects, using APIs that are not perfectly documented or whose documentation is massive, etc.
Honestly I don't know what commenters on hackernews are building, but a few months back I was hoping to use AI to build the interaction layer with Stripe to handle multiple products and delayed cancellations via subscription schedules. Everything is documented, the documentation is a bit scattered across pages, but the information is out there. At the time there was Opus 4.1, so I used that. It wrote 1000 lines of non-functional code with 0 reusability after several prompts. I then asked something to Chat gpt to see if it was possible without using schedules, it told me yes (even if there is not) and when I told Claude to recode it, it started coding random stuff that doesn't exist. I built everything to be functional and reusable myself, in approximately 300 lines of code.
The above is a software engineering problem. Reimplementing a JSON parser using Opus is not fun nor useful, so that should not be used as a metric
You need to give it search and tool calls and the ability to test its own code and iterate. I too could not oneshot an interaction layer with Stripe without tools. It also helps to make it research a plan beforehand.