hmmm wonder if decosting is actually linear vs. discrete jumps in ability (ie. we might just nail fusion or boosts in efficiency)
Readit Newsnee1r commented on Energy Predictions 2025 – Casey Handmer's blog caseyhandmer.wordpress.co... · Posted by u/bilsbie
Love MOFs! Did research about MOFs <=> language modeling a couple years ago and I'm excited to see them getting more coverage https://arxiv.org/abs/2311.07617
nee1r commented on Building the heap: racking 30 petabytes of hard drives for pretraining si.inc/posts/the-heap/... · Posted by u/nee1r
nee1r commented on Building the heap: racking 30 petabytes of hard drives for pretraining si.inc/posts/the-heap/... · Posted by u/nee1r
nee1r commented on Building the heap: racking 30 petabytes of hard drives for pretraining si.inc/posts/the-heap/... · Posted by u/nee1r
If the authors chime in, I'd like to ask what "Standard Intelligence PBC" does.
Is it a public benefit corp?
What are y'all building?
We did want more pictures!! Recently bought a Sony A7III to capture more fun moments like this.
We're working on pretraining computer action models from the ground up—hence the pretraining data cluster. We're a public benefit corp because we think its important for AGI to built in the public's interest + are planning on automating a lot of the work done on computers!
nee1r commented on Building the heap: racking 30 petabytes of hard drives for pretraining si.inc/posts/the-heap/... · Posted by u/nee1r
Had the pleasure of helping rack drives! Nothing more fun than an insane amount of data :P
Thanks for helping!!!
nee1r commented on Building the heap: racking 30 petabytes of hard drives for pretraining si.inc/posts/the-heap/... · Posted by u/nee1r
damn this is cool as hell. estimate on the maintenance cost in person-hours/month?
Around 2-5 hours/month, mostly powercycling the servers and replacing hard drives
nee1r commented on Building the heap: racking 30 petabytes of hard drives for pretraining si.inc/posts/the-heap/... · Posted by u/nee1r
Nice writeup. All of the technical detail is great!
I'm curious about the process of getting colo space. Did you use a broker? Did you negotiate, and if so, how large was the difference in price between what you initially were quoted and what you ended up paying?
We reached out to almost every colocation space in SF/some in Fremont to get quotes. There wasn't a difference between the quote price and what we ended up paying, though we did negotiate terms + one-time costs.
nee1r commented on Building the heap: racking 30 petabytes of hard drives for pretraining si.inc/posts/the-heap/... · Posted by u/nee1r