Readit News logoReadit News
sliken commented on Pirate library operator arrested, study canceled for 330k members   torrentfreak.com/pirate-l... · Posted by u/speckx
cyberpunk · 9 days ago
I really would love to help out, but I don't have 650TB of storage laying around :(

The logistics of this archive are quite crazy; most 2-4U JBODs I worked with hold like 24 or 45 SFF SAS disks.

Standard size (unless things have changed) for 10k sff sas disks seems to be about 1.2TB, so you'd need 544 of these to build a raidz big enough. So we're talking 12 4U jbods, well over a full rack.

I guess I can just hope some rich techie with a volcano lair / private datacenter somewhere is keeping a copy..

sliken · 8 days ago
24TB drives are quite available, $300 on newegg.

Buy a Data60 (60 disk chassis), add 60 drives. Buy a 1U server (2 for redundancy). I'd recommend 5 stripes of 11 drives (55 total) with 5 global spares. Use a RAIDz3 so 8 disks of data per 11 drives.

Total storage should be around 8 * 24 * 5 = 960GB, likely 10% less because of marketing 10^9 bytes instead of 2^30 for drive sizes. Another 10% because ZFS doesn't like to get very full. So something like 777TB usable which easily fits 650TB.

I'd recommend a pair of 2TB NVMe with a high DWPD as a cache.

The disks will cost $18k, the data60 is 4U, and a server to connect it is 1U. If you want more space upgrade to 30TB $550 each) drives or buy another Data60 full of drives.

sliken commented on The Framework Desktop is a beast   world.hey.com/dhh/the-fra... · Posted by u/lemonberry
fmajid · 12 days ago
You're right, I had asked my HP specialist to confirm that it was ECC, and he had said yes, but when I prompted him again on the distinction between link ECC (protects data in motion) vs true on-die ECC (protects data at rest in RAM, much more important), he admitted it was the former and canceled my order.

I now ordered a Beelink GTR9 Pro, which unlike the Framework has dual 10G Ethernet, not the weird 5G flavor. We'll see how that goes.

sliken · 12 days ago
Ah, interesting. Did you get a ship date? I do like the idea of dual 10G. It would be nice to see a review on how well the GTR9's cooling works and how quiet it is under full load.
sliken commented on The Framework Desktop is a beast   world.hey.com/dhh/the-fra... · Posted by u/lemonberry
zozbot234 · 15 days ago
> We need a more expensive CPU, more expensive motherboard, more power, more cooling, and a larger system. Congratulations you've reinvented threadripper (4 channel), siena (6 channel), Threadripper pro (8 channel), or epyc (12 channel).

This is the real story not the conspiracy-tinged market segmentation one. Which is silly because at levels where high-end consumer/enthusiast Ryzen (say, 9950 X3D) and lowest-end Threadripper/EPYC (most likely a previous-gen chip) just happen to truly overlap in performance, the former will generally cost you more!

sliken · 15 days ago
Well sort of. Apple makes a competitive mac mini and macbook air with a 128 bit memory interface, decent design, solid build, nice materials, etc starting at $1k. PC laptops can match nearly any aspect, but rarely match the quality of the build, keyboard, trackpad, display, aluminum chassis, etc.

However Apple will let you upgrade to the pro (double the bandwidth), max (4x the bandwidth), and ultra (8x the bandwidth). The m4 max is still efficient, gives decent battery life in a thin light laptop. Even the ultra is pretty quiet/cool even in a tiny mac studio MUCH smaller than any thread ripper pro build I've seen.

Does mystify me that x86 has a hard time matching even a mac mini pro on bandwidth, let alone the models with 2x or 4x the memory bandwidth.

sliken commented on The Framework Desktop is a beast   world.hey.com/dhh/the-fra... · Posted by u/lemonberry
beeflet · 16 days ago
Why not make a platform with a greater number of channels
sliken · 15 days ago
Sure, you could. The design would do something like:

We need a bigger memory controller.

To get more traces to the memory controller We need more pins on the CPU.

Now need a bigger CPU package to accommodate the pins.

Now we need a motherboard with more traces, which requires more layers, which requires a more expensive motherboard.

We need a bigger motherboard to accommodate the 6 or 8 dimm sockets.

The additional traces, longer traces, more layers on the motherboard, and related makes the signalling harder, likely needs ECC or even registered ECC.

We need a more expensive CPU, more expensive motherboard, more power, more cooling, and a larger system. Congratulations you've reinvented threadripper (4 channel), siena (6 channel), Threadripper pro (8 channel), or epyc (12 channel). All larger, more expensive more than 2x the power, and is likely to be in a $5-$15k workstation/server not a $2k framework desktop the size of a liter of milk or so.

sliken commented on The Framework Desktop is a beast   world.hey.com/dhh/the-fra... · Posted by u/lemonberry
Jtsummers · 17 days ago
> In some ways, the Framework Desktop is a curious machine. Desktop PCs are already very user-repairable! So why is Framework even bringing their talents to this domain? In the laptop realm, they're basically alone with that concept, but in the desktop space, it's rather crowded already. Yet it somehow still makes sense.

And even more curious, Framework Desktop is deliberately less repairable than their laptops. They soldered on the RAM. Which makes it a very strange entry for a brand marketing itself as the DIY dream manufacturer. They threw away their user-repairable mantra when they made the Desktop, it's less user repairable than most other desktops you could go out and buy today.

sliken · 15 days ago
Dunno, nice, quiet, small machine, using standard parts (power supply, motherboard, etc).

If you want the high memory bandwidth get the strix halo, if not get any normal PC. Sure apple has the bandwidth as well, and also soldered memory as well.

If you want dimms and you want the memory bandwidth get a threadripper (4 channel), siena (6 channel), thread ripper pro (8 channel), or Epyc (12 channel). But be prepared to double your power (at least), quadruple your space, double your cost, and still not have a decent GPU.

sliken commented on The Framework Desktop is a beast   world.hey.com/dhh/the-fra... · Posted by u/lemonberry
mixmastamyk · 15 days ago
Was scoffing at HP, but then you got my attention with ECC RAM. Looks nice as well.
sliken · 15 days ago
Keep scoffing, it's not real end to end ECC, just "link" ecc, which is just part of the chip -> CPU pipeline.

So it's not full ECC like servers have with dimms with a multiple of 9 chips with ECC protecting everything from the dimms to the CPU.

Keep in mind the ram is inside the strix halo package, not something HP has control over.

sliken commented on Benchmark Framework Desktop Mainboard and 4-node cluster   github.com/geerlingguy/ol... · Posted by u/geerlingguy
jeffbee · 18 days ago
Yeah I don't get it either. To get marginally more resources than the 9950X you have to make a significant leap in price to a $1500+ CPU on a $1000 motherboard.
sliken · 16 days ago
Doubly so when a $650 Epyc motherboard and a $650 Epyc CPU gets you 3x the threadipper's bandwidth and 1.5 the thread ripper pro's bandwidth.

Seems like threadripper is too low volume to be price competitive with Epyc and there's a relatively price insensitive workstation market out there.

sliken commented on Benchmark Framework Desktop Mainboard and 4-node cluster   github.com/geerlingguy/ol... · Posted by u/geerlingguy
StrangeDoctor · 18 days ago
I bought a threadripper pro system out of desperation, trying to get secondhand PCIe 80G A100s to run locally. The huge rebar allocations confused/crashed every Intel/AMD system I had access to.

I think the Xeon systems should have worked and that it was actually a motherboard bios issue, but I had seen a photo of it running in a threadripper and prayed I wasn’t digging an even deeper hole.

sliken · 16 days ago
I've been tempted, but had a hard time finding a case where I needed more than the 9950x but less than a single socket epyc. Especially since the epyc motherboards are cheaper, CPUs are cheaper, and the Epycs have 3x the memory bandwidth of the thread ripper and 1.5x the memory bandwidth of the Threadripper pro.
sliken commented on Benchmark Framework Desktop Mainboard and 4-node cluster   github.com/geerlingguy/ol... · Posted by u/geerlingguy
jeffbee · 18 days ago
I had been hoping that these would be a bit faster than the 9950X because of the different memory architecture, but it appears that due to the lower power design point the AI Max+ 395 loses across the board, by large margins. So I guess these really are niche products for ML users only, and people with generic workloads that want more than the 9950X offers are shopping for a Threadripper.
sliken · 16 days ago
Across the board, by a large margin? Phoronix ran 200 benchmarks on the 9950x vs 395x max and found a difference of less than 5%. Not bad considering the average power use was 91 watts vs 154 watts.

If you need the memory bandwidth the strix halo looks good, if you are cache friendly and don't care about using almost double the power than the 9950x is a better deal.

sliken commented on Benchmark Framework Desktop Mainboard and 4-node cluster   github.com/geerlingguy/ol... · Posted by u/geerlingguy
adolph · 17 days ago
I missed that. Too bad it is under the power cables. I’d be hard to fit something in there using the stock case.
sliken · 16 days ago
Sure, so $100 for an ITX case.

u/sliken

KarmaCake day5594January 25, 2014View Original