Readit News logoReadit News
huntaub commented on GPUHammer: Rowhammer attacks on GPU memories are practical   gpuhammer.com/... · Posted by u/jonbaer
privatelypublic · a month ago
This seems predicated on there being significant workloads that split gpu's between tenants for compute purposes.

Anybody have sizable examples? Everything I can think of results in dedicated gpus.

huntaub · a month ago
My (limited) understanding was that the industry previously knew that it was unsafe to share GPUs between tenants, which is why the major cloud providers only sell dedicated GPUs.
huntaub commented on Show HN: S3mini – Tiny and fast S3-compatible client, no-deps, edge-ready   github.com/good-lly/s3min... · Posted by u/neon_me
vbezhenar · 2 months ago
TLS ensures that stream was not altered. Any further checksums are redundant.
huntaub · 2 months ago
This is actually not the case. The TLS stream ensures that the packets transferred between your machine and S3 are not corrupted, but that doesn't protect against bit-flips which could (though, obviously, shouldn't) occur from within S3 itself. The benefit of an end-to-end checksum like this is that the S3 system can store it directly next to the data, validate it when it reads the data back (making sure that nothing has changed since your original PutObject), and then give it back to you on request (so that you can also validate it in your client). It's the only way for your client to have bullet-proof certainty of integrity the entire time that the data is in the system.
huntaub commented on Archil: From a file system, to a data company   archil.com/post/archil-fi... · Posted by u/huntaub
gunnarmorling · 3 months ago
Congrats on the launch! Could you clarify perhaps what Archil volumes actually are from a technical perspective? Like, is it EC2 instances with locally attached storage, your own bare metal machines in a CoLo space, something in between? It's not quite clear to me after reading the announcement.
huntaub · 3 months ago
Thanks! Under the hood, when you mount an Archil volume, you connect to a fleet of instances that we're managing with SSD drives attached, which cache reads+writes before hitting the underlying data in your S3 bucket.
huntaub commented on Archil: From a file system, to a data company   archil.com/post/archil-fi... · Posted by u/huntaub
huntaub · 3 months ago
Hey, I'm Hunter -- the founder of Archil. I'll be around in the comments to answer any questions that people have about the platform, or how things have changed since the Fall.
huntaub commented on Atuin Desktop: Runbooks That Run   blog.atuin.sh/atuin-deskt... · Posted by u/freetonik
huntaub · 4 months ago
This is exactly what I wanted for our team when I was at AWS. There are so many versions of operations which are just slightly too dangerous to automate, and this provides a path to iteratively building that up. Congratulations!
huntaub commented on An intro to DeepSeek's distributed file system   maknee.github.io/blog/202... · Posted by u/sebg
ashu1461 · 4 months ago
Are these attached directly to your server or hosted separately ?
huntaub · 4 months ago
i-series instances have direct-attached drives
huntaub commented on An intro to DeepSeek's distributed file system   maknee.github.io/blog/202... · Posted by u/sebg
xpe · 4 months ago
> I think that's a pretty odd concern to have.

Thinking about security risks is an odd concern to have?

huntaub · 4 months ago
I think that worrying that a self-hosted file system has a backdoor to exfiltrate data is an odd concern. Security concerns are (obviously) normal, but you should not be exposing these kinds of services to the public internet (or giving them access to the public internet), eliminating the concern that it's giving your data away.
huntaub commented on An intro to DeepSeek's distributed file system   maknee.github.io/blog/202... · Posted by u/sebg
snthpy · 4 months ago
Similar to the SeaweedFS question in sibling comment, how does this compare to JuiceFS?

In particular for my homelab setup I'm planning to run JuiceFS on top of S3 Garage. I know garage is only replication without any erasure coding or sharding so it's not really comparable but I don't need all that and it looked at lot simpler to set up to me.

huntaub · 4 months ago
It's a very different architecture. 3FS is storing everything on SSDs, which makes it extremely expensive but also low latency (think ~100-300us for access). JuiceFS stores data in S3, which is extremely cheap but very high latency (~20-60ms for access). The performance scalability should be pretty similar, if you're able to tolerate the latency numbers. Of course, they both use databases for the metadata layer, so assuming you pick the same one -- the metadata performance should also be similar.

u/huntaub

KarmaCake day696January 19, 2012
About
I love to chat about storage. Talk to me at regattastorage.com.
View Original