Readit News logoReadit News
alexeldeib commented on Ask HN: Senior people, how did your career evolve?    · Posted by u/Seb-C
mixmastamyk · 3 months ago
Experienced dev here who took a machine learning class and found it interesting. Could I get a position in it now? Would anyone hire a grey-haired ML junior? So far my experience says no, but may be bad luck so far.
alexeldeib · 3 months ago
“It depends”: what’s your prior experience, what kind of roles interest you, how big is the gap between what you have + a little ML knowledge/side projects?

I’d argue there’s a big need for people with solid fundamental CS, sysadmin, infra skills who can bridge the gap into ML practitioner/researcher understanding. Applications or inference generally are probably easiest to break into, especially if you already have service knowledge. If you want to work on distributed training or kernel/model optimization, you probably need to prove your chops there.

Neoclouds, startups in the AI space, maybe hw vendors are probably good places to look.

alexeldeib commented on Show HN: Katakate – Dozens of VMs per node for safe code exec   github.com/Katakate/k7... · Posted by u/gbxk
alexeldeib · 4 months ago
as someone in the space this ticks a lot of boxes: kubernetes-native, strong isolation, python sdk (ideal for ML scenarios). devmapper is a nice ootb approach.

Glancing at the readme, is your business model technical support? Or what's your plan with this?

Anything interesting to share around startup time for large artifacts, scaling, passing through persistent storage (or GPUs) to these sandboxes?

Curious what things like 'Multi-node cluster capabilities for distributed workloads' mean exactly? inter-VM networking?

alexeldeib commented on Apple M5 chip   apple.com/newsroom/2025/1... · Posted by u/mihau
bombcar · 4 months ago
I’m trying to find any reason I can that my M1 Max needs replacement; it’s hard. How do you justify it?
alexeldeib commented on Ask HN: Abandoned/dead projects you think died before their time and why?    · Posted by u/ofalkaed
valorzard · 4 months ago
The author got hired by Modular, the AI startup founded by the creators of LLVM and Swift, and is now working on the new language Mojo. He’s been bringing a bunch of ideas from Vale to Mojo
alexeldeib · 4 months ago
Oh nice! I just had an excuse to try mojo via max inference, it was pretty impressive. Basically on par with vllm for some small benchmarks, bit of variance in ttft and tpot. Very cool!
alexeldeib commented on Ask HN: Abandoned/dead projects you think died before their time and why?    · Posted by u/ofalkaed
khaledh · 4 months ago
Same with Vale: https://vale.dev
alexeldeib · 4 months ago
ouch, last “recent update” in 2023. Any idea what happened?
alexeldeib commented on AMD signs AI chip-supply deal with OpenAI, gives it option to take a 10% stake   reuters.com/business/amd-... · Posted by u/chillax
giancarlostoro · 4 months ago
My understanding from the more hardware savvy friends I have is that AMD is better for inference (so when you run a model) vs for training Nvidia is still king. Would be interesting if OpenAI does in fact take AMD's offer and how they use it (if they even share openly).
alexeldeib · 4 months ago
Larger memory, weaker comms. You can optimize for this by doing things like increasing batch size/data parallelism vs sharding schemes with more comms.

At scale training won’t be able to avoid comms entirely, while many models can fit in a single MI300 for serving.

alexeldeib commented on PlanetScale for Postgres is now GA   planetscale.com/blog/plan... · Posted by u/munns
fourseventy · 5 months ago
The way I understood NVMe drives to work on Google Cloud is that they are ephemeral and your data will be lost if the vm reboots. How do they work in this case?
alexeldeib · 5 months ago
can't speak to GCP specifically but usually the issue is they are host-attached and can't be migrated, so need to be wiped on VM termination or migration -- that's when you lose data.

Reboots typically don't otherwise do anything special unless they also trigger a host migration. GCP live migration has some mention of support though

GCP mentions data persists across reboots here https://cloud.google.com/compute/docs/disks/local-ssd#data_p...

note that stop/terminate via cloud APIs usually releases host capacity for other customers and would trigger data wipe, a guest initiated reboot typically will not.

alexeldeib commented on About Containers and VMs   linuxcontainers.org/incus... · Posted by u/Bogdanp
lotharcable · 6 months ago
I think that using the term 'application containers' to reference docker and 'system containers' to reference LXC is a bit of a meaningless distinction.

You can 100% host "systems containers" on Docker and you can host "applications" on LXC.

Like if I want a entire OS with it's own init system and users and so on and so forth I can do it it OCI images.

In fact I use it every single day with distrobox on top of Podman using OCI container images.

And it works a hell of a lot better then if I tried to do it on LXC.

alexeldeib · 5 months ago
yeah, the system/application distinction feels somewhat superficial. The “multiple user space” inside a container thing sounds interesting (not sure what that means exactly), but maybe more similar to a Kubernetes pod, except maybe instead of different rootfs there’s another isolation mechanism?
alexeldeib commented on BusyBeaver(6) Is Quite Large   scottaaronson.blog/?p=897... · Posted by u/bdr
refulgentis · 8 months ago
Could I bother you for some more info?

I spent 5 minutes trying to verify any link in the post above links to Scott Aaronson, or mentions him, and found nothing. :\ (both the siglocki, and when I found nothing there, the busy beaver site)

alexeldeib · 8 months ago
The "first" link (after the home button) on bbchallenge is the header bar link to https://bbchallenge.org/story which cites Aaronson in the first sentence (double first!). I would not describe it like OP for someone trying to find the actual link ;)

"One Collatz Coincidence", the 2nd story on the blog, also mentions Aaronson

alexeldeib commented on Matt Godbolt sold me on Rust by showing me C++   collabora.com/news-and-bl... · Posted by u/LorenDB
zozbot234 · 9 months ago
> The one thing that sold me on Rust (going from C++) was that there is a single way errors are propagated: the Result type. No need to bother with exceptions

This isn't really true since Rust has panics. It would be nice to have out-of-the-box support for a "no panics" subset of Rust, which would also make it easier to properly support linear (no auto-drop) types.

alexeldeib · 9 months ago
that's kind of a thing with https://docs.rs/no-panic/latest/no_panic/ or no std and custom panic handlers.

not sure what the latest is in the space, if I recall there are some subtleties

u/alexeldeib

KarmaCake day875January 31, 2016
About
I work on infrastructure for AI/ML.

Interested in virtualization, cryptography, distributed computing, hardware architecture.

contact info is my username @gmail.com

View Original