EU should focus on making an attractive startup market and more European LLMs (and so many other things) will emerge
Readit Newsfbergen commented on EuroLLM: LLM made in Europe built to support all 24 official EU languages eurollm.io/... · Posted by u/NotInOurNames
fbergen commented on Rust: Doubling Throughput with Continuous Profiling and Optimization polarsignals.com/blog/pos... · Posted by u/mesto1
(S2 dev) I think it took a bit of time to figure out what was going on as it was more of a game of enabling a feature in the sha2 crate since the profile showed us that it was using `soft` while we needed the hardware optimized. We thought being on neoverse-v1 would automatically detect to use hardware optimization, but that wasn't the case and we ended up looking at the sha2 crate closely only to figure that enabling the asm feature fixes it!
Cool, makes you wonder how many more of these oneliners are scattered across the codebase (in application and also OS etc).
Sidenote, I wonder how close we are to detect these automatically. From profiling many various applications, it feels like that should be a tractable problem.
fbergen commented on Rust: Doubling Throughput with Continuous Profiling and Optimization polarsignals.com/blog/pos... · Posted by u/mesto1
The point of the first one is that you can create snapshots from within the product where profiling data isn't forever. This is so you can use the pprof.me link in a GitHub issue, PR, or elsewhere and trust that the data never goes away even if the original data went out of retention. We actually originally built pprof.me out of frustration that users of Prometheus (several of us are Prometheus maintainers) at best submitted screenshots of profiling data when all we wanted was an easy way to explore it.
I agree that neither of these are terribly complicated features, but as far as I know no other product on the market actually has this combination. (yes, you can export data from most systems and use a different visualization tool but the point of products is to provide a single integrated package)
(disclaimer: Founder of the company that offers the product featured in this case study.)
Thanks for the reply
I see, thanks for adding colour here I can see the benefits of a guaranteed immutable and permanent profiling data!
Indeed even seemingly non complicated things do have a lot of devils in a lot of details :)
Kudos of getting this out
fbergen commented on Rust: Doubling Throughput with Continuous Profiling and Optimization polarsignals.com/blog/pos... · Posted by u/mesto1
Shouldn't "long term snapshot for profiling and inverting call stacks" be table stakes by now?
fbergen commented on Rust: Doubling Throughput with Continuous Profiling and Optimization polarsignals.com/blog/pos... · Posted by u/mesto1
I'm more curious on how much manual effort was required to find said line of code? Strikes me as moest of these optimizations are super easy to verify, very difficult to find
fbergen commented on Autoscale Kubernetes workloads on any cloud using any event kedify.io/resources/blog/... · Posted by u/innovate
What part of the stack takes the majority of the time for spawning a new replica? Is it the time to boot a VM/environment or is it application doing bunch of init work setting up connections etc?
Looks great!
Would this work for hosting databases too? I found the biggest annoyance and expense on my "infrequently accessed" side projects are databases, which are almost always idle.
fbergen commented on Software Infrastructure 2.0: A Wishlist (2021) erikbern.com/2021/04/19/s... · Posted by u/whoiskatrin
> You know how crappy software is crappy in ways that are so blatantly obvious to the user that you wonder why it was released?
It has crossed my mind several times recently that I want a word to describe this exact state of affairs. Where a thing has a defect so blatant that it is evident to any user that the creator of the thing has never tried using it.
Eg. an airbnb with no towels in it.
What's the word for this situation?
Yet still people are using it?
Otherwise it’s called an MVP and a promise of plugging the holes
fbergen commented on Software Infrastructure 2.0: A Wishlist (2021) erikbern.com/2021/04/19/s... · Posted by u/whoiskatrin
> The speed that's not there is setting up infrastructure. If I make a change in the AWS console, or if I add a new pod to Kubernetes, or whatever, I want that to happen in seconds. I'm not asking for milliseconds!
Milliseconds is now possible: https://kraft.cloud/ (e.g., an NGINX web server in under 20 millis).
But you still have clusters, why not everywhere… ?
fbergen commented on Software Infrastructure 2.0: A Wishlist (2021) erikbern.com/2021/04/19/s... · Posted by u/whoiskatrin
I would love to have what we were sold as a “truly” serverless (even though the name doesn’t mean no server)
- CloudRun did a good job, but the autoscaling is too slow to not pay for idle
- Lambda is great, but I want to run way more complex workloads than simple functions
Am I asking too much? =P