Readit News logoReadit News
snicker7 commented on Building a Durable Execution Engine with SQLite   morling.dev/blog/building... · Posted by u/ingve
websiteapi · a month ago
there's a lot of hype around durable execution these days. why do that instead of regular use of queues? is it the dev ergonomics that's cool here?

you can (and people already) model steps in any arbitrarily large workflow and have those results be processed in a modular fashion and have whatever process that begins this workflow check the state of the necessary preconditions prior to taking any action and thus go to the currently needed step, or retry ones that failed, and so forth.

snicker7 · 25 days ago
Message queues (e.g. SQS) are inappropriate for tracking long-running tasks/workflows. This is due to the operational requirements such as:

- Checking the status of a task (queued, pending, failed, cancelled, completed) - Cancelling a queued task (or pending task if the execution environment supports it) - Re-prioritizing queued tasks - Searching for tasks based off an attribute (e.g. tag)

You really do need a database for this.

snicker7 commented on I could not convince my k8s team to go AWS serverless   medium.com/@dnsearching/h... · Posted by u/gpi
snicker7 · 5 months ago
We literally had a major us-east-1 incident on AWS today. Only thing we can do is sit on our butts and wait for it to end so that we can clean up. This happens every few months. I am unimpressed with the the "thousands of engineers" argument.
snicker7 commented on New horizons for Julia   lwn.net/Articles/1006117/... · Posted by u/leephillips
kbarros · 10 months ago
As we've been discussing in another thread, it's possible! One can "opt out" of Julia's dynamic behaviors on a function-by-function basis using the JET.jl tool for static analysis: https://aviatesk.github.io/JET.jl/dev/optanalysis/

Why not make this the default everywhere? Well, there are a lot of scientific use cases where it's convenient to have Python-style dynamic typing and interactivity. A cool thing about Julia is that it allows that, while _also_ allowing to achieve high-performance, all within a single language.

For the record, I do also love the static type system and overall design of Rust. But for my day job (research in numerical methods and computational physics), I find Julia to be the most efficient way to get the job done -- rapid algorithm prototyping, data analysis, plot generation, etc.

snicker7 · 10 months ago
It may be worthwhile to understand where dynamic typing is helpful since this gets mentioned a lot. Python and other dynamic languages are increasingly reliant on static type checkers.
snicker7 commented on New horizons for Julia   lwn.net/Articles/1006117/... · Posted by u/leephillips
catgary · 10 months ago
Oh, I would advocate for writing high quality libraries/components in Rust and then using Maturin to generate Python bindings for interactivity, [1] is an example of that workflow and it looks quite smooth.

[1]https://github.com/ChemAI-Lab/molpipx/

snicker7 · 10 months ago
An interpreter is an optimization barrier relative to native composition.
snicker7 commented on Don't "optimize" conditional moves in shaders with mix()+step()   iquilezles.org/articles/g... · Posted by u/romes
dist-epoch · 10 months ago
Funnily enough, this is sort of what the NVIDIA drivers do: they intercept game shaders and replace them by custom ones optimized by NVIDIA. Which is why you see stuff like this in NVIDIA drivers changelog: "optimized game X, runs 40% faster"
snicker7 · 10 months ago
Imagine being the dev competing game Y and seeing the changelog.
snicker7 commented on Ask HN: Who is hiring? (February 2025)    · Posted by u/whoishiring
wafisher · 10 months ago
MTA (think trains and buses) | Full-time | NYC | 3x/week in office

We're looking for two frontend software engineers! (Interviews are starting this week, we're very ready.)

Our team works on all the (non-ad) screens in the subway, as well as two apps (TrainTime and the MTA app) and our website. We're a team of 20, mostly engineers, a few PMs and a designer. We operate like a startup within the MTA and are responsible for all customer-facing digital endpoints.

See one of our products here: https://apps.apple.com/us/app/mta-traintime/id1104885987 as well as some new screen designs here: https://www.reddit.com/r/nycrail/comments/1h2rqr6/new_countd...

Job description and application details: https://www.mta.info/document/163661

snicker7 · 10 months ago
Not looking to apply, but can I DM you when the E train is late again?
snicker7 commented on A new learning experience on MDN   developer.mozilla.org/en-... · Posted by u/Vinnl
snicker7 · a year ago
The Neopets HTML Guide [1] remains the best beginner’s guide to Web development.

[1] https://www.neopets.com/help/html1.phtml

snicker7 commented on Conda: A package management disaster?   pyherald.com/articles/16_... · Posted by u/osdotsystem
alkh · a year ago
+1. On top of that, even with the new resolver it still takes ages to resolve a dependency for me, so somethimes I end up just using pip directly. Not sure if I am doing something wrong(mb you have to manually tweak something in the configs?) but it's pretty common for me to experience this
snicker7 · a year ago
I believe the problem is the lack of proper dependency indexing at PyPI. The SAT solvers used by poetry or pdm or uv often have to download multiple versions of the same dependencies to find a solution.

u/snicker7

KarmaCake day1713February 27, 2016
About
Domains of expertise: financial mathematics, data engineering.
View Original