The idea of active-active is too seductive compared to how hard learning distributed systems is.
It is so seductive that people don’t read the footnotes that explain that active-active does not do what they think it does.
Readit Newsokigan commented on Pgactive: Postgres active-active replication extension github.com/aws/pgactive... · Posted by u/ForHackernews
okigan commented on Pgactive: Postgres active-active replication extension github.com/aws/pgactive... · Posted by u/ForHackernews
Sounds interesting. So how soon one knows if his write has been accepted or rejected? Is it immediate or eventual?
It took 20 years to acknowledge that pushing eventual consistency to application layer is not worth it for most applications.
Seems the same is playing out out in Postgres with this extension, maybe will take it another 20 years
okigan commented on DumPy: NumPy except it's OK if you're dum dynomight.net/dumpy/... · Posted by u/RebelPotato
I’ve known some people who didn’t want to learn the syntax of numpy and did it all in loops, and the code was not easy to read. It was harder to read. The fundamental issue is that operations on high dimensional arrays are very difficult to reason about. Numpy can probably be improved, but I don’t think loops are the answer.
What’s a better syntax then?
okigan commented on DumPy: NumPy except it's OK if you're dum dynomight.net/dumpy/... · Posted by u/RebelPotato
Fantastic article.
I don’t use numpy often enough - but this explains the many WTF moments why it’s so annoying to get numpy pieces to work together.
Instead of taking a image every 5 seconds from the video and embed it, you could detect when there are enough changes between frames to decide to embed or not. One frame, one scene, one vector.
For instance, Ffmpeg can do that with the filter `select=gt(scene,0.3)`. It selects the frames whose scene detection score is greater then 0.3 (the scene change detection score are values between 0 and 1).
Don’t you need to apply filtering to the frame selection based on scene score?
Otherwise you’d select frames with 0.3, 0.7, 1.0, 0.7, 0.3 - selecting 5 frames instead of 1?
Two pass with sobel filter comes to mind.
okigan commented on Betting on DSPy for Systems of LLMs blog.isaacmiller.dev/post... · Posted by u/wavelander
Could we have a concise and specific explanation how DSPy works?
All I've seen are vague definitions of new terms (ex. signatures) and "trust me this very powerful and will optimize it all for you".
Also, what would a good way to reason between DSPy and TextGrad?
One word of caution about naively porting a regular web app to lambda: since you’re charged for duration, if your app does something like make an API call, you’re paying for duration while waiting on that API call for each request. If that API breaks and hangs for 30s, and you are used to it being (say) a 300ms round trip, your costs have 100xed.
So lambda pricing scales down to cheaper than a VPC, but it also scales up a lot faster ;)
As @leef mentioned, you should transition between Lambda and <another offering> based on the current load.
I've published LambdaFlex as an Infrastructure as Code (IaC) template. It automatically scales and manages traffic between AWS Lambda and AWS Fargate [1].
This setup leverages the strengths of both services: rapid scaling, scaling down to zero, and cost-effectiveness.
[1] GitHub: https://github.com/okigan/lambdaflex
I'd like to give praise for the "Target User Group" section on the homepage.
Not only does it say what users the app is for, but also who it is NOT for. I think this kind of information is invaluable in deciding whether or not to use or suggest an app.
I can understand if app developers want EVERYBODY to user their app (whether or not its the best for the job) or if the app developer just doesn't want to take the time to write out who the app is NOT for. But I will praise those who do include that information.
After reading the parent comment - I thought to myself “so what”.
But after reading it on the product page - I fully agree: seeing clearly the targeted personas and out of scope usage significantly elevates my trust in the product and the team behind it.
Have not used the software, but now I want to try
Dead Comment
okigan commented on LangChain Guide to Get Started shurutech.com/getting-sta... · Posted by u/akashkahlon
I'm really puzzled about LangChain. It looks like a lot of cruft and abstraction over something that is very simple. Every senior engineer I know feels the same way. Please explain why I'm wrong.
I find langchain complicates more than it helps: abstractions are leaky, API is not consistent across components, and it creates overly complex components.
It's too many layers of over-engineered complexity, and it's for underlying components that are changing very rapidly, so you are getting bogged down with out-dated architecture very quickly.