Readit News logoReadit News
fvncc commented on The future of large files in Git is Git   tylercipriani.com/blog/20... · Posted by u/thcipriani
bahmboo · 17 days ago
I'm just dipping my toe into Data Version Control - DVC. It is aimed towards data science and large digital asset management using configurable storage sources under a git meta layer. The goal is separation of concerns: git is used for versioning and the storage layers are dumb storage.

Does anyone have feedback about personally using DVC vs LFS?

fvncc · 17 days ago
When I tried DVC ~5 years ago it was very slow as it constantly hashed files for some reason.

Switched to https://github.com/kevin-hanselman/dud and I have been happy since ..

fvncc commented on Matt Godbolt sold me on Rust by showing me C++   collabora.com/news-and-bl... · Posted by u/LorenDB
nyanpasu64 · 4 months ago
The problem I've always had with unit type wrappers is you can't convert between a &[f32] and a &[Amplitude<f32>] like you can convert a single scalar value.
fvncc · 4 months ago
There are libraries that help with these conversions. See e.g.: https://docs.rs/bytemuck/latest/bytemuck/trait.TransparentWr...
fvncc commented on The data that powers AI is disappearing fast   nytimes.com/2024/07/19/te... · Posted by u/sgammon
qingcharles · a year ago
Caveat: In countries that adopt an AI-aware copyright statute. In other countries they will just scrape whatever-the-hell from wherever-the-hell.

Right now all we're seeing is gentlemens' agreements and self-enforcement. A robots.txt is just asking you nicely. I don't know of any country that has any judicial ruling on the topic of AI scraping yet?

fvncc · a year ago
Japan passed a law allowing use of copyrighted material for machine learning.

https://www.deeplearning.ai/the-batch/japan-ai-data-laws-exp...

fvncc commented on Rapier is a set of 2D and 3D physics engines written in Rust   rapier.rs/docs/... · Posted by u/excsn
porphyra · 2 years ago
Yeah the ROS node architecture sucks. However, one reason for that design was so that you can run ROS on distributed systems where things communicate to each other over the network.
fvncc · 2 years ago
Actually another reason people use the architecture is for process level isolation, i.e. limiting the blast radius of memory corruption. But in both cases, Im sure you could design an ergonomic RPC framework that takes care of offloading computation mostly transparently behind the scenes :)
fvncc commented on Rapier is a set of 2D and 3D physics engines written in Rust   rapier.rs/docs/... · Posted by u/excsn
abricq · 2 years ago
I want to make this happen ! Do you know of any good robotics framework in Rust, as of today ? I heard that ROS2 was slowly including Rust [1], not sure at how did it go. Ros would be a good entry door to sensor fusion, mapping and localization. Because all of the hardware integration / abstraction is already done (in C++). I'm curious to know if company are using this.

[1] https://github.com/ros2-rust/ros2_rust

fvncc · 2 years ago
You can also check https://github.com/sequenceplanner/r2r for another example of ROS2 bindings (using in production at work for a couple of ROS nodes).

But TBH, in a Rust world, it’s worth revisiting the assumptions behind the ROS node architecture, since Rust is so strong at scaling to large monolithic applications (due to the strict hierarchical code patterns it encourages).

A transitional Rust approach, that doesn't try to reimplement everything from scratch, could do something like a strangler pattern: Take each ROS node, run them separately in “jails” with a Rust API around each one, then implement the plumbing/management logic in pure Rust.

fvncc commented on How to think about async/await in Rust   cliffle.com/blog/async-in... · Posted by u/mpweiher
charcircuit · 2 years ago
>In regular threaded programming, cancellation is a bit more painful

No, it isn't. Nothing is stopping your threading library from implementing the same thing. It just turns out it is a bad idea to kill threads at random points in time because they may own things like locks. Or in the case of async await doing something that is thought to be atomic.

fvncc · 2 years ago
Well each time you use the await keyword you are saying its a safe point to exit, which is more predictable than killing at random points. Holding locks across await points is an anti-pattern, and Rust at least can give a hint if you try to do that. Async/await implementations will also generally allow you to run cleanup code on cancellation (but the exact mechanism depends on the language).

In the end, its about expressing a state machine in a more concise implicit way, which is a suitable level of abstraction for most use cases.

fvncc commented on How to think about async/await in Rust   cliffle.com/blog/async-in... · Posted by u/mpweiher
usrbinbash · 2 years ago
Not specific to rust, but I think asynchronous programming in general is a hype.

It didn't start because it is so awesome, it started because JS can't do parallel any other way. That's the long and short of it. People wanted to use JS in the backend for some reason. The backend requires concurrency. JS cannot do concurrency. Enter the event loop. Then enter some syntactic sugar for the event loop. And since JS is popular, async became popular.

Code written using threads is, at least to me, much more readable and easier to reason about. Each section in itself is just synchronous code. The runtime/kernel take care of concurrency. The overhead is negligible in a day when we have greenlet implementations. It works for both i/o bound concurrency and cpu bound parallel computing. It doesn't require entire libraries rewritten to support it. There is no callback hell. It scales both horizontically and vertically. Modern languages support it out of the box (Hello `go` keyword).

I realise that this is going to get a lot of downvotes. I don't really care. To me, async is just "cooperative multitasking" with a quick paintjob. We left behind that paradigm in Operating Systems decades ago, and with good reason.

fvncc · 2 years ago
One advantage of async/await is that its easier to cancel things. For example, this leads to the design pattern where you have multiple futures and you want to select the one that finishes first and cancel the rest.

In regular threaded programming, cancellation is a bit more painful as you need to have some type of cancellation token used each time the thread waits for something. This a) is more verbose and b) can lead to bugs where you forget to implement the cancellation logic.

fvncc commented on Pynecone – Performant, customizable web apps in pure Python   pynecone.io/... · Posted by u/gilad
abraxas · 2 years ago
I played with it and subsequently turned my back on it in favor of alpine.js and some vanilla JavaScript to handle client state with Flask on the back end.

The reason I gave up on Pynecone is that these things transpile to other already high abstraction frameworks like React. This is all good and well until something goes wrong and you now have more layers to troubleshoot. Another huge downside to this approach is that now I have to deal with two sets of build and deployment tools: python and node. And given that I have few fond memories of the node tool set from previous project, I refuse to incur this complexity unless it's absolutely unavoidable.

If someone actually built something like Pynecone that targeted html/dom/js directly instead of wrapping node/react/next I would be the first to hop on the bandwagon. Because the API is very good but the way that sausage is made ain't pretty.

fvncc · 2 years ago
There are a few options I’ve seen for “liveview” type approaches in Python, see e.g. reactpy and streamlit. (Assuming you are not looking specifically for something that transpiles to JS.)
fvncc commented on Mojo – a new programming language for AI developers   modular.com/mojo... · Posted by u/lairv
jph00 · 2 years ago
If I have anything to do with it, there will be high level model training tools. Perhaps something a little like fastai, for instance?...
fvncc · 2 years ago
That would work nicely :)
fvncc commented on Mojo – a new programming language for AI developers   modular.com/mojo... · Posted by u/lairv
jph00 · 2 years ago
Hi Jeremy Howard here. I pop up in the launch video to demo super-fast matmul and mandelbrot in mojo. I'm pretty excited about this language, to say the least - not just for AI/ML, but for pretty much everything!

Lemme know if you have any questions and I'll answer as best as I can. (I'm an advisor to Modulo.)

fvncc · 2 years ago
Hi is there any plan to have high level model training tools (one example is things like Pytorch dataset loaders), or is the focus more on inference/deployment use cases?

u/fvncc

KarmaCake day35April 23, 2017View Original