Readit Newscraydandy commented on Should you ditch Spark for DuckDB or Polars? milescole.dev/data-engine... · Posted by u/RobinL
FYI I had V-Order and Optimzed Write disabled in the benchmark. The only wrote diff was that I enabled deletion vectors in Spark since it’s supported which the other two don’t.
Thanks for the clarification. I didn't see it in the article.
craydandy commented on Should you ditch Spark for DuckDB or Polars? milescole.dev/data-engine... · Posted by u/RobinL
Interesting and well-written article. Thanks to the author for writing it. Replacing Spark with these single-machine tools seems to be on the hype, and Spark is not en vogue anymore.
The author ran Spark in Fabric, which has V-Order write enabled by default. DuckDB and Polars don't have this, as it's an MS proprietary algorithm. V-Order adds about 15% overhead to write, so it does change the result a bit.
The data sizes were bit on a large size, at least for the data amounts I see daily. There definitely are tables in the 10GB, 100GB, and even in 1TB size range, but most tables traveling through data pipelines are much smaller.
craydandy commented on Retiring from the idea of retirement candost.blog/retiring-fro... · Posted by u/mooreds
I'm a software developer myself and had a rude awakening into the life of someone who loves what they do but can't do it due to a physical limitation recently. I'm lucky that It is fixable and I'm in the process but it makes me dread a time when I have something that can't be fixed.
I developed Cubital tunnel syndrome in both elbows which leads to extreme numbness and pain in my pinky, ring finger wrist, elbow and top of the hand when doing any activity requiring using my hands or bending elbow for even small minutes of time. Luckily I can get surgery for it, but I've still had to wait this long going through months of other prevention measures that didn't work at all before I was finally allowed to consider it.
Even though its only been 6 months, its been an extremely depressing ride not being physically able to do basic daily things including my job and passion of developing/learning about development without pain.
Its made me scared for the day when I wont be able to do this and many other things anymore since even just this short 6 months has been a rude awakening into the life of someone dealing with extreme pain in just daily life, and sympathize for people who are going through the same things.
For many people "retiring" doing what they love just is not possible.
I had pinched ulnaris nerve in both elbows a few years ago. The symptoms were pretty much the same as you describe. It took two operations and more than a year to recover. The symptoms started to creep back this year, probably because I started to hit the keyboard more. Luckily I found a book about trigger points [1] and releasing the triceps trigger points, especially #3 removes the symptoms. The book is godsend; I've found help from it to so many other issues too.
[1] https://www.amazon.com/Trigger-Point-Therapy-Workbook-Self-T...
craydandy commented on Detection of mRNA COVID-19 Vaccines in Human Breast Milk jamanetwork.com/journals/... · Posted by u/CentralHarvest
The comment on that page:
> The method (eSupplement) states the study was conduce between February and October 2020. That surprises me because the vaccinations being studied were not available to the public for that entire period. The first dose outside a clinical trial was given in Queens, New York on December 14 that year. Before this, they were only available as part of trials which excluded lactating individuals.
One of the authors has responded to the comment:
> The Supplement section of the letter states that the study was conducted from February to October 2020. The year reported was an error; the study was conducted in 2021. The Journal is in the process of correcting this error.
craydandy commented on Covid-19 can damage hearts of some college athletes directorsblog.nih.gov/202... · Posted by u/rkolberg
Quite the opposite. Covid is dangerous for elderly and people having severe medical condition, much, much less dangerous for young and healthy. Flu is more dangerous to young people than Covid.
Flu also causes hospitalizations in comparable amounts to Covid[1]. Note that we have a vaccine for flu, and it is still causing almost a million hospitalizations in bad seasons.
And here's the missing reference:
craydandy commented on Covid-19 can damage hearts of some college athletes directorsblog.nih.gov/202... · Posted by u/rkolberg
If you have to be hospitalized for the flu, you are pretty close to death's door. It's not a very common occurance.
Hospitalization for COVID is, unfortunately, quite common.
Quite the opposite. Covid is dangerous for elderly and people having severe medical condition, much, much less dangerous for young and healthy. Flu is more dangerous to young people than Covid.
Flu also causes hospitalizations in comparable amounts to Covid[1]. Note that we have a vaccine for flu, and it is still causing almost a million hospitalizations in bad seasons.
Loading parent story...
Loading comment...
Loading parent story...
Loading comment...