Readit News logoReadit News
Sheldon_fun commented on Data Engineering 2025: Unified Batch‑Streaming, Iceberg Rise and Data Contracts   old.reddit.com/r/dataengi... · Posted by u/Sheldon_fun
Sheldon_fun · 4 days ago
I’m curious: Have you started using data contracts in your pipelines? Is the unified batch/stream model worth the added complexity?
Sheldon_fun commented on The Equality Delete Problem in Apache Iceberg   risingwave.com/blog/the-e... · Posted by u/Sheldon_fun
Sheldon_fun · 11 days ago
From my private conversations with several Iceberg PMC members, it’s clear that full equality delete support across major query engines will be slow — not due to lack of will, but due to complexity.
Sheldon_fun commented on Why Postgres CDC to Iceberg isn't a solved problem: lessons from production   risingwave.com/blog/postg... · Posted by u/Sheldon_fun
Sheldon_fun · a month ago
Although the last time I touched Debezium in 2020, it was too immature to adopt, I thought surely its problems had been solved by now. Apparently not. I really appreciate this in-depth list of real-world problems encountered by clients trying to pipe CDC-captured changes.

u/Sheldon_fun

KarmaCake day94July 10, 2023View Original