Readit Newskarakanb commented on Benchmarking the Most Reliable Document Parsing API tensorlake.ai/blog/benchm... · Posted by u/calavera
I have been recently looking into extracting a bunch of details from a set of legacy invoice PDFs and had a subpar experience. Gemini was the best among the ones that I tried, but even that missed quite a bit. I'll definitely give this a look.
It seems like such a crowded space and there are many tools doing document extraction, I wonder if there's anything particular pulling more attention into the space?
karakanb commented on A16Z-backed data firms Fivetran, dbt Labs to merge in all-stock deal reuters.com/business/a16z... · Posted by u/mjirv
How will Fivetran and dbt who are detested for being overpriced and underfeatured in the segment they are supposed to be good at (ETL/ELT) be taking on being a datalake? That's orders of magnitude more complex in engineering and operating and they have no experience. This is really a play to consolidate, get rid of duplicate functions and provide a better experience to customers.
This seems to undermine the engineering muscle these companies have. Fivetran is well-capable of building a query engine, and with this merger, they also get access to SDF's query engine. They have the engineering capabilities, as well as the capital to attract the talent where needed.
I would not underestimate any of these players in the space.
karakanb commented on A16Z-backed data firms Fivetran, dbt Labs to merge in all-stock deal reuters.com/business/a16z... · Posted by u/mjirv
With Snowflake's new OpenFlow offering based on Apache Nifi, Snowflake will be able to become Fivetran faster than Fivetran can become Snowflake/Databricks, though....
Thoughts?
OpenFlow feels like an attempt at keeping customers within Snowflake boundaries, and while it might work for some, I see no way Snowflake being able to keep up with the data integration needs unless they allow another way of extending their capabilities other than pre-built integrations.
On the other hand, I do agree with you that it is quite a big challenge for Fivetran to try and become Snowflake.
karakanb commented on A16Z-backed data firms Fivetran, dbt Labs to merge in all-stock deal reuters.com/business/a16z... · Posted by u/mjirv
Disclaimer: I am the co-founder of a dbt alternative, Bruin. (https://github.com/bruin-data/bruin)
I think consolidation in the space has been coming for quite some time now and this merger only confirms what us, along with many others, have been saying: the data tooling is in a miserable state and we had to glue together a bunch of different tools that don't work with each other.
At this point, I think it is quite obvious that Fivetran is going for Snowflake/Databricks's market share. They own the ingestion for many companies already, and they will offer a managed data lake product in order to compete with the data giants. By owning the means of bringing the data in (Fivetran) as well as the transformation layer (dbt/sqlmesh) they will aim to get ahead of Snowflakes of the world.
I think it'll be a win for the data community if they maintain and continue investing into the existing tooling, as they are running in quite a few places already, especially dbt core running in a self-managed way. I certainly hope they won't try to squeeze revenue for the sake of it from their combined users.
It's an interesting time to be in the space, and it feels great to be one of the few independent players in the market.
This seems really interesting, thanks for sharing.
I can see myself deploying something like this for some of our internal usecases, however the deployment options around such tooling seem to be rather complicated, especially when it comes to the need for RAG and stuff. Would I need to host something else on top of Upsonic for these sorts of usecases?
Golang just gets bogged down in irrelevant details way too easily for this.