But looks like there are plenty of products coming out in this area, and it has me wondering: what is the actual big picture for enterprises here?
I would assume enterprises employ enough people to write yet another query for whatever use case.
- Is the expectation that in the future, we can bring the flexibility of SQL-like languages to people unfamiliar with SQL?
- Perhaps a salesperson unfamiliar with SQL would like to conduct an analysis. Is the volume and variety of such queries so high that optimizing for the turnaround time from an SQL query designed by data analyst to the salesperson to consume the results is so worthwhile?
Perhaps I am underestimating the scale of the problem but would love some insider perspective here.
1) I appreciate that it's said to be local first but the fact that it depends on an OpenAI API usage is...kinda a big hole in that? The organization I work in wouldn't really accept this for approval, and from the title I was hoping that this would be a local-first fine tuned (or fine-tunable) LLM.
2) The about page stating that you met at Princeton is a huge bear signal for me. I don't think tools should be adopted based on how much of an elite (cognitive or financial or social or athletic or whatever) their creators are, and given the use of the OpenAI APIs I question why the "top ML conferences" bit is here at all.
2 - agreed the background isn't why anyone should adopt a tool, just wanted to share our story. I would add that creating a good wrapper can actually be quite challenging, need to synthesize many pieces under constraints like memory, compute, speed, accuracy.
https://github.com/defog-ai/sql-eval