Check it out at https://doctly.ai
Readit Newskapitalx commented on PDF to Text, a challenging problem marginalia.nu/log/a_119_p... · Posted by u/ingve
When accommodating the general case, solving PDF-to-text is approximately equivalent to solving JPEG-to-text.
The only PDF parsing scenario I would consider putting my name on is scraping AcroForm field values from standardized documents.
This is approximately the approach we're taking also at https://doctly.ai, add to that a "multiple experts" approach for analyzing the image (for our 'ultra' version), and we get really good results. And we're making it better constantly.
kapitalx commented on Show HN: Qwen-2.5-32B is now the best open source OCR model github.com/getomni-ai/ben... · Posted by u/themanmaran
kapitalx commented on Show HN: Qwen-2.5-32B is now the best open source OCR model github.com/getomni-ai/ben... · Posted by u/themanmaran
If you're limited to open source models, that's very true. But for larger models and depending on your document needs, we're definitely seeing very high accuracy (95%-99%) for direct to json extraction (no markdown in between step) with our solution at https://doctly.ai.
In addition, gemini Pro 2.5 does really well with bounding boxes, but yeah not open source :(
kapitalx commented on Show HN: Qwen-2.5-32B is now the best open source OCR model github.com/getomni-ai/ben... · Posted by u/themanmaran
I suppose none of these models can output bounding box coordinates for extracted text? That seems to be a big advantage of traditional OCR over LLMs.
For applications I'm interested in, until we can get to 95+% accuracy, it will require human double-checking / corrections, which seems unfeasible w/o bounding boxes to quickly check for errors.
If you're limited to open source models, that's very true. But for larger models and depending on your document needs, we're definitely seeing very high accuracy (95%-99%) for direct to json extraction (no markdown in between step) with our solution at https://doctly.ai.
Deleted Comment
We're building Doctly.ai - PDF Extraction with AI.
We started out with document conversions to Markdown but quickly realized that most use cases were for JSON conversion. We recently launched our "Extractor Studio" where you can have AI analyze a few sample variations of your documents and come up with a schema for you and publish it to an API endpoint.
We've built a technique on top of AI models that dramatically improves run to run consistency of JSON output.
Checkout the blog post here: https://medium.com/@abasiri/introducing-doctlys-extractor-st...