Mistral Introduces New OCR API That Can Convert PDF Documents Into AI-Prepared Format

Mistral launched the Mistral Optical Character Recognition (OCR) software programming interface (API) on Thursday. The synthetic intelligence (AI) mannequin is able to analysing and processing PDF paperwork and changing it into an AI-ready textual content format resembling Markdown or uncooked textual content file. The instrument is able to extracting information from PDFs to make them digestible for AI fashions. The Paris-based AI agency claimed that the Mistral OCR API will permit builders to construct AI purposes for PDF recordsdata in addition to permit them to create datasets to coach new AI fashions.

Mistral OCR API Introduced

PDF paperwork pose a singular problem for AI fashions. The content material on this file format can’t be accessed by massive language fashions (LLMs) utilizing conventional Retrieval-Augmented Generation (RAG) strategies as the info can’t be processed by them. For instance, when you ask an AI software to scan by PDF paperwork in your laptop computer to discover a piece of knowledge, it’d battle to take action.

This signifies that builders constructing AI purposes can be restricted in providing PDF-analysis functionality. While Google’s NotebookLM, Adobe’s AI assistant, and several other different instruments use specialised OCR instruments to beat this problem, builders within the open-source neighborhood should not have entry to a high-efficiency instrument.

Mistral OCR API solves this problem by permitting builders to extract PDF information into an AI-ready format. The firm claims in a newsroom publish that the instrument can perceive separate components in paperwork, together with media, textual content, tables, and equations with excessive accuracy. Once analysed, it might probably extract and current the data within the Markdown or a uncooked textual content file format.

AI fashions can then use this extracted textual content as enter and RAG techniques can simply entry them and reply queries about them. “Mistral OCR excels in understanding complex document elements, including interleaved imagery, mathematical expressions, tables, and advanced layouts such as LaTeX formatting. The model enables deeper understanding of rich documents such as scientific papers with charts, graphs, equations and figures,” the publish acknowledged.

The firm claimed that the Mistral OCR can course of as much as 2,000 pages per minute on a single node. The API additionally lets builders use the doc as a immediate, and chain outputs to construct perform calling instruments and AI brokers.

Based on inside testing, the Mistral OCR outperformed fashions resembling Google Document AI, Azure OCR, and GPT-4o model 2024-11-20 for “text-only” paperwork. It additionally outperformed Google and Azure in multilingual capabilities.

Those serious about making an attempt out the aptitude of the mannequin can go to Mistral’s Le Chat platform. The API might be accessed from la Plateforme.