Repository navigation
Open
Labels
enhancementNew feature or requestNew feature or request
Description
Reference Issues
Summary
Would like to have docling implement OCR scanning for documents that have images.
Basic Example
Not sure how to implement this in docling_loader.py but basically need docling to use OCR when images are detected in a PDF, then to use OCR to extract the text from the images inside the PDF so it can be used for RAG. Example of docling with OCR:
pip install huggingface_hub docling opencv-python
pip install rapidocr_onnxruntime
import os
from huggingface_hub import snapshot_download
from docling.datamodel.pipeline_options import PdfPipelineOptions, RapidOcrOptions
from docling.document_converter import (
ConversionResult,
DocumentConverter,
InputFormat,
PdfFormatOption,
)
def main():
# Source document to convert
source = "./input/2408.09869v4.pdf"
# Download RapidOCR models from HuggingFace
print("Downloading RapidOCR models")
download_path = snapshot_download(repo_id="SWHL/RapidOCR")
# Setup RapidOcrOptions for english detection
det_model_path = os.path.join(
download_path, "PP-OCRv4", "en_PP-OCRv3_det_infer.onnx"
)
rec_model_path = os.path.join(
download_path, "PP-OCRv4", "ch_PP-OCRv4_rec_server_infer.onnx"
)
cls_model_path = os.path.join(
download_path, "PP-OCRv3", "ch_ppocr_mobile_v2.0_cls_train.onnx"
)
ocr_options = RapidOcrOptions(
det_model_path=det_model_path,
rec_model_path=rec_model_path,
cls_model_path=cls_model_path,
)
pipeline_options = PdfPipelineOptions(
ocr_options=ocr_options,
)
# Convert the document
converter = DocumentConverter(
format_options={
InputFormat.PDF: PdfFormatOption(
pipeline_options=pipeline_options,
),
},
)
conversion_result: ConversionResult = converter.convert(source=source)
doc = conversion_result.document
md = doc.export_to_markdown()
# Create the output filename based on the input filename
input_filename = os.path.basename(source)
input_filename_without_extension = os.path.splitext(input_filename)[0]
output_filename = f"{input_filename_without_extension}.md"
# Create the 'output' directory if it doesn't exist
output_directory = "output"
os.makedirs(output_directory, exist_ok=True)
output_path = os.path.join(output_directory, output_filename)
# Write the Markdown output to the file
with open(output_path, 'w', encoding='utf-8') as outfile:
outfile.write(md)
print(f"Markdown output written to: {output_path}")
if __name__ == "__main__":
main()
Drawbacks
None, since it will enable PDFs that have images and no text (such as scanned pages from a scanner that creates a PDF) to have text extraction.
Additional information
No response
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request
Activity
heapsoftware commentedon Jun 9, 2025
I would also like to have the ability to set the URL for docling in your UI so it can be installed on a different server, since I got docling using EasyOCR on a RTX5090 in a different docker container on a different IP and dont want to pip install it to the docker container running kotaemon.