Support Indexing Images via OCR (#823)

Browse Source

- Added support for uploading .jpeg, .jpg, and .png files to Khoj from Web, Desktop app
- Updating indexer to generate raw text and entries using RapidOCR
- Details
  * added support for indexing images via ocr
  * fixed pyproject.toml
  * Update src/khoj/processor/content/images/image_to_entries.py
     Co-authored-by: Debanjum <debanjum@gmail.com>
  * Update src/khoj/processor/content/images/image_to_entries.py
     Co-authored-by: Debanjum <debanjum@gmail.com>
  * removed redudant try except blocks
  * updated desktop js file to support image formats
  * added tests for jpg and png
  * Fix processing for image to entries files
  * Update unit tests with working image indexer
  * Change png test from version verificaition to open-cv verification

---------

Co-authored-by: Debanjum <debanjum@gmail.com>
Co-authored-by: sabaimran <narmiabas@gmail.com>

...

This commit is contained in:

Raghav Tirumale

2024-07-01 09:00:00 -04:00

committed by GitHub

parent c83b8f2768

commit 8eccd8a5e4

10 changed files with 180 additions and 7 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

BIN

tests/data/images/nasdaq.jpg vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 1.4 MiB

BIN

tests/data/images/testocr.png vendored Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 59 KiB