Debanjum Singh Solanky b673d26a12 Extract Entries in a standardized format across text search types ...

Issue:
 - Had different schema of extracted entries for symmetric_ledger vs asymmetric

 - Entry extraction for asymmetric was dirty, relying on cryptic
   indices to store raw entry vs cleaned entry meant to be passed to embeddings

 - This was pushing the load of figuring out what property to extract
   from each entry to downstream processes like the filters

 - This limited the filters to only work for asymmetric search, not for
   symmetric_ledger

- Fix
   - Use consistent format for extracted entries
     {
       'embed': entry_string_meant_to_be_passed_to_model_and_get_embeddings,
       'raw'  : raw_entry_string_meant_to_be_passed_to_use
     }

 - Result
   - Now filters can be applied across search types, and the specific
     field they should be applied on can be configured by each search
     type

2022-07-19 20:52:25 +04:00

..

data

Give the project a short, less generic name. Rename it to Khoj

2022-07-19 18:26:16 +04:00

__init__.py

Move tests out to project root. Use absolute import in project

2021-09-30 04:12:14 -07:00

conftest.py

Use a more accurate model for symmetric semantic search

2022-07-18 20:27:26 +04:00

test_asymmetric_search.py

Give the project a short, less generic name. Rename it to Khoj

2022-07-19 18:26:16 +04:00

test_chatbot.py

Fix the user intent extraction prompt for GPT. Clean up chatbot test

2022-01-12 10:36:01 -05:00

test_cli.py

Update unit tests to use the new BaseModel types

2021-12-05 09:31:39 -05:00

test_client.py

Give the project a short, less generic name. Rename it to Khoj

2022-07-19 18:26:16 +04:00

test_date_filter.py

Extract Entries in a standardized format across text search types

2022-07-19 20:52:25 +04:00

test_helpers.py

Move tests out to project root. Use absolute import in project

2021-09-30 04:12:14 -07:00

test_image_search.py

Rename RawConfig Types for Consistency

2022-01-14 20:54:38 -05:00

test_orgnode.py

Normalize org notes path to be relative to home directory

2022-06-28 19:16:11 +04:00