Set index_heading_entries field in config to index entries with no body

- Previously heading entries were not indexed to maintain search quality
- But given that there are use-cases for indexing entries with no body
- Add a configurable `index_heading_entries' field to index heading entries
- This `TextContentConfig' field is currently only used for OrgMode content
This commit is contained in:
Debanjum Singh Solanky
2022-09-11 12:40:58 +03:00
parent 1d3b3d5f39
commit 253c9eae9a
3 changed files with 22 additions and 15 deletions

View File

@@ -18,6 +18,7 @@ class TextContentConfig(ConfigBase):
input_filter: Optional[str]
compressed_jsonl: Path
embeddings_file: Path
index_heading_entries: Optional[bool] = False
@validator('input_filter')
def input_filter_or_files_required(cls, input_filter, values, **kwargs):