klbr/khoj
1
0
Fork 0
mirror of https://github.com/khoaliber/khoj.git synced 2026-03-06 13:22:12 +00:00
Code Issues Packages Projects Releases Wiki Activity

Run explicit filter on raw entry, add more terms to split entries by

Browse Source 
- With \t Last Word in Headings was suffixed by \t and so couldn't be
filtered by
- User interacts with raw entries, so run explicit filters on raw entry
   - For semantic search using the filtered entry is cleaner, still
This commit is contained in:
Debanjum Singh Solanky
2022-07-14 21:54:04 +04:00
parent 7640e2ab0c
commit 3aac3c7d52
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
src/search_filter/explicit_filter.py
View File

@@ -18,8 +18,8 @@ def explicit_filter(raw_query, entries, embeddings):
entries_by_word_set = [set(word.lower()
for word
in re.split(
r',|\.| |\]|\[\(|\)|\{|\}', # split on fullstop, comma or any brackets
entry[0])
r',|\.| |\]|\[\(|\)|\{|\}|\t|\n|\:', # split on fullstop, comma or any brackets
entry[1])
if word != "")
for entry in entries]