Add support for indexing plaintext files (#420)

* Add support for indexing plaintext files
- Adds backend support for parsing plaintext files generically (.html, .txt, .xml, .csv, .md)
- Add equivalent frontend views for setting up plaintext file indexing
- Update config, rawconfig, default config, search API, setup endpoints
* Add a nifty plaintext file icon to configure plaintext files in the Web UI
* Use generic glob path for plaintext files. Skip indexing files that aren't in whitelist
This commit is contained in:
sabaimran
2023-08-09 22:44:40 +00:00
committed by GitHub
parent 84d774ea34
commit 7b907add77
14 changed files with 314 additions and 15 deletions

View File

@@ -25,4 +25,4 @@ search-type:
asymmetric:
cross-encoder: cross-encoder/ms-marco-MiniLM-L-6-v2
encoder: sentence-transformers/msmarco-MiniLM-L-6-v3
version: 0.9.1.dev0
version: 0.10.1