Debanjum Singh Solanky d9d133dfb9 Read text files as utf-8, instead of default os locale ...

On Windows, the default locale isn't utf8. Khoj had regressed to
reading files in OS specified locale encoding, e.g cp1252, cp949 etc.

It now explicitly uses utf8 encoding to read text files for indexing

Resolves #495, resolves #472

2023-10-17 21:47:19 -07:00

..

data

Fix plaintext HTML parsing and rendering (#464)

2023-08-27 11:24:30 -07:00

__init__.py

Move tests out to project root. Use absolute import in project

2021-09-30 04:12:14 -07:00

conftest.py

Update chat config schema. Make max_prompt, chat tokenizer configurable

2023-10-15 16:35:11 -07:00

test_cli.py

Remove PySide dependency and deprecate desktop builds (#475)

2023-09-07 11:36:27 -07:00

test_client.py

Mark test_get_configured_types_via_api unit test as flaky

2023-10-17 05:56:00 -07:00

test_conversation_utils.py

Add additional check for chat_messages length in UT

2023-08-01 09:25:52 -07:00

test_date_filter.py

Update date filter test to use compiled rather than raw key

2023-09-18 11:24:56 -07:00

test_file_filter.py

Add method to extract filter terms from query to all filters

2023-08-28 00:55:28 -07:00

test_gpt4all_chat_actors.py

Update Chat Actor test to not incept with prior world knowledge

2023-10-15 17:22:44 -07:00

test_gpt4all_chat_director.py

Enable passing search query filters via chat and test it

2023-08-28 09:24:32 -07:00

test_helpers.py

Use Black to format Khoj server code and tests

2023-02-17 11:55:17 -06:00

test_image_search.py

Update Tests to setup both content_index, search_models before testing

2023-07-14 01:29:48 -07:00

test_jsonl_to_jsonl.py

Prepend entry heading to all compiled org snippets to improve search context

2023-05-03 22:50:31 +08:00

test_markdown_to_jsonl.py

Move to a push-first model for retrieving embeddings from local files (#457)

2023-08-31 12:55:17 -07:00

test_openai_chat_actors.py

Add support for our first Local LLM 🤖🏠 (#330)

2023-07-26 16:27:08 -07:00

test_openai_chat_director.py

Enable passing search query filters via chat and test it

2023-08-28 09:24:32 -07:00

test_org_to_jsonl.py

Move to a push-first model for retrieving embeddings from local files (#457)

2023-08-31 12:55:17 -07:00

test_orgnode.py

Move to a push-first model for retrieving embeddings from local files (#457)

2023-08-31 12:55:17 -07:00

test_pdf_to_jsonl.py

Let fs_syncer pass PDF files directly as binary before indexing

2023-10-17 04:58:13 -07:00

test_plaintext_to_jsonl.py

Move to a push-first model for retrieving embeddings from local files (#457)

2023-08-31 12:55:17 -07:00

test_rawconfig.py

Add front-end Electron application for Khoj local file syncing (#473)

2023-09-06 12:04:18 -07:00

test_text_search.py

Read text files as utf-8, instead of default os locale

2023-10-17 21:47:19 -07:00

test_word_filter.py

Add method to extract filter terms from query to all filters

2023-08-28 00:55:28 -07:00