Commit Graph

  • 16c6bfce8e Improve Quality and Reliability of Offline Chat (#393) Debanjum 2023-08-01 22:07:27 -07:00
  • 44292afff2 Put offline model response generation behind the chat lock as well Debanjum Singh Solanky 2023-08-01 21:52:24 -07:00
  • 1812473d27 Extract new schema version for each migration script into a variable Debanjum Singh Solanky 2023-08-01 21:41:08 -07:00
  • b9937549aa Simplify migration scripts management. Make them use static version Debanjum Singh Solanky 2023-08-01 21:28:20 -07:00
  • 185a1fbed7 Remove old chat setup timer. It is mislabelled, irrelevant since streaming Debanjum Singh Solanky 2023-08-01 20:24:15 -07:00
  • 95acb1583d Update local Chat Actor and Director tests expected to fail Debanjum Singh Solanky 2023-08-01 20:13:47 -07:00
  • c2b7a14ed5 Fix context, response size for Llama 2 to stay within max token limits Debanjum Singh Solanky 2023-08-01 19:29:03 -07:00
  • 6e4050fa81 Make Llama 2 stop generating response on hitting specified stop words Debanjum Singh Solanky 2023-08-01 18:53:46 -07:00
  • aa6846395d Fix offline model migration script to run for version < 0.10.1 Debanjum Singh Solanky 2023-08-01 17:08:37 -07:00
  • 49abb9df9c Fix typo in orgnode.py (#397) Ikko Eltociear Ashimine 2023-08-02 11:54:57 +09:00
  • d8fa967b43 Update chat actor unit tests for greater accuracy and benchmarking sabaimran 2023-08-01 12:24:43 -07:00
  • f409e16137 Update some of the extract question prompts for llamav2 sabaimran 2023-08-01 12:23:36 -07:00
  • b11b00a9ff Add log line for time to first response sabaimran 2023-08-01 10:57:38 -07:00
  • 778df6be71 Add a logline when the offline model migration script runs sabaimran 2023-08-01 09:27:42 -07:00
  • 48363ec861 Add additional check for chat_messages length in UT sabaimran 2023-08-01 09:25:52 -07:00
  • 3a5d93d673 Add migration script for getting the new offline model sabaimran 2023-08-01 09:25:05 -07:00
  • 90efc2ea7a Update comments and add explanations sabaimran 2023-08-01 09:24:03 -07:00
  • f7e03f6d63 Switch spinner snake case -> camel case sabaimran 2023-08-01 08:52:25 -07:00
  • 1c52a6993f add a lock around chat operations to prevent the offline model from getting bombarded and stealing a bunch of compute resources sabaimran 2023-08-01 00:23:17 -07:00
  • 6c3074061b Disable the input bar when chat response is in flight sabaimran 2023-08-01 00:21:39 -07:00
  • c14cbe926a Add a loading symbol to web chat. Closes #392 sabaimran 2023-07-31 23:35:48 -07:00
  • 8054bdc896 Use n_batch parameter to increase resource consumption on host machine (and implicitly engage GPU) sabaimran 2023-07-31 23:25:08 -07:00
  • e55e9a7b67 Fix unit tests and truncation logic sabaimran 2023-07-31 21:37:59 -07:00
  • 2335f11b00 Add better error handling for download processes incase of failure sabaimran 2023-07-31 21:07:38 -07:00
  • 95c7b07c20 Make the fake message longer sabaimran 2023-07-31 20:55:19 -07:00
  • 8dd5756ce9 Add new director tests for the offline chat model with llama v2 sabaimran 2023-07-31 20:24:52 -07:00
  • 209975e065 Resolve merge conflicts: let Khoj fail if the model tokenizer is not found sabaimran 2023-07-31 19:12:26 -07:00
  • 2d6c3cd4fa Misc. quality improvements for Llama V2 sabaimran 2023-07-31 19:11:20 -07:00
  • ca195097d7 Update chat hint message at first run sabaimran 2023-07-31 17:46:09 -07:00
  • ded606c7cb Fix format of user query during general conversation with Llama 2 Debanjum Singh Solanky 2023-07-31 17:07:20 -07:00
  • 48e5ac0169 Do not drop system message when truncating context to max prompt size Debanjum Singh Solanky 2023-07-31 16:36:31 -07:00
  • 02e216c135 Clarify usage in telmetry.md Saba 2023-07-30 22:37:20 -07:00
  • 7eabf8ab0f Add instructions for installing the desktop app and opting out of telemetry Saba 2023-07-30 22:26:52 -07:00
  • 88ef86ad5c Fix typing issues for mypy (#372) sabaimran 2023-07-31 02:27:48 +00:00
  • ca2c942b65 Add typing to compiled_references and inferred_queries sabaimran 2023-07-30 19:10:30 -07:00
  • dbb54cfcfa Merge branch 'master' of github.com:khoj-ai/khoj sabaimran 2023-07-30 18:52:17 -07:00
  • 3646fd1449 Add a warning to indicate that Khoj is not configured to work with personal data sources sabaimran 2023-07-30 18:52:10 -07:00
  • 996832dc72 Allow user to chat even if content types aren't configured - use empty references sabaimran 2023-07-30 18:47:45 -07:00
  • 41d36a5ecc Merge pull request #371 from felixonmars/patch-1 Debanjum 2023-07-30 18:37:22 -07:00
  • f4fdfe8d8c Correct typos in setup.md Felix Yan 2023-07-31 03:32:56 +03:00
  • 28df08b907 Fix configure openai processor for khoj docker Debanjum Singh Solanky 2023-07-30 02:07:33 -07:00
  • dffbfee62b Fix sample khoj docker config to index test data using new schema Debanjum Singh Solanky 2023-07-30 01:48:18 -07:00
  • 53810a0ff7 Create khoj config dir if non-existant, before writing to khoj env file Debanjum Singh Solanky 2023-07-30 01:35:36 -07:00
  • 56394d2879 Update demo video to configure offline chat via the web interface Debanjum Singh Solanky 2023-07-29 19:17:40 -07:00
  • b32673db8e Fix link to Docs website in Khoj readme on Github Debanjum Singh Solanky 2023-07-29 12:50:22 -07:00
  • a3d1212e79 Align docs landing page with updated github readme Debanjum Singh Solanky 2023-07-29 12:42:36 -07:00
  • d7205aed36 Update docs with setup instructions for Offline and Online Chat Debanjum Singh Solanky 2023-07-29 10:49:40 -07:00
  • 0404e33437 Add screenshots, style content in README Debanjum 2023-07-29 01:22:48 -07:00
  • f65d157244 Release Khoj version 0.10.0 sabaimran 2023-07-28 19:27:47 -07:00
  • f76af869f1 Do not log the gpt4all chat response stream in khoj backend Debanjum Singh Solanky 2023-07-28 19:14:04 -07:00
  • 5ccb01343e Add Offline chat to Obsidian (#359) sabaimran 2023-07-29 01:47:56 +00:00
  • b3c1507708 Merge pull request #361 from khoj-ai/configure-offline-chat-from-emacs Debanjum 2023-07-28 18:06:58 -07:00
  • 9f78db0579 Let Offline chat override OpenAI API settings (#362) sabaimran 2023-07-29 00:26:20 +00:00
  • ebfbef1f68 Configure using offline chat from Emacs Debanjum Singh Solanky 2023-07-28 16:04:34 -07:00
  • 9b1048caf7 Remove asymmetric from name of remaining text search tests Debanjum Singh Solanky 2023-07-28 15:33:22 -07:00
  • 12cfb48f16 Fix gpt4all import error in Desktop builds (#356) sabaimran 2023-07-28 18:54:18 +00:00
  • 4b0639cfbd Merge pull request #354 from ducksblock/master Debanjum 2023-07-28 11:00:12 -07:00
  • cbecd7b66f Fix #353: Remove references to localhost:8000 ducksblock 2023-07-28 13:57:00 +05:30
  • 702486dab7 Add gpt4all for copying metadata sabaimran 2023-07-27 22:22:24 -07:00
  • 29081f4429 Adjust parameters for offline chat sabaimran 2023-07-27 22:22:09 -07:00
  • 124d97c26d Replace Falcon 🦅 model with Llama V2 🦙 for offline chat (#352) sabaimran 2023-07-28 03:51:20 +00:00
  • 55965eea7d Delete FUNDING.yml sabaimran 2023-07-27 15:28:47 -07:00
  • 925177b150 Update FUNDING.yml sabaimran 2023-07-27 15:19:20 -07:00
  • 78197bb5c3 Create FUNDING.yml sabaimran 2023-07-27 15:16:45 -07:00
  • da3f4dc7e4 Fix test config to run OpenAI Chat Actor, Director tests Debanjum Singh Solanky 2023-07-27 11:27:32 -07:00
  • 715d56d4f0 Use new schema to update khoj.yml config from khoj.el Debanjum Singh Solanky 2023-07-26 17:34:16 -07:00
  • 8b2af0b5ef Add support for our first Local LLM 🤖🏠 (#330) sabaimran 2023-07-26 23:27:08 +00:00
  • 23d77ee338 Fix import issues in desktop image builds (#343) sabaimran 2023-07-26 22:45:52 +00:00
  • 8dcc21052f Add chat-model param in sample config yml and document (#341) Justin Bassett-Green 2023-07-22 18:53:08 -05:00
  • 5bb42e56a8 Fix formatting of khoj test config and unused references in conftests Debanjum Singh Solanky 2023-07-22 00:28:14 -07:00
  • 7722a9c347 Default to using the gpt-3.5-turbo model for chat from khoj.el Debanjum Singh Solanky 2023-07-22 00:26:52 -07:00
  • 36d25c4f1d Center the title, add table headers Saba 2023-07-21 23:36:38 -07:00
  • 01b6a10cd1 Simplify readme Saba 2023-07-21 23:30:44 -07:00
  • 4ce072c4b3 Make the README on our Github minimal (#334) sabaimran 2023-07-21 23:29:04 -07:00
  • 4089e38283 Fix links to demos and screenshots in docs Debanjum Singh Solanky 2023-07-21 20:01:19 -07:00
  • 89ad362758 Update Screenshots and Demos in Docs Debanjum Singh Solanky 2023-07-21 15:22:35 -07:00
  • f0d4a4cf9a Revert "Make configure_content functional. Do not pass content index state to it." Debanjum Singh Solanky 2023-07-21 13:57:16 -07:00
  • 82c725817e Merge branch 'master' of github.com:khoj-ai/khoj sabaimran 2023-07-21 13:24:05 -07:00
  • 596e11ec6d Use the same function for computing entries for IDs regardless of whether it has prev entries sabaimran 2023-07-21 13:23:56 -07:00
  • 634f0b4cc4 Fix docs indexing issue Saba 2023-07-21 08:30:00 -07:00
  • c28755ccd2 Fix diff blocks, links, remove footnotes & rearrange sections in docs Debanjum Singh Solanky 2023-07-21 00:05:44 -07:00
  • 2ddee7e745 Make configure_content functional. Do not pass content index state to it. Debanjum Singh Solanky 2023-07-20 23:13:16 -07:00
  • e92bc0e2e6 Create CNAME to make Docs accessible at docs.khoj.dev Debanjum 2023-07-20 23:00:26 -07:00
  • 1610d2ebd9 📝 Add a documentation base for Khoj! (#333) sabaimran 2023-07-20 22:34:25 -07:00
  • 3e59be7f1d Release Khoj version 0.9.0 Debanjum Singh Solanky 2023-07-18 19:59:27 -07:00
  • d078e7b1f6 Clean up search type usage in khoj server, tests and Readme Debanjum Singh Solanky 2023-07-18 19:34:09 -07:00
  • 4d910936b7 Fix triggering index update on khoj server from khoj.el Debanjum Singh Solanky 2023-07-18 19:32:06 -07:00
  • 5c7d7f558d Make AI model used for Khoj chat configurable from khoj.el Debanjum Singh Solanky 2023-07-18 17:54:43 -07:00
  • 5f2be2a9bb Merge pull request #298 from HyunggyuJang/patch-1 Debanjum 2023-07-18 17:54:11 -07:00
  • 3a1c5a6dab Merge pull request #329 from khoj-ai/create-schema-migration-func-and-reindex-to-fix-corruption Debanjum 2023-07-18 16:43:17 -07:00
  • 429e1b4b48 Regenerate index to apply corruption fixes on first run of new khoj Debanjum Singh Solanky 2023-07-18 16:10:47 -07:00
  • 83e1088d42 Manage khoj.yml config migrations on app start. Version the schema Debanjum Singh Solanky 2023-07-18 15:27:55 -07:00
  • 71e8ddd9a2 Check if PDF is configured before showing it as an option in khoj.el Debanjum Singh Solanky 2023-07-17 15:49:20 -07:00
  • d00c5da8b7 Merge pull request #325 from khoj-ai/stablize-simplify-content-indexing Debanjum 2023-07-17 14:51:10 -07:00
  • 3e3a1ecbc8 Start app even if server init fails to let user fix it Debanjum Singh Solanky 2023-07-17 14:33:02 -07:00
  • ef6a0044f4 Drop embeddings of deleted text entries from index Debanjum Singh Solanky 2023-07-16 03:47:05 -07:00
  • c73feebf25 Test index embeddings are stable on incremental update & no norm Debanjum Singh Solanky 2023-07-16 02:16:58 -07:00
  • ad41ef3991 Make normalizing embeddings configurable Debanjum Singh Solanky 2023-07-16 02:16:33 -07:00
  • 1482fd4d4d Test index is stable sorted on incremental update with new entry Debanjum Singh Solanky 2023-07-16 01:24:03 -07:00
  • b02323ade6 Improve name of text search test functions Debanjum Singh Solanky 2023-07-16 01:23:22 -07:00