Commit Graph

  • 89c7819cb7 Unify logic to generate embeddings from scratch and incrementally Debanjum Singh Solanky 2023-07-16 00:22:14 -07:00
  • 6a0297cc86 Stable sort new entries when marking entries for update Debanjum Singh Solanky 2023-07-15 23:58:13 -07:00
  • 7669b85da6 Test index is stable sorted on regenerate with new entry Debanjum Singh Solanky 2023-07-16 00:47:11 -07:00
  • 6e70b914c2 Remove unused dump_jsonl method Debanjum Singh Solanky 2023-07-15 20:42:26 -07:00
  • 9bcca43299 Use single func to handle indexing from scratch and incrementally Debanjum Singh Solanky 2023-07-15 20:03:19 -07:00
  • 1673bb5558 Add todo state to compiled form of each org-mode entry Debanjum Singh Solanky 2023-07-15 19:55:40 -07:00
  • 88d1a29a84 Test index is stable for duplicate entries across regenerate, update Debanjum Singh Solanky 2023-07-15 17:18:07 -07:00
  • da98b92dd4 Create helper function to test value, order of entries & embeddings Debanjum Singh Solanky 2023-07-15 14:33:15 -07:00
  • 7ad96036b0 Improve lock name to config_lock instead of search_index_lock Debanjum Singh Solanky 2023-07-15 12:07:07 -07:00
  • 58d86d7876 Use single func to configure server via API and on server start Debanjum Singh Solanky 2023-07-15 12:01:37 -07:00
  • a15711e635 Fix null type checks in get /config sabaimran 2023-07-15 15:53:56 -07:00
  • e590d75b20 Start Khoj even when config is not valid (#320) sabaimran 2023-07-15 14:11:54 -07:00
  • 49ab201c30 Fix issues importing PySide in Docker container (#322) sabaimran 2023-07-15 13:33:13 -07:00
  • ba47f2ab39 Merge branch 'master' of github.com:debanjum/khoj sabaimran 2023-07-14 22:28:05 -07:00
  • 874cffd256 Add additional support for parsing notion workspaces sabaimran 2023-07-14 22:27:56 -07:00
  • 52f68167ce Merge pull request #317 from khoj-ai/reduce-memory-consumption-by-search-model-duplication Debanjum 2023-07-14 19:54:12 -07:00
  • f08e9539f1 Release lock after updating index even if update fails to prevent deadlock Debanjum Singh Solanky 2023-07-14 16:57:27 -07:00
  • 37f7f9fd1d Add additional telemetry for system understanding (#316) sabaimran 2023-07-14 10:14:07 -07:00
  • b9fb656657 Update Tests to setup both content_index, search_models before testing Debanjum Singh Solanky 2023-07-14 01:19:38 -07:00
  • 86e2bec9a0 Reuse Search Models across Content Types to Reduce Memory Consumption Debanjum Singh Solanky 2023-07-14 01:07:44 -07:00
  • c2249eadb2 Add a Github workflow that allows you to build dev versions of Desktop applications (#309) sabaimran 2023-07-13 22:11:39 -07:00
  • b2718d330c Merge pull request #304 from migrate-from-pyqt-to-pyside Debanjum 2023-07-13 11:54:47 -07:00
  • 31e933207f Set default values for sys.stdout if they're unavailable sabaimran 2023-07-12 22:22:49 -07:00
  • 9c76150895 Migrate from PyQT6 to PySide6 Debanjum Singh Solanky 2023-07-11 18:43:44 -07:00
  • 83ed8561ee Reduce size of Docker image and build it from local code Debanjum 2023-07-11 01:30:06 -07:00
  • 88c42b3043 Encode data as utf-8 HyunggyuJang 2023-07-11 17:06:05 +09:00
  • 6308388dfc Install Khoj on Docker from local app instead of pulling from github Debanjum Singh Solanky 2023-07-11 00:41:05 -07:00
  • 802472cd99 Reduce Khoj Docker image size by 2Gb by not caching pip packages Debanjum Singh Solanky 2023-07-10 23:27:02 -07:00
  • f664a74e77 Update Khoj server to run on non standard port, 42110 instead of 8000 Debanjum Singh Solanky 2023-07-10 20:16:25 -07:00
  • bfd516c1a4 Deprecate (unmaintained) support to setup Khoj via Conda Debanjum Singh Solanky 2023-07-10 20:08:07 -07:00
  • 58c2c3b71a Add Documentation to Release Khoj Debanjum Singh Solanky 2023-07-10 15:59:34 -07:00
  • effb52f859 Fix demo rendering with the new header sabaimran 2023-07-10 21:16:19 -07:00
  • 55f5be7b03 Release Khoj version 0.8.2 sabaimran 2023-07-10 14:39:32 -07:00
  • 9a63f89f33 Merge branch 'master' of github.com:debanjum/khoj sabaimran 2023-07-10 14:31:19 -07:00
  • 53809298c0 Release Khoj version 0.8.1 sabaimran 2023-07-10 14:30:04 -07:00
  • 5b37e988e6 Allow using configured GPT chat model (#292) tjsousa 2023-07-10 22:24:40 +01:00
  • 75ff871217 Release Khoj version 0.8.0 Debanjum Singh Solanky 2023-07-10 13:37:51 -07:00
  • 979088b3dc Add tooltip helper text on web settings page buttons Debanjum Singh Solanky 2023-07-10 13:32:41 -07:00
  • 255781e135 Use relative link on logo to jump to correct page on local and cloud Debanjum Singh Solanky 2023-07-10 13:22:20 -07:00
  • b2d229c116 Move header pane style to base khoj.css for reuse. Fix logo size Debanjum Singh Solanky 2023-07-10 13:10:17 -07:00
  • f4cef377ca Add details to run, configure Khoj via Web in Readme Debanjum Singh Solanky 2023-07-10 11:54:57 -07:00
  • 20cb314171 Open the Khoj config page in the browser on first run Debanjum Singh Solanky 2023-07-10 11:52:56 -07:00
  • 07cf5a214a Check if PDF files are present in the Obsidian vault before initializing the Khoj configuration (#293) sabaimran 2023-07-10 10:33:04 -07:00
  • 7364bac8ae Make the header take up less space sabaimran 2023-07-09 22:31:37 -07:00
  • 62704cac09 Add a plugin which allows users to index their Notion pages (#284) sabaimran 2023-07-09 15:29:26 -07:00
  • 77755c0284 Fix Packaging the Khoj Desktop Apps (#289) Debanjum 2023-07-09 10:21:16 -07:00
  • 4c135ea316 Make streaming optional for the /chat endpoint (#287) sabaimran 2023-07-09 10:12:09 -07:00
  • 0a86220d42 Use default values, delete content config on disable and update state Debanjum Singh Solanky 2023-07-07 20:35:32 -07:00
  • 362063f5fe By default, connect to Khoj server over IPv4 from Obsidian plugin Debanjum Singh Solanky 2023-07-07 18:54:36 -07:00
  • 571e8c2548 Add rerank, index corruption hint on search page of web interface Debanjum Singh Solanky 2023-07-07 18:50:09 -07:00
  • 4b79d8216f Move remaining chat actors to use OpenAI chat models Debanjum 2023-07-07 18:53:05 -07:00
  • 61e131f95c Hide unused model field from chat settings on web interface Debanjum Singh Solanky 2023-07-07 18:38:08 -07:00
  • af30d01e85 Move to newer chat models to extract questions & summarize chats Debanjum Singh Solanky 2023-07-07 17:14:23 -07:00
  • 171ce19e1f Update date filter to allow quoting values in single quotes Debanjum Singh Solanky 2023-07-07 17:13:47 -07:00
  • e588f7c528 Deprecate unused beta search and answer API endpoints Debanjum Singh Solanky 2023-07-07 16:38:07 -07:00
  • c9fc4d1296 Revert to using cross-encoder to improve search results used by chat Debanjum Singh Solanky 2023-07-07 15:31:34 -07:00
  • 11f0a9f196 Fix chat tests since streaming. Pass args correctly to chat methods Debanjum Singh Solanky 2023-07-07 15:23:44 -07:00
  • 48870d9170 Fix parsing questions generated by extract_questions actor into list Debanjum Singh Solanky 2023-07-07 15:18:55 -07:00
  • 279662620b Move results count to settings page on web. Use it for search & chat Debanjum Singh Solanky 2023-07-07 14:08:08 -07:00
  • 2ec8da89e8 Remove Update button from Khoj Search page on the Web interface Debanjum Singh Solanky 2023-07-07 12:49:58 -07:00
  • bf427cd8dd Set no. of results used to generate chat response from Khoj Emacs Debanjum Singh Solanky 2023-07-07 12:34:50 -07:00
  • 1d77fe712c Set no. of results used to generate chat response from Khoj Obsidian Debanjum Singh Solanky 2023-07-07 12:32:32 -07:00
  • 2f31de5ed5 Set no. of references to use for chat configurable in Chat API Debanjum Singh Solanky 2023-07-07 12:29:36 -07:00
  • d97682fdac Use tooltip, placeholders to guide Khoj setup via web settings page Debanjum Singh Solanky 2023-07-06 21:37:48 -07:00
  • f5cf09424b Use more descriptive field names for content type settings on Khoj web Debanjum Singh Solanky 2023-07-06 20:47:39 -07:00
  • a2c668268f Use node-fetch >=3.1.0 in khoj obsidian plugin to avoid security vulnerability Debanjum Singh Solanky 2023-07-06 13:01:05 -07:00
  • d688ddf92c Re-instate the scheduler for the demo instances (#279) sabaimran 2023-07-06 11:01:32 -07:00
  • 8f36572a9b Improve typing, null checks in controllers and gpt functions Debanjum Singh Solanky 2023-07-05 20:49:25 -07:00
  • 41ac1e24c9 Add docs for a pre-emptive setup of Khoj for later offline usage Debanjum Singh Solanky 2023-07-05 20:45:00 -07:00
  • 6c2a8a5bce ️ Stream Responses by Khoj Chat on Web, Obsidian Debanjum 2023-07-05 20:02:11 -07:00
  • e111eda6ae Make client, app_config optional in telemetry logger for correct typing Debanjum Singh Solanky 2023-07-05 18:55:14 -07:00
  • e562114f6b Improve comments, var names in js for chat streaming on web interface Debanjum Singh Solanky 2023-07-05 18:53:49 -07:00
  • 46269ddfd3 Fix chat logging messages to get context without flooding logs Debanjum Singh Solanky 2023-07-05 18:27:06 -07:00
  • 0ba838b53a Show temp status message in Khoj Obsidian chat while Khoj is thinking Debanjum Singh Solanky 2023-07-05 18:01:49 -07:00
  • 8271abe729 Use optional chaining operator to extract khojBannerSubmit from conditional Debanjum Singh Solanky 2023-07-05 17:24:42 -07:00
  • c12ec1fd03 Show temp status message in Khoj web chat while Khoj is thinking Debanjum Singh Solanky 2023-07-05 17:19:39 -07:00
  • 257a421e45 Bonus: add try-catch logic around telemetry upload in case of JSON serializability issues sabaimran 2023-07-05 15:12:18 -07:00
  • 4e6b66b139 Add support for streaming chat response from OpenAI to Obsidian sabaimran 2023-07-05 15:01:22 -07:00
  • 3ff5074cf5 Log the end-to-end time of generating a streamed response from OpenAI sabaimran 2023-07-05 14:59:44 -07:00
  • 68e635cc32 Remove additional comments and debug statements sabaimran 2023-07-05 11:33:56 -07:00
  • 67a8795b1f Clean-up commented out code sabaimran 2023-07-05 11:24:40 -07:00
  • 79b1b1d350 Save streamed chat conversations via partial function passed to the ThreadGenerator sabaimran 2023-07-04 17:33:52 -07:00
  • afd162de01 Add reference notes to result response from GPT when streaming is completed sabaimran 2023-07-04 12:47:50 -07:00
  • 8f491d72de Initial code with chat streaming working (warning: messy code) sabaimran 2023-07-04 10:14:39 -07:00
  • 5889eceba4 Make text selectable in Khoj chat modal on Obsidian Debanjum Singh Solanky 2023-07-03 23:21:39 -07:00
  • 89354def9b Update request timeout window to 20 seconds sabaimran 2023-07-03 22:28:18 -07:00
  • b1940519c3 Log error if unable to decode chunk from Github sabaimran 2023-07-03 16:29:32 -07:00
  • ecf9730cd7 Disable Chat, Search on Web if Khoj not configured & show next steps Debanjum Singh Solanky 2023-07-03 16:02:20 -07:00
  • 017e8c1aef Skip indexing a PDF that has an indexing error (#274) sabaimran 2023-07-03 15:55:11 -07:00
  • a6f313589e Release Khoj version 0.7.1 sabaimran 2023-07-03 12:26:41 -07:00
  • 70f6b8266c Upgrade minimum supported pydantic version Debanjum Singh Solanky 2023-07-03 12:22:56 -07:00
  • 8bfd5828e6 Remove deprecation notice since we're opening the web UI by default sabaimran 2023-07-03 12:01:09 -07:00
  • 92d81d3b16 Initialize the search.model field to SearchModels() and fix Reinitialize API call (#273) sabaimran 2023-07-03 11:32:44 -07:00
  • 61403138d5 Merge pull request #269 from khoj-ai/features/simplify-configuration-steps sabaimran 2023-07-03 00:16:51 -07:00
  • ea3dc2cfa3 Simplify rendering of content type pages and logic of selecting config sabaimran 2023-07-03 00:15:29 -07:00
  • 260272dca2 Check if state.config is populated before configuring via the update method sabaimran 2023-07-03 00:10:56 -07:00
  • bf8914d0c8 Fix default config initialization for for chat.html sabaimran 2023-07-03 00:00:47 -07:00
  • faad1297f4 Drop Support for Org Music, Ledger Content Types Debanjum 2023-07-02 17:48:29 -07:00
  • 0f993b332e Drop support for Ledger as a separate content type Debanjum Singh Solanky 2023-07-02 16:49:51 -07:00
  • fa218ff5aa Fix call to update for Reinitialize button sabaimran 2023-07-02 16:31:30 -07:00