Commit Graph

  • 1a5d1130f4 Generate search queries from message to answer users chat questions Debanjum Singh Solanky 2023-03-12 18:19:54 -06:00
  • d0f14d3f85 Test usage of = in date filter queries Debanjum Singh Solanky 2023-03-16 14:51:40 -06:00
  • dfb277ee37 Set skipif at module level if OpenAI API key not set for chat tests Debanjum Singh Solanky 2023-03-16 12:20:33 -06:00
  • e75e13d788 Create Tests to Measure Chat Quality, Capabilities Debanjum 2023-03-16 11:30:52 -06:00
  • 4e15b4e411 Create test notes dataset for chat testing Debanjum Singh Solanky 2023-03-15 18:03:05 -06:00
  • 1b4d562700 Test Chat Director Capabilities: Answer from notes, chat history etc Debanjum Singh Solanky 2023-03-15 14:52:59 -06:00
  • b6d63137f1 Setup Pytest fixture for conversation processor to test chat API Debanjum Singh Solanky 2023-03-15 14:26:19 -06:00
  • 3f719c9e17 Rename Chat Model+Prompt tests to chat actor tests Debanjum Singh Solanky 2023-03-15 14:18:08 -06:00
  • 7526a50dd4 Extract conversation processor utility funcs from gpt.py into utils.py Debanjum Singh Solanky 2023-03-15 11:42:07 -06:00
  • 7c4d546039 Configure tests to mark chat quality tests & filter unhelpful warnings Debanjum Singh Solanky 2023-03-14 18:56:14 -06:00
  • c1128a1ad8 Test Chat Actor Capabilities; ability to answer from notes, chat logs etc Debanjum Singh Solanky 2023-03-14 17:44:16 -06:00
  • 9306cd901a Clean up chat tests to work with updated chat methods in gpt.py Debanjum Singh Solanky 2023-03-14 11:27:58 -06:00
  • 24ddebf3ce Make converse prompt more precise. Fix default arg vals in gpt methods Debanjum Singh Solanky 2023-03-14 19:06:02 -06:00
  • 8609e3129e Fix, improve displaying chat messages, sources by Khoj in web interface Debanjum Singh Solanky 2023-03-14 11:24:47 -06:00
  • 6c0e82b2d6 Merge Improve Khoj Chat PR #183 from debanjum/improve-chat-interface Debanjum 2023-03-10 19:03:44 -06:00
  • cccd225247 Deduplicate and simplify logic to render chat message with reference Debanjum Singh Solanky 2023-03-10 18:46:47 -06:00
  • b9caad458e Type score_threshold with union, not |, to support python <3.10 Debanjum Singh Solanky 2023-03-10 18:18:31 -06:00
  • 198d9af8cf Update Readme to reflect Khoj Chat out of Beta Debanjum Singh Solanky 2023-03-10 17:31:59 -06:00
  • a71f168273 Move the chat API out of beta. Save chat sessions at 15min intervals Debanjum Singh Solanky 2023-03-10 17:20:52 -06:00
  • bcc0bed9db Upgrade bump_version script to handle release and post-release commit Debanjum Singh Solanky 2023-03-10 15:15:08 -06:00
  • 8bb8824d0c Bump khoj versions in obsidian, emacs files Debanjum Singh Solanky 2023-03-10 12:13:18 -06:00
  • e16d0b6d7e Open references notes used for chat on mobile too (by clicking) Debanjum Singh Solanky 2023-03-09 16:57:00 -06:00
  • c3c7b8a951 Make Khoj chat a separate Progressive Web App (PWA) for easier access Debanjum Singh Solanky 2023-03-09 13:43:21 -06:00
  • 3838f9d8e3 Remove explicitly asking GPT to say I don't know in prompt for now Debanjum Singh Solanky 2023-03-09 12:11:44 -06:00
  • f7b8cdd02e Log prompts being passed to GPT for debugging Debanjum Singh Solanky 2023-03-08 19:17:52 -06:00
  • 2739a492b4 Log message metadata along with Khoj message instead of user message Debanjum Singh Solanky 2023-03-08 18:45:13 -06:00
  • 87d1e1341d Show reference notes used as response context in chat interface Debanjum Singh Solanky 2023-03-08 18:04:44 -06:00
  • 280061e1fa Do not deduplicate search results used for chat context Debanjum Singh Solanky 2023-03-06 23:51:31 -06:00
  • 672f61529e Make getting deduped search results configurable via Search API Debanjum Singh Solanky 2023-03-06 23:48:46 -06:00
  • 4fb628975c Fix jumping to note from Khoj Obsidian search modal result on Windows Debanjum Singh Solanky 2023-03-05 21:07:54 -06:00
  • b6cdc5c7cb Do not expose answer API as a chat type in chat web interface or API Debanjum Singh Solanky 2023-03-05 17:34:09 -06:00
  • 7f994274bb Support multi-turn conversations in chat mode Debanjum Singh Solanky 2023-03-05 16:05:46 -06:00
  • d73042426d Support filtering for results above threshold score in search API Debanjum Singh Solanky 2023-03-05 15:43:27 -06:00
  • 45f461d175 Keep search results passed to GPT as context in conversation logs Debanjum Singh Solanky 2023-03-05 15:00:20 -06:00
  • 7cad1c9428 Only use past chat message, not session summaries as chat context Debanjum Singh Solanky 2023-03-05 14:55:03 -06:00
  • ad1f1cf620 Improve and simplify Khoj Chat using ChatGPT Debanjum Singh Solanky 2023-03-04 11:01:49 -06:00
  • 9d42b5d60d Use multiple compiled search results for more relevant context to GPT Debanjum Singh Solanky 2023-03-03 13:31:41 -06:00
  • c3b624e351 Introduce improved answer API and prompt. Use by default in chat web interface Debanjum Singh Solanky 2023-03-03 12:52:03 -06:00
  • 7184508784 Mention Python and Pip need to be installed in Main and Emacs Readme Debanjum Singh Solanky 2023-03-02 21:26:01 -06:00
  • 211e460398 Output date filter from cache log at debug level. Remove unused imports Debanjum Singh Solanky 2023-03-02 15:38:09 -06:00
  • c823f46d89 Test error on missing fields in ContentConfig pulled from Khoj.yml Debanjum Singh Solanky 2023-03-02 15:35:39 -06:00
  • b6dbe4dd1d Do not try retrieve an unconfigured core content type in Config GUI Debanjum Singh Solanky 2023-03-02 11:09:31 -06:00
  • 1ae40163a9 Show user friendly information logs by default for context Debanjum Singh Solanky 2023-03-01 15:22:14 -06:00
  • fe03ba3dce Index intro text before headings in org files Debanjum Singh Solanky 2023-03-01 12:11:33 -06:00
  • ed177db2be Emojify step names in workflows. Stop publishing to TestPyPi from PR Debanjum Singh Solanky 2023-03-01 10:56:39 -06:00
  • 7ad251b8ef Log and Continue on OSError while collating dates for date filters Debanjum Singh Solanky 2023-03-01 00:50:51 -06:00
  • 2bed4c3b50 Fix configuring search types & /config/types API when no plugin configured Debanjum Singh Solanky 2023-03-01 00:35:21 -06:00
  • 8914dbd073 Fix creating GUI panels for unconfigured search, processor types Debanjum Singh Solanky 2023-02-28 23:25:19 -06:00
  • e77a5ffc83 Merge pull request #173 from debanjum/enable-creating-content-plugins Debanjum 2023-02-28 22:23:25 -06:00
  • b09350c052 Fix to return only enabled content types via the new config/types API Debanjum Singh Solanky 2023-02-28 22:08:26 -06:00
  • b177adf3a7 Return value of search_type in /config/type API endpoint Debanjum Singh Solanky 2023-02-28 21:49:26 -06:00
  • ede6eb6879 Re-enable testing search and update API with image content type Debanjum Singh Solanky 2023-02-28 19:31:16 -06:00
  • 88a9eadfba Use client pytest fixture to test API with plugin type configured Debanjum Singh Solanky 2023-02-28 19:27:12 -06:00
  • ab501a56c9 Create pytest fixture to configure app with plugin, search types Debanjum Singh Solanky 2023-02-28 19:26:06 -06:00
  • f944408e69 Update content_config pytest fixture to index plugin content Debanjum Singh Solanky 2023-02-28 19:18:04 -06:00
  • 88344f9ed2 Improve rendering search results of plugin content types on web interface Debanjum Singh Solanky 2023-02-24 15:53:58 -06:00
  • c2814fce58 Improve rendering search results of plugin content types in khoj.el Debanjum Singh Solanky 2023-02-24 16:16:13 -06:00
  • f3f24387ec Use new config/types API to set enabled content types on web interface Debanjum Singh Solanky 2023-02-24 04:08:34 -06:00
  • 1e43f1a12e Use new config/types API to set enabled content types in khoj.el menu Debanjum Singh Solanky 2023-02-24 04:01:51 -06:00
  • 9d38eadd42 Return enabled content types via api/config/types API endpoint Debanjum Singh Solanky 2023-02-24 04:01:03 -06:00
  • 68bd5d9ebc Configure API routes after set up search types while configuring server Debanjum Singh Solanky 2023-02-24 03:06:58 -06:00
  • d91c7e2761 Search for plugin content via the search API Debanjum Singh Solanky 2023-02-24 01:32:51 -06:00
  • 47b58a2a4d Configure, use dynamically instantiated SearchType enum on app start Debanjum Singh Solanky 2023-02-24 01:25:20 -06:00
  • ab0d3a08e2 Index configured plugins on app start and via update API endpoint Debanjum Singh Solanky 2023-02-24 00:27:29 -06:00
  • 55a032e8c4 Add processor to index entries from jsonl files for plugins Debanjum Singh Solanky 2023-02-23 22:29:07 -06:00
  • fcbbe8c759 Read content plugin configs from Khoj config YAML Debanjum Singh Solanky 2023-02-22 14:47:22 -06:00
  • f57d7bf5ad Use pypi khoj to fix docker builds and dockerize github workflow Debanjum Singh Solanky 2023-02-18 23:59:03 -06:00
  • fada617faa Fix TOC links, Add how to auto start Khoj server to Readme Debanjum Singh Solanky 2023-02-18 23:43:59 -06:00
  • 61b6ee2857 Use helper script to bump khoj pre-release versions Debanjum Singh Solanky 2023-02-17 20:31:51 -06:00
  • 47c2cc63e1 Automate uploading Obsidian artifacts to new releases Debanjum Singh Solanky 2023-02-17 18:14:46 -06:00
  • a8940462c4 Automate khoj python package versioning using hatch-vcs and Git tags Debanjum Singh Solanky 2023-02-17 17:08:05 -06:00
  • 053d6141f3 Ignore ts typing error, Fix SPDX license identifier in Obsidian plugin Debanjum Singh Solanky 2023-02-17 18:08:34 -06:00
  • 47569da38e Fix usage of "\" in orgnode test string to resolve DeprecationWarning Debanjum Singh Solanky 2023-02-17 17:12:43 -06:00
  • 36be3c4b8f Fix or ignore MyPy issues in PyQt desktop GUI code Debanjum Singh Solanky 2023-02-17 16:11:17 -06:00
  • fd0a2f55f8 Run mypy checks in test workflow and on push (via pre-commit) Debanjum Singh Solanky 2023-02-17 14:29:12 -06:00
  • 5c0d340970 Update Development section in Readme. Add steps for code validation Debanjum Singh Solanky 2023-02-17 12:52:45 -06:00
  • 051f0e3fb5 Add, configure and run pre-commit locally and in test workflow Debanjum Singh Solanky 2023-02-17 12:07:59 -06:00
  • 5e83baab21 Use Black to format Khoj server code and tests Debanjum Singh Solanky 2023-02-17 10:04:26 -06:00
  • 6130fddf45 Install pytest as optional dev dependency of app in test workflow Debanjum Singh Solanky 2023-02-17 10:10:59 -06:00
  • 8b293edd7c Move mypy config into pyproject.toml. Ignore 2 remaining mypy issues Debanjum Singh Solanky 2023-02-16 03:33:08 -06:00
  • 7a9a811874 Fix authors, homepage URL in pyproject.toml and workflow triggers Debanjum Singh Solanky 2023-02-16 03:12:04 -06:00
  • dcb86c2d3e Build khoj python package using hatchling, pyproject.toml Debanjum Singh Solanky 2023-02-15 19:02:30 -06:00
  • c641eb4ad6 Improve rendering log and error stacktraces using the Rich package Debanjum Singh Solanky 2023-02-15 01:10:46 -06:00
  • a403def19e Fix workflow to publish Khoj python package to PyPi Debanjum Singh Solanky 2023-02-14 21:44:00 -06:00
  • eee57599ad Improve Dockerize, Publish to PyPi Workflows Debanjum 2023-02-14 21:11:56 -06:00
  • af6d65a909 Create tagged Docker image on new tag/release Debanjum Singh Solanky 2023-02-14 19:53:35 -06:00
  • 25e06f26c0 Improve workflow to publish khoj to pypi Debanjum Singh Solanky 2023-02-14 19:47:42 -06:00
  • 11873795a6 Use src layout to fix packaging khoj for pypi Debanjum 2023-02-14 16:26:07 -06:00
  • e76c285bdc No need to prune plugins as not included in pypi package. Debanjum Singh Solanky 2023-02-14 16:15:40 -06:00
  • bc7477ea3e Move Emacs, Obsidian plugin code out from under src/khoj directory Debanjum Singh Solanky 2023-02-14 15:44:22 -06:00
  • f83cf4ebc6 Check wheel contents in workflow before publishing it to PyPI Debanjum Singh Solanky 2023-02-14 13:41:33 -06:00
  • 25a749ca1d Use the src/ layout to fix packaging Khoj for PyPi Debanjum Singh Solanky 2023-02-14 14:50:51 -06:00
  • cc31cd070d Enable the publish workflow for PRs created in the main repo Debanjum Singh Solanky 2023-02-14 13:47:25 -06:00
  • 84322b2a45 Demo using Search in Khoj Obsidian Plugin Debanjum 2023-02-14 08:43:50 -08:00
  • a4dcb20622 Add setting to toggle auto configuring of khoj backend from Obsidian Debanjum Singh Solanky 2023-02-13 19:53:06 -06:00
  • 24aa696ef5 Indicate indexing active on Update button in Obsidian plugin settings Debanjum Singh Solanky 2023-02-13 19:09:33 -06:00
  • 11517ba8eb Encode jsonl data as utf8 for gzip write for consistent read/write encoding Debanjum Singh Solanky 2023-02-12 17:33:23 -06:00
  • c156b3e087 Remove sub-dependencies from setup.py. Upgrade sentence-transformer Debanjum Singh Solanky 2023-02-12 10:40:47 -06:00
  • 3ec41c4d64 Wrap lines for org, markdown results in khoj search results buffer Debanjum Singh Solanky 2023-02-12 07:33:50 -06:00
  • d1945c5ba8 Do not run publish workflow for PRs as forks do not have auth token Debanjum Singh Solanky 2023-02-12 07:31:24 -06:00