klbr/khoj
1
0
Fork 0
mirror of https://github.com/khoaliber/khoj.git synced 2026-03-09 05:39:12 +00:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • 8837b02de6 dump updated config to a yaml file Saba 2021-11-28 12:26:07 -05:00
  • 5b80b87379 Streamline None checking in initialize_search Saba 2021-11-28 12:05:04 -05:00
  • bf8ae31e6a Streamline None checking in initialize_search Saba 2021-11-28 11:59:45 -05:00
  • da52433d89 Update to re-use the raw config base models in config.py as well Saba 2021-11-28 11:57:33 -05:00
  • 6292fe4481 Update to re-use the raw config base models in config.py as well Saba 2021-11-28 11:57:13 -05:00
  • 311c4b7e7b Working API request body parsing to /post config! Saba 2021-11-28 11:16:33 -05:00
  • 66183cc298 Working API request body parsing to /post config! Saba 2021-11-28 11:12:26 -05:00
  • 5cd920544d Add GPT method to summarize notes and chat logs Debanjum Singh Solanky 2021-11-28 13:08:05 +05:30
  • 1785047ea6 Improve understand primer and load understand response as dict Debanjum Singh Solanky 2021-11-28 13:04:16 +05:30
  • 64645c3ac1 Begin type checking/input validation effort Saba 2021-11-27 21:47:56 -05:00
  • 9a0264b7fc Add a dummy POST config endpoint, integrate with editable UI Saba 2021-11-27 20:36:03 -05:00
  • f3b03ea5b7 Make raw data reactive to changes Saba 2021-11-27 19:17:15 -05:00
  • 7ffa70a001 Add button to modify text, not save Saba 2021-11-27 18:00:47 -05:00
  • d150bd9ad7 Add stylesheet to config page Saba 2021-11-27 14:39:05 -05:00
  • 67c3cd7372 Wire up GPT understand method to /chat API. Log conversation metadata too Debanjum Singh Solanky 2021-11-28 00:04:39 +05:30
  • 49461a0c97 Working example for reading and display the config.yml Saba 2021-11-27 11:14:49 -05:00
  • fa15d8dcf6 Rename readWriteConfig to just config.js Saba 2021-11-27 10:52:54 -05:00
  • 2e4a56daa3 Add script for reading config Saba 2021-11-27 10:50:05 -05:00
  • 3db06eee3f Basic example of serving conifg as JSON and retriving on button click Saba 2021-11-27 10:49:33 -05:00
  • 3d4471e107 Merge branch 'master' of github.com:debanjum/semantic-search into saba/configui Saba 2021-11-27 08:52:48 -05:00
  • 882e0f81b4 Skip running the inconsistent image search test Debanjum Singh Solanky 2021-11-27 18:14:29 +05:30
  • ccfb97e1a7 Wire up minimal conversation processor. Expose it over /chat API endpoint Debanjum Singh Solanky 2021-11-27 01:27:46 +05:30
  • a99b4b3434 Make conversation processor configurable Debanjum Singh Solanky 2021-11-27 01:26:26 +05:30
  • d4e1120b22 Add GPT based conversation processor to understand intent and converse with user Debanjum Singh Solanky 2021-11-26 17:23:03 +05:30
  • 3edecf91f2 Image reader, placeholder Saba 2021-11-26 15:21:02 -05:00
  • baee52648d Set up basic ui page with no functionality Saba 2021-11-26 14:51:11 -05:00
  • 6244ccc01a Add Configuring Application Section, Update Run command in Readme Debanjum Singh Solanky 2021-11-18 19:25:50 +05:30
  • 46661b3057 Ensure top_k never more than total entries to run symmetric search on debanjum 2021-11-16 11:32:21 -08:00
  • 8c858d1a94 Reduce symmetric search results for cross-encoder to re-rank to improve search speed debanjum 2021-11-16 11:31:19 -08:00
  • f3fd5ae978 Improve code comments. Do not import unused modules in asymmetric search Debanjum Singh Solanky 2021-11-17 00:57:21 +05:30
  • 8cf2465e8e Ensure top_k never more than total entries to search from Debanjum Singh Solanky 2021-11-17 00:56:31 +05:30
  • 4d37ace3d6 Reduce search results for cross-encoder to re-rank to improve search speed Debanjum Singh Solanky 2021-11-17 00:50:28 +05:30
  • 0082631f16 Fixup caching step of Github workflow. Correct path to environment.yml Debanjum Singh Solanky 2021-10-03 01:38:37 -07:00
  • faebde41d2 Cache conda dependencies for Github workflow execution Debanjum Singh Solanky 2021-10-03 01:04:14 -07:00
  • 5c92db7562 Try see if tests pass on a macos build for github action Debanjum Singh Solanky 2021-10-03 00:38:39 -07:00
  • d896664fdb Lock packages python dependencies to their current major version Debanjum Singh Solanky 2021-10-02 20:34:07 -07:00
  • 9dcffe3e8e Rename test_main to test_client. It only contains client specific tests Debanjum Singh Solanky 2021-10-02 20:32:53 -07:00
  • 7e0d9bafa7 Split test_main into client and search type specific test files Debanjum Singh Solanky 2021-10-02 20:28:33 -07:00
  • da33e9e743 Create test directory with model data to reuse for pytest session Debanjum Singh Solanky 2021-10-02 19:46:29 -07:00
  • 1832e418e5 Use raw string for regex in orgnode to fix deprecation warning Debanjum Singh Solanky 2021-10-02 17:38:31 -07:00
  • f59e321419 Update CLIP model load path Debanjum Singh Solanky 2021-10-02 16:50:06 -07:00
  • 31e21a6e4e Update gitignore to ignore src/data and vscode directories Debanjum Singh Solanky 2021-10-02 16:17:33 -07:00
  • c47a8cdf16 Allow configuring host, port or unix socket of server via CLI Debanjum Singh Solanky 2021-10-02 16:16:33 -07:00
  • 866ccb5cd3 Add all configurables to sample_config. Add test music, ledger data Debanjum Singh Solanky 2021-10-02 16:11:27 -07:00
  • e933a5d3d0 Fix badge in readme, post workflow rename Debanjum Singh Solanky 2021-09-30 04:58:18 -07:00
  • 0a02dba25f Rename workflow to build from tests Debanjum Singh Solanky 2021-09-30 04:57:32 -07:00
  • cedd723721 Add tests badge to readme. Simplify name of tests workflow Debanjum Singh Solanky 2021-09-30 04:51:47 -07:00
  • 266a03b03d Test application on Push or PR using Github Actions Debanjum Singh Solanky 2021-09-30 04:36:00 -07:00
  • e8b7f06709 Ignore less files. Make gitignore more specific Debanjum Singh Solanky 2021-09-30 04:35:22 -07:00
  • 516f28b082 Merge branch 'master' of github.com:debanjum/semantic-search Debanjum Singh Solanky 2021-09-30 04:17:32 -07:00
  • c200189385 Test notes search with explicit include, exclude filters Debanjum Singh Solanky 2021-09-30 04:13:40 -07:00
  • d2905c4be6 Move tests out to project root. Use absolute import in project Debanjum Singh Solanky 2021-09-30 04:12:14 -07:00
  • 58bb420f69 Fix image_metadata argument ordering bug. Add E2E image search test Debanjum Singh Solanky 2021-09-30 03:29:31 -07:00
  • d5597442f4 Modularize Code. Wrap Search, Model Config in Classes. Add Tests Debanjum Singh Solanky 2021-09-30 02:04:04 -07:00
  • f4dd9cd117 Use type specific model for other search types too. Expose them via SearchModels Debanjum Singh Solanky 2021-09-29 21:09:42 -07:00
  • 352d2930ee Use multiple threads to generate model embeddings. Other minor formating Debanjum Singh Solanky 2021-09-29 20:47:58 -07:00
  • e22e0b41e3 Wrap asymmetric search model into SearchModels. Test notes search end-to-end Debanjum Singh Solanky 2021-09-29 20:24:27 -07:00
  • cde11a2331 Wrap search type enablement status in a search settings class Debanjum Singh Solanky 2021-09-29 19:18:33 -07:00
  • 81ce0cacc3 Only allow supported search types to /search, /regenerate APIs Debanjum Singh Solanky 2021-09-29 19:02:55 -07:00
  • 5db08c5293 Set query as heading of notes search results in Emacs Org buffer Debanjum Singh Solanky 2021-09-29 13:30:15 -07:00
  • 150593c776 Update Readme. Acknowledger PyExifTool and Minor Fixes Debanjum Singh Solanky 2021-09-16 12:39:42 -07:00
  • fdb60a8dcf Set Query as Heading of Image Search Results Emacs Buffer Debanjum Singh Solanky 2021-09-16 12:28:05 -07:00
  • 169ddcc8c6 Make Using XMP Metadata to Enhance Image Search Optional, Configurable Debanjum Singh Solanky 2021-09-16 12:01:05 -07:00
  • a4a23d7a72 Batch encode XMP metadata from images too for image_search Debanjum Singh Solanky 2021-09-16 11:11:36 -07:00
  • 3afe054312 Make image batch size to encode configurable via config.yml Debanjum Singh Solanky 2021-09-16 10:51:39 -07:00
  • 41c328dae0 Batch encode images to keep memory consumption manageable Debanjum Singh Solanky 2021-09-16 10:15:54 -07:00
  • d8abbc0552 Use XMP metadata in images to improve image search Debanjum Singh Solanky 2021-09-15 22:54:03 -07:00
  • 0e34c8f493 Allow semantic search on images from Emacs Debanjum Singh Solanky 2021-09-10 01:01:23 -07:00
  • 7d5514ecaa Allow user to override inferred search type with other valid options Debanjum Singh Solanky 2021-09-10 00:54:10 -07:00
  • 3bdeeb1e19 Autoload main semantic-search function Debanjum Singh Solanky 2021-09-09 22:10:37 -07:00
  • f4bde75249 Decouple results shown to user and text the model is trained on Debanjum Singh Solanky 2021-08-29 05:47:43 -07:00
  • 7ee3007070 Get ID, QUERY, TYPE, CATEGORY properties from org property drawer when present Debanjum Singh Solanky 2021-08-29 04:33:24 -07:00
  • 0263d4d068 Enable semantic search for songs in org-music Debanjum Singh Solanky 2021-08-29 03:07:36 -07:00
  • fd7888f3d4 Resolve relative file paths to config YAML file in cli.py Debanjum Singh Solanky 2021-08-29 03:03:37 -07:00
  • fc531a1915 Resolve relative file paths to model embeddings in all search types Debanjum Singh Solanky 2021-08-28 22:26:12 -07:00
  • 74faa34bee Update sample config to add minimal config for ledger, image search Debanjum Singh Solanky 2021-08-22 21:54:49 -07:00
  • 8dec58b12a Update Readme to state can now query beancount transactions, images Debanjum Singh Solanky 2021-08-22 21:50:27 -07:00
  • 4daeddbbda Enable Semantic Search on Images Debanjum Singh Solanky 2021-08-22 21:00:54 -07:00
  • fd217fe8b7 Enable Semantic Search for Beancount transactions Debanjum Singh Solanky 2021-08-22 03:16:57 -07:00
  • 97263b8209 Move CLI into a separate module. Move CLI tests into a separate file Debanjum Singh Solanky 2021-08-21 19:21:38 -07:00
  • 78a1f4ebb4 Use YAML file to allow user to configure application. Add tests Debanjum Singh Solanky 2021-08-21 18:47:55 -07:00
  • bafc86d583 Add helpers to merge dictionaries and get keys deep inside a dictionary Debanjum Singh Solanky 2021-08-21 15:32:23 -07:00
  • eddbc67358 Document how to install latest version in Readme Debanjum Singh Solanky 2021-08-17 18:27:10 -07:00
  • 252266b62a Pass type of item via regenerate API. Default type query param to None Debanjum Singh Solanky 2021-08-17 04:36:48 -07:00
  • ff7207a6bd Extract commandline arguments into separate testable method Debanjum Singh Solanky 2021-08-17 04:00:45 -07:00
  • a3a1100be9 Arrange modules in standardized ordering Debanjum Singh Solanky 2021-08-17 03:59:58 -07:00
  • 569e30b1c8 Create a few basic tests Debanjum Singh Solanky 2021-08-17 03:27:16 -07:00
  • af9660f28e Move application files under src directory. Update Readmes Debanjum Singh Solanky 2021-08-17 01:25:12 -07:00
  • c35c6fb0b3 Reuse asymmetric.setup & input validation from asymmetric & org_to_jsonl Debanjum Singh Solanky 2021-08-16 23:58:24 -07:00
  • 02a84df37a Update state vars after regeneration. Minimize time app in inconsistent state Debanjum Singh Solanky 2021-08-16 23:47:33 -07:00
  • 0509854e14 Replace README.md with README.org. Can be used as notes for testing Debanjum Singh Solanky 2021-08-16 20:00:05 -07:00
  • 79aff85fcb Update Readme. No separate SETUP step required. Simpler RUN step Debanjum Singh Solanky 2021-08-16 19:18:48 -07:00
  • 95bf26a7f2 Set verbosity commandline parameters default value to 0 Debanjum Singh Solanky 2021-08-16 19:16:29 -07:00
  • 04a9a6d62f Expose API endpoint to (re-)generate embeddings from latest notes Debanjum Singh Solanky 2021-08-16 18:52:38 -07:00
  • 1c00c33e73 Improve debug output from org_to_jsonl.py script Debanjum Singh Solanky 2021-08-16 18:50:29 -07:00
  • 2a57156428 Fix org_to_jsonl. Use passed args not global variables in methods. Fix orgnode import Debanjum Singh Solanky 2021-08-16 17:37:44 -07:00
  • 66238004d8 Use verbosity level instead of bool across application Debanjum Singh Solanky 2021-08-16 17:15:41 -07:00
  • adbf157deb Remove usage of the closure to search_notes as it's not required Debanjum Singh Solanky 2021-08-16 16:52:48 -07:00
  • 649e5d1327 Allow reuse of get_absolute_path, is_none_or_empty methods Debanjum Singh Solanky 2021-08-16 16:33:43 -07:00
  • 9703afb814 Rename search_types to search_type to standardize to singular naming Debanjum Singh Solanky 2021-08-16 16:04:45 -07:00