Commit Graph

  • de23fc2051 Revert Add Scheduled, Deadlne date to Model Embeddings for Date Aware Search Debanjum Singh Solanky 2022-06-17 02:57:28 +03:00
  • a2a08d1354 Add Scheduled, Deadlne date to Model Embeddings for Date Aware Search Debanjum Singh Solanky 2022-06-17 02:55:27 +03:00
  • cfbd5c4ecc Update global model on regenerate via API Debanjum Singh Solanky 2022-06-17 00:49:06 +03:00
  • 35117af322 Show Demo of Semantic Search in Readme Debanjum 2022-05-14 01:32:18 -07:00
  • 2eab256af9 Delete markdown file. It helped upload the demo video to Github Debanjum Singh Solanky 2022-05-14 04:30:20 -04:00
  • 96c588b7bc Add demo of semantic search to repository Debanjum Singh Solanky 2022-05-14 04:29:25 -04:00
  • 19f8f85333 Show Demo of Semantic Search in Readme Debanjum 2022-05-14 01:29:13 -07:00
  • 031d6bddb4 Delete markdown file. It helped upload the demo video to Github Debanjum Singh Solanky 2022-05-14 04:25:17 -04:00
  • c78bf84eef Introduce search api endpoint that auto infers search type intent Debanjum Singh Solanky 2022-02-27 21:01:33 -05:00
  • 8ef7917014 Fix json format passed in prompt to GPT Debanjum Singh Solanky 2022-02-27 20:01:03 -05:00
  • f57b7f65ea Wrap prompts for GPT in triple quotes to improve prompt readability Debanjum Singh Solanky 2022-02-27 19:55:14 -05:00
  • 1eba7b1c6f Use empty_escape_sequence constant to strip response text from gpt Debanjum Singh Solanky 2022-02-27 19:53:53 -05:00
  • 37bfc956c9 Update Readme Local Development Section Debanjum Singh Solanky 2022-02-27 19:05:44 -05:00
  • 1c3a1420f8 Update asymmetric extract_entries method to handle uncompressed jsonl Debanjum Singh Solanky 2022-02-27 19:03:31 -05:00
  • 3d8a07f252 Extract empty line escape sequences var into constants file for reuse Debanjum Singh Solanky 2022-02-27 19:01:49 -05:00
  • 624a3faf92 Update Readme. Improve Organization, Reduce Staleness Debanjum Singh Solanky 2022-02-26 19:04:49 -05:00
  • bb5d0d8908 Improve Semantic Search Buffer Names in Emacs Debanjum Singh Solanky 2022-02-26 18:30:14 -05:00
  • 6a84ca965a Merge pull request #25 from debanjum/users/debanjum/improve-semantic-search-on-ledger Debanjum 2022-02-26 15:18:22 -08:00
  • b68558651b Improve Extraction of Beancount Entries Debanjum Singh Solanky 2022-02-26 17:36:30 -05:00
  • b3ac2dd730 Improve Results Rendered on Emacs from Semantic Search on Ledger Debanjum Singh Solanky 2022-02-26 17:33:10 -05:00
  • 502c68d4f8 Remove trailling escape sequence in ledger search response entries Debanjum Singh Solanky 2022-02-26 17:23:02 -05:00
  • 248aa632c0 Do not throw warning for beancount files with .beancount extension Debanjum Singh Solanky 2022-02-26 16:56:13 -05:00
  • 76cd63f4bd Fix count of processed jsonl entries shown to user by ledger processor Debanjum Singh Solanky 2022-02-26 16:54:08 -05:00
  • f08591c880 Set PORT arg when building docker image in the build workflow Debanjum Singh Solanky 2022-01-29 18:04:28 -05:00
  • 359f25b0a4 Rename publish workflow to build. Add badge to the workflow on Readme Debanjum Singh Solanky 2022-01-29 17:48:52 -05:00
  • 4add348e3c Remove context from path to Dockerfile in Github build, push action Debanjum Singh Solanky 2022-01-29 17:16:12 -05:00
  • 859258864c Update Readme badge post rename of build.yml to test.yml Debanjum Singh Solanky 2022-01-29 17:10:43 -05:00
  • fa685dc37f Create Github workflow to build, publish docker container to registry Debanjum Singh Solanky 2022-01-29 16:31:27 -05:00
  • 78b76d65a0 Minor fix to notes jsonl file extension in sample_config.yml Debanjum Singh Solanky 2022-01-29 04:13:36 -05:00
  • 7c773d29ef Update github workflow to use environment.yml under config/ directory Debanjum Singh Solanky 2022-01-29 03:43:34 -05:00
  • c31abad0a6 Mount embeddings to /data/embeddings for directory naming consistency Debanjum Singh Solanky 2022-01-29 03:24:02 -05:00
  • b0067fc32e Store docker, conda, semantic-search configuration in a config directory Debanjum Singh Solanky 2022-01-29 02:41:11 -05:00
  • 79c2224eaa Improve test data organization and update correspoding conftests Debanjum Singh Solanky 2022-01-29 01:57:08 -05:00
  • 3e889760c7 Merge sample_config, docker_sample_config yml into a single sample_config.yml Debanjum Singh Solanky 2022-01-29 01:32:12 -05:00
  • 2bc2780501 Mention the experimental /chat API interacts with OpenAI's API Debanjum Singh Solanky 2022-01-28 23:56:47 -05:00
  • 6ed667aed0 Add Troubleshooting Section, Minor Fixes to Readme Debanjum Singh Solanky 2022-01-28 23:41:08 -05:00
  • d943d2be80 Merge pull request #21 from debanjum/saba/dockerize Debanjum 2022-01-28 20:27:40 -08:00
  • 1ba7fa66e5 Update README and default folders in docker_sample_config.yml - Add instruction to using Docker with README - Use the ./tests/data folder in docker_sample_conifg.yml so it can work right away for users Saba 2022-01-28 23:20:50 -05:00
  • 52e701b3c2 Simplify Dockerfile by removing multibuild - Install exiftool dependency directly in the miniconda image Saba 2022-01-24 21:54:10 -05:00
  • 33bc62dc19 Fix type of use_xmp_metadata to be bool, rather than str Saba 2022-01-24 21:53:26 -05:00
  • 9fb410fc25 Clean up docker_sample_config.yml - Uncomment other search types - Explain the file prefixes behavior and how it interfaces with the docker image Saba 2022-01-24 14:11:38 -05:00
  • 9802023c79 Clean up docker-compose - Mount the local directory to /app - Reformat the file paths to generically indicate what their purpose is - Add comments to assist users who wasnt to modify properties themselves Saba 2022-01-24 14:10:18 -05:00
  • 4ae8c15170 Clean the Dockerfile - Use /app as the working directory - Clarify comment to explain why the ENTRYPOINT is constructed as it is - Move explanations for the argument to docker-compose, where it's set - Copy required artifacts from the first build image into the subsequent one (exiftool) Saba 2022-01-24 14:08:55 -05:00
  • 66d08ab5df Rename web to server in docker-compose.yml Saba 2022-01-24 00:14:01 -05:00
  • 77fa8718d9 Working example with docker-compose Still need quite a bit of clean-up, but this adds a working docker-compose + Dockerfile setup Saba 2022-01-23 23:44:38 -05:00
  • 875188dc6f Initialize working on #20 to add Docker support - Add a Dockerfile which uses an Ubuntu image to install relevant dependencies (exif) and uses a Miniconda image for setting up/reusing the conda environment - Add a dummy docker-compose file Saba 2022-01-23 14:57:28 -05:00
  • 974690939c Merge pull request #19 from debanjum/rename-config-types-for-consistency sabaimran 2022-01-14 21:14:08 -05:00
  • 179153dc5a Rename RawConfig Types for Consistency Debanjum Singh Solanky 2022-01-14 20:54:38 -05:00
  • ed7c2901f5 Merge pull request #18 from debanjum/deb/save-models-to-disk-on-first-run Debanjum 2022-01-14 17:30:46 -08:00
  • ed144f7984 Setup Search with Search_Config to Fix Tests Debanjum Singh Solanky 2022-01-14 20:13:14 -05:00
  • c64e0c2965 Load model from HuggingFace if model_directory unset in config YAML Debanjum Singh Solanky 2022-01-14 17:32:45 -05:00
  • 510faa1904 Save Image Search Model to Disk Debanjum Singh Solanky 2022-01-14 17:09:18 -05:00
  • 934ec233b0 Add Search Config for Symmetric Model. Save Model to Disk Debanjum Singh Solanky 2022-01-14 16:46:56 -05:00
  • b63026d97c Save Asymmetric Search Model to Disk Debanjum Singh Solanky 2022-01-14 16:31:55 -05:00
  • e8146e8ebb Merge pull request #17 from albd/patch-1 Debanjum 2022-01-13 18:09:10 -08:00
  • 2e2069f720 Fix url error in README Albert Davies 2022-01-13 16:28:46 -08:00
  • 2e53fbc844 Fix the user intent extraction prompt for GPT. Clean up chatbot test Debanjum Singh Solanky 2022-01-12 10:36:01 -05:00
  • ea28897cdd Remove deprecated conversation_history field from config Debanjum Singh Solanky 2022-01-12 10:34:21 -05:00
  • 5a686b7be9 Add logs for chat bot in verbose mode Debanjum Singh Solanky 2022-01-12 09:06:32 -05:00
  • 6dc2a99d35 Merge branch 'master' of github.com:debanjum/semantic-search into add-summarize-capability-to-chat-bot Debanjum Singh Solanky 2021-12-20 13:26:35 +05:30
  • 29543d2dc3 Merge pull request #16 from debanjum/cache-conda-env-setup-to-improve-cloud-build Debanjum 2021-12-18 06:58:42 -08:00
  • ee6aae3a40 Merge branch 'master' of github.com:debanjum/semantic-search Saba 2021-12-16 20:36:36 -05:00
  • 916a1ffc73 Fix formatting of REAMDE env dependencies Saba 2021-12-16 20:36:31 -05:00
  • d91f645198 Try cache conda build step using online docs Debanjum Singh Solanky 2021-12-15 11:45:49 +05:30
  • 65da7daf1f Load, Save Conversation Session Summaries to Log. s/chat_log/chat_session Debanjum Singh Solanky 2021-12-08 02:34:52 +05:30
  • 35b46849a2 Merge pull request #15 from debanjum/debanjum-skip-flaky-image-search-pytest Debanjum 2021-12-12 02:28:15 -08:00
  • ef911aa6be Skip Flaky Image Search Test Debanjum 2021-12-12 02:15:20 -08:00
  • d14f5d54e3 Merge branch 'master' of github.com:debanjum/semantic-search Saba 2021-12-11 14:18:06 -05:00
  • 4832a107d7 Merge branch 'saba/fix-unit-tests' Saba 2021-12-11 14:17:52 -05:00
  • ba8dc9ed5f Update the search_config instantiated for tests in conftest Saba 2021-12-11 14:14:31 -05:00
  • 9ebf00e29b Add instructions for installing exiftool to README (for Ubuntu only) Saba 2021-12-11 14:13:37 -05:00
  • 97a6dfaa1e Use default value False for verbose parameter, and small changes Pass config as parameter to initialize_search, change name of API methods to handle config CRUD operations, and initalize config to FullConfig Saba 2021-12-11 14:13:14 -05:00
  • 930bdb5403 Use ubuntu-latest as machine for Github Actions sabaimran 2021-12-11 12:54:32 -05:00
  • 386534c236 Remove apt-get update from build.yml sabaimran 2021-12-11 12:52:13 -05:00
  • c7d88a7a63 Update build.yml to include exiftool package sabaimran 2021-12-11 12:50:30 -05:00
  • 9536358d34 Fix key error model_name issue by upgrade sentence-transformers version Refer to https://github.com/UKPLab/sentence-transformers/issues/1241 Also user verbose flag passed through function parameters in image_search Saba 2021-12-11 11:58:19 -05:00
  • ce7a751e6b Fix passing verbose flag down in symmetric_ledger.py Saba 2021-12-11 11:36:32 -05:00
  • e5a19f5b0e Merge pull request #10 from debanjum/saba/configui sabaimran 2021-12-10 22:10:49 -05:00
  • d65190c3ee Update unit tests, files with removing model suffix to config types Saba 2021-12-09 08:50:38 -05:00
  • 0ac1e5f372 Summarize chat logs and notes returned by semantic search via /chat API Debanjum Singh Solanky 2021-11-28 13:13:39 +05:30
  • b3eac888fb Add jinja to conda environment config Saba 2021-12-06 20:13:25 -05:00
  • 76e9e9da2f Update unit tests to use the new BaseModel types Saba 2021-12-05 09:31:39 -05:00
  • c4cd4b57f1 Update types used in conftest.py Saba 2021-12-04 12:02:19 -05:00
  • 9b16cdbb41 Use past tense for verbose log Saba 2021-12-04 11:45:44 -05:00
  • 10e4065e05 Consolidate the search config models and pass verbose as a top level flag Saba 2021-12-04 11:43:48 -05:00
  • 43e647835b Append Model Suffixed to config models Saba 2021-12-04 10:51:21 -05:00
  • 2490e72df5 Fix input text behavior for null/empty value fields Saba 2021-12-04 10:45:48 -05:00
  • e068968b35 Update imports for raw config models in config.py Saba 2021-12-04 10:44:55 -05:00
  • 4d6284b0af Remove Test suffix from Config models Saba 2021-12-04 10:44:13 -05:00
  • 7fcc8d2cef Add null check for processor config Saba 2021-12-04 10:11:00 -05:00
  • 7ca4fc3453 Resolve mrege conflicts with updated processor conversation data model Saba 2021-11-28 16:22:52 -05:00
  • 6b8efb81b3 Document config.js Saba 2021-11-28 14:41:57 -05:00
  • 87a6c2d716 Use parse_obj instead of parse_raw as incoming data is in dict Saba 2021-11-28 14:34:32 -05:00
  • faf1df47fe remove extra whitespace in environment.yml Saba 2021-11-28 14:32:51 -05:00
  • 04132a2f34 Remove config.yml and fix regenerate fetch response Saba 2021-11-28 14:29:16 -05:00
  • 112868962b Disable regenerate button while embeddings are being regenerated Saba 2021-11-28 13:45:00 -05:00
  • 5d50487d83 Linting New line at end of config.html Remove debug print statement Saba 2021-11-28 13:32:56 -05:00
  • 6f466c8d99 Use global config and add a regenerate button to the config ui' && git push Saba 2021-11-28 13:28:22 -05:00
  • 34d1e4199c Use alias generator when deserializing the config file Saba 2021-11-28 13:05:48 -05:00
  • 19b81e82f0 Write back to the raw config.yml file on update Saba 2021-11-28 12:34:40 -05:00