Add Troubleshooting Section, Minor Fixes to Readme

This commit is contained in:
Debanjum Singh Solanky
2022-01-28 23:41:08 -05:00
parent d943d2be80
commit 6ed667aed0
2 changed files with 18 additions and 9 deletions

View File

@@ -15,15 +15,23 @@
#+end_src #+end_src
**** 2. Configure **** 2. Configure
Add Content Directories for Semantic Search to Docker-Compose - Add Content Directories for Semantic Search to Docker-Compose
Update [[./docker-compose.yml][docker-compose.yml]] to mount your images, org-mode notes, ledger/beancount directories - Update [[./docker-compose.yml][docker-compose.yml]] to mount your images, org-mode notes, ledger/beancount directories
If required, edit config settings in [[./docker_sample_config.yml][docker_sample_config.yml]]. - If required, edit config settings in [[./docker_sample_config.yml][docker_sample_config.yml]].
**** 3. Run **** 3. Run
#+begin_src shell #+begin_src shell
docker-compose up -d docker-compose up -d
#+end_src #+end_src
***** Troubleshooting
- The first run will take time. Let it run, it's mostly not hung
- Symptom: Errors out with "Killed" in error message
- Fix: Increase RAM available to Docker Containers in Docker Settings
- Refer: [[https://stackoverflow.com/a/50770267][StackOverflow Solution]], [[https://docs.docker.com/desktop/mac/#resources][Configure Resources on Docker for Mac]]
- Symptom: Errors out complaining about Tensors mismatch, null etc
- Mitigation: Delete content-type > image section from docker_sample_config.yml
*** Setup on Local Machine *** Setup on Local Machine
**** 1. Install Dependencies **** 1. Install Dependencies
@@ -42,8 +50,8 @@
#+end_src #+end_src
**** 3. Configure **** 3. Configure
Configure application search types and their underlying data source/files in ~sample_config.yml~ - Configure application search types and their underlying data source/files in ~sample_config.yml~
Use the ~sample_config.yml~ as reference - Use the ~sample_config.yml~ as reference
**** 4. Run **** 4. Run
Load ML model, generate embeddings and expose API to query notes, images, transactions etc specified in config YAML Load ML model, generate embeddings and expose API to query notes, images, transactions etc specified in config YAML
@@ -67,15 +75,16 @@
** Upgrade ** Upgrade
*** Using Docker *** On Docker
#+begin_src shell #+begin_src shell
docker-compose up docker-compose build
#+end_src #+end_src
*** On Local Machine *** On Local Machine
#+begin_src shell #+begin_src shell
cd semantic-search cd semantic-search
git pull origin master git pull origin master
conda deactivate semantic-search
conda env update -f environment.yml conda env update -f environment.yml
conda activate semantic-search conda activate semantic-search
#+end_src #+end_src
@@ -84,4 +93,4 @@
- [[https://huggingface.co/sentence-transformers/msmarco-MiniLM-L-6-v3][MiniLM Model]] for Asymmetric Text Search. See [[https://www.sbert.net/examples/applications/retrieve_rerank/README.html][SBert Documentation]] - [[https://huggingface.co/sentence-transformers/msmarco-MiniLM-L-6-v3][MiniLM Model]] for Asymmetric Text Search. See [[https://www.sbert.net/examples/applications/retrieve_rerank/README.html][SBert Documentation]]
- [[https://github.com/openai/CLIP][OpenAI CLIP Model]] for Image Search. See [[https://www.sbert.net/examples/applications/image-search/README.html][SBert Documentation]] - [[https://github.com/openai/CLIP][OpenAI CLIP Model]] for Image Search. See [[https://www.sbert.net/examples/applications/image-search/README.html][SBert Documentation]]
- Charles Cave for [[http://members.optusnet.com.au/~charles57/GTD/orgnode.html][OrgNode Parser]] - Charles Cave for [[http://members.optusnet.com.au/~charles57/GTD/orgnode.html][OrgNode Parser]]
- Sven Marnach for [[https://github.com/smarnach/pyexiftool/blob/master/exiftool.py][PyExifTool]] - Sven Marnach for [[https://github.com/smarnach/pyexiftool/blob/master/exiftool.py][PyExifTool]]

View File

@@ -26,7 +26,7 @@ services:
- ./tests/data/:/data/music/ - ./tests/data/:/data/music/
# It's ok if you don't have existing embeddings. # It's ok if you don't have existing embeddings.
# You can set this volume to point to an empty folder. # You can set this volume to point to an empty folder.
- ./tests/data/:/data/generated/ - ./tests/data/embeddings/:/data/generated/
# Use 0.0.0.0 to explicitly set the host ip for the service on the container. https://pythonspeed.com/articles/docker-connection-refused/ # Use 0.0.0.0 to explicitly set the host ip for the service on the container. https://pythonspeed.com/articles/docker-connection-refused/
command: --host="0.0.0.0" --port=8000 -c=docker_sample_config.yml -vv command: --host="0.0.0.0" --port=8000 -c=docker_sample_config.yml -vv