8 Commits

Author	SHA1	Message	Date
Debanjum Singh Solanky	4a90972e38	Use a better model for asymmetric semantic search ... - The multi-qa-MiniLM-L6-cos-v1 is more extensively benchmarked[1] - It has the right mix of model query speed, size and performance on benchmarks - On hugging face it has way more downloads and likes than the msmarco model[2] - On very preliminary evaluation of the model - It doubles the encoding speed of all entries (down from ~8min to 4mins) - It gave more entries that stay relevant to the query (3/5 vs 1/5 earlier) [1]: https://www.sbert.net/docs/pretrained_models.html [2]: https://huggingface.co/sentence-transformers	2022-07-18 20:27:26 +04:00
Debanjum Singh Solanky	50658453cd	Add separate conda environment.yml for osx-arm64 ... Conda doesn't support using the same environment across platforms We were able to get away with this till now because of manually setting up the conda environment.yml But it's more robust to just add conda environment YAML files for each platform as necessary	2022-07-14 23:16:49 +04:00
Debanjum Singh Solanky	e96253a7c1	Add dateparser library to conda environment YAML	2022-07-14 22:29:07 +04:00
Saba	07a56c4ab6	Add specific version for Python packages and downgrade miniconda Docker image to potentially fix build issues	2022-07-04 18:01:55 -04:00
Saba	092d0f2f21	Move Dockerfile to project root to avoid permissions issues. Allocate more memory to docker-compose to avoid OOM	2022-07-04 12:33:55 -04:00
Debanjum Singh Solanky	78b76d65a0	Minor fix to notes jsonl file extension in sample_config.yml	2022-01-29 04:13:36 -05:00
Debanjum Singh Solanky	c31abad0a6	Mount embeddings to /data/embeddings for directory naming consistency ... - Keeps directory paths consistent between host and container volumes - Consistency simplifies documentation and updates required to setup sample_config.yml for local installation	2022-01-29 03:24:02 -05:00
Debanjum Singh Solanky	b0067fc32e	Store docker, conda, semantic-search configuration in a config directory ... - Improves organization of config files required for application - Declutters the application root directory from configs	2022-01-29 02:41:11 -05:00