klbr/khoj
1
0
Fork 0
mirror of https://github.com/khoaliber/khoj.git synced 2026-03-10 13:26:13 +00:00
Code Issues Packages Projects Releases Wiki Activity

Turn off Tokenizers Parallelism. Khoj doesn't support it right now

Browse Source 
- Forking and multiprocess are problemantic in frozen python
  scenarios. This will cause issues when running App packaged by
  pyinstaller
This commit is contained in:
Debanjum Singh Solanky
2022-08-18 23:14:39 +03:00
parent d4072974d7
commit 6c5c1c33c1
1 changed files with 5 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
src/main.py
View File

@@ -1,7 +1,8 @@
# Standard Packages # Standard Packages
from platform import system import os
import signal import signal
import sys import sys
from platform import system
# External Packages # External Packages
import uvicorn import uvicorn
@@ -26,6 +27,9 @@ app.include_router(router)
def run(): def run():
# Turn Tokenizers Parallelism Off. App does not support it.
os.environ["TOKENIZERS_PARALLELISM"] = 'false'
# Load config from CLI # Load config from CLI
state.cli_args = sys.argv[1:] state.cli_args = sys.argv[1:]
args = cli(state.cli_args) args = cli(state.cli_args)