klbr/khoj
1
0
Fork 0
mirror of https://github.com/khoaliber/khoj.git synced 2026-03-10 05:39:11 +00:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • f6a7aa6c96 Style Khoj chat on web interface with new lantern theme Debanjum Singh Solanky 2023-06-20 01:10:16 -07:00
  • 6d94d6e75a Encode the asymmetric, symmetric search queries in parallel for speed Debanjum Singh Solanky 2023-06-20 01:17:21 -07:00
  • d292dc03b3 Use new Khoj Logotype in Web interface Debanjum Singh Solanky 2023-06-20 00:48:32 -07:00
  • db07362ca3 Encode user query as same across search types to speed up query time Debanjum Singh Solanky 2023-06-08 13:37:19 +05:30
  • 285d17af2a Search in parallel across all enabled content types requested via API Debanjum Singh Solanky 2023-06-06 19:28:54 +05:30
  • 79d325fbb6 Fix triggering @general queries in Khoj Chat Debanjum Singh Solanky 2023-06-19 22:55:32 -07:00
  • e97a20d70c Set conversation type if query param set, else return chat history Debanjum Singh Solanky 2023-06-19 19:56:18 -07:00
  • 6224dce49d Merge pull request #228 from debanjum/features/pretty-config-page sabaimran 2023-06-19 18:11:35 -07:00
  • 4722a2c16d Add Github configuration page and success notifications sabaimran 2023-06-18 10:06:45 -07:00
  • 668135c763 Merge branch 'master' of github.com:debanjum/khoj into features/pretty-config-page sabaimran 2023-06-18 08:35:09 -07:00
  • 81183a1fe1 Address misc PR comments and update logo in all clients sabaimran 2023-06-18 08:34:58 -07:00
  • a44cde2865 Show hint to re-index vault if wonky results in Obsidian search modal Debanjum Singh Solanky 2023-06-18 04:51:25 -07:00
  • 595cc5b0f5 Use printer icon for PDF logs. Only split lines if file at web link in web interface Debanjum Singh Solanky 2023-06-18 02:24:25 -07:00
  • e06be395f9 Use Github REST API and Index Commit Messages off Github Repository Debanjum 2023-06-18 14:51:32 +05:30
  • e31a540a5e Get all md files recursively in repository by passing recursive param Debanjum Singh Solanky 2023-06-18 01:47:15 -07:00
  • 6fdac24416 Set page size to 100 to reduce requests required to Github API to 1/3 Debanjum Singh Solanky 2023-06-18 01:20:05 -07:00
  • 87975e589a Fix passing auth token to Github API to increase rate limits by x85 Debanjum Singh Solanky 2023-06-18 01:12:47 -07:00
  • 9c70af960c Extract logic to get file content from Github into a separate method Debanjum Singh Solanky 2023-06-18 01:08:57 -07:00
  • 10d4c38ce9 Extract Wait for rate limit reset logic into a function for reuse Debanjum Singh Solanky 2023-06-18 01:06:46 -07:00
  • aad7f825e0 Remove music configuration sabaimran 2023-06-17 21:23:56 -07:00
  • 5f97afbfac Ignore type checks from mypy in subindexed fields sabaimran 2023-06-17 16:53:36 -07:00
  • c2d46de8bc Add endpoint for regenerating directly from the config page and add music content-type sabaimran 2023-06-17 15:47:33 -07:00
  • ded3100caf Update the configuration page to make config management easier sabaimran 2023-06-17 15:21:28 -07:00
  • 3f24e53b6e Render URL as link in web interface if file param of result is a web link Debanjum Singh Solanky 2023-06-17 04:26:40 -07:00
  • 63ec84ad78 Store Github URL of Markdown files on Github in file jsonl param Debanjum Singh Solanky 2023-06-17 04:23:01 -07:00
  • 0c1c7583b5 Handle pagination, API rate limits. Get all commits from Github repo Debanjum Singh Solanky 2023-06-17 03:38:16 -07:00
  • 31d17d0b22 Index commits message from repository with the github plugin Debanjum Singh Solanky 2023-06-17 02:50:58 -07:00
  • c29c141a7e Use Github Rest API to index Markdown files in Github Repository Debanjum Singh Solanky 2023-06-17 01:39:57 -07:00
  • 9f00a366ab Add a Github plugin to index content from a Github repository Debanjum 2023-06-17 12:28:47 +05:30
  • ac96f43b1b Remove try-catch specific to Github plugin; consolidate GUI logic Saba 2023-06-16 23:46:25 -07:00
  • 07ade2262a Set default value of pat_token in conftest.py to be empty string Saba 2023-06-13 17:03:03 -07:00
  • 751edfefe5 Add separate unit test for github. Will only run of a PAT token is set Saba 2023-06-13 16:55:58 -07:00
  • 3a61919344 Fix failing unit tests by hard-coding model presence of expected search types Saba 2023-06-13 16:32:47 -07:00
  • 019d3732de Rename orgmode_search to org_search Saba 2023-06-13 16:06:54 -07:00
  • 08d79f5ba4 Unify types used in Github and other text-based configs. Fix typing issues Saba 2023-06-13 15:52:36 -07:00
  • a6cd96a6a9 Add a Github plugin which can be used to read from a Github repository Saba 2023-06-13 14:40:06 -07:00
  • c68cde4803 Log clients calling API endpoints on Khoj server Debanjum 2023-06-09 18:36:49 +05:30
  • 59fa48036f Merge pull request #224 from debanjum/fix/message-exceeds-prompt-size sabaimran 2023-06-08 17:32:53 -07:00
  • 139a3ba060 Update server to log new server version field to telemetry db Debanjum Singh Solanky 2023-06-08 13:41:16 +05:30
  • c5666e0404 Move factory dependencies to optional settings Saba 2023-06-06 23:26:24 -07:00
  • 5d5ebcbf7c Rename truncate messages method and update unit tests to simplify assertion logic Saba 2023-06-06 23:25:43 -07:00
  • 7119ed0849 Run pre-commit script Saba 2023-06-05 19:29:23 -07:00
  • 948ba6ddca Remove unused logger Saba 2023-06-05 19:01:03 -07:00
  • 6212d7c2e8 Remove debug line Saba 2023-06-05 19:00:25 -07:00
  • f65ff9815d Move message truncation logic into a separate function. Add unit tests with factory boy. Saba 2023-06-05 18:58:29 -07:00
  • eb6175e9b0 Update description field in webmanifest of Khoj, Khoj Chat PWA Debanjum Singh Solanky 2023-06-06 01:53:42 +05:30
  • bb2363f324 Set client request param when calling khoj server APIs from Web Debanjum Singh Solanky 2023-06-06 00:05:00 +05:30
  • caab55fbdd Set client request param when calling khoj server APIs from Obsidian Debanjum Singh Solanky 2023-06-06 00:04:06 +05:30
  • de2494154f Set client request param when calling khoj server APIs from Emacs Debanjum Singh Solanky 2023-06-06 00:02:10 +05:30
  • 168c11cea7 Make server API endpoints accept client as query param Debanjum Singh Solanky 2023-06-05 23:57:08 +05:30
  • 8617cf1389 Push telemetry to Posthog to grok Khoj usage Debanjum Singh Solanky 2023-06-05 13:19:27 +05:30
  • d13db2e666 Make old telemetry server forward requests to new server Debanjum Singh Solanky 2023-06-05 07:46:41 +05:30
  • 5f4223efb4 Increase timeout to OpenAI call Saba 2023-06-04 20:49:47 -07:00
  • 0e63a90377 Fix the mechanism to retrieve the message content Saba 2023-06-04 20:25:37 -07:00
  • f0efe0177e Pass truncated message as string in ChatMessage when exceeding max prompt size Saba 2023-06-04 19:33:46 -07:00
  • f6ceb22373 Use api_key keyword argument to set the openai_api_key parameter for GPT Debanjum 2023-06-04 15:05:34 +05:30
  • 068ee0ac5e Swap elif with else, as usage of this method does not use openai_api_key Saba 2023-06-04 02:25:08 -07:00
  • 6508379d7b Use api_key keyword argument to set the openai_api_key parameter for GPT Saba 2023-06-04 00:57:00 -07:00
  • 7af8a56434 Remove filename from reference before rendering references in khoj.el Debanjum Singh Solanky 2023-06-02 10:29:12 +05:30
  • ec280067ef Do not retrieve relevant notes when having a general chat with Khoj Debanjum Singh Solanky 2023-06-02 10:24:40 +05:30
  • 90439a8db1 Update Khoj subtitle to AI personal assistant for your digital brain Debanjum Singh Solanky 2023-06-02 10:40:33 +05:30
  • e022910f31 Search PDF files with Khoj. Integrate with LangChain Debanjum 2023-06-02 10:20:26 +05:30
  • e9ed7a19fd Update search prompt to extract PDF search type. Fix extract_question prompt Debanjum Singh Solanky 2023-06-02 10:06:03 +05:30
  • 89fbfce20a Mention PDF are also supported in Khoj Readme Debanjum Singh Solanky 2023-06-01 20:38:44 +05:30
  • bbe3bf9733 Render PDF search results in Khoj Obsidian interface Debanjum Singh Solanky 2023-06-01 20:31:28 +05:30
  • e3892945d4 Render PDF search results in Khoj.el Emacs interface Debanjum Singh Solanky 2023-06-01 18:04:24 +05:30
  • 85144006a1 Render PDF search results in khoj web interface Debanjum Singh Solanky 2023-06-01 17:47:45 +05:30
  • acd14a5e41 Wire up PDF to jsonl processor to Khoj server layer (API, config) Debanjum Singh Solanky 2023-06-01 09:55:48 +05:30
  • d63194c3a9 Create tests for PDF to JSONL processor Debanjum Singh Solanky 2023-06-01 16:57:38 +05:30
  • 286b500f66 Create PDF to JSONL processor using PyPDF and LangChain Debanjum Singh Solanky 2023-06-01 09:31:18 +05:30
  • 1b3effd8e6 Fork Markdown to JSONL processor as start template for PDF to Jsonl Processor Debanjum Singh Solanky 2023-06-01 09:13:31 +05:30
  • 1cd9ecd449 Truncate last message if still over max supported prompt size by model Debanjum Singh Solanky 2023-06-01 08:05:18 +05:30
  • ed4d0f9076 Simplify argument names used in khoj openai completion functions Debanjum Singh Solanky 2023-05-31 10:59:31 +05:30
  • 703a7c89c0 Reduce retry count and request timeout for faster response or failure Debanjum Singh Solanky 2023-05-31 10:52:59 +05:30
  • 18081b3bc6 Use LangChain to call GPT over API Debanjum Singh Solanky 2023-05-30 23:23:42 +05:30
  • 277d2f5c96 Do not add "Notes:" suffix to chat messages when no notes retrieved Debanjum Singh Solanky 2023-05-28 19:28:57 +05:30
  • 334be4e600 Use LangChain to call OpenAI for Khoj Chat Debanjum Singh Solanky 2023-05-28 19:12:36 +05:30
  • efcf7d1508 Extract prompts as LangChain Prompt Templates into a separate module Debanjum Singh Solanky 2023-05-28 17:45:31 +05:30
  • b484953bb3 Import app state correctly to generate embeddings with OpenAI model Debanjum Singh Solanky 2023-05-28 10:11:38 +05:30
  • 9cfaaf0941 Update docs to configure khoj.yml for using OpenAI model for embeddings Debanjum Singh Solanky 2023-05-28 10:20:26 +05:30
  • a0d0dbaca7 Fix link to Khoj Obsidian Demo video in Readmes Debanjum Singh Solanky 2023-05-23 04:23:08 +05:30
  • ebb5d7b8e5 Release Khoj version 0.6.2 Debanjum Singh Solanky 2023-05-17 20:04:20 +05:30
  • d02415edcc Write generated server id to env file when env file does not contain it Debanjum Singh Solanky 2023-05-17 19:12:05 +05:30
  • dc0626856e Put the telemetry db in a separate directory by default Debanjum Singh Solanky 2023-05-17 18:58:08 +05:30
  • dc495babb3 Add Telemetry to Understand Khoj Usage Debanjum 2023-05-17 19:09:50 +08:00
  • 55d72231b3 Generate docker image for telemetry server using Github workflow Debanjum Singh Solanky 2023-05-17 11:46:34 +05:30
  • e9f04dc644 Add dockerfile to containerize telemetry server Debanjum Singh Solanky 2023-05-17 11:46:19 +05:30
  • 07b19964d4 Schedule jobs at (co-)prime intervals to reduce overlap in job runs Debanjum Singh Solanky 2023-05-17 09:45:26 +05:30
  • d42f0f5055 Add basic telemetry server for khoj Debanjum Singh Solanky 2023-05-15 22:55:49 +08:00
  • 134cce9d32 Batch upload telemetry data at regular interval instead of while querying Debanjum Singh Solanky 2023-05-16 23:32:18 +05:30
  • 3ede919c66 Log usage of /search, /chat, /update API endpoints to telemetry server Debanjum Singh Solanky 2023-05-15 20:58:51 +08:00
  • f2e89f6f46 Add khoj app helper methods to log app usage to a telemetry server Debanjum Singh Solanky 2023-05-15 20:57:54 +08:00
  • 9ca61d62ff Enable/disable logging telemetry by setting bool in khoj.yml config Debanjum Singh Solanky 2023-05-15 20:51:49 +08:00
  • 131b8407b5 Allow Khoj Chat to respond to general queries not in reference notes Debanjum Singh Solanky 2023-05-12 18:35:14 +08:00
  • cc75f986b2 Test text search index only updates on changes to text content Debanjum Singh Solanky 2023-05-12 17:37:34 +08:00
  • f9ccce430e Allow configuring OpenAI chat model for Khoj chat Debanjum Singh Solanky 2023-05-03 16:56:59 +08:00
  • f0253e2cbb Include Filename, Entry Heading in All Compiled Entries to Improve Search Context Debanjum 2023-05-03 22:59:30 +08:00
  • 6b535cc345 Snip prepended heading to avoid crossing model max_token limits Debanjum Singh Solanky 2023-05-03 22:08:41 +08:00
  • 02aeee60aa Set filename as top heading of org entries for better search context Debanjum Singh Solanky 2023-05-03 19:51:25 +08:00
  • 94825a70b9 Set heading of md entries to improve search context for long entries Debanjum Singh Solanky 2023-05-03 18:58:37 +08:00