Commit Graph

  • 306f7a2132 Show error in picking next tool to researcher llm in next iteration Debanjum 2024-11-10 13:14:46 -08:00
  • eb492f3025 Only keep webpage content requested, even if Jina API gets more data Debanjum 2024-11-10 13:19:24 -08:00
  • 8ef7892c5e Exclude non-dictionary doc context from chat history sent to chat models Debanjum 2024-11-10 13:42:55 -08:00
  • d892ab3174 Fix handling of command rate limit and improve rate limit messages Debanjum 2024-11-09 11:30:55 -08:00
  • 80ee35b9b1 Wrap messages in web, obsidian UI to stay within screen when long links Debanjum 2024-11-07 15:56:43 -08:00
  • f967bdf702 Show correct example index being currently processed in frames eval Debanjum 2024-11-08 15:46:44 -08:00
  • 84a8088c2b Only evaluate non-empty responses to reduce eval script latency, cost Debanjum 2024-11-07 15:23:30 -08:00
  • 170d959feb Handle offline messages differently, as they don't respond well to the structured messages sabaimran 2024-11-09 19:52:46 -08:00
  • 2c543bedd7 Add typing to the constructed messages listed sabaimran 2024-11-09 19:40:27 -08:00
  • 79b15e4594 Only add images when they're present and vision enabled sabaimran 2024-11-09 19:37:30 -08:00
  • bd55028115 Fix randint import from random when creating filenames for tmp sabaimran 2024-11-09 19:17:18 -08:00
  • 92b6b3ef7b Add attached files to latest structured message in chat ml format sabaimran 2024-11-09 19:17:00 -08:00
  • 835fa80a4b Allow docx conversion in the chatFunction.ts sabaimran 2024-11-09 18:51:00 -08:00
  • 459318be13 And random suffixes to decreases any clash probability when writing tmp files to disc sabaimran 2024-11-09 18:46:34 -08:00
  • dbf0c26247 Remove _summary_ description in function descriptions sabaimran 2024-11-09 18:42:42 -08:00
  • e5ac076fc4 Move construct_chat_history method back to conversation.utils.py sabaimran 2024-11-09 18:27:46 -08:00
  • bc95a99fb4 Make tracer the last input parameter for all the relevant chat helper methods sabaimran 2024-11-09 18:22:46 -08:00
  • ceb29eae74 Add phone number verification and remove telemetry update call from place where authentication middleware isn't yet installed (in the middleware itself). sabaimran 2024-11-09 12:25:36 -08:00
  • 3badb27744 Remove stored uploaded files after they're processed. sabaimran 2024-11-08 23:28:02 -08:00
  • 78630603f4 Delete the fact checker application sabaimran 2024-11-08 17:27:42 -08:00
  • 807687a0ac Automatically generate titles for conversations from history sabaimran 2024-11-08 16:02:34 -08:00
  • 7159b0b735 Enforce limits on file size when converting to text sabaimran 2024-11-08 15:27:28 -08:00
  • 4695174149 Add support for file preview in the chat input area (before message sent) sabaimran 2024-11-08 15:12:48 -08:00
  • ad46b0e718 Label pages when extract text from pdf, docs content. Fix scroll area in doc preview. sabaimran 2024-11-08 14:53:20 -08:00
  • ee062d1c48 Fix parsing for PDFs via content indexing API sabaimran 2024-11-07 18:17:29 -08:00
  • 623a97a9ee Merge branch 'master' of github.com:khoj-ai/khoj into features/include-full-file-in-convo-with-filter sabaimran 2024-11-07 17:18:23 -08:00
  • 33498d876b Simplify the share chat page. Don't need it to maintain its own conversation history sabaimran 2024-11-07 17:14:11 -08:00
  • 4b8be55958 Convert UUID to string when forking a conversation sabaimran 2024-11-07 17:13:04 -08:00
  • 9bbe27fe36 Set default value of attached files to empty list sabaimran 2024-11-07 17:12:45 -08:00
  • 3a51996f64 Process attached files in the chat history and add them to the chat message sabaimran 2024-11-07 16:06:58 -08:00
  • a89160e2f7 Add support for converting an attached doc and chatting with it sabaimran 2024-11-07 16:06:37 -08:00
  • e521853895 Remove unnecessary console.log statements sabaimran 2024-11-07 16:03:31 -08:00
  • 92c3b9c502 Add function to get an icon from a file type sabaimran 2024-11-07 16:02:53 -08:00
  • 140c67f6b5 Remove focus ring from the text area component sabaimran 2024-11-07 16:02:02 -08:00
  • b8ed98530f Accept attached files in the chat API sabaimran 2024-11-07 16:01:48 -08:00
  • ecc81e06a7 Add separate methods for docx and pdf files to just convert files to raw text, before further processing sabaimran 2024-11-07 16:01:08 -08:00
  • 394035136d Add an api that gets a document, and converts it to just text sabaimran 2024-11-07 16:00:10 -08:00
  • 3b1e8462cd Include attach files in calls to extract questions sabaimran 2024-11-07 15:59:15 -08:00
  • de73cbc610 Add support for relaying attached files through backend calls to models sabaimran 2024-11-07 15:58:52 -08:00
  • 4cad96ded6 Add Script to Evaluate Khoj on Google's FRAMES benchmark (#955) Debanjum 2024-11-06 17:52:01 -08:00
  • 8679294bed Remove need to set server chat settings from use openai proxies docs Debanjum 2024-11-05 17:03:17 -08:00
  • 05a93fcbed v-align attach, send buttons with chat input text area on web app Debanjum 2024-11-04 20:49:35 -08:00
  • a0480d5f6c use fill weight for the toggle right (enabled state) for research mode sabaimran 2024-11-04 22:01:09 -08:00
  • dc26da0a12 Add uploaded files in the conversation file filter for a new convo sabaimran 2024-11-04 22:00:47 -08:00
  • b51ee644aa Fix escaping filename when normalizing in org node parser Debanjum 2024-11-04 20:24:01 -08:00
  • 5724d16a6f Fix passing images to anthropic chat models to extract questions Debanjum 2024-11-04 20:23:31 -08:00
  • cf0bcec0e7 Revert SKIP_TESTS flag in offline chat director tests sabaimran 2024-11-04 19:06:54 -08:00
  • 1f372bf2b1 Update file summarization unit tests now that multiple files are allowed sabaimran 2024-11-04 17:45:54 -08:00
  • 7543360210 Merge branch 'master' of github.com:khoj-ai/khoj into features/include-full-file-in-convo-with-filter sabaimran 2024-11-04 16:55:48 -08:00
  • b6145df3be Handle file retrieval when agent is None sabaimran 2024-11-04 16:55:22 -08:00
  • 3dc9139cee Add additional handling for when file_object comes back empty sabaimran 2024-11-04 16:53:07 -08:00
  • a27b8d3e54 Remove summarize condition for only 1 file filter sabaimran 2024-11-04 16:51:37 -08:00
  • 362bdebd02 Add methods for reading full files by name and including context sabaimran 2024-11-04 16:37:13 -08:00
  • e3ca52b7cb Use .get() to get text accompanying image url, instead of subindexing sabaimran 2024-11-04 16:09:16 -08:00
  • 1e89baca7b Deprecate the UserSearchModelConfig and remove all references sabaimran 2024-11-04 12:24:41 -08:00
  • 1ccbf72752 Use logger instead of print to track eval Debanjum 2024-11-02 18:20:42 -07:00
  • 99c1d2831a Release Khoj version 1.28.3 sabaimran 2024-11-02 12:23:11 -07:00
  • 075b4ecf15 Call subscription_to_state with sync_to_async wrapper when getting user subscription state sabaimran 2024-11-02 12:22:35 -07:00
  • ec44cbe1e7 Release Khoj version 1.28.2 sabaimran 2024-11-02 07:53:51 -07:00
  • 791eb205f6 Run prompt batches in parallel for faster eval runs Debanjum 2024-11-02 04:58:03 -07:00
  • 96904e0769 Add script to evaluate khoj on Google's FRAMES benchmark Debanjum 2024-11-02 02:38:26 -07:00
  • 31b5fde163 Only enable prompt tracer if git python is installed Debanjum 2024-11-01 23:57:22 -07:00
  • 5b18dc96e0 Release Khoj version 1.28.1 sabaimran 2024-11-01 22:51:51 -07:00
  • 8d1b1bc78e Move the git python dependency into top level dependencies sabaimran 2024-11-01 22:51:00 -07:00
  • e85dd59295 Release Khoj version 1.28.0 Debanjum 2024-11-01 19:06:59 -07:00
  • 1f79a10541 Fix link to code execution feature in docs Debanjum 2024-11-01 18:22:21 -07:00
  • cff8e02b60 Research Mode [Part 2]: Improve Prompts, Edit Chat Messages. Set LLM Seed for Reproducibility (#954) Debanjum 2024-11-01 18:16:42 -07:00
  • 14e453039d Add prompt tracing, agent personality to infer webpage urls chat actor Debanjum 2024-11-01 18:03:52 -07:00
  • ab321dc518 Expect query before tool in response to give think space in research prompt Debanjum 2024-11-01 17:48:35 -07:00
  • 1a83bbcc94 Clean API chat router. Move FeedbackData response type to router helper Debanjum 2024-11-01 17:31:43 -07:00
  • e6eb87bbb5 Merge branch 'improve-debug-reasoning-and-other-misc-fixes' of github.com:khoj-ai/khoj into improve-debug-reasoning-and-other-misc-fixes sabaimran 2024-11-01 16:48:39 -07:00
  • a213b593e8 Limit the number of urls the webscraper can extract for scraping sabaimran 2024-11-01 16:48:36 -07:00
  • 327fcb8f62 create defiltered query after conversation command is extracted sabaimran 2024-11-01 16:48:03 -07:00
  • b79a9ec36d Clarify description of the code evaluation environment: not for document creation sabaimran 2024-11-01 16:47:27 -07:00
  • 9c7b36dc69 Use standard per minute rate limits across user types Debanjum 2024-11-01 16:15:09 -07:00
  • ac21b10dd5 Simplify logic to get default search model. Remove unused import Debanjum 2024-11-01 15:14:00 -07:00
  • 2b35790165 Merge branch 'master' of github.com:khoj-ai/khoj into improve-debug-reasoning-and-other-misc-fixes sabaimran 2024-11-01 14:51:26 -07:00
  • 22f3ed3f5d Research Mode: Give Khoj the ability to perform more advanced reasoning (#952) Debanjum 2024-11-01 14:46:29 -07:00
  • baa939f4ce When running code, strip any code delimiters. Disable application json type specification in Gemini request. sabaimran 2024-11-01 13:47:39 -07:00
  • 8fd2fe162f Determine if research mode is enabled by checking the conversation commands and 'linting' them in the selection phase sabaimran 2024-11-01 13:12:34 -07:00
  • cead1598b9 Don't reset research mode after completing research execution sabaimran 2024-11-01 13:00:11 -07:00
  • c1c779a7ef Do not yaml format raw code results in context for LLM. It's confusing Debanjum 2024-11-01 12:04:38 -07:00
  • b3dad1f393 Standardize rate limits to 1/6 ratio sabaimran 2024-11-01 12:21:09 -07:00
  • 23a49b6b95 Add documentation for python code execution capability sabaimran 2024-11-01 12:14:33 -07:00
  • cd75151431 Do not allow auto selecting research mode as tool for now. Debanjum 2024-11-01 11:58:44 -07:00
  • 0b0cfb35e6 Simplify in research mode check in api_chat. Debanjum 2024-11-01 11:55:13 -07:00
  • ffa7f95559 Add template for a code sandbox to the docker-compose configuration sabaimran 2024-11-01 11:50:58 -07:00
  • 73750ef286 Merge branch 'master' into features/advanced-reasoning Debanjum 2024-11-01 11:42:01 -07:00
  • 1fc280db35 Handle case where infer_webpage_url returns no valid urls sabaimran 2024-11-01 11:41:32 -07:00
  • 1c920273dd Add Prompt Tracer to Visualize, Analyze and Debug Khoj's Train of Thought (#951) Debanjum 2024-11-01 11:33:54 -07:00
  • 33d36ee58c Add experimental notice to research mode tooltip sabaimran 2024-11-01 11:00:27 -07:00
  • 0145b2a366 Set usage limits on the research mode sabaimran 2024-11-01 10:29:33 -07:00
  • 3ea94ac972 Only include inferred-queries in chat history when present sabaimran 2024-10-31 22:01:41 -07:00
  • 149cbe1019 Use bottom anchor for the commandbar popover sabaimran 2024-10-31 20:40:38 -07:00
  • 21858acccc Remove conversation command always in query, filter out inferred queries that were not with selected tool when going through tool selection iterations sabaimran 2024-10-31 20:27:38 -07:00
  • 19241805ee Merge branch 'master' of github.com:khoj-ai/khoj into improve-debug-reasoning-and-other-misc-fixes sabaimran 2024-10-31 18:20:23 -07:00
  • 302bd51d17 Improve online chat actor prompt for research and normal mode Debanjum 2024-10-31 17:56:06 -07:00
  • 52163fe299 Improve research planner prompt to reduce looping Debanjum 2024-10-31 18:15:58 -07:00
  • 7ebf999688 Merge branch 'master' of github.com:khoj-ai/khoj into features/advanced-reasoning sabaimran 2024-10-31 18:15:13 -07:00
  • 159ea44883 Remove frame references in the diagramming prompts sabaimran 2024-10-31 18:14:51 -07:00