Add and update documentation for setting up khoj with an openai proxy server or offline llm

documentation/docs/data-sources/_category_.json

@@ -0,0 +1,8 @@
+{
+  "label": "Data Sources",
+  "position": 5,
+  "link": {
+    "type": "generated-index",
+    "description": "Online data sources for indexing via Khoj"
+  }
+}

documentation/docs/data-sources/github_integration.md

@@ -0,0 +1,14 @@
+# Github integration
+
+The Github integration allows you to index as many repositories as you want. It's currently default configured to index Issues, Commits, and all Markdown/Org files in each repository. For large repositories, this takes a fairly long time, but it works well for smaller projects.
+
+# Configure your settings
+
+1. Go to [https://app.khoj.dev/config](https://app.khoj.dev/config) and enter in settings for the data sources you want to index. You'll have to specify the file paths.
+
+## Use the Github plugin
+
+1. Generate a [classic PAT (personal access token)](https://docs.github.com/en/authentication/keeping-your-account-and-data-secure/managing-your-personal-access-tokens) from [Github](https://github.com/settings/tokens) with `repo` and `admin:org` scopes at least.
+2. Navigate to [https://app.khoj.dev/config/content-source/github](https://app.khoj.dev/config/content-source/github) to configure your Github settings. Enter in your PAT, along with details for each repository you want to index.
+3. Click `Save`. Go back to the settings page and click `Configure`.
+4. Go to [https://app.khoj.dev/](https://app.khoj.dev/) and start searching!

documentation/docs/data-sources/notion_integration.md

@@ -0,0 +1,19 @@
+# Notion Integration
+
+The Notion integration allows you to search/chat with your Notion workspaces. [Notion](https://notion.so/) is a platform people use for taking notes, especially for collaboration.
+
+Go to https://app.khoj.dev/config to connect your Notion workspace(s) to Khoj.
+
+![notion_integration](/img/notion_integration.gif)
+
+
+## Self-Hosted Setup
+
+1. Go to https://www.notion.so/my-integrations and create a new integration called Khoj to get an API key.
+![setup_new_integration](https://github.com/khoj-ai/khoj/assets/65192171/b056e057-d4dc-47dc-aad3-57b59a22c68b)
+3. Share all the workspaces that you want to integrate with the Khoj integration you just made in the previous step
+![enable_workspace](https://github.com/khoj-ai/khoj/assets/65192171/98290303-b5b8-4cb0-b32c-f68c6923a3d0)
+4. In the first step, you generated an API key. Use the newly generated API Key in your Khoj settings, by default at http://localhost:42110/config/content-source/notion. Click `Save`.
+5. Click `Configure` in http://localhost:42110/config to index your Notion workspace(s).
+
+That's it! You should be ready to start searching and chatting. Make sure you've configured your [chat settings](/get-started/setup#2-configure).

documentation/docs/data-sources/share_your_data.md

@@ -0,0 +1,16 @@
+---
+sidebar_position: 0
+keywords: ["upload data", "upload files", "share data", "share files", "pdf ai", "ai for pdf", "ai for documents", "ai for files", "local ai pdf", "local ai documents", "local ai files"]
+
+---
+
+# Upload your data
+
+There are several ways you can get started with sharing your data with the Khoj AI.
+
+- Drag and drop your documents via [the web UI](/clients/web/#upload-documents). This is best if you have a one-off document you need to interact with.
+- Use the desktop app to [upload and sync your documents](/clients/desktop). This is best if you have a lot of documents on your computer or you need the docs to stay in sync.
+- Setup the sync options for either [Obsidian](/clients/obsidian) or [Emacs](/clients/emacs) to automatically sync your documents with Khoj. This is best if you are already using these tools and want to leverage Khoj's AI capabilities.
+- Configure your [Notion](/data-sources/notion_integration) or [Github](/data-sources/github_integration) to sync with Khoj. By providing your credentials, you can keep the data synced in the background.
+
+![demo of dragging and dropping a file](https://khoj-web-bucket.s3.amazonaws.com/drag_drop_file.gif)