Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 6 additions & 4 deletions docs/admin/architecture.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -188,11 +188,13 @@ Debugging includes [tracing](/admin/observability/tracing) and [logging](/admin/

## Cody

This section covers the Enterprise architecture of our AI assistant, Cody. [Cody Enterprise](/cody/clients/enable-cody-enterprise) can be deployed via the Sourcegraph Cloud or on your self-hosted infrastructure.
[Cody Enterprise](/cody/clients/enable-cody-enterprise) can be deployed via [Sourcegraph Cloud](/cloud) or on your self-hosted infrastructure. This section contains architecture diagrams for Cody deployed in different Sourcegraph environments.

### Cody with Sourcegraph Cloud deployment
{/* Figma source: https://www.figma.com/file/lAPHpdhtEmOJ22IQXVZ0vs/Cody-architecture-diagrams-SQS-draft-2024-04?type=whiteboard&node-id=0-1&t=blg78H2YXXbdGSPc-0 */}

This is a recommended deployment for Cody Enterprise. It uses the Sourcegraph Cloud infrastructure and Cody gateway.
### Sourcegraph Cloud deployment

This is a recommended deployment for Cody Enterprise. It uses the Sourcegraph Cloud infrastructure and is backed by the [Sourcegraph Model Provider (Cody Gateway)](/model-provider).

<img src="https://sourcegraphstatic.com/docs/enterprise-architecture-cloud-v2.png" />

Expand All @@ -202,7 +204,7 @@ This is an example of a more complex deployment that uses Sourcegraph Enterprise

<img src="https://sourcegraphstatic.com/docs/enterprise-architecture-aws-v0.png" />

### Data flow
### Cody Data flow

The following diagram describes the data flow between the different components of Cody Enterprise.

Expand Down
2 changes: 1 addition & 1 deletion docs/admin/self-hosted.mdx
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# Administration
# Enterprise Self-Hosted

<TierCallout>
Supported on [Enterprise](/pricing/enterprise) plans.
Expand Down
6 changes: 3 additions & 3 deletions docs/cody/capabilities/auto-edit.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -56,7 +56,7 @@ Site admins can opt their organization out of the auto-edit feature by disabling

### Configure auto-edit access

Auto-edit is available as default for Enterprise customers with [Sourcegraph Cody Gateway](/cody/core-concepts/cody-gateway#sourcegraph-cody-gateway) access. To configure auto-edit:
Auto-edit is available as default for Enterprise customers with [Sourcegraph Model Provider (Cody Gateway)](/model-provider) access. To configure auto-edit:

- Add `fireworks::*` as an [allowed provider](https://sourcegraph.com/docs/cody/enterprise/model-configuration#model-filters)

Expand Down Expand Up @@ -104,7 +104,7 @@ Site admins can opt their organization out of the auto-edit feature by disabling

### Configure auto-edit access

Auto-edit is available as default for Enterprise customers with [Sourcegraph Cody Gateway](/cody/core-concepts/cody-gateway#sourcegraph-cody-gateway) access. To configure auto-edit:
Auto-edit is available as default for Enterprise customers with [Sourcegraph Model Provider (Cody Gateway)](/model-provider) access. To configure auto-edit:

- Add `fireworks::*` as an [allowed provider](https://sourcegraph.com/docs/cody/enterprise/model-configuration#model-filters)

Expand Down Expand Up @@ -151,7 +151,7 @@ You can opt out and switch back to autocomplete by deselecting it from the Cody

### Configure auto-edit access

Auto-edit is available as default for Enterprise customers with [Sourcegraph Cody Gateway](/cody/core-concepts/cody-gateway#sourcegraph-cody-gateway) access. To configure auto-edit:
Auto-edit is available as default for Enterprise customers with [Sourcegraph Model Provider (Cody Gateway)](/model-provider) access. To configure auto-edit:

- Add `fireworks::*` as an [allowed provider](https://sourcegraph.com/docs/cody/enterprise/model-configuration#model-filters)

Expand Down
4 changes: 2 additions & 2 deletions docs/cody/clients/enable-cody-enterprise.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -22,13 +22,13 @@ With [Sourcegraph Cloud](/cloud/), you get Cody as a managed service, and you **
### Prerequisites

- You have Sourcegraph version `5.1.0` or more
- A Sourcegraph Enterprise subscription with [Cody Gateway](/cody/core-concepts/cody-gateway) or an account with a third-party LLM provider
- A Sourcegraph Enterprise subscription with [Sourcegraph Model Provider (Cody Gateway)](/model-provider) or an account with a third-party LLM provider

### Enable Cody on your Sourcegraph instance

Site admins can only enable Cody on the Sourcegraph instance. To do so,

- First, configure your desired LLM provider either by [using Sourcegraph Cody Gateway](/cody/core-concepts/cody-gateway) or by directly using a third-party LLM provider
- First, configure your desired LLM provider either by [using Sourcegraph Model Provider (Cody Gateway)](/model-provider) or by directly using a third-party LLM provider
- Next, go to **Site admin > Site configuration** (`/site-admin/configuration`) on your instance and set:

```json
Expand Down
2 changes: 1 addition & 1 deletion docs/cody/clients/install-vscode.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -232,7 +232,7 @@ Enterprise users get Claude 3.5 Sonnet as the default LLM models without extra c

<Callout type="info">For enterprise users on Amazon Bedrock: 3.5 Sonnet is unavailable in `us-west-2` but available in `us-east-1`. Check the current model availability on AWS and your customer's instance location before switching. Provisioned throughput via AWS is not supported for 3.5 Sonnet.</Callout>

You also get additional capabilities like BYOLLM (Bring Your Own LLM), supporting Single-Tenant and Self Hosted setups for flexible coding environments. Your site administrator determines the LLM, and cannot be changed within the editor. However, Cody Enterprise users when using Cody Gateway have the ability to [configure custom models](/cody/core-concepts/cody-gateway#configuring-custom-models) from Anthropic, OpenAI, and Google Gemini.
You also get additional capabilities like BYOLLM (Bring Your Own LLM), supporting Single-Tenant and Self Hosted setups for flexible coding environments. Your site administrator determines the LLM, and cannot be changed within the editor. However, Cody Enterprise users when using Sourcegraph Model Provider (Cody Gateway) have the ability to [configure custom models](/model-provider#configuring-custom-models) from Anthropic, OpenAI, and Google Gemini.

<Callout type="note">Read more about all the supported LLM models [here](/cody/capabilities/supported-models)</Callout>

Expand Down
51 changes: 0 additions & 51 deletions docs/cody/core-concepts/cody-gateway.mdx

This file was deleted.

23 changes: 0 additions & 23 deletions docs/cody/core-concepts/enterprise-architecture.mdx

This file was deleted.

4 changes: 2 additions & 2 deletions docs/cody/core-concepts/index.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -8,9 +8,9 @@

<QuickLink title="Keyword Search" icon='presets' href="/cody/core-concepts/keyword-search" description="Learn how Cody makes use to Keyword Search to gather context." />

<QuickLink title="Cody Gateway" icon='theming' href="/cody/core-concepts/cody-gateway" description="Learn how Cody Gateway powers the default Sourcegraph provider for completions to facilitate Cody features." />
<QuickLink title="Sourcegraph Model Provider" icon='theming' href="/model-provider" description="Learn how the default Sourcegraph Model Provider facilitates Cody features." />

<QuickLink title="Enterprise Architecture" icon='installation' href="/cody/core-concepts/enterprise-architecture" description="Understand how Cody Enterprise is deployed and fits into your environment." />
<QuickLink title="Enterprise Architecture" icon='installation' href="/admin/architecture#cody" description="Understand how Cody Enterprise is deployed and fits into your environment." />

<QuickLink title="Token Limits" icon='languagemodels' href="/cody/core-concepts/token-limits" description="Understand the constraints of Cody's context window." />

Expand Down
2 changes: 1 addition & 1 deletion docs/cody/enterprise/completions-configuration.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -168,7 +168,7 @@ For the access token,

When tested with other coder models for the autocomplete use case, [StarCoder](https://huggingface.co/blog/starcoder) offered significant improvements in quality and latency compared to our control groups for users on Sourcegraph.com. You can read more about the improvements in our [October 2023 release notes](https://sourcegraph.com/blog/feature-release-october-2023) and the [GA release notes](https://sourcegraph.com/blog/cody-is-generally-available).

To ensure a fast and reliable experience, we are partnering with [Fireworks](https://fireworks.ai/) and have set up a dedicated hardware deployment for our Enterprise users. Sourcegraph supports StarCoder using the [Cody Gateway](/cody/core-concepts/cody-gateway).
To ensure a fast and reliable experience, we are partnering with [Fireworks](https://fireworks.ai/) and have set up a dedicated hardware deployment for our Enterprise users. Sourcegraph supports StarCoder using the [Sourcegraph Model Provider (Cody Gateway)](/model-provider).

To enable StarCoder, go to **Site admin > Site configuration** (`/site-admin/configuration`) and change the `completionModel`:

Expand Down
2 changes: 1 addition & 1 deletion docs/cody/enterprise/features.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ Site administrators can set the duration of access tokens for users connecting C

<Callout type="warning">Guardrails has been deprecated and is no longer recommended for use.</Callout>

<Callout type= "note">Guardrails for public code is only supported on VS Code, JetBrains IDEs extension, and Sourcegraph Web app for Cody Enterprise customers using [Cody Gateway](https://sourcegraph.com/docs/cody/core-concepts/cody-gateway#sourcegraph-cody-gateway). It is not supported for any BYOK (Bring Your Own Key) deployments. </Callout>
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

wtf absolute links in our doc site 🙃

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

sadge

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this was something that is caused by some of our syncing from our sourcegraph repo.
Context:
https://sourcegraph.slack.com/archives/C04MYFW01NV/p1762553754456049

<Callout type= "note">Guardrails for public code is only supported on VS Code, JetBrains IDEs extension, and Sourcegraph Web app for Cody Enterprise customers using [Sourcegraph Model Provider (Cody Gateway)](/model-provider). It is not supported for any BYOK (Bring Your Own Key) deployments. </Callout>

Open source attribution guardrails for public code, commonly called copyright guardrails, reduce the exposure to copyrighted code. This involves implementing a verification mechanism within Cody to ensure that any code generated by the platform does not replicate open source code.

Expand Down
6 changes: 3 additions & 3 deletions docs/cody/enterprise/model-configuration.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -36,9 +36,9 @@ For a minimal configuration example, see [Configure Sourcegraph-supplied models]

## Sourcegraph-provided models

Sourcegraph-provided models, accessible through the [Cody Gateway](/cody/core-concepts/cody-gateway), are managed via your site configuration.
Sourcegraph-provided models, accessible through the [Sourcegraph Model Provider (Cody Gateway)](/model-provider), are managed via your site configuration.

For most administrators, relying on these models alone ensures access to high-quality models without needing to manage specific configurations.
For most administrators, relying on these models alone ensures access to high-quality models without needing to manage specific configurations. See [Supported LLMs](/cody/capabilities/supported-models) for the full list of available models.

The use of these models is controlled through the `"modelConfiguration.sourcegraph"` field in the site config.

Expand Down Expand Up @@ -190,7 +190,7 @@ Sourcegraph natively supports several types of LLM API providers. The current se

| **Provider type** | **Description** |
| -------------------- | ---------------------------------------------------------------------------------------------------------- |
| `"sourcegraph"` | [Cody Gateway](/cody/core-concepts/cody-gateway), offering access to various models from multiple services |
| `"sourcegraph"` | [Sourcegraph Model Provider (Cody Gateway)](/model-provider), offering access to various models from multiple services |
| `"openaicompatible"` | Any OpenAI-compatible API implementation |
| `"awsBedrock"` | [Amazon Bedrock](https://docs.aws.amazon.com/bedrock/) |
| `"azureOpenAI"` | [Microsoft Azure OpenAI](https://azure.microsoft.com/en-us/products/ai-services/openai-service/) |
Expand Down
4 changes: 2 additions & 2 deletions docs/cody/faq.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -106,13 +106,13 @@ Sourcegraph does not use models hosted by DeepSeek (the company), and does not s

### What is the default `sourcegraph` provider for completions?

The default provider for completions, specified as `"provider": "sourcegraph"` refers to the [Sourcegraph Cody Gateway](/cody/core-concepts/cody-gateway). The Cody Gateway facilitates access to completions for Sourcegraph enterprise instances by leveraging third-party services such as Anthropic and OpenAI.
The default provider for completions, specified as `"provider": "sourcegraph"` refers to the [Sourcegraph Model Provider (Cody Gateway)](/model-provider). The Sourcegraph Model Provider facilitates access to completions for Sourcegraph enterprise instances by leveraging third-party services such as Anthropic and OpenAI.

### What third-party cloud services does Cody depend on?

Cody relies on one primary third-party dependency, i.e., Anthropic's Claude API. Users can use this with the OpenAI API configuration.

It's worth noting that these dependencies remain consistent when utilizing the [default `sourcegraph` provider, Cody Gateway](/cody/core-concepts/cody-gateway), which uses the same third-party providers.
It's worth noting that these dependencies remain consistent when utilizing the [default `sourcegraph` provider, Sourcegraph Model Provider (Cody Gateway)](/model-provider), which uses the same third-party providers.

### What is the retention policy for Anthropic and OpenAI?

Expand Down
Loading