You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
| Ollama |`"openai"`| Local models via OpenAI-compatible API |
13
+
| Foundry Local |`"openai"`| On-device inference via Microsoft's OpenAI-compatible local server |
13
14
| Other OpenAI-compatible |`"openai"`| vLLM, LiteLLM, etc. |
14
15
15
16
## Quick Start: Azure AI Foundry
@@ -250,6 +251,27 @@ provider: {
250
251
}
251
252
```
252
253
254
+
### Foundry Local (On-Device)
255
+
256
+
[Foundry Local](https://github.com/microsoft/Foundry-Local) runs AI models on-device without requiring an Azure subscription. It exposes an OpenAI-compatible API at `http://localhost:5272/v1`.
257
+
258
+
Use the [Foundry Local SDK](https://github.com/microsoft/Foundry-Local#-integrate-with-your-applications-using-the-sdk) to bootstrap the service and model, then point the Copilot SDK at the local endpoint:
259
+
260
+
```typescript
261
+
// Bootstrap: npm install foundry-local-sdk
262
+
// import { FoundryLocalManager } from "foundry-local-sdk";
baseUrl: "http://localhost:5272/v1", // Default Foundry Local endpoint
269
+
apiKey: manager.apiKey, // Provided by Foundry Local SDK
270
+
}
271
+
```
272
+
273
+
> **Note:** Foundry Local must be [installed separately](https://github.com/microsoft/Foundry-Local#installing). Run `foundry model run phi-3.5-mini` to download and start a model.
274
+
253
275
### Anthropic
254
276
255
277
```typescript
@@ -301,6 +323,7 @@ Some Copilot features may behave differently with BYOK:
301
323
|----------|-------------|
302
324
| Azure AI Foundry | No Entra ID auth; must use API keys |
303
325
| Ollama | No API key; local only; model support varies |
326
+
| Foundry Local | Local only; requires [Foundry Local installed](https://github.com/microsoft/Foundry-Local#installing); model catalog limited to Foundry Local models; REST API is in preview |
304
327
| OpenAI | Subject to OpenAI rate limits and quotas |
0 commit comments