feat: Add OpenRouter Provider Support with Dynamic Model Loading #8738

partha-sarathyy · 2025-11-15T20:34:55Z

feat(openrouter): Add OpenRouter Provider Support with Dynamic Model Loading

Overview

This PR adds OpenRouter as a model provider in Continue, with automatic model loading from OpenRouter JSON data and an enhanced model selection UI featuring fuzzy search.

Changes Made

1. OpenRouter Model Data Processing (`openRouterModel.ts`)

New file to convert OpenRouter JSON model data into Continue's ModelPackage format.
Implements automatic model discovery from openRouterModels.json.
Features:
- Converts OpenRouter model metadata to Continue's ModelPackage type.
- Extracts provider names, context lengths, and descriptions.
- Generates reference URLs to OpenRouter model pages.
- Error handling for malformed model entries.
- Exports both keyed object (openRouterModels) and array (openRouterModelsList) formats.

Files:

2. Provider Configuration (`providers.ts`)

Added OpenRouter provider configuration with setup instructions and metadata.
Integrated OpenRouter models into provider packages by importing openRouterModelsList.
Configured provider metadata:
- Title: OpenRouter
- Icon: openrouter.png
- API Key URL and documentation links
- Completion parameters input fields

File:

gui/src/pages/AddNewModel/configs/providers.ts

3. Enhanced Model Selection UI (`ModelSelectionListbox.tsx`)

Added fuzzy search to the model/provider selection dropdown.
Features:
- Sticky search box with magnifying glass icon.
- Fuzzy matching algorithm that matches characters in order and gives bonuses for consecutive matches.
- Real-time filtering and smart result sorting by match quality.
- Search persistence behavior: clears on provider change or dropdown close.
- Empty state message when no matches are found.
- New searchPlaceholder prop for context-specific labels.

File:

gui/src/components/modelSelection/ModelSelectionListbox.tsx

Other modified imports:

gui/src/pages/AddNewModel/configs/models.ts

Search Algorithm Details

Matches partial strings while preserving character order.
Rewards consecutive character matches with bonus points.
Normalized scoring for fair ranking across varying text lengths.
Supports both "Search models..." and "Search providers..." contexts.

UI Improvements

Search box is sticky at the top of dropdown.
Respects the existing theme (no custom colors).
Uses Heroicons: @heroicons/react/24/outline.
Smooth transitions and proper focus management.

Technical Details

New Dependencies

No new external dependencies added.
Uses React hooks: useState, useEffect, useMemo.
Uses existing Continue UI components.

File Structure (new / modified)

gui/src/pages/AddNewModel/configs/
├── openRouterModel.ts (NEW)
├── openRouterModels.json (NEW)
├── models.ts (modified imports)
├── providers.ts (added OpenRouter config)

gui/src/components/modelSelection/
├── ModelSelectionListbox.tsx (enhanced with search)

Usage Examples

For users:

Go to Add New Model settings.
Select "OpenRouter" from providers (or search).
Enter OpenRouter API key.
Browse available models and use fuzzy search:
- Search examples: gpt, claude, llama.

Files Added

gui/src/pages/AddNewModel/configs/openRouterModel.ts (new)
gui/src/pages/AddNewModel/configs/openRouterModels.json (new)
Icon: openrouter.png (ensure included in repo assets)

Tests / Verification

Manual:
- Open Add New Model UI and select OpenRouter.
- Confirm models load from openRouterModels.json.
- Verify fuzzy search returns expected results and empty state message is shown for no matches.
Edge cases:
- Malformed entries are skipped and logged.
- Short inputs and single-character searches return sensible results.

Notes for Reviewers

No runtime dependencies added.
Ensure openRouterModels.json and openrouter.png are included in packaged assets/build.
Users must provide an OpenRouter API key in settings (consider documenting in README or provider docs).

Breaking Changes

None. If any breaking API changes were introduced, the title should include a ! and a BREAKING CHANGE section.

Changelog (one-liner)

feat(openrouter): add OpenRouter provider with dynamic model loading and fuzzy search for model selection

Adds OpenRouter as a provider with dynamic model loading from OpenRouter data and adds fuzzy search to the model/provider selection for faster discovery.

github-actions · 2025-11-15T20:35:04Z

All contributors have signed the CLA ✍️ ✅
_{Posted by the CLA Assistant Lite bot.}

cubic-dev-ai

2 issues found across 6 files

Prompt for AI agents (all 2 issues)


Understand the root cause of the following 2 issues and fix them.


<file name="gui/src/pages/AddNewModel/configs/openRouterModel.ts">

<violation number="1" location="gui/src/pages/AddNewModel/configs/openRouterModel.ts:60">
Because nearly every OpenRouter model populates `architecture.modality`, this condition marks all of them as not open source—including open-weight models—so they disappear from any open-source-only filters. Please base `isOpenSource` on a discriminator that actually reflects open weights (e.g., the presence of a Hugging Face ID) instead of the modality flag.</violation>
</file>

<file name="gui/src/components/modelSelection/ModelSelectionListbox.tsx">

<violation number="1" location="gui/src/components/modelSelection/ModelSelectionListbox.tsx:161">
Popular list entries lost the pointer cursor class, so they no longer show a pointer on hover—please add `cursor-pointer` back to keep them visibly interactive.</violation>
</file>

Since this is your first cubic review, here's how it works:

cubic automatically reviews your code and comments on bugs and improvements
Teach cubic by replying to its comments. cubic learns from your replies and gets better over time
Ask questions if you need clarification on any suggestion

_{Reply to cubic to teach it or ask questions. Re-run a review with @cubic-dev-ai review this PR}

cubic-dev-ai · 2025-11-15T20:42:34Z

gui/src/pages/AddNewModel/configs/openRouterModel.ts

+      model: model.id,
+      contextLength,
+    },
+    isOpenSource: model.architecture?.modality ? false : true,


Because nearly every OpenRouter model populates architecture.modality, this condition marks all of them as not open source—including open-weight models—so they disappear from any open-source-only filters. Please base isOpenSource on a discriminator that actually reflects open weights (e.g., the presence of a Hugging Face ID) instead of the modality flag.

Prompt for AI agents

Address the following comment on gui/src/pages/AddNewModel/configs/openRouterModel.ts at line 60: <comment>Because nearly every OpenRouter model populates `architecture.modality`, this condition marks all of them as not open source—including open-weight models—so they disappear from any open-source-only filters. Please base `isOpenSource` on a discriminator that actually reflects open weights (e.g., the presence of a Hugging Face ID) instead of the modality flag.</comment> <file context> @@ -0,0 +1,107 @@ + model: model.id, + contextLength, + }, + isOpenSource: model.architecture?.modality ? false : true, + tags: [provider as any], + }; </file context>

✅ Addressed in 564e0b0

gui/src/components/modelSelection/ModelSelectionListbox.tsx

ai suggestion Co-authored-by: cubic-dev-ai[bot] <191113872+cubic-dev-ai[bot]@users.noreply.github.com>

…tha-sarathyy/continue into addmodel-openrouter-provider

partha-sarathyy · 2025-11-16T12:00:43Z

I have read the CLA Document and I hereby sign the CLA

RomneyDa

@partha-sarathyy this is great!
The only change I'd request is could you write a super simple script or similar to eliminate all the unused parameters/extra data from the operouter models JSON to whittle it down to a more manageable size? I think it should be a few hundred lines tops. You might even just prompt Continue to rewrite it with the following changes:

Descriptions need to be shorter to fit in the UI. Once brief sentence max
All unused fields should be eliminated (most of them)

You could include brief instructions on where you got the JSON and the prompt you used to clean it up, in a comment

partha-sarathyy · 2025-11-19T05:56:37Z

@RomneyDa thanks for the review.
As per your suggestion i removed most of the unwanted properties. But just to be sure are these below properties enough or should i add any additional properties

Interface OpenRouterModel {
  id: string;
  name: string;
  description: string;
  context_length: number;
  hugging_face_id: string;
}

RomneyDa

@partha-sarathyy appreciate the followup!

I think it should be a few hundred lines tops

I'm still a bit concerned with maintainability of 2000 lines of model constants. Is there a way we could dynamically fetch this from openrouter only when openrouter is selected or similar?

partha-sarathyy · 2025-11-26T04:09:37Z

@RomneyDa yeah I think it's totally possible and I'll look into it

- Replaced the import of openRouterModelsList with getOpenRouterModelsList. - Added a new function `initializeOpenRouterModels` to fetch and initialize OpenRouter models from the API. - Updated the providers object with the fetched models upon successful retrieval. - Added error handling to reset the models list in case of a fetch failure.

cubic-dev-ai

2 issues found across 4 files (reviewed changes from recent commits).

Prompt for AI agents (all 2 issues)


Check if these issues are valid — if so, understand the root cause of each and fix them.


<file name="gui/src/forms/AddModelForm.tsx">

<violation number="1" location="gui/src/forms/AddModelForm.tsx:45">
`initializeOpenRouterModels` performs network work and should run in an effect, not on every render; wrap the call in a mount-only `useEffect` so it executes once.</violation>
</file>

<file name="gui/src/pages/AddNewModel/configs/providers.ts">

<violation number="1" location="gui/src/pages/AddNewModel/configs/providers.ts:53">
Loading OpenRouter models asynchronously leaves `providers.openrouter.packages` empty on first use, so selecting the provider before the fetch completes sets `selectedModel` to undefined and crashes when `selectedModel.params` is accessed.</violation>
</file>

_{Reply to cubic to teach it or ask questions. Re-run a review with @cubic-dev-ai review this PR}

gui/src/forms/AddModelForm.tsx

cubic-dev-ai · 2025-11-26T17:41:21Z

gui/src/pages/AddNewModel/configs/providers.ts

+ */
+export async function initializeOpenRouterModels() {
+  try {
+    openRouterModelsList = await getOpenRouterModelsList();


Loading OpenRouter models asynchronously leaves providers.openrouter.packages empty on first use, so selecting the provider before the fetch completes sets selectedModel to undefined and crashes when selectedModel.params is accessed.

Prompt for AI agents

Check if this issue is valid — if so, understand the root cause and fix it. At gui/src/pages/AddNewModel/configs/providers.ts, line 53: <comment>Loading OpenRouter models asynchronously leaves `providers.openrouter.packages` empty on first use, so selecting the provider before the fetch completes sets `selectedModel` to undefined and crashes when `selectedModel.params` is accessed.</comment> <file context> @@ -41,6 +41,26 @@ const openSourceModels = Object.values(models).filter( + */ +export async function initializeOpenRouterModels() { + try { + openRouterModelsList = await getOpenRouterModelsList(); + // Update the providers object with the fetched models + if (providers.openrouter) { </file context>

…r and effect hook

partha-sarathyy added 2 commits November 16, 2025 01:33

Add OpenRouter provider configuration to Add Model Form

2eb5c97

feat: add search functionality to model selection listbox

a89daa6

partha-sarathyy requested a review from a team as a code owner November 15, 2025 20:34

partha-sarathyy requested review from Patrick-Erichsen and removed request for a team November 15, 2025 20:34

github-project-automation bot added this to Issues and PRs Nov 15, 2025

github-project-automation bot moved this to Todo in Issues and PRs Nov 15, 2025

dosubot bot added the size:L This PR changes 100-499 lines, ignoring generated files. label Nov 15, 2025

cubic-dev-ai bot reviewed Nov 15, 2025

View reviewed changes

partha-sarathyy and others added 3 commits November 16, 2025 02:20

Update gui/src/components/modelSelection/ModelSelectionListbox.tsx

46619a7

ai suggestion Co-authored-by: cubic-dev-ai[bot] <191113872+cubic-dev-ai[bot]@users.noreply.github.com>

fix: update isOpenSource determination based on hugging_face_id

564e0b0

Merge branch 'addmodel-openrouter-provider' of https://github.com/par…

555b7d4

…tha-sarathyy/continue into addmodel-openrouter-provider

partha-sarathyy changed the title ~~Add OpenRouter Provider Support with Dynamic Model Loading~~ feat: Add OpenRouter Provider Support with Dynamic Model Loading Nov 16, 2025

Trigger CI/CD

cc1c013

RomneyDa requested changes Nov 19, 2025

View reviewed changes

github-project-automation bot moved this from Todo to In Progress in Issues and PRs Nov 19, 2025

refactor: propery cleanup openrouter

84dd6ba

partha-sarathyy requested a review from RomneyDa November 19, 2025 15:34

RomneyDa requested changes Nov 25, 2025

View reviewed changes

cubic-dev-ai bot reviewed Nov 26, 2025

View reviewed changes

partha-sarathyy requested a review from RomneyDa November 26, 2025 17:43

feat: enhance OpenRouter model initialization with loading placeholde…

3ca1749

…r and effect hook

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

feat: Add OpenRouter Provider Support with Dynamic Model Loading #8738

feat: Add OpenRouter Provider Support with Dynamic Model Loading #8738

partha-sarathyy commented Nov 15, 2025 •

edited

Loading

Uh oh!

github-actions bot commented Nov 15, 2025 •

edited

Loading

Uh oh!

cubic-dev-ai bot left a comment

Uh oh!

cubic-dev-ai bot Nov 15, 2025 •

edited

Loading

Uh oh!

Uh oh!

partha-sarathyy commented Nov 16, 2025

Uh oh!

RomneyDa left a comment •

edited

Loading

Uh oh!

partha-sarathyy commented Nov 19, 2025

Uh oh!

RomneyDa left a comment

Uh oh!

partha-sarathyy commented Nov 26, 2025

Uh oh!

cubic-dev-ai bot left a comment

Uh oh!

Uh oh!

cubic-dev-ai bot Nov 26, 2025 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

feat: Add OpenRouter Provider Support with Dynamic Model Loading #8738

Are you sure you want to change the base?

feat: Add OpenRouter Provider Support with Dynamic Model Loading #8738

Conversation

partha-sarathyy commented Nov 15, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

feat(openrouter): Add OpenRouter Provider Support with Dynamic Model Loading

Overview

Changes Made

1. OpenRouter Model Data Processing (openRouterModel.ts)

2. Provider Configuration (providers.ts)

3. Enhanced Model Selection UI (ModelSelectionListbox.tsx)

Search Algorithm Details

UI Improvements

Technical Details

New Dependencies

File Structure (new / modified)

Usage Examples

Files Added

Tests / Verification

Notes for Reviewers

Breaking Changes

Changelog (one-liner)

Uh oh!

github-actions bot commented Nov 15, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

cubic-dev-ai bot left a comment

Choose a reason for hiding this comment

Uh oh!

cubic-dev-ai bot Nov 15, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

partha-sarathyy commented Nov 16, 2025

Uh oh!

RomneyDa left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

partha-sarathyy commented Nov 19, 2025

Uh oh!

RomneyDa left a comment

Choose a reason for hiding this comment

Uh oh!

partha-sarathyy commented Nov 26, 2025

Uh oh!

cubic-dev-ai bot left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

cubic-dev-ai bot Nov 26, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

partha-sarathyy commented Nov 15, 2025 •

edited

Loading

1. OpenRouter Model Data Processing (`openRouterModel.ts`)

2. Provider Configuration (`providers.ts`)

3. Enhanced Model Selection UI (`ModelSelectionListbox.tsx`)

github-actions bot commented Nov 15, 2025 •

edited

Loading

cubic-dev-ai bot Nov 15, 2025 •

edited

Loading

RomneyDa left a comment •

edited

Loading

cubic-dev-ai bot Nov 26, 2025 •

edited

Loading