-
Notifications
You must be signed in to change notification settings - Fork 1.9k
feat: gateway v2 #4462
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
feat: gateway v2 #4462
Changes from all commits
Commits
Show all changes
30 commits
Select commit
Hold shift + click to select a range
cc34b92
feat: pki and ssh setup for instance proxy
sheensantoscapadngan ae62c59
feat: add gateway registration and org-proxy initialization
sheensantoscapadngan 2fb1346
misc: add schema for gateway
sheensantoscapadngan 81dfcb5
feat: gateway registration + start of gateway v2 integration
sheensantoscapadngan 879361f
feat: half-way done through integrating with platform
sheensantoscapadngan d5dcaf0
feat: added heartbeat and fixed up gateway page
sheensantoscapadngan 9a9cdf1
feat: integrated with github app connection to gateway and some adjus…
sheensantoscapadngan e30cb9d
Merge remote-tracking branch 'origin/main' into feat/gateway-v2
sheensantoscapadngan ec39f84
misc: addressed greptile comments 1
sheensantoscapadngan e00df2c
mics: added missing github app connection usage
sheensantoscapadngan 54cd93a
misc: added proper error message handling
sheensantoscapadngan a22903b
misc: improved error being thrown
sheensantoscapadngan d994cb0
misc: updated helm chart for gateway v2
sheensantoscapadngan 0a9f51f
doc: cli docs for gateway v2
sheensantoscapadngan 4d22030
doc: added platform dcs
sheensantoscapadngan 4f7b0ea
misc: added proper handling for gateway name conflicts
sheensantoscapadngan 09d179f
misc: addressed comments
sheensantoscapadngan c9136a2
misc: updated proxy terminology to relay
sheensantoscapadngan 43d6c13
Merge remote-tracking branch 'origin/main' into feat/gateway-v2
sheensantoscapadngan 49742b2
misc: doc updates
sheensantoscapadngan b7dcc10
Merge remote-tracking branch 'origin/main' into feat/gateway-v2
sheensantoscapadngan 1839845
misc: addressed comments
sheensantoscapadngan 27d2512
misc: corrected gateway registration endpoint
sheensantoscapadngan 0ed6601
misc: added version indicator
sheensantoscapadngan c297961
misc: updated remaining proxy remnants
sheensantoscapadngan f86f3ce
misc: moved protocol indicator to alpn header
sheensantoscapadngan 1dcdb90
misc: add fix for v2 to app connection
sheensantoscapadngan 71ff01d
misc: addressed comments
sheensantoscapadngan 26de424
Merge remote-tracking branch 'origin/main' into feat/gateway-v2
sheensantoscapadngan cb3ba75
misc: shortened cert expiry
sheensantoscapadngan File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
150 changes: 150 additions & 0 deletions
150
backend/src/db/migrations/20250825131627_add-gateway-v2-pki-and-ssh-configs.ts
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,150 @@ | ||
| import { Knex } from "knex"; | ||
|
|
||
| import { TableName } from "../schemas"; | ||
| import { createOnUpdateTrigger, dropOnUpdateTrigger } from "../utils"; | ||
|
|
||
| export async function up(knex: Knex): Promise<void> { | ||
| if (!(await knex.schema.hasTable(TableName.InstanceRelayConfig))) { | ||
| await knex.schema.createTable(TableName.InstanceRelayConfig, (t) => { | ||
| t.uuid("id", { primaryKey: true }).defaultTo(knex.fn.uuid()); | ||
| t.timestamps(true, true, true); | ||
|
|
||
| // Root CA for relay PKI | ||
| t.binary("encryptedRootRelayPkiCaPrivateKey").notNullable(); | ||
| t.binary("encryptedRootRelayPkiCaCertificate").notNullable(); | ||
|
|
||
| // Instance CA for relay PKI | ||
| t.binary("encryptedInstanceRelayPkiCaPrivateKey").notNullable(); | ||
| t.binary("encryptedInstanceRelayPkiCaCertificate").notNullable(); | ||
| t.binary("encryptedInstanceRelayPkiCaCertificateChain").notNullable(); | ||
|
|
||
| // Instance client/server intermediates for relay PKI | ||
| t.binary("encryptedInstanceRelayPkiClientCaPrivateKey").notNullable(); | ||
| t.binary("encryptedInstanceRelayPkiClientCaCertificate").notNullable(); | ||
| t.binary("encryptedInstanceRelayPkiClientCaCertificateChain").notNullable(); | ||
| t.binary("encryptedInstanceRelayPkiServerCaPrivateKey").notNullable(); | ||
| t.binary("encryptedInstanceRelayPkiServerCaCertificate").notNullable(); | ||
| t.binary("encryptedInstanceRelayPkiServerCaCertificateChain").notNullable(); | ||
|
|
||
| // Org Parent CAs for relay | ||
| t.binary("encryptedOrgRelayPkiCaPrivateKey").notNullable(); | ||
| t.binary("encryptedOrgRelayPkiCaCertificate").notNullable(); | ||
| t.binary("encryptedOrgRelayPkiCaCertificateChain").notNullable(); | ||
|
|
||
| // Instance SSH CAs for relay | ||
| t.binary("encryptedInstanceRelaySshClientCaPrivateKey").notNullable(); | ||
| t.binary("encryptedInstanceRelaySshClientCaPublicKey").notNullable(); | ||
| t.binary("encryptedInstanceRelaySshServerCaPrivateKey").notNullable(); | ||
| t.binary("encryptedInstanceRelaySshServerCaPublicKey").notNullable(); | ||
| }); | ||
|
|
||
| await createOnUpdateTrigger(knex, TableName.InstanceRelayConfig); | ||
| } | ||
|
|
||
| // Org-level relay configuration (one-to-one with organization) | ||
| if (!(await knex.schema.hasTable(TableName.OrgRelayConfig))) { | ||
| await knex.schema.createTable(TableName.OrgRelayConfig, (t) => { | ||
| t.uuid("id", { primaryKey: true }).defaultTo(knex.fn.uuid()); | ||
| t.timestamps(true, true, true); | ||
|
|
||
| t.uuid("orgId").notNullable().unique(); | ||
| t.foreign("orgId").references("id").inTable(TableName.Organization).onDelete("CASCADE"); | ||
|
|
||
| // Org-scoped relay PKI (client + server) | ||
| t.binary("encryptedRelayPkiClientCaPrivateKey").notNullable(); | ||
| t.binary("encryptedRelayPkiClientCaCertificate").notNullable(); | ||
| t.binary("encryptedRelayPkiClientCaCertificateChain").notNullable(); | ||
| t.binary("encryptedRelayPkiServerCaPrivateKey").notNullable(); | ||
| t.binary("encryptedRelayPkiServerCaCertificate").notNullable(); | ||
| t.binary("encryptedRelayPkiServerCaCertificateChain").notNullable(); | ||
|
|
||
| // Org-scoped relay SSH (client + server) | ||
| t.binary("encryptedRelaySshClientCaPrivateKey").notNullable(); | ||
| t.binary("encryptedRelaySshClientCaPublicKey").notNullable(); | ||
| t.binary("encryptedRelaySshServerCaPrivateKey").notNullable(); | ||
| t.binary("encryptedRelaySshServerCaPublicKey").notNullable(); | ||
| }); | ||
|
|
||
| await createOnUpdateTrigger(knex, TableName.OrgRelayConfig); | ||
| } | ||
|
|
||
| if (!(await knex.schema.hasTable(TableName.OrgGatewayConfigV2))) { | ||
| await knex.schema.createTable(TableName.OrgGatewayConfigV2, (t) => { | ||
| t.uuid("id", { primaryKey: true }).defaultTo(knex.fn.uuid()); | ||
| t.uuid("orgId").notNullable().unique(); | ||
| t.foreign("orgId").references("id").inTable(TableName.Organization).onDelete("CASCADE"); | ||
| t.timestamps(true, true, true); | ||
| t.binary("encryptedRootGatewayCaPrivateKey").notNullable(); | ||
| t.binary("encryptedRootGatewayCaCertificate").notNullable(); | ||
| t.binary("encryptedGatewayServerCaPrivateKey").notNullable(); | ||
| t.binary("encryptedGatewayServerCaCertificate").notNullable(); | ||
| t.binary("encryptedGatewayServerCaCertificateChain").notNullable(); | ||
| t.binary("encryptedGatewayClientCaPrivateKey").notNullable(); | ||
| t.binary("encryptedGatewayClientCaCertificate").notNullable(); | ||
| t.binary("encryptedGatewayClientCaCertificateChain").notNullable(); | ||
| }); | ||
|
|
||
| await createOnUpdateTrigger(knex, TableName.OrgGatewayConfigV2); | ||
| } | ||
|
|
||
| if (!(await knex.schema.hasTable(TableName.Relay))) { | ||
| await knex.schema.createTable(TableName.Relay, (t) => { | ||
| t.uuid("id", { primaryKey: true }).defaultTo(knex.fn.uuid()); | ||
| t.timestamps(true, true, true); | ||
|
|
||
| t.uuid("orgId"); | ||
| t.foreign("orgId").references("id").inTable(TableName.Organization).onDelete("CASCADE"); | ||
|
|
||
| t.uuid("identityId"); | ||
| t.foreign("identityId").references("id").inTable(TableName.Identity).onDelete("CASCADE"); | ||
|
sheensantoscapadngan marked this conversation as resolved.
|
||
|
|
||
| t.string("name").notNullable(); | ||
| t.string("host").notNullable(); | ||
|
|
||
| t.unique(["orgId", "name"]); | ||
| }); | ||
|
|
||
| await createOnUpdateTrigger(knex, TableName.Relay); | ||
| } | ||
|
|
||
| if (!(await knex.schema.hasTable(TableName.GatewayV2))) { | ||
| await knex.schema.createTable(TableName.GatewayV2, (t) => { | ||
| t.uuid("id", { primaryKey: true }).defaultTo(knex.fn.uuid()); | ||
| t.timestamps(true, true, true); | ||
|
|
||
| t.uuid("orgId").notNullable(); | ||
| t.foreign("orgId").references("id").inTable(TableName.Organization).onDelete("CASCADE"); | ||
|
|
||
| t.uuid("identityId").notNullable().unique(); | ||
| t.foreign("identityId").references("id").inTable(TableName.Identity).onDelete("CASCADE"); | ||
|
|
||
| t.uuid("relayId"); | ||
| t.foreign("relayId").references("id").inTable(TableName.Relay).onDelete("SET NULL"); | ||
|
|
||
| t.string("name").notNullable(); | ||
|
|
||
| t.unique(["orgId", "name"]); | ||
|
|
||
| t.dateTime("heartbeat"); | ||
| }); | ||
|
|
||
| await createOnUpdateTrigger(knex, TableName.GatewayV2); | ||
| } | ||
| } | ||
|
|
||
| export async function down(knex: Knex): Promise<void> { | ||
| await dropOnUpdateTrigger(knex, TableName.OrgRelayConfig); | ||
| await knex.schema.dropTableIfExists(TableName.OrgRelayConfig); | ||
|
|
||
| await dropOnUpdateTrigger(knex, TableName.InstanceRelayConfig); | ||
| await knex.schema.dropTableIfExists(TableName.InstanceRelayConfig); | ||
|
|
||
| await dropOnUpdateTrigger(knex, TableName.OrgGatewayConfigV2); | ||
| await knex.schema.dropTableIfExists(TableName.OrgGatewayConfigV2); | ||
|
|
||
| await dropOnUpdateTrigger(knex, TableName.GatewayV2); | ||
| await knex.schema.dropTableIfExists(TableName.GatewayV2); | ||
|
|
||
| await dropOnUpdateTrigger(knex, TableName.Relay); | ||
| await knex.schema.dropTableIfExists(TableName.Relay); | ||
| } | ||
33 changes: 33 additions & 0 deletions
33
backend/src/db/migrations/20250901091637_add-gateway-v2-id-columns.ts
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,33 @@ | ||
| import { Knex } from "knex"; | ||
|
|
||
| import { TableName } from "../schemas"; | ||
|
|
||
| export async function up(knex: Knex): Promise<void> { | ||
| if (!(await knex.schema.hasColumn(TableName.DynamicSecret, "gatewayV2Id"))) { | ||
| await knex.schema.alterTable(TableName.DynamicSecret, (table) => { | ||
| table.uuid("gatewayV2Id"); | ||
| table.foreign("gatewayV2Id").references("id").inTable(TableName.GatewayV2).onDelete("SET NULL"); | ||
| }); | ||
| } | ||
|
|
||
| if (!(await knex.schema.hasColumn(TableName.IdentityKubernetesAuth, "gatewayV2Id"))) { | ||
| await knex.schema.alterTable(TableName.IdentityKubernetesAuth, (table) => { | ||
| table.uuid("gatewayV2Id"); | ||
| table.foreign("gatewayV2Id").references("id").inTable(TableName.GatewayV2).onDelete("SET NULL"); | ||
| }); | ||
| } | ||
| } | ||
|
|
||
| export async function down(knex: Knex): Promise<void> { | ||
| if (await knex.schema.hasColumn(TableName.DynamicSecret, "gatewayV2Id")) { | ||
| await knex.schema.alterTable(TableName.DynamicSecret, (table) => { | ||
| table.dropColumn("gatewayV2Id"); | ||
| }); | ||
|
sheensantoscapadngan marked this conversation as resolved.
|
||
| } | ||
|
|
||
| if (await knex.schema.hasColumn(TableName.IdentityKubernetesAuth, "gatewayV2Id")) { | ||
| await knex.schema.alterTable(TableName.IdentityKubernetesAuth, (table) => { | ||
| table.dropColumn("gatewayV2Id"); | ||
| }); | ||
|
sheensantoscapadngan marked this conversation as resolved.
|
||
| } | ||
| } | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,23 @@ | ||
| // Code generated by automation script, DO NOT EDIT. | ||
| // Automated by pulling database and generating zod schema | ||
| // To update. Just run npm run generate:schema | ||
| // Written by akhilmhdh. | ||
|
|
||
| import { z } from "zod"; | ||
|
|
||
| import { TImmutableDBKeys } from "./models"; | ||
|
|
||
| export const GatewaysV2Schema = z.object({ | ||
| id: z.string().uuid(), | ||
| createdAt: z.date(), | ||
| updatedAt: z.date(), | ||
| orgId: z.string().uuid(), | ||
| identityId: z.string().uuid(), | ||
| relayId: z.string().uuid().nullable().optional(), | ||
| name: z.string(), | ||
|
sheensantoscapadngan marked this conversation as resolved.
|
||
| heartbeat: z.date().nullable().optional() | ||
| }); | ||
|
|
||
| export type TGatewaysV2 = z.infer<typeof GatewaysV2Schema>; | ||
| export type TGatewaysV2Insert = Omit<z.input<typeof GatewaysV2Schema>, TImmutableDBKeys>; | ||
| export type TGatewaysV2Update = Partial<Omit<z.input<typeof GatewaysV2Schema>, TImmutableDBKeys>>; | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.