Skip to content

[DXP-2166] Stateful delivery services mesh and deployment configs #101

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
marekczajkowski merged 2 commits into from
Aug 21, 2025
Merged

[DXP-2166] Stateful delivery services mesh and deployment configs #101

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
51ff92a
[DXP-2166] Stateful delivery services mesh and deployment configs
kamilchociej Aug 19, 2025
0129604
bump operator version to 0.0.17
marekczajkowski Aug 21, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 16 additions & 0 deletions mesh/deployment.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -35,6 +35,13 @@ ingestion:
secretName: rest-ingestion.crt
delivery:
blueprint-web:
stateful: true
volumes:
repository-volume:
size: 10Gi
rocksdb:
mountPath: "/var/lib/rocksdb"
size: 5Gi
ingress:
enabled: true
hosts:
Expand Down Expand Up @@ -101,6 +108,11 @@ delivery:
successThreshold: 1
failureThreshold: 3
blueprint-search:
stateful: true
volumes:
rocksdb:
mountPath: "/var/lib/rocksdb"
size: 5Gi
ingress:
enabled: true
hosts:
Expand Down Expand Up @@ -133,6 +145,10 @@ delivery:
components:
opensearch:
sidecar: true
volumes:
opensearch-data:
mountPath: /usr/share/opensearch/data
size: 10Gi
probes:
readiness:
httpGet:
Expand Down
6 changes: 2 additions & 4 deletions mesh/mesh.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -228,7 +228,6 @@ delivery:
indexable-resource-fragments:
topic: outboxes/indexable-resource-fragments
port: 8082
repositoryVolume: "/usr/share/opensearch/data"
volumesFrom:
configs:
- "opensearch/service-init:/deployments/opensearch/service-init"
Expand All @@ -238,7 +237,7 @@ delivery:
STREAMX_BLUEPRINTS_OPENSEARCH-DELIVERY-SERVICE_MIGRATION-SCRIPT-LOCATIONS: "classpath:opensearch/service-init,file:opensearch/service-init"
# Keep stores up to date when container inside a pod restarts
QUASAR_MESSAGING_STORE_BACKEND: "rocksdb"
QUASAR_MESSAGING_STORE_ROCKSDB_PATH: "/usr/share/opensearch/data"
QUASAR_MESSAGING_STORE_ROCKSDB_PATH: "/var/lib/rocksdb"
environmentFrom:
secrets:
- "opensearch-secrets.properties"
Expand All @@ -247,7 +246,6 @@ delivery:
image: "docker.io/opensearchproject/opensearch:2.16.0"
ports:
- 9201:9201
repositoryVolume: "/usr/share/opensearch/data"
environment:
network.host: "0.0.0.0"
http.port: "9201"
Expand All @@ -272,7 +270,7 @@ delivery:
STREAMX_URL-INCLUDE-REPLACEMENT-PROVIDER_SSI-INCLUDE-FALLBACK-CONTENT: "<!-- Include Not Found -->"
# Keep stores up to date when container inside a pod restarts
QUASAR_MESSAGING_STORE_BACKEND: "rocksdb"
QUASAR_MESSAGING_STORE_ROCKSDB_PATH: "/srv/www"
QUASAR_MESSAGING_STORE_ROCKSDB_PATH: "/var/lib/rocksdb"
repositoryVolume: "/srv/www"
port: 8083
components:
Expand Down
6 changes: 5 additions & 1 deletion terraform/azure/platform/main.tf
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -55,7 +55,7 @@ module "grafana_secret" {

module "streamx" {
source = "streamx-dev/charts/helm"
version = "0.0.13"
version = "0.0.15"

ingress_controller_nginx_enabled = false
cert_manager_lets_encrypt_issuer_acme_email = var.cert_manager_lets_encrypt_issuer_acme_email
Expand All @@ -64,10 +64,14 @@ module "streamx" {
pulsar_kaap_values = [
file("${path.module}/config/pulsar-kaap/values.yaml")
]

streamx_operator_image_pull_secret_registry_email = var.streamx_operator_image_pull_secret_registry_email
streamx_operator_image_pull_secret_registry_password = var.streamx_operator_image_pull_secret_registry_password
streamx_operator_chart_repository_username = "_json_key_base64"
streamx_operator_chart_repository_password = var.streamx_operator_image_pull_secret_registry_password
streamx_operator_settings = {
"image.tag" : "0.0.17-jvm"
}

ingress_controller_apisix_settings = var.public_ip_address != null && var.public_ip_address != "" ? {
"gateway.annotations.service\\.beta\\.kubernetes\\.io/azure-load-balancer-resource-group" : var.resource_group_name
Expand Down