Skip to content

build init-db image #1976

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
carlomazzaferro wants to merge 19 commits into
base: main
Choose a base branch
from
Draft

build init-db image #1976

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
9588d8b
build init-db image
carlomazzaferro Feb 16, 2026
65f5a82
init db image
carlomazzaferro Feb 16, 2026
4e41547
fix call to restore
carlomazzaferro Feb 16, 2026
51b6912
image
carlomazzaferro Feb 16, 2026
114f493
correct file name
carlomazzaferro Feb 16, 2026
c589a3b
fix set path
carlomazzaferro Feb 16, 2026
004bb5d
new sha
carlomazzaferro Feb 16, 2026
b74a878
merge
carlomazzaferro Feb 20, 2026
503e40f
correct indices
carlomazzaferro Feb 20, 2026
1d6e2d8
latest sha
carlomazzaferro Feb 20, 2026
ac3c0e9
merge
carlomazzaferro Feb 23, 2026
c0f0b81
deploy to stage
carlomazzaferro Feb 23, 2026
8a8478e
do not release
carlomazzaferro Feb 23, 2026
7564819
redeploy
carlomazzaferro Feb 23, 2026
7d56ab8
scale down
carlomazzaferro Feb 23, 2026
cde55c8
scale up
carlomazzaferro Feb 23, 2026
95afb44
merge
carlomazzaferro Mar 9, 2026
9fe0c61
scale down
carlomazzaferro Mar 9, 2026
098bc92
scale up
carlomazzaferro Mar 9, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions .github/workflows/temp-branch-build-and-push-hawk-arm64.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ on:
push:
branches:
- "dev"
- "feat/recovery-update"
- "chore/build-init-db-image"

paths-ignore:
- "deploy/**"
Expand Down Expand Up @@ -56,4 +56,4 @@ jobs:
ARCHITECTURE=aarch64
cache-from: type=gha
cache-to: type=gha,mode=max
file: Dockerfile.arm64.hawk
file: Dockerfile.arm64.init-db
2 changes: 1 addition & 1 deletion Dockerfile.arm64.init-db
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -39,7 +39,7 @@ ENV DEBIAN_FRONTEND=noninteractive
ARG ARCHITECTURE
ENV ARCHITECTURE=$ARCHITECTURE

RUN apt-get update && apt-get install -y ca-certificates curl unzip
RUN apt-get update && apt-get install -y ca-certificates curl unzip postgresql-client

RUN curl "https://awscli.amazonaws.com/awscli-exe-linux-$ARCHITECTURE.zip" -o "awscliv2.zip" && \
unzip awscliv2.zip && \
Expand Down
4 changes: 2 additions & 2 deletions deploy/stage/common-values-ampc-hnsw.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
image: "ghcr.io/worldcoin/iris-mpc-cpu:79ca389017b8f5943aaace17c19365dd5092512d-arm64"
image: "ghcr.io/worldcoin/iris-mpc-cpu:ac3c0e99ca1b822a86da9e8afa988271e3a393da-arm64"

environment: stage
replicaCount: 1
Expand Down Expand Up @@ -38,7 +38,7 @@ readinessProbe:

startupProbe:
initialDelaySeconds: 60
failureThreshold: 120
failureThreshold: 240
periodSeconds: 30
httpGet:
path: /ready
Expand Down
12 changes: 6 additions & 6 deletions scripts/tools/init-single-db.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,28 +4,28 @@
aws s3 cp s3://wf-smpcv2-stage-hnsw-performance-reports/graph_right.dat /tmp/graph_right.dat
aws s3 cp s3://wf-smpcv2-stage-hnsw-performance-reports/graph_left.dat /tmp/graph_left.dat

aws s3 cp s3://wf-smpcv2-stage-hnsw-performance-reports/gallery_left.ndjson /tmp/gallery_left_right_interleaved.ndjson
aws s3 cp s3://wf-smpcv2-stage-hnsw-performance-reports/gallery_left_right_interleaved.ndjson /tmp/gallery_left_right_interleaved.ndjson


echo "starting left init"
/bin/init-single-db \
--party-id $SMPC__SERVER_COORDINATION__PARTY_ID \
--source "/tmp/gallery_left_right_interleaved.ndjson" \
--db-url "$SMPC__CPU_DATABASE__URL" \
--db-schema "SMPC_correctness_test_stage_$SMPC__SERVER_COORDINATION__PARTY_ID" \
--target-db-size 287895
--db-schema "SMPC_correctness_test_stage_$SMPC__SERVER_COORDINATION__PARTY_ID"

echo "starting restore graph left"
/bin/graph-mem-cli --db-url $SMPC__CPU_DATABASE__URL --schema SMPC_correctness_test_stage_$SMPC__SERVER_COORDINATION__PARTY_ID --file /tmp/graph_left.dat restore-side --side "left"
/bin/graph-mem-cli --db-url $SMPC__CPU_DATABASE__URL --schema SMPC_correctness_test_stage_$SMPC__SERVER_COORDINATION__PARTY_ID --file /tmp/graph_left.dat restore-side "left"
echo "restore graph left done"

echo "starting restore graph right"
/bin/graph-mem-cli --db-url $SMPC__CPU_DATABASE__URL --schema SMPC_correctness_test_stage_$SMPC__SERVER_COORDINATION__PARTY_ID --file /tmp/graph_right.dat restore-side --side "right"
/bin/graph-mem-cli --db-url $SMPC__CPU_DATABASE__URL --schema SMPC_correctness_test_stage_$SMPC__SERVER_COORDINATION__PARTY_ID --file /tmp/graph_right.dat restore-side "right"
echo "restore graph right done"

psql "$SMPC__CPU_DATABASE__URL" -c "
SET search_path TO \"SMPC_correctness_test_stage_$SMPC__SERVER_COORDINATION__PARTY_ID\";
INSERT INTO persistent_state (domain, \"key\", \"value\")
VALUES ('genesis', 'last_indexed_iris_id', '287895')
VALUES ('genesis', 'last_indexed_iris_id', '280422')
ON CONFLICT (domain, \"key\")
DO UPDATE SET \"value\" = EXCLUDED.\"value\";
"
Expand Down
Loading