Skip to content

Feat: Midaz #688 Add /batch Endpoint for Batch Request Processing #1779

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
lazaroborges wants to merge 13 commits into
base: main
Choose a base branch
from
Open

Feat: Midaz #688 Add /batch Endpoint for Batch Request Processing #1779

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
f3c6b65
chore: ignore the .agent/ directory and docker-compose.override.yml f…
lazaroborges Jan 28, 2026
19fcc00
chore: .gitignore
lazaroborges Jan 30, 2026
e9b6f42
feat: implement batch processing and rate limiting for API requests
lazaroborges Feb 2, 2026
25e9878
chore: update dependencies and enhance batch request error handling
lazaroborges Feb 2, 2026
44fb36e
fix: Update pkg/net/http/ratelimit_test.go
lazaroborges Feb 2, 2026
83c292f
fix: Update miniredis to v2.36.1 and ensure go-redis/v9 is patched ag…
lazaroborges Feb 2, 2026
d390a93
fix: avoid allocating the full response body before truncation in bat…
lazaroborges Feb 2, 2026
7ca5b1d
feat: add validation for handler constructors in transaction adapters
lazaroborges Feb 3, 2026
e0e30a2
fix: add type assertion checks in validation functions
lazaroborges Feb 3, 2026
0727f4f
fix: correct TTL handling in idempotency key logic
lazaroborges Feb 3, 2026
07ed55d
fix: rate limiting can be silently bypassed when enabled but Redis is…
lazaroborges Feb 3, 2026
793d70e
fix: avoid single-slot hash tag and cross-tenant collisions for batch…
lazaroborges Feb 3, 2026
3abf3bb
Merge pull request #3 from lazaroborges/feat/MDZ-688_batch_processing
lazaroborges Feb 3, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 2 additions & 1 deletion .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,7 @@ CLAUDE.md
.cursor/
.run/onboarding.run.xml
.run/transaction.run.xml
.gemini/

# OS generated files
.DS_Store
Expand All @@ -24,7 +25,7 @@ reports/
# Docker compose files
components/ledger/_docker-compose.yml
components/onboarding/_docker-compose.yml

docker-compose.override.yml
# Environment files
.env

Expand Down
11 changes: 11 additions & 0 deletions components/ledger/.env.example
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -166,3 +166,14 @@ MAX_PAGINATION_MONTH_DATE_RANGE=3
# Default: true (if not set, the worker is enabled)
# BALANCE_SYNC_WORKER_ENABLED=true
BALANCE_SYNC_MAX_WORKERS=5

# RATE LIMITING CONFIGURATION
# This is the rate limiting configuration for batch requests in the ledger.
# Enable/disable rate limiting (default: false)
RATE_LIMIT_ENABLED=false
# Maximum requests per minute for standard endpoints
RATE_LIMIT_MAX_REQUESTS_PER_MINUTE=1000
# Maximum batch items per minute (counts individual items, not requests)
RATE_LIMIT_MAX_BATCH_ITEMS_PER_MINUTE=5000
# Maximum batch size per request (max items in a single batch request)
RATE_LIMIT_MAX_BATCH_SIZE=100
Comment on lines +170 to +179
Copy link

@coderabbitai coderabbitai bot Feb 3, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Potential issue | 🟡 Minor

Fix dotenv-linter UnorderedKey warnings.
Reorder the new RATE_LIMIT_* keys to satisfy the linter expectations.

🔧 Suggested reorder 
 RATE_LIMIT_ENABLED=false
-# Maximum requests per minute for standard endpoints
-RATE_LIMIT_MAX_REQUESTS_PER_MINUTE=1000
 # Maximum batch items per minute (counts individual items, not requests)
 RATE_LIMIT_MAX_BATCH_ITEMS_PER_MINUTE=5000
 # Maximum batch size per request (max items in a single batch request)
 RATE_LIMIT_MAX_BATCH_SIZE=100
+# Maximum requests per minute for standard endpoints
+RATE_LIMIT_MAX_REQUESTS_PER_MINUTE=1000
🧰 Tools
🪛 dotenv-linter (4.0.0)

[warning] 177-177: [UnorderedKey] The RATE_LIMIT_MAX_BATCH_ITEMS_PER_MINUTE key should go before the RATE_LIMIT_MAX_REQUESTS_PER_MINUTE key

(UnorderedKey)

[warning] 179-179: [UnorderedKey] The RATE_LIMIT_MAX_BATCH_SIZE key should go before the RATE_LIMIT_MAX_REQUESTS_PER_MINUTE key

(UnorderedKey)

🤖 Prompt for AI Agents 
In `@components/ledger/.env.example` around lines 170 - 179, Reorder the
RATE_LIMIT_* keys in components/ledger/.env.example to satisfy dotenv-linter's
alphabetical ordering: keep RATE_LIMIT_ENABLED first, then
RATE_LIMIT_MAX_BATCH_ITEMS_PER_MINUTE, then RATE_LIMIT_MAX_BATCH_SIZE, and
finally RATE_LIMIT_MAX_REQUESTS_PER_MINUTE; update the file so the four
RATE_LIMIT_* entries appear in that exact order and keep their current
values/comments.

Loading