Skip to content
This repository has been archived by the owner on Nov 8, 2023. It is now read-only.

Build a collect strategy that support batching #40

Open
lynnagara opened this issue Jun 14, 2022 · 0 comments
Open

Build a collect strategy that support batching #40

lynnagara opened this issue Jun 14, 2022 · 0 comments

Comments

@lynnagara
Copy link
Member

Build a processing strategy that collects messages into batches and periodically submits the batch to the next step. This is useful in scenarios where we need to batch messages, e.g. to bulk write on a storage. We want to provide something equivalent to what Python Arroyo does here: https://github.com/getsentry/arroyo/blob/main/arroyo/processing/strategies/streaming/collect.py

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant