Skip to content

📥 Ingestion-Throughput | Asynchronous Batch Flattening for Regional Exchange Rest APIs #501

Description

@Sadeequ

Description

Processing individual websocket ticker responses using multi-layered parsing schemas runs into internal Python function overhead, creating slight processing bottlenecks during fast-moving market swings.

Technical Requirements

  • Implement an aggressive data-flattening pipeline within src/ingestion/parser.py.

  • Group concurrent telemetry frames into uniform, flat tuple segments before sending them over to the analytics engine to maximize ingestion speeds.

If you find this implementation useful, please star the project and leave a review! 😊

Metadata

Metadata

Labels

Stellar WaveIssues in the Stellar wave program

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions