🧠 Thread-Management | Lock-Free Queue Ring Buffers for Multi-Threaded Ingestion Channels

[Sadeequ]

Description

Using basic synchronized thread queues (queue.Queue) under extreme traffic loads creates contention delays among parallel network listeners trying to pass telemetry data points down to the engine.

Technical Requirements

• Refactor connection passing paths inside src/utils/threading_pool.py to use a lock-free, fixed-size ring buffer array pattern.

• Leverage atomic sequence indexes to track memory spaces safely without locking core processing threads.

If you find this implementation useful, please star the project and leave a review! 😊

[jaynomyaro]

@jaynomyaro has applied to work on this issue as part of the Stellar Wave Program's 6th wave.

Hi! I’m a full-stack developer with a strong blockchain background. I’d love to handle this issue and can deliver a clean, reliable solution. Kindly assign it to me.

ℹ️ Repo Maintainers: To accept this application, review their application or assign @jaynomyaro to this issue.

[GauravKarakoti]

@GauravKarakoti has applied to work on this issue as part of the Stellar Wave Program's 6th wave.

Allow me to work on this one

ℹ️ Repo Maintainers: To accept this application, review their application or assign @GauravKarakoti to this issue.

[drips-wave]

Congratulations, @jaynomyaro! 🎉 Your application was accepted by the repo's maintainers, and the issue is due on June 30, 2026.

🧑‍💻 @jaynomyaro: Please resolve the issue such that the repo's maintainers have enough time to review your contribution before the due date. You'll earn Points for completing the issue on-time, which will make you eligible for a share of the Stellar Wave Program's reward pool.

Warning

When opening a PR, please link it to this issue to ensure it gets tracked accurately. Points are awarded when this issue is marked as completed by the maintainer.

🤠 Repo maintainers: Please keep an eye on the contributor's progress and review their work before the due date. You can manage this issue, including adjusting its complexity and points, here.

🌊 Happy Wave 🌊

[drips-wave]

This issue has been completed by @jaynomyaro as part of the Stellar Wave Program's 6th Wave 🥳

😎 @jaynomyaro: You earned 200 Points for completing this issue! After the current Wave ends, you'll be eligible for a percentage of the Wave's reward pool based on the percentage of total points you've earned. Learn more here. You can also Leave a review to share your experience working on this issue.

🧑‍💻 Repo maintainers: How'd the contributor do? Leave a review to share your experience working with them.