Cross-platform, customizable ML solutions for live and streaming media.

A high-performance observability data pipeline.

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

A curated list of awesome big data frameworks, ressources and other awesomeness.

A curated list of awesome System Design (A.K.A. Distributed Systems) resources.

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

Fancy stream processing made operationally mundane

Building event-driven applications the easy way in Go.

Best-in-class stream processing, analytics, and management. Perform continuous analytics, or build event-driven applications, real-time ETL pipelines, and feature stores in minutes. Unified streaming and batch. PostgreSQL compatible.

Python Stream Processing

Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.

Fast and Lightweight Logs and Metrics processor for Linux, BSD, OSX and Windows

The Cloud Operational Data Store: use SQL to transform, deliver, and act on fast-changing data.

Upserts, Deletes And Incremental Processing on Big Data.

🌊 Online machine learning in Python

Danfo.js is an open source, JavaScript library providing high performance, intuitive, and easy to use data structures for manipulating and processing structured data.

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

Lean and mean distributed stream processing system written in rust and web assembly. Alternative to Kafka + Flink in one.

Distributed stream processing engine in Rust

FastStream is a powerful and easy-to-use Python framework for building asynchronous services interacting with event streams such as Apache Kafka, RabbitMQ, NATS and Redis.