Apache Kafka

kafka.apache.org

Open-source distributed event streaming platform for high-performance data pipelines

Visit
Apache Kafka screenshot
/ About /

Apache Kafka is an open-source distributed event streaming platform designed for high-throughput, fault-tolerant, and scalable data streaming. It is used by thousands of companies worldwide for real-time data pipelines, streaming analytics, data integration, and mission-critical applications. Kafka supports processing trillions of messages per day with low latency and connects to hundreds of data sources and sinks.

/ How it works /

Kafka operates as a distributed log-based message broker where producers publish events to topics, and consumers read from those topics at scale across a cluster of brokers.

/ Who it's for /

enterprise engineers and data engineers building high-performance data pipelines and streaming applications

/ More info /

Background.

Status
launched
Business model
open-source
Company
Apache Software Foundation
/ Discovered patterns /

Similar projects.

Coming soonSpektrail’s read on Data & Analytics

Editorial take on the space this project sits in — momentum signals, adjacent moves, our call on whether the wedge is real. Get pinged when we publish a new read or when the landscape shifts.

Coming soon

Have a take on this space?

Tell us what you’d build differently, where you think the incumbents miss, or what we’ve gotten wrong about this project. Comments + reactions are coming soon.