Information Density: Apache Kafka – Signal Evidence & AI Readability

Learn More
Download More than 80% of all Fortune 100 companies trust, and use Apache Kafka.
[H1] Apache Kafka
Apache Kafka is an open-source distributed event streaming platform used by thousands of companies for high-performance data pipelines, streaming analytics, data integration, and mission-critical applications.
[H4] Manufacturing
10 OUT OF 10
[H4] Banks
7 OUT OF 10
[H4] Insurance
10 OUT OF 10
[H4] Telecom
8 OUT OF 10
[H4] Transportation
8 OUT OF 10
[H4] Energy and Utilities
10 OUT OF 10Above is a snapshot of the number of top-ten largest companies using Kafka, per-industry.See full list
[H1] Core capabilities
Kafka boasts core capabilities that are battle tested and ready to power businesses in the digital world.
[H4] High Throughput
Deliver messages at network limited throughput using a cluster of machines with latencies as low as 2ms.
[H4] Scalable
Scale production clusters up to a thousand brokers, trillions of messages per day, petabytes of data, hundreds of thousands of partitions. Elastically expand and contract storage and processing.
[H4] Permanent Storage
Store streams of data safely in a distributed, durable, fault-tolerant cluster.
[H4] High Availability
Stretch clusters efficiently over availability zones or connect separate clusters across geographic regions.
[H4] Built-in Stream Processing
Process streams of events with joins, aggregations, filters, transformations, and more, using event-time and exactly-once processing.
[H4] Connect to almost anything
Kafka’s out-of-the-box Connect interface integrates with hundreds of event sources and event sinks including Postgres, JMS, Elasticsearch, AWS S3, and more.
[H1] Trust and Ease of Use
Kafka is simple to use and is trusted by thousands of organizations around the world.
[H4] Mission Critical
Support mission-critical use cases with guaranteed ordering, zero message loss, and efficient exactly-once processing.
[H4] Trusted By Thousands of Orgs
Thousands of organizations use Kafka, from internet giants to car manufacturers to stock exchanges. More than 5 million unique lifetime downloads.
[H4] Vast User Community
Kafka is one of the five most active projects of the Apache Software Foundation, with hundreds of meetups around the world.
[H4] Client Libraries
Read, write and process streams of events in a vast array of programming languages.
[H4] Rich Online Resources
Rich documentation, online training, guided tutorials, videos, sample projects, Stack overflow, etc.
[H4] Large Ecosystem Open Source Tools
Large ecosystem of open source tools: Leverage a vast array of community-driven tooling.

Redirecting...

[H1] Powered By
Apache Kafka is the most popular open-source stream-processing software for collecting, processing, storing, and analyzing data at scale. Most known for its excellent performance, low latency, fault tolerance, and high throughput, it’s capable of handling thousands of messages per second. With over 1,000 Kafka use cases and counting, some common benefits are building data pipelines, leveraging real-time data streams, enabling operational metrics, and data integration across countless sources.Today, Kafka is used by thousands of companies including over 80% of the Fortune 100. Among these are Box, Goldman Sachs, Target, Cisco, Intuit, and more. As the trusted tool for empowering and innovating companies, Kafka allows organizations to modernize their data strategies with event streaming architecture. Learn how Kafka is used by organizations in every industry - from computer software, financial services, and health care, to government and transportation.Apache Kafka is used at AddThis to collect events generated by our data network and broker that data to our analytics clusters and real-time web analytics platform.adidas uses Kafka as the core of Fast Data Streaming Platform, integrating source systems and enabling teams to implement real-time event processing for monitoring, analytics and reporting solutions.Apache Kafka powers the backbone of Agoda's data pipeline with trillions of events streaming through daily across multiple data centers. The majority of the events are destined for analytical systems and directly influence business decisions at one of the world’s fastest growing online travel booking platforms.AGOORA is a data-platform for Apache Kafka that encourages collaboration around data transparency and ownership.Used in our event pipeline, exception tracking & more to come.Aiven is a cloud platform for open source technologies. We provide Apache Kafka as a managed service on public clouds, and use it internally to run and monitor our platform of tens of thousands of clusters.AllegroGraph and Kafka are used together as an Entity Event Knowledge Graph platform in diverse settings such as call centers, hospitals, insurance companies, aviation organizations and financial firms. By coupling AllegroGraph with Kafka, users can create a real-time decision engine that produces real-time event streams based on computations that trigger specific actions. AllegroGraph accepts incoming events, executes instant queries and analytics on the new data and then stores events and results.Altair Panopticon(TM) incorporates Kafka into its stream processing engine. The software allows business users to build stream processing applications that subscribe to streaming data inputs, including Kafka topics and other real-time message queues, retrieve from SQL, NoSQL, and time series databases, join data streams and tables, aggregate streams within defined time windows, and conflate, filter, and merge data streams. The system can output processed data flows to Kafka or email, or write to databases like Kx kdb+, InfluxDb, or any SQL database.Apache Kafka is used for both real-time and batch data processing, and is the chosen event log technology for Amadeus microservice-based streaming applications. Kafka is also used for operational use cases such as application logs collection.Kafka is used as the event log processing pipeline for delivering better personalized product and service to our customers.Ants.vn uses Kafka in production for stream processing and log transfer (over 5B messages/month and growing)Apache Kafka is a core piece of AppsFlyer large-scale event driven architecture.It enables AppsFlyer to run a data pipeline that streams tens of billions of events on a daily basisIn our real-time data warehouse, apache kafka is used as a reliable distributed message queue, which allows us to build a highly available analysis system.At Atruvia we use Apache Kafka to share events within the modern banking platform.The Data Platform team at Axios uses kafka to stream real-time data from our products into our data lake where we are able to run exploratory queries to understand our data and build machine learning models. Kafka enables us to automate the collection of data from various parts of the organization for ingestion into our data platform.Axon uses Apache Kafka to power mission critical infrastructure that enables first responders do their jobs effectively.Bandwidth uses Kafka in their Communications Platform to process call and message data records for billing and data analytics. Kafka also powers Bandwidth application metrics, system metrics and log aggregation pipelines.The Banno Digital Platform from Jack Henry enables community financial institutions to provide world-class service in today’s digital landscape. The Banno team integrates various streams of data through Apache Kafka, reacting to events as they occur, to provide innovative banking solutions.Barclays utilizes Kafka for streaming and analytical information.Apache Kafka is used as a backbone of data synchronization and propagating changes of entitites/aggregates between multiple applications in BookingSync ecosystem.Apache Kafka aggregates high-flow message streams into a unified distributed pubsub service, brokering the data for other internal systems as part of Boundary's real-time network analytics infrastructure.At Box, Kafka is used for the production analytics pipeline & real time monitoring infrastructure. We are planning to use Kafka for some of the new products & featuresKafka is used as a bulk transaction queue and batch data processing in banking solutions where customer satisfaction relies on most. It is also used in batch data validation and filtering process.ByteDance uses Kafka as a data hub to collect events and logs for a variety of services such as online model training, stream data processing and real-time data analytics.Kafka is used with HBase and Storm as described here.Cisco is using Kafka as part of their OpenSOC (Security Operations Center). More details here.Cityzen Data uses Kafka as well, we provide a platform for collecting, storing and analyzing machine data.Apache Kafka is used at CJ Affiliate to process many of the key events driving our core product. Nearly every aspect of CJ's products and services currently benefit from the speed and stability this provides; additionally, Apache Kafka is one of the key technologies enabling CJ's upcoming real-time Insights & Analytics platform.Cloudflare uses Kafka for our log processing and analytics pipeline, collecting hundreds of billions of events/day and data from thousands of servers.Kafka powers CloudIO Flow which is an enterprise grade data ingestion platform that streams data from multiple sources in real time or periodic intervals. Data is streamed through various stages such as Data Masking of some sensitive parts of your data, validations, transformation, actions and mapping to the output schema and then automatically loaded into the output (data lake such as Redshift, Azure SQL, Snowflake, S3 or any Database) for analysis and reporting.Kafka is powering our high-flow event pipeline that aggregates over 1.2 billion metric series from 1000+ data centers for near-to-real time data center operational analytics and modelingCloud Scale® Inc uses Kafka for building a real-time analytics system for our eventing, logging, and messaging services.The largest DSP in China which has its HQ in Beijing and offices in Shanghai, Guangzhou, Silicon Valley and Seattle. Kafka clusters are the central data hub in iPinYou. All kinds of Internet display advertising data, such as bid/no-bid, impression, click, advertiser, conversion and etc., are collected as primary data streams into Kafka brokers in real time, by LogAggregator (a substitute for Apache Flume, which is implemented in C/C++ by iPinYou, has customized functionality, better performance, lower resource-consuming).Itaú Unibanco uses Apache Kafka for integrations, decoupling and application modernization. This kind of technology help us on digital strategies and enable us to deliver new solutions applied to the business, through application streaming and data pipelines, accelerating our digital transformation and evolving our technology architecture.We use Kafka in production for online and near real-time solutions. Kafka is a core part for many products, such as our Credit Card System.At Coursera, Kafka powers education at scale, serving as the data pipeline for realtime learning analytics/dashboards.Covage is an infrastructure operator designing, deploying and operating high speed open access networks. At the very heart of our IT platform, Kafka is ensuring propagating our business workflows' events among all applications.Criteo takes advantage of Apache Kafka at the heart of the core business. Kafka powers our business log collection pipeline and streaming infrastructure. We have tens of Kafka clusters deployed over multiple data centres across three continents processing up to 30 million messages/sec.Dash0 leverages Apache Kafka as its core event streaming platform to ingest, process, and distribute customer OpenTelemetry data at scale. Kafka's distributed architecture allows Dash0 to handle high volumes of real-time telemetry data with low latency.Kafka brokers data to most systems in our metrics and events ingestion pipeline. Different modules contribute and consume data from it, for streaming CEP (homegrown), persistence (at different "atemperatures"a in Redis, ElasticSearch, Cassandra, S3), or batch analysis (Hadoop).Apache Kafka is used at DataSift as a collector of monitoring events and to track user's consumption of data streams in real time. DataSift architectureDataVisor uses Apache Kafka as a critical real-time data pipeline that connects various micro-services in our fraud detection systems. Kafka is at the core of enabling our product to horizontally scale for large, enterprise data flows.Dattell is a data architecture company that uses Apache Kafka to power the core of our own platform operations and provides fully managed Kafka support services for organizations worldwide. Kafka plays a central role in the event-driven systems we design, helping teams build resilient, high-throughput architectures across cloud and on-prem deployments.Deep.BI helps enterprises leverage next-gen data & AI pipelines, powered by Apache Druid & Apache Flink. We use Kafka to process hundreds of thousands of real-time events per second.Deephaven is a query engine for streaming workloads. Deephaven enables you to ingest and transform Kafka feeds as live dataframes.We use Apache Kafka (and Kafka Streams) to collect and ingest all of our game service logs (including analytics, server, or access logs). Apache Kafka has been one of the core components of our data pipeline from early 2015.Customer relationship management, order management system, incident management system, and tech support system.We use Apache Kafka heavily for data ingestion to the Data platform, streaming as well as batch analytics, and for our microservices to communicate with one another. Kafka is a core component of the overall Dream11 Tech stack.Edenlab FHIR engineers use Kafka to manage real-time data flow between dozens of microservices in our product - Kodjin Interoperability Suite - a low-code FHIR-based infrastructure for healthcare data management (contains FHIR Server, Terminology Service, and Mapper). Edenlab is a custom software and product development company focused primarily on healthcare data interoperability. We are also working with some major customers from the Fintech space (like Mastercard ® and Raffeisen BankInternational).Emerging threats uses Kafka in our event pipeline to process billions of malware events for search indices, alerting systems, etc.See this article.Evident Systems helps companies build world-class applications and services using Event Sourcing and CQRS on Apache Kafka.oNote relies on Kafka for its own implementation, and also empowers its users to store Events defined in their Event Models into Kafka.Exoscale European Cloud uses Kafka in production to ingest, process and store large volumes of events.Exponential is using Kafka in production to power the events ingestion pipeline for real time analytics and log feed consumption.Kpow is an enterprise-grade toolkit that provides a rich, data-oriented UI and secure API for Apache Kafka. It's designed to give engineers deep visibility and control over their Kafka clusters, Schema Registry, Kafka Connect, and Kafka Streams applications. Offering multiple deployment options for cloud or on-premise environments, Kpow works with any Kafka distribution and integrates with enterprise security systems for authentication and role-based access.Falkon SMS relies on Apache Kafka to deliver scalable and real-time event-driven solutions. Kafka's reliability and performance empower Falkon to streamline complex messaging workflows with ease.We use Kafka to collect all metrics and events generated by the users of the website.Kafka powers online to online messaging, and online to offline messaging at Foursquare. We integrate with monitoring, production systems, and our offline infrastructure, including hadoop.Kafka is used at Globo to queue and stream real-time and batch data to our Big Data event ingestion. It is also used for our logging systems.Kafka is used in their twitter ingestion and processing pipeline.www.goldmansachs.comThe Data Technology team at Grab deploys, maintains, operates, and expands on Kafka's capabilities to support TB/hour scale, mission critical event logs, event sourcing and stream processing architectures. Both stateful and stateless applications built over these logs by backend engineers, machine learning engineers, data scientists, and analysts support realtime, near realtime, and analytical use cases across our business lines, from ride hailing and food delivery to fintech.Graylog2 is a free and open source log management and data analysis system. It's using Kafka as default transport for Graylog2 Radio. The use case is described here.HackerRank uses Kafka as events as a service platform. We publish all the internal activity on our infrastructure into Kafka, and a wide range of internal services subscribe to it.HelloSafe is an international online insurance policy comparison platform. It is a completely free site, made available to consumers with the aim of helping them to facilitate their choice of insurance, and to bring more transparency to a market that is often lacking.Kafka is used as a distributed high speed message queue in our help desk software as well as our real-time event data aggregation and analytics.Produces billions of events with Kafka through an erlang based producer ekaf that supports 8.0, and consumes topics primarily with storm and clojure.Kafka at HolidayCheck is driving mission-critical features ahead like near-real-time

[H1] Contact
[H2] Mailing Lists
We have a few mailing lists hosted by Apache:User mailing list : A list for general user questions about Kafka®. To subscribe, send an email to users-subscribe@kafka.apache.org. Once subscribed, you can ask general user questions by mailing to users@kafka.apache.org. Archives are available here. To unsubscribe, send an email to users-unsubscribe@kafka.apache.org.
Note that the mailing list works on plain text emails. Sending HTML based emails can leads to issues and should be avoided.Developer mailing list : A list for discussion on Kafka® development. To subscribe, send an email to dev-subscribe@kafka.apache.org. Once subscribed, you can have discussion on Kafka® development by mailing to dev@kafka.apache.org. Archives are available here. To unsubscribe, send an email to dev-unsubscribe@kafka.apache.org.
Note that the mailing list works on plain text emails. Sending HTML based emails can leads to issues and should be avoided.JIRA mailing list : A list to track Kafka® JIRA notifications. To subscribe, send an email to jira-subscribe@kafka.apache.org. Archives are available here. To unsubscribe, send an email to jira-unsubscribe@kafka.apache.org.Commit mailing list : A list to track Kafka® commits. To subscribe, send an email to commits-subscribe@kafka.apache.org. Archives are available here. To unsubscribe, send an email to commits-unsubscribe@kafka.apache.org.For all Apache mailing lists, you must confirm your subscription by replying to an email. See the Apache Mailing Lists page for more information.Prior to the move to Apache we had a Google group we used for discussion. Archives can be found here. After that we were in Apache Incubator which has its own archives for user, dev, and commit lists.Last modified January 7, 2026: MINOR: add hint about HTML emails (#775) (7956ad60f3)