Apache Kafka Architectures and Fundamentals - ERP Spain.com - España y América Latina

Apache Kafka is a community distributed event streaming platform capable of handling trillions of events a day. Initially conceived as a messaging queue, Kafka is based on an abstraction of a distributed commit log. Since being created and open sourced by LinkedIn in 2011, Kafka has quickly evolved from messaging queue to a full-fledged event streaming platform. In this session Martijn Kieboom, Senior Solutions Engineer at Confluent, explains Apache Kafka’s internal design and architecture. by attending you will learn why companies like LinkedIn, ING, Dominos Pizza, Nordea, & Royal Bank of Canada are now sending trillions of messages per day to Apache Kafka. In addition you will come to understand the underlying design in Kafka that leads to such high throughput. This talk provides a comprehensive overview of Kafka architecture and internal functions, including: •Topics, partitions and segments •The commit log and streams •Brokers and broker replication •Producer basics •Consumers, consumer groups and offset