Kafka
-
AWS MSKData Engineering 2022. 7. 1. 20:05
Overview Alternative to Kinesis (Kafka vs Kinesis next lecture) Fully managed Apache Kafka on AWS Allow you to create, update, delete clusters MSK create & manages Kafka brokers nodes & Zookeeper nodes for you Deploy the MSK cluster in your VPC, multi-AZ (up to 3 for HA) Automatic recovery from common Apache Kafka failures Data is stored on EBS volumes You can build producers and consumers for y..
-
Apache KafkaData Engineering 2019. 9. 5. 01:33
1. Overview Apache Kafka is a community distributed event streaming platform capable of handling trillions of events a day. Initially conceived as a messaging queue, Kafka is based on an abstraction of a distributed commit log. Since being created and open-sourced by LinkedIn in 2011, Kafka has quickly evolved from messaging queue to a full-fledged event streaming platform. Founded by the origin..