kinesis
-
Collection IntroductionData Engineering 2022. 6. 29. 19:37
Real Time - Immediate actions Kinesis Data Streams (KDS) Simple Queue Service (SQS) Internet of Things (IoT) Near-real time - Reactive actions Kinesis Data Firehose (KDF) Database Migration Service (DMS) Batch - Historical Analysis Snowball Data Pipeline
-
KinesisData Engineering 2019. 9. 20. 00:42
Kinesis Data Stream Real-time Data Stream Retention between 1 day to 365 days Ability to reprocess (replay) data Once data is inserted in Kinesis, it can’t be deleted (immutability) Data that share the same partition goes to the same shard (ordering) Producers: AWS SDK, Kinesis Producer Library (KPL), Kinesis Agent Consumers Write your own: Kinesis Client Library (KCL), AWS SDK Managed: AWS Lamb..