description Amazon Kinesis Data Streams Overview
Kinesis is AWS's native service for real-time data streaming. It provides a managed, durable stream of records, making it straightforward to ingest data from sources like IoT devices directly into AWS analytics services. It is the default choice for organizations already heavily invested in the AWS cloud stack.
help Amazon Kinesis Data Streams FAQ
What is a shard in Amazon Kinesis Data Streams?
A shard is a unit of stream capacity containing an ordered sequence of records. In provisioned mode, producers and consumers distribute records across shards using partition keys.
How long does Kinesis Data Streams retain records?
The service supports a default retention period of 24 hours, with configurable extended retention for longer replay windows. A longer setting increases storage cost but gives consumers more time to recover or reprocess data.
When should I use Kinesis Data Streams instead of Amazon SQS?
Kinesis fits ordered event streams that may be processed independently by multiple consumers, such as telemetry or click events. Amazon SQS is a message queue designed around workers consuming tasks, including patterns where a message is removed after successful processing.
Can AWS Lambda process records directly from a Kinesis stream?
Yes, Lambda can use a Kinesis stream as an event source and invoke a function with batches of records. Teams must design for retries, duplicate processing, batch failures, and hot partition keys because delivery should not be treated as exactly once.
explore Explore More
Similar to Amazon Kinesis Data Streams
See all arrow_forward
Reviews & Comments
Write a Review
Be the first to review
Share your thoughts with the community and help others make better decisions.
