Help Amazon Web Services Amazon Kinesis Data Stream

Amazon Kinesis Data Stream Integration

A fully managed, distributed data streaming platform to help you collect and store data streams from hundreds of thousands of producers. With Site24x7's integration you can monitor and alert on basic stream level metrics with ease.

Setup and configuration

  • If you haven't done it already, enable access to your AWS resource by creating Site24x7 as an IAM user or by creating a cross-account IAM role between your account and Site24x7's AWS account. Learn more.
  • Next, In the Integrate AWS Account page, please make sure the Kinesis Data Stream checkbox is selected in the Services to be discovered field. Learn more.

Policies and Permissions

Please make sure the following read level permissions are present in the IAM policy assigned to the Site24x7 IAM entity. Learn more.

  • kinesis:Describe* : Describes the specified Kinesis data stream
  • kinesis:Get*: Returns information about records and shard iterator age
  • kinesis:List*: Lists the kinesis data streams and tags for specified streams

Polling frequency

Performance metrics are collected as per the poll frequency set (1 minute to a day), by querying the CloudWatch API. Learn more.

IT Automations

You can add automations for the AWS services supported by Site24x7. Log in to Site24x7 and go to Admin > IT Automation Templates (+) > Add Automation Templates. Once automations are added, you can schedule them to be executed one after the other.

You can now push data to kinesis data streams using Amazon Kinesis Data Stream automations.

To view metrics.

  • Log in to the Site24x7 console, click on AWS > Monitored AWS account and select Kinesis Data Stream from the drop down
  • From the list of monitored data streams, choose the stream for which you want to access metrics for.
  • The various graphs applicable for your Amazon Kinesis Data stream are displayed in the Summary tab.

Supported performance metrics

The following basic stream level performance metrics are collected:

AttributeDescriptionData typeStatistics
GetRecords.Bytes Measures the number of bytes retrieved from the Kinesis stream. Bytes  Sum 
GetRecords.IteratorAgeMilliseconds Measures the age of the last record in all GetRecords calls made against an Kinesis stream. Milliseconds  Maximum 
GetRecords.Latency Measures the time taken per GetRecords operation. Milliseconds  Average 
GetRecords.Records Measures the number of records retrieved from the shard Count Sum 
GetRecords.Success Measures the number of successful GetRecords operations per stream. Count Average
IncomingBytes Measures the number of bytes successfully put to the Kinesis stream. Bytes Sum 
IncomingRecords Measures the number of records successfully put to the Kinesis stream. Count Sum 
PutRecord.Bytes Measures the number of bytes put to the Kinesis stream using the PutRecord operation. Bytes  Sum 
PutRecord.Latency  Measures the time taken per PutRecord operation. Milliseconds  Average 
PutRecord.Success Measures the number of successful PutRecord operations per Kinesis stream. Count  Average 
PutRecords.Bytes Measures the number of bytes put to the Kinesis stream using the PutRecords operation  Bytes  Sum 
PutRecords.Latency Measures the time taken per PutRecords operation Milliseconds  Average 
PutRecords.Records Measures the number of successful records in a PutRecords operation per Kinesis stream Count  Sum 
PutRecords.Success Measures the number of PutRecords operations where at least one record succeeded. Count  Average 
ReadProvisionedThroughputExceeded Measures the number of GetRecords calls throttled. Count  Average 
WriteProvisionedThroughputExceeded Measures the number of records rejected due to throttling. Count  Average 

Configuration details

The following config data is collected on a per data stream basis

AttributeDescription
Stream name Displays the name of the data stream 
Stream ARN  Displays the Amazon Resource Name of the data stream
Created time Displays the time stamp for data stream creation
Stream status Displays the current status of the data stream
Encrypted Type The type of encryption in user – server side or client side 
Number of Shards Displays the number of shards associated with the stream
Shard Level Metrics Shows whether shard level metrics is enabled or not
Data Retention Period Displays the retention period in hours. 
Was this document helpful?
Thanks for taking the time to share your feedback. We’ll use your feedback to improve our online help resources.

Help Amazon Web Services Amazon Kinesis Data Stream