Amazon Kinesis, a platform for streaming data on AWS, offers powerful services that make it easier to build data processing applications, load massive volumes of streaming data, and analyze it in real time.
Crazy Labs’ solution uses Amazon Kinesis Streams and Amazon Kinesis Firehose to load streaming data into Amazon Kinesis Analytics. An Amazon Kinesis Analytics application filters and pre-aggregates the data, and puts it into Amazon Kinesis Firehose. Then, an Amazon Kinesis Firehose delivery stream delivers the analyzed data to various data stores for search, storage, or further analytics.
Crazy Labs is putting pre-aggregated data into an Amazon S3 bucket and an Amazon Redshift cluster as well as another Amazon Kinesis stream to be reused in other data pipelines. Finally, Crazy Labs are using Amazon Athena to interactively analyze the collected data stored in Amazon S3 bucket.