BRC

The data from the various sources(cloud, simiti, etc) is fed into Amazon Kinesis Data Streams where the data is pre-processed, cleaned and clustered. The clean data will be stored on Amazon S3. Amazon Kinesis Data will enable us to process and clean the data as in real time as it streams in. Amazon Kinesis Data Firehose routes the clean data to Amazon S3.

The delivery stream will be configured to automatically load processed data from Kinesis Data Streams. From the S3 storage, Amazon Redshift will be used for data analysis.

Design considerations

These are the considerations made by the developer in determining their proposed implementation. These may be aspects such as: Resources available, System architecture and any other aspects.

Environment

The data warehouse will be hosted on Amazon AWS and accessed from a web interface. Redshift supports analysis on both Microsoft Windows and MacOS.

Security

Define any security concerns and planned implementation of their remedies if any.