Big Data on AWS

Overview

Big Data on AWS introduces you to cloud-based big data solutions such as Amazon EMR, Amazon Redshift, Amazon Kinesis and the rest of the AWS big data platform. In this course, we show you how to use Amazon EMR to process data using the broad ecosystem of Hadoop tools like Hive and Hue. We also teach you how to create big data environments, work with Amazon DynamoDB, Amazon Redshift, Amazon Quicksight, Amazon Athena and Amazon Kinesis, and leverage best practices to design big data environments for security and cost-effectiveness.

• Fit AWS solutions inside of a big data ecosystem
• Leverage Apache Hadoop in the context of Amazon EMR
• Identify the components of an Amazon EMR cluster
• Launch and configure an Amazon EMR cluster
• Leverage common programming frameworks available for Amazon EMR including Hive, Pig, and Streaming
• Leverage Hue to improve the ease-of-use of Amazon EMR
• Use in-memory analytics with Spark on Amazon EMR
• Choose appropriate AWS data storage options
• Identify the benefits of using Amazon Kinesis for near real-time big data processing
• Leverage Amazon Redshift to efficiently store and analyze data

Course Outline

Day 1

1. Overview of Big Data
2. Big Data Ingestion and Transfer
3. Big Data Streaming and Amazon Kinesis
4. Lab 1: Using Amazon Kinesis to Stream and Analyze Apache Server Log Data
5. Big Data Storage Solutions
6. Big Data Processing and Analytics
7. Lab 2: Using Amazon Athena to Query Log Data From Amazon S3

Day 2

1. Apache Hadoop and Amazon EMR
2. Lab 3: Storing and Querying Data on Amazon DynamoDB
3. Using Amazon EMR
4. Hadoop Programming Frameworks
5. Lab 4: Processing Server Logs With Hive on Amazon EMR
6. Web Interfaces on Amazon EMR
7. Lab 5: Running Pig Scripts in Hue on Amazon EMR
8. Apache Spark on Amazon EMR
9. Lab 6: Processing NY Taxi data using Spark on Amazon EMR

Day 3

1. Using AWS Glue to automate ETL workloads
2. Amazon Redshift and Big Data
3. Visualizing and Orchestrating Big Data
4. Lab 7: Using TIBCO Spotfire to Visualize Data
5. Managing Big Data Costs
6. Securing Your Amazon Deployments
7. Big Data Design Patterns

The course is also offered on our public schedule via Live Virtual Classroom: