Orchestrating ETL Workflows

In this lesson, we will compare Amazon EMR and AWS Glue and cover ways to make ETL processes more automated and repeatable.

Learning Objectives

• What AWS Glue is and how it works 
• How AWS Glue compares to Amazon EMR 
• How to make ETL processes more automated and repeatable using orchestration services such as AWS Data Pipeline, AWS Glue Workflows, and AWS Step Functions

Intended Audience

• Those who are implementing and managing ETL on AWS

• Those who are looking to take an AWS certification — specifically the AWS Certified Solutions Architect – Associate Certification or the AWS Certified Data Analytics - Specialty Certification

Prerequisites 

In this lesson, I will provide introductory information on AWS Glue. However, to get the most from this lesson, you should already have an understanding of Amazon EMR and Amazon EC2. For more information on these services, please see our existing content titled: 

• Introduction to Amazon Elastic Map Reduce
• Compute Fundamentals for AWS