Batching and Streaming with AWS Glue
About
In this lesson, you are going to learn the specifics of using AWS Glue for batch workloads and for streaming data.
Learning Objectives
By the end of this lesson you should have a good understanding of the following:
-
Understand both main use cases for AWS Glue; Batch mode and Streaming mode.
-
Understand the architecture of both use cases.
-
Use this knowledge as a stepping stone towards your Data Engineer associate certification.
Intended Audience
-
Those interested in taking the AWS Data Engineer Associate Certification and anyone interested in understanding the architecture behind AWS Glue before getting hands-on experience with the tool.
Prerequisites
Some useful knowledge to have before starting includes:
-
Since we’ll only be covering specifics about AWS Glue, prior knowledge of this tool is recommended – which you can learn right here with us at Cloud Academy.
-
The basics of data engineering, such as file formats, data transformations and some basic use-cases of ETL workloads.