Serverless Streaming ETL using Amazon Managed Service for Apache Flink

In this lesson, I will show you how the Amazon Managed Service for Apache Flink, formerly known as Amazon Kinesis Data Analytics, can be used to perform serverless ETL of your streaming data.

Learning Objectives

• A greater understanding of how the Amazon Managed Service for Apache Flink allows you to build and run streaming data processing applications in AWS
• Learn about the types of APIs and connectors you can use within your Flink applications
• Learn how AWS-provided blueprints can help you quickly get started when using the Amazon Managed Service for Apache Flink, to create end-to-end stream processing applications and Studio notebooks

Intended Audience

• Data engineers who want to process and analyze streaming data in AWS using Apache Flink
• Anyone who may be preparing to take an AWS certification exam such as the AWS Certified Data Engineer - Associate

Prerequisites

• You should have a basic understanding of AWS, as well as data engineering concepts such as streaming data and ETL
• It may also be useful to have some experience with Amazon Kinesis Data Streams and Amazon Managed Streaming for Apache Kafka, or MSK, both of which can interact with the Amazon Managed Service for Apache Flink
• To learn more about these services, check out our existing lessons here:
  • Lesson: Fundamentals of Streaming with Amazon Kinesis
  • Lesson: Fundamentals of Amazon MSK (Amazon Managed Streaming for Apache Kafka)