Monitor Azure Data Factory using Azure Monitor

Azure Data Factory (ADF) is a cloud-based ETL and data integration service that allows you to create data-driven workloads for orchestrating the data movement and transforming data at scale. The capabilities of ADF include the data transformation with intelligent intent-driven mapping that automates the copy activities and allows you to prepare and construct the ETL process pipeline code-free.

In this hands-on lab, you will provision a monitoring solution for the ADF resource using Azure Log Analytics and Log solution.

Learning Objectives

Upon completion of this intermediate-level lab, you will be able to:

• Create Azure Log Analytics workspace
• Configure Diagnostic settings for Azure Data Factory
• Create and review a Log Solution for the Azure Data Factory
• Setup Monitor Alerts for Azure Data Factory

Intended Audience

• Candidates for Data Engineer Exam (DP-203)
• Cloud Architects
• Data Engineers/Analysts
• DevOps Engineers
• Software Engineers

Prerequisites

Familiarity with the following will be beneficial but is not required:

• Azure Data Factory
• Azure Monitor
• Azure Log Analytics

The following course and labs can be used to fulfill the prerequisite:

• Azure Data Factory (Course)
• Using Azure Data Factory Pipelines to Copy Data (Lab)
• Azure Data Factory Pipeline Challenge (Challenge)

Updates

December 11th, 2023 - Updated the instructions and screenshots to reflect the latest UI

July 31st, 2023 - Updated the instructions and screenshots to reflect the latest UI

September 12th, 2022 - Updated the instructions and screenshots to reflect the latest UI