Skip to content
hands-on lab

Monitor Azure Data Factory using Azure Monitor

Difficulty: Intermediate
Duration: Up to 1 hour
Students: 1,456
Rating: 4/5
Start lab
Get guided in a real environmentPractice with a step-by-step scenario in a real, provisioned environment.
Learn and validateUse validations to check your solutions every step of the way.
See resultsTrack your knowledge and monitor your progress.

Description

Azure Data Factory (ADF) is a cloud-based ETL and data integration service that allows you to create data-driven workloads for orchestrating the data movement and transforming data at scale. The capabilities of ADF include the data transformation with intelligent intent-driven mapping that automates the copy activities and allows you to prepare and construct the ETL process pipeline code-free.

In this hands-on lab, you will provision a monitoring solution for the ADF resource using Azure Log Analytics and Log solution.

Learning Objectives

Upon completion of this intermediate-level lab, you will be able to:

  • Create Azure Log Analytics workspace
  • Configure Diagnostic settings for Azure Data Factory
  • Create and review a Log Solution for the Azure Data Factory
  • Setup Monitor Alerts for Azure Data Factory

Intended Audience

  • Candidates for Data Engineer Exam (DP-203)
  • Cloud Architects
  • Data Engineers/Analysts
  • DevOps Engineers
  • Software Engineers

Prerequisites

Familiarity with the following will be beneficial but is not required:

  • Azure Data Factory
  • Azure Monitor
  • Azure Log Analytics

The following course and labs can be used to fulfill the prerequisite:

Updates

December 11th, 2023 - Updated the instructions and screenshots to reflect the latest UI

July 31st, 2023 - Updated the instructions and screenshots to reflect the latest UI

September 12th, 2022 - Updated the instructions and screenshots to reflect the latest UI

Environment before

Environment after

Covered topics

Big Data
Analytics
Monitoring
Microsoft Azure
Analytics for Azure
Monitoring for Azure
Azure Data Factory
Azure Monitor

Lab steps

Logging in to the Microsoft Azure Portal
Publishing Pipeline Triggers in Azure Data Factory
Creating Azure Log Analytics Workspace
Configuring Diagnostic Settings for Azure Data Factory
Reviewing Logs for Azure Data Factory using Data Factory Dashboard
Configuring Alerts for Data Factory Failures

Lab Rules