Skip to content
hands-on lab

Monitor Azure Data Factory using Azure Monitor

Difficulty: Intermediate
Duration: Up to 1 hour
Students: 1,604
Rating: 4.1/5
Start lab
On average, students complete this lab in35m
Get guided in a real environmentPractice with a step-by-step scenario in a real, provisioned environment.
Learn and validateUse validations to check your solutions every step of the way.
See resultsTrack your knowledge and monitor your progress.
About
Author

Description

Azure Data Factory (ADF) is a cloud-based ETL and data integration service that allows you to create data-driven workloads for orchestrating the data movement and transforming data at scale. The capabilities of ADF include the data transformation with intelligent intent-driven mapping that automates the copy activities and allows you to prepare and construct the ETL process pipeline code-free.

In this hands-on lab, you will provision a monitoring solution for the ADF resource using Azure Log Analytics and Log solution.

Learning Objectives

Upon completion of this intermediate-level lab, you will be able to:

  • Create Azure Log Analytics workspace
  • Configure Diagnostic settings for Azure Data Factory
  • Create and review a Log Solution for the Azure Data Factory
  • Setup Monitor Alerts for Azure Data Factory

Intended Audience

  • Candidates for Data Engineer Exam (DP-203)
  • Cloud Architects
  • Data Engineers/Analysts
  • DevOps Engineers
  • Software Engineers

Prerequisites

Familiarity with the following will be beneficial but is not required:

  • Azure Data Factory
  • Azure Monitor
  • Azure Log Analytics

The following course and labs can be used to fulfill the prerequisite:

Updates

December 11th, 2023 - Updated the instructions and screenshots to reflect the latest UI

July 31st, 2023 - Updated the instructions and screenshots to reflect the latest UI

September 12th, 2022 - Updated the instructions and screenshots to reflect the latest UI

Environment before

Environment after

Covered topics

Microsoft Azure
Analytics for Azure
Monitoring for Azure
Azure Data Factory
Azure Monitor
Big Data for Azure
Big Data
Analytics
Monitoring
Hands-on Lab UUID

Lab steps

0 of 6 steps completed.Use arrow keys to navigate between steps. Press Enter to go to a step if available.
  1. Logging in to the Microsoft Azure Portal
  2. Publishing Pipeline Triggers in Azure Data Factory
  3. Creating Azure Log Analytics Workspace
  4. Configuring Diagnostic Settings for Azure Data Factory
  5. Reviewing Logs for Azure Data Factory using Data Factory Dashboard
  6. Configuring Alerts for Data Factory Failures

Lab Rules