Skip to content
hands-on lab

Observability & Monitoring for Azure AI Agents Using Application Insights and Log Analytics

Difficulty: Beginner
Duration: Up to 45 minutes
Students: 51
Start lab
Get guided in a real environmentPractice with a step-by-step scenario in a real, provisioned environment.
Learn and validateUse validations to check your solutions every step of the way.
See resultsTrack your knowledge and monitor your progress.
About
Author

Description

Microsoft Foundry Agent Service enables developers to build, deploy, and manage AI agents that can interact with users and other services. To ensure the reliability and performance of these AI agents, it is crucial to implement robust observability and monitoring solutions.

Generative AI Operations (GenAIOps) is a set of practices and tools designed to manage and monitor generative AI models and applications effectively. By leveraging GenAIOps, organizations can ensure that their AI agents operate efficiently, deliver high-quality results, and maintain compliance with regulatory requirements.

Learning objectives

Upon completion of this beginner-level lab, you will be able to:

  • Create an AI agent using Microsoft Foundry Agent Service
  • Implement observability and monitoring solutions for AI agents
  • Utilize Application Insights to track AI agent performance and user interactions
  • Set up alerts for AI agent evaluation metrics

Intended audience

  • AI Engineers and Developers
  • Cloud Architects

Prerequisites

Familiarity with the following will be beneficial but is not required:

  • Microsoft Foundry

The following content can be used to fulfill the prerequisites:

Updates

August 11th, 2026 - Updated instructions for improved clarity and updated recurring evaluation creation process

Jul 14th, 2026 - Updated documentation and screenshots to reflect the latest UI

Environment before

Environment after

Covered topics

Artificial Intelligence
Microsoft Azure
Artificial Intelligence for Azure
Hands-on Lab UUID

Lab steps

0 of 4 steps completed.Use arrow keys to navigate between steps. Press Enter to go to a step if available.
  1. Logging in to the Microsoft Azure Portal
  2. Preparing to Create a Microsoft Foundry Agent
  3. Creating an AI Agent with Microsoft Foundry Agent Service
  4. Configuring Observability Features for Azure AI Agents

Lab Rules