Overview
Explore our specialized course designed to equip you with the skills to evaluate generative AI applications effectively. This course is divided into two essential modules:
-
Module 1: Fundamental Concepts
Grasp the core principles needed for evaluating generative AI applications. By completing this module, you will be adept at:
- Implementing best practices for selecting evaluation data
- Understanding the purpose and types of synthetic data used in evaluations
- Comprehending the built-in metrics' scope
- Choosing appropriate metrics based on specific AI system use cases
- Interpreting evaluation results effectively
-
Module 2: Running Evaluations & Synthetic Data Generation
Delve deeper into practical applications using the Azure AI Evaluation SDK. By the end of this module, you will be capable of:
- Evaluating generative AI application responses with performance and quality metrics
- Using risk and safety metrics for comprehensive assessments
- Executing evaluations and monitoring results in Azure AI Studio
- Creating custom evaluators with Prompty
- Sending queries to endpoints and utilizing evaluators on queries and responses
- Generating synthetic datasets using conversation starters
Enhance your expertise in generative AI today. Join our program to gain valuable insights and hands-on experience, offered by Microsoft Learn.