Evaluate generative AI applications

Overview

Explore our specialized course designed to equip you with the skills to evaluate generative AI applications effectively. This course is divided into two essential modules:

• Module 1:

  Fundamental Concepts

  Grasp the core principles needed for evaluating generative AI applications.

  By completing this module, you will be adept at:

  • Implementing best practices for selecting evaluation data
  • Understanding the purpose and types of synthetic data used in evaluations
  • Comprehending the built-in metrics' scope
  • Choosing appropriate metrics based on specific AI system use cases
  • Interpreting evaluation results effectively
• Module 2:

  Running Evaluations & Synthetic Data Generation

  Delve deeper into practical applications using the Azure AI Evaluation SDK. By the end of this module, you will be capable of:

  • Evaluating generative AI application responses with performance and quality metrics
  • Using risk and safety metrics for comprehensive assessments
  • Executing evaluations and monitoring results in Azure AI Studio
  • Creating custom evaluators with Prompty
  • Sending queries to endpoints and utilizing evaluators on queries and responses
  • Generating synthetic datasets using conversation starters

Enhance your expertise in generative AI today.

Join our program to gain valuable insights and hands-on experience, offered by Microsoft Learn.

Subjects