Evaluate generative AI applications

סקירה כללית

Explore our specialized course designed to equip you with the skills to evaluate generative AI applications effectively. This course is divided into two essential modules:

• Module 1:

  Fundamental Concepts

  Grasp the core principles needed for evaluating generative AI applications.

  By completing this module, you will be adept at:

  • Implementing best practices for selecting evaluation data
  • Understanding the purpose and types of synthetic data used in evaluations
  • Comprehending the built-in metrics' scope
  • Choosing appropriate metrics based on specific AI system use cases
  • Interpreting evaluation results effectively
• Module 2:

  Running Evaluations & Synthetic Data Generation

  Delve deeper into practical applications using the Azure AI Evaluation SDK. By the end of this module, you will be capable of:

  • Evaluating generative AI application responses with performance and quality metrics
  • Using risk and safety metrics for comprehensive assessments
  • Executing evaluations and monitoring results in Azure AI Studio
  • Creating custom evaluators with Prompty
  • Sending queries to endpoints and utilizing evaluators on queries and responses
  • Generating synthetic datasets using conversation starters

Enhance your expertise in generative AI today.

Join our program to gain valuable insights and hands-on experience, offered by Microsoft Learn.

נושאים