EINNET - Optimizing Tensor Programs with Derivation-Based Transformations

Overview

Join us for an insightful exploration into optimizing tensor programs specifically designed for deep neural networks. Utilizing derivation-based transformations, this approach promises to surpass existing optimization methods by leveraging an extended search space and the ability to automatically generate new operators.

Delve into the forefront of artificial intelligence advancements and enhance your understanding with our comprehensive coverage, accessible now on YouTube.

Syllabus

• Introduction to Tensor Programs
Overview of Tensor Operations and Structures
Importance in Deep Neural Networks
• Basics of Program Optimization
Traditional Optimization Techniques
Limitations of Current Optimizers
• Derivation-Based Transformations
Concept and Theory
Examples of Derivations in Tensor Programs
• Search Space Exploration
Benefits of a Larger Search Space
Techniques for Effective Exploration
• Automatic Operator Creation
Understanding Novel Operator Generation
Implementing Automatic Creation in Tensor Programs
• Practical Examples and Case Studies
Transformations in Real-World Neural Networks
Comparative Analysis with Existing Optimizers
• Tools and Frameworks
Overview of Tools for Optimization
Hands-on Practice with Optimization Software
• Optimization Challenges and Solutions
Common Obstacles
Innovative Approaches to Problem Solving
• Future Directions in Tensor Program Optimization
Emerging Trends and Technologies
Research Opportunities
• Project and Evaluation
Designing a Tensor Program with Derivation-Based Transformations
Performance Evaluation and Metrics
• Conclusion and Course Wrap-Up
Summary of Key Concepts
Next Steps for Learners in Tensor Optimization Technologies

---

Subjects

Conference Talks