What You Need to Know Before
You Start

Starts 8 June 2025 00:14

Ends 8 June 2025

00 days
00 hours
00 minutes
00 seconds
course image

The Frontier between Retrieval-augmented and Long-context Language Models

Explore the evolving boundary between retrieval-augmented and long-context language models with Princeton researcher Danqi Chen in this technical talk from the Simons Institute.
Simons Institute via YouTube

Simons Institute

2544 Courses


1 hour

Optional upgrade avallable

Not Specified

Progress at your own speed

Free Video

Optional upgrade avallable

Overview

Explore the evolving boundary between retrieval-augmented and long-context language models with Princeton researcher Danqi Chen in this technical talk from the Simons Institute.

Syllabus

  • Introduction to Retrieval-augmented Models
  • Definition and basic concepts
    Key differences from traditional models
    Applications and use cases
  • Overview of Long-context Language Models
  • Definition and basic concepts
    Advantages over short-context models
    Notable examples and their impact
  • Comparative Analysis: Retrieval-Augmented vs. Long-Context Models
  • Strengths and weaknesses
    Performance metrics and benchmarks
    Case studies
  • Integration Techniques
  • Hybrid models combining retrieval and long-context
    Techniques for optimizing performance
    Real-world applications
  • Recent Advances and Research Directions
  • Cutting-edge research by Danqi Chen and other leaders
    Trends and future developments
  • Practical Considerations
  • Challenges in implementation
    Resource management and scalability
    Ethical implications and responsible use
  • Conclusion
  • Key takeaways
    Open questions and areas for further exploration
  • Q&A Session
  • Interactive discussion with participants
    Addressing specific questions related to the field

Subjects

Computer Science