AI for Beginners: Inside Large Language Models

Overview

Understand how LLMs actually work under the hood from scratch with practical and fun lessons. No prior knowledge required!Learn the fundamentals of Large Language Models with engaging, beginner-friendly explanationsGain practical experience and a deeper understanding of both the benefits and shortcomings of LLMs through hands-on exercisesUnderstand the breakthroughs that have enabled the creation of frontier models that power ChatGPTGo beyond the basics to understand how LLMs predict the next word and whether they are truly Artificial Intelligence

Syllabus

•   Introduction
Introduction
Exercise: Meet Your Classmates and Instructor
Course Resources
•   How LLMs Work
Introduction to LLMs
Tokens
Word Guessing Machines?
Thinking Like LLMs - Roll a Dice
The Transformer Model
Inside LLMs
GPT Meaning
Exercise: Visualize the LLM Architecture
The Training Process
Base Model vs. Assistant Model
Thinking Like LLMs - The Reversal Curse
Exercise: The Reversal Curse
Artificial General Intelligence (AGI)
Exercise: Use ChatGPT to Read the Research
The World of LLMs
•   AI Research and the Quest for Artificial General Intelligence
Introduction - Through The Looking Glass...
Mechanistic Interpretability - Part 1
Mechanistic Interpretability - Part 2
Scaling Laws - Model Size
Scaling Laws - Dataset Size
Scaling Laws - Training Compute
•   Where To Go From Here?
Let's Keep Learning!
Review This Byte!

---

Taught by

Scott Kerr

---

Subjects

Computer Science