The Attention Mechanism in Large Language Models
Serrano.Academy Serrano.Academy
144K subscribers
71,420 views
0

 Published On Jul 25, 2023

Attention mechanisms are crucial to the huge boom LLMs have recently had.
In this video you'll see a friendly pictorial explanation of how attention mechanisms work in Large Language Models.
This is the first of a series of three videos on Transformer models.

Video 1: The attention mechanism in high level (this one)
Video 2: The attention mechanism with math:    • The math behind Attention: Keys, Quer...  
Video 3: Transformer models    • What are Transformer Models and how d...  

Learn more in LLM University! https://llm.university

show more

Share/Embed