Visualizing transformers and attention | Talk for TNG Big Tech Day '24
An overview of transforms, as used in LLMs, and the attention mechanism within them.
Based on the 3blue1brown deep learning series: https://www.youtube.com/playlist?list=PLZHQObOWTQDNU6R1_67000Dx_ZCJB-3pi