The Mathematics of Training LLMs — with Quentin Anthony of Eleuther AI

Breaking down the viral Transformers Math 101 article and high performance distributed training for Transformers-based architectures (or "How I Learned to Stop Handwaving and Make the GPU go brrrrrr")