Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity

Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity
Share:

Download MP3


Similar Tracks

Feedback Transformers: Addressing Some Limitations of Transformers with Feedback Memory (Explained) Yannic Kilcher
Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters (Paper) Yannic Kilcher
Cybersecurity Architecture: Data Security IBM Technology
Mixtral of Experts (Paper Explained) Yannic Kilcher
Understanding Vibration and Resonance The Efficient Engineer
Transformers Explained - How transformers work The Engineering Mindset
GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding (Paper Explained) Yannic Kilcher
An introduction to Policy Gradient methods - Deep Reinforcement Learning Arxiv Insights
Cybersecurity Architecture: Five Principles to Follow (and One to Avoid) IBM Technology
OpenAI CLIP: ConnectingText and Images (Paper Explained) Yannic Kilcher
Transformers (how LLMs work) explained visually | DL5 3Blue1Brown
Understanding Thermal Radiation The Efficient Engineer
The Essential Main Ideas of Neural Networks StatQuest with Josh Starmer
Let's build GPT: from scratch, in code, spelled out. Andrej Karpathy
Sparse Expert Models (Switch Transformers, GLAM, and more... w/ the Authors) Yannic Kilcher
Andrew Ng Explores The Rise Of AI Agents And Agentic Reasoning | BUILD 2024 Keynote Snowflake Inc.
Reinforcement Learning: Machine Learning Meets Control Theory Steve Brunton
Rethinking Attention with Performers (Paper Explained) Yannic Kilcher
But what is a neural network? | Deep learning chapter 1 3Blue1Brown
StatQuest: Principal Component Analysis (PCA), Step-by-Step StatQuest with Josh Starmer