Deep dive - Better Attention layers for Transformer models

Deep dive - Better Attention layers for Transformer models
Share:

Download MP3


Similar Tracks

Deep Dive: Compiling deep learning models, from XLA to PyTorch 2 Julien Simon
Deep Dive: Optimizing LLM inference Julien Simon
Attention in transformers, visually explained | DL6 3Blue1Brown
How FlashAttention Accelerates Generative AI Revolution Jia-Bin Huang
LLM inference optimization: Architecture, KV cache and Flash attention YanAITalk
Deep Dive: Quantizing Large Language Models, part 1 Julien Simon
Deep dive: model merging (part 1) Julien Simon
Transformers (how LLMs work) explained visually | DL5 3Blue1Brown
Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention Yannic Kilcher
A Statistical Analysis of Shot Success in Basketball Jalen Gaines
Longformer: The Long-Document Transformer Yannic Kilcher
FlashAttention - Tri Dao | Stanford MLSys #67 Stanford MLSys Seminars
Deep Dive: Quantizing Large Language Models, part 2 Julien Simon
AI’s Hardware Problem Asianometry
Multi-Head Attention (MHA), Multi-Query Attention (MQA), Grouped Query Attention (GQA) Explained DataMListic
Flash Attention Machine Learning Stephen Blum
Coding in Research Presentation William Webb
Accelerating LLM Inference with vLLM Databricks
Decoder-Only Transformers, ChatGPTs specific Transformer, Clearly Explained!!! StatQuest with Josh Starmer
LLaMA explained: KV-Cache, Rotary Positional Embedding, RMS Norm, Grouped Query Attention, SwiGLU Umar Jamil