Quantization vs Pruning vs Distillation: Optimizing NNs for Inference

Quantization vs Pruning vs Distillation: Optimizing NNs for Inference

Share:

Similar Tracks

Fine-tuning Whisper to learn my Chinese dialect (Teochew) Efficient NLP

Quantization explained with PyTorch - Post-Training Quantization, Quantization-Aware Training Umar Jamil

Model Distillation: Same LLM Power but 3240x Smaller Adam Lucek

Optimize Your AI - Quantization Explained Matt Williams

Speculative Decoding: When Two LLMs are Faster than One Efficient NLP

Why Does Diffusion Work Better than Auto-Regression? Algorithmic Simplicity

LLM inference optimization: Architecture, KV cache and Flash attention YanAITalk

Knowledge Distillation: How LLMs train each other Julia Turc

Deep Dive into LLMs like ChatGPT Andrej Karpathy

Pruning and Distillation Best Practices: The Minitron Approach Explained What's AI by Louis-François Bouchard

LoRA explained (and a bit about precision and quantization) DeepFindr

Attention is all you need (Transformer) - Model explanation (including math), Inference and Training Umar Jamil

Understanding the LLM Inference Workload - Mark Moyou, NVIDIA PyTorch

tinyML Talks: A Practical Guide to Neural Network Quantization EDGE AI FOUNDATION

Speech LLMs: Models that listen and talk back Efficient NLP

Which Quantization Method is Right for You? (GPTQ vs. GGUF vs. AWQ) Maarten Grootendorst

How might LLMs store facts | DL7 3Blue1Brown

AI Engineering in 76 Minutes (Complete Course/Speedrun!) Marina Wyss - Gratitude Driven

A better Hugging Face model search with OpenAI, RAG, pgvector Efficient NLP

Residual Vector Quantization for Audio and Speech Embeddings Efficient NLP