Deep Dive: Optimizing LLM inference Share: Download MP3 Similar Tracks Deep Dive: Quantizing Large Language Models, part 2 Julien Simon LLM inference optimization: Architecture, KV cache and Flash attention YanAITalk Accelerating LLM Inference with vLLM Databricks Exploring the Latency/Throughput & Cost Space for LLM Inference // Timothée Lacroix // CTO Mistral MLOps.community Andrew Ng Explores The Rise Of AI Agents And Agentic Reasoning | BUILD 2024 Keynote Snowflake Inc. Understanding the LLM Inference Workload - Mark Moyou, NVIDIA PyTorch How might LLMs store facts | DL7 3Blue1Brown Transformers (how LLMs work) explained visually | DL5 3Blue1Brown Deep Dive into Inference Optimization for LLMs with Philip Kiely Software Huddle Decoder-only inference: a step-by-step deep dive Julien Simon Lecture 22: Hacker's Guide to Speculative Decoding in VLLM GPU MODE The Misconception that Almost Stopped AI Welch Labs Mastering LLM Inference Optimization From Theory to Cost Effective Deployment: Mark Moyou AI Engineer An introduction to Policy Gradient methods - Deep Reinforcement Learning Arxiv Insights A Hackers' Guide to Language Models Jeremy Howard vLLM Office Hours - Advanced Techniques for Maximizing vLLM Performance - September 19, 2024 Neural Magic
