Exploring the Latency/Throughput & Cost Space for LLM Inference // Timothée Lacroix // CTO Mistral

Exploring the Latency/Throughput & Cost Space for LLM Inference // Timothée Lacroix // CTO Mistral
Share:

Download MP3


Similar Tracks

LLMs in Production at GetYourGuide // Meghana Satish & Tina Treimane // LLMs III Talk MLOps.community
Fast LLM Serving with vLLM and PagedAttention Anyscale
Stanford Webinar - Large Language Models Get the Hype, but Compound Systems Are the Future of AI Stanford Online
Accelerating LLM Inference with vLLM Databricks
LLM inference optimization: Architecture, KV cache and Flash attention YanAITalk
How to Make AI Agents that ACTUALLY WORK MLOps.community
Understanding LLM Inference | NVIDIA Experts Deconstruct How AI Works DataCamp
Deep Dive: Optimizing LLM inference Julien Simon
Decoding Mistral AI's Large Language Models: Devendra Chaplot AI Engineer
Efficiently Scaling and Deploying LLMs // Hanlin Tang // LLM's in Production Conference MLOps.community
Transformers (how LLMs work) explained visually | DL5 3Blue1Brown
Andrew Ng Explores The Rise Of AI Agents And Agentic Reasoning | BUILD 2024 Keynote Snowflake Inc.
Practical LLM Inference in Modern Java by Alfonso² Peterssen, Alina Yurenko Devoxx
Codon DSF: Image classification in recommerce w/ Thomas Whitington (Schibsted Media Group) Codon Consulting
Understanding the LLM Inference Workload - Mark Moyou, NVIDIA PyTorch
Nov24 NGN Webinar Mahesh Marina Disaggregating Mobile Networks Netsys : Network System
Fine-Tuning LLMs: Best Practices and When to Go Small // Mark Kim-Huang // MLOps Meetup #124 MLOps.community
Large Model Training and Inference with DeepSpeed // Samyam Rajbhandari // LLMs in Prod Conference MLOps.community
A Survey of Techniques for Maximizing LLM Performance OpenAI
Quantization vs Pruning vs Distillation: Optimizing NNs for Inference Efficient NLP