Exploring the Latency/Throughput & Cost Space for LLM Inference // Timothée Lacroix // CTO Mistral

Exploring the Latency/Throughput & Cost Space for LLM Inference // Timothée Lacroix // CTO Mistral
Share:

Download MP3


Similar Tracks

LLMs in Production at GetYourGuide // Meghana Satish & Tina Treimane // LLMs III Talk MLOps.community
Accelerating LLM Inference with vLLM (and SGLang) - Ion Stoica Nadav Timor
Stanford Webinar - Agentic AI: A Progression of Language Model Usage Stanford Online
Understanding the LLM Inference Workload - Mark Moyou, NVIDIA PyTorch
MCP vs API: Simplifying AI Agent Integration with External Data IBM Technology
Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI | Lex Fridman Podcast #416 Lex Fridman
Fine Tuning LLM Models – Generative AI Course freeCodeCamp.org
Fast LLM Serving with vLLM and PagedAttention Anyscale
Efficiently Scaling and Deploying LLMs // Hanlin Tang // LLM's in Production Conference MLOps.community
Accelerating LLM Inference with vLLM Databricks
Andrew Ng Explores The Rise Of AI Agents And Agentic Reasoning | BUILD 2024 Keynote Snowflake Inc.
How might LLMs store facts | DL7 3Blue1Brown
A Hackers' Guide to Language Models Jeremy Howard
From model weights to API endpoint with TensorRT LLM: Philip Kiely and Pankaj Gupta AI Engineer
Understanding LLM Inference | NVIDIA Experts Deconstruct How AI Works DataCamp
The Shape of AI to Come! Yann LeCun at AI Action Summit 2025 DSAI by Dr. Osbert Tay
Efficient LLM Inference with SGLang, Lianmin Zheng, xAI AMD Developer Central
Mastering LLM Inference Optimization From Theory to Cost Effective Deployment: Mark Moyou AI Engineer
LLM Course – Build a Semantic Book Recommender (Python, OpenAI, LangChain, Gradio) freeCodeCamp.org
Optimize Your AI - Quantization Explained Matt Williams