LoRA: Low-Rank Adaptation of Large Language Models - Explained visually + PyTorch code from scratch

Similar Tracks
Attention is all you need (Transformer) - Model explanation (including math), Inference and Training
Umar Jamil
Coding a Multimodal (Vision) Language Model from scratch in PyTorch with full explanation
Umar Jamil
Reinforcement Learning from Human Feedback explained with math derivations and the PyTorch code.
Umar Jamil
Coding a Transformer from scratch on PyTorch, with full explanation, training and inference.
Umar Jamil
LLaMA explained: KV-Cache, Rotary Positional Embedding, RMS Norm, Grouped Query Attention, SwiGLU
Umar Jamil