I’ve had this list of resources saved for a while, which fills some of those gaps.
- Good Courses / Videos
- CS336 Stanford (Lecture 5-11): https://buff.ly/9o4jRxl
- GPU MODE: https://buff.ly/bPEHYL0
- LLM Inference Patterns: https://buff.ly/4ASDS5c
- LLM Inference (NVIDIA): https://buff.ly/muDMcor
- Repositories / Blogs
- GPU Performance Engineering (E.Andere): https://buff.ly/sfGJNMK
- AI Performance Engineering (C.Fregly) https://buff.ly/8ey3GPa
- Inside NVIDIA GPUs (A.Gordic): https://buff.ly/wmgNwMg
- Understanding LLM Inference (my article): https://buff.ly/NrNU3Qz