Notes: Stanford CS336, Language Modeling from Scratch
Condensed notes from all 17 published lectures of Stanford's CS336 - tokenization, resource accounting, architectures, MoEs, GPUs and Triton kernels, parallelism, scaling laws, inference, evaluation, data, and alignment.
Jun 6, 2025
