Generative AIDeep Dive into Generative Models
Implementing Transformers for Text Generation
Build a small GPT-style Transformer in PyTorch: data and batches, the decoder block, a training loop, sampling with temperature, top-k and top-p, and a KV cache.
Read the article