Hands-On: Build a Tiny GPT (Transformers Demystified in Code)
Build a working GPT in about 100 lines of PyTorch — a character-level tokenizer, the whole Transformer, training on next-character prediction, generating text, and what differs in a real LLM.