Implement a decoder-only GPT model
Write a small decoder-only transformer from scratch as four classes: multi-head self-attention with a causal mask, the feed-forward block, a decoder layer that combines them with residual connections and layer norm, and the GPT model that adds token and position embeddings, stacks the layers and projects to vocabulary logits.
No answer yet. Write the first one; the best answer gets endorsed.
