Transformer and attention fundamentals

Explain how a transformer works from the inside: how self-attention is computed, why the scores are scaled, how encoder and decoder masking differ, and what multiple heads buy you. Expect follow-ups on positional information, the cost of attention as sequences get long, and ways to make inference cheaper.