Implement multi-head attention and LLM sampling
Implement multi-head self-attention from scratch, then the sampling step of a language model: given logits, pick the next token with temperature, top-k and top-p (nucleus) sampling.
Scale AICodingNo answer yet. Write the first one; the best answer gets endorsed.