Shard an LM head and combine the logits
The output layer maps a hidden state through an [H, V] weight matrix to vocabulary logits. Compare splitting the weight by vocabulary with splitting it by hidden dimension: what each device computes, which reductions are needed, and whether full logits must be gathered before top-k selection or sampling.
No answer yet. Write the first one; the best answer gets endorsed.
