What perplexity tells you about a language model
Define perplexity and explain how to read it: what a lower or higher number means, how it relates to cross-entropy, how it is used for today's large language models, and where it stops being a good measure.
No answer yet. Write the first one; the best answer gets endorsed.
