KL divergence in language models
Define KL divergence and explain what it measures. Then explain where it is used with large language models and why, for example as a penalty that keeps a fine-tuned model close to its reference model.
GoogleTechnical phone screenNo answer yet. Write the first one; the best answer gets endorsed.