Clean OCR output into a training dataset for an LLM

You have a large amount of text produced by OCR. Design the pipeline that cleans it and turns it into a dataset for training a language model: fixing or dropping garbled text, layout and header noise, deduplication, quality filters, and checking that the result helps the model. Only the title of this report was public.