Design a RAG system end to end

Design a retrieval-augmented generation system from documents to answers: ingesting and chunking documents, embeddings and the index, retrieval and reranking, the prompt to the model, and evaluation of retrieval and answers. Cover latency, cost, keeping the index fresh and what happens when retrieval finds nothing useful.