Improve a chatbot's answers to questions it doesn't know

Users ask a ChatGPT-style assistant questions it does not know the answer to. Design how the system notices these questions and gives better answers to them: what it does instead of answering from the model alone, how the pieces fit together, and how you measure that the answers actually improved.