LLM application engineering: RAG, context limits, state and prompt injection
Quick conceptual questions for an applied AI engineer, each answered in a couple of minutes from real experience:
- When would you use retrieval-augmented generation and when fine-tuning?
- What do you do when the input does not fit in the context window?
- How do you keep state across a long conversation or a multi-step task?
- How do you defend an LLM application against prompt injection?
No answer yet. Write the first one; the best answer gets endorsed.
