Design a pipeline around embedding and classification services
You have two services, one that embeds items and one that classifies them. Design the API and the pipeline that uses them to process incoming data: how requests flow, batching, latency and throughput, failures and retries, and how you would monitor quality.
No answer yet. Write the first one; the best answer gets endorsed.
