Precision and recall at k from a flaky top-k API
An API returns a model's top-k predictions for each query, but calls sometimes fail or time out. Compute precision and recall against the true labels across a set of queries, with retries and a sensible way to report queries that never succeeded.
MicrosoftTechnical phone screenNo answer yet. Write the first one; the best answer gets endorsed.