Concurrent latency percentile tracker
Build a component that records request latencies from many threads and answers percentile queries such as p50, p95 and p99. Discuss exact versus approximate approaches (sorted buffers, buckets or histograms, sketches), memory over long runs, sliding time windows, and how to keep recording fast when many threads write at once.
No answer yet. Write the first one; the best answer gets endorsed.
