Design a distributed rate limiter

0
Remix

Design a rate limiter that enforces a token-bucket limit per client across a fleet of servers. Cover where the limiter sits, where the bucket state lives (a shared store, local buckets with syncing), keeping the check fast on every request, race conditions between servers, what happens when the shared store is slow or down, and how limits are configured per client or endpoint.

AppleGoogleMetaMicrosoftOpenAISystem designLast asked Aug 2026
No answer yet. Write the first one; the best answer gets endorsed.