Design a token-based rate limiter for AI agents
AI agents call paid services, and each call spends billing tokens. Design a limiter that caps how many tokens each agent or customer can spend over time, enforces the cap across many servers, and stays accurate enough to bill from.
GoogleSystem designNo answer yet. Write the first one; the best answer gets endorsed.