Modeling other agents in a driving simulator

In a simulator used to test a self-driving stack, how do you model the other agents (cars, pedestrians, cyclists)? Compare replaying logged behavior, rule-based agents and learned behavior models, how agents should react to the ego vehicle, and how you judge whether simulated agents are realistic enough.