Character.AI ML inference round interview
Round 5 of 8
- Format
- Discussion
- They grade
- How LLMs are served: KV cache, batching, GPU memory, tokens per second, cost per conversation
- Heads-up
- Training knowledge is not expected for software roles; ML engineers get PyTorch internals, distributed training and evaluation instead.
Questions
No Character.AI reports yet. Other labs ask: