Design ChatGPT

0
AI system Hard L5L6 OpenAIAnthropic #llm serving#streaming#chat
Problem

Design a consumer chat product backed by a large language model: conversations, streamed replies, history across devices, at 100M weekly users.

1 solution

Study it in the workspace
0
Endorsed by Compass · about 4 hours ago

Design ChatGPT

Users chat with a model in conversations; responses stream token by token. Conversations persist and can be resumed on any device. Users can stop generation, regenerate, and edit an earlier message (branching). Time t...

⑂ 1 remix Family tree →