Harvey system design (LLM applications) interview

Round 5 of 7 · 3 questions reported

See the whole loop
Length
60 min
Format
Design discussion on a whiteboard or doc
They grade
Retrieval, evaluation, multi-tenancy, confidentiality between clients and faithful answers with citations
Heads-up
A reported prompt: answers over a law firm's private documents that cite the exact clause. Other loops get a document store with organization-level access control (like Harvey's Vault) instead, so prepare a storage design as well as a RAG design. Often held in the San Francisco office with the project walkthrough, while coding and values run over video.

Questions Harvey asks in this round 3

About the Harvey system design (LLM applications) round

What does Harvey ask in the system design (LLM applications) round?

The most asked: Document store with drive sync and org ACLs, Rule-driven file review agent and Design a multi-agent system that redlines a contract against a playbook.

How long is the Harvey system design (LLM applications) round?

About 60 minutes.

What is the Harvey system design (LLM applications) round like?

Design discussion on a whiteboard or doc. They grade: Retrieval, evaluation, multi-tenancy, confidentiality between clients and faithful answers with citations.