Design a distributed file system for large structured datasets

Design a distributed file system or storage service for large structured datasets that data-processing jobs read and write.

Go past the box diagram and walk through the concrete flows: how metadata and data are read and written, caching at each layer, the job queues, what happens when a node fails, and how load is balanced.