Design log storage with live tailing of growing files
Producers keep appending records to log files at very high volume. Store them durably and let users read files back, including users who read a file while it is still being written and expect new records as they arrive. Cover the write path, file and segment layout, replication, how readers follow the end of a file, retention, and scale.
No answer yet. Write the first one; the best answer gets endorsed.
