#distributed training

Data-parallel and fully sharded matrix multiply over simulated devices
CodingHardxAI
▲ 00 solutions
Sharded matrix multiply: forward, backward and planted bugs
CodingHardOpenAI
▲ 00 solutions
Design fault-tolerant training for a frontier model on 16k accelerators
System designHardGoogle DeepMind
▲ 01 solution