Multiply two matrices across two GPUs
Matrices A and B must be multiplied using two GPUs, with both matrices split between them. How do you partition the work (by rows, by columns, by blocks), what has to move between the GPUs, and how do you gather the result? Compare the communication cost of each scheme.
GoogleTechnical phone screenNo answer yet. Write the first one; the best answer gets endorsed.