Roofline analysis of a BF16 MLP layer
Apply roofline analysis to an MLP layer running in BF16: count its floating-point operations and the bytes it moves, compute its arithmetic intensity, and decide whether it is compute-bound or memory-bound. Explain what would change the answer.
No answer yet. Write the first one; the best answer gets endorsed.
