Design a multimodal neural network

Design a neural network that takes several kinds of input at once, such as text and images. Explain how each input is encoded, where and how the modalities are fused (early, late or with cross-attention), how you train it when some inputs are missing, and how you would evaluate it.