Multimodal representation learning is shifting from traditional two-tower architectures to LLM-based embedders due to their strong instruction-following capabilities

Multimodal representation learning has been shifting from traditional two-tower architectures to large language model (LLM)-based embedders due to their strong instruction-following capabilities.

http://arxiv.org/abs/2608.27044v1