Multimodal foundation models show substantial inconsistencies when handling semantically equivalent queries across different modalities (text vs. speech) and languages (English vs. Arabic)

it remains unclear whether semantically equivalent queries yield consistent judgments across modality (text vs. speech) and language (English vs. Arabic)

http://arxiv.org/abs/2608.27135v1