Multi-modal Large Language Models used for task planning in industrial human-robot collaboration inherently lack an understanding of system states and do not track state transitions, leading to hallucinated actions that deviate from the intended goal

MM-LLMs inherently lack an understanding of system states and do not track state transitions, often leading to hallucinated actions that deviate from the intended goal

http://arxiv.org/abs/2608.27225v1