Hu Zhang

Thinking outside the frame: viewpoint-aware spatial reasoning in large multimodal models

Abstract Large multimodal models (LMMs) have greatly improved cross-modal tasks but continue to struggle with spatial reasoning. In particular, they exhibit a bias toward egocentric reasoning and have limited ability to reframe spatial relations allocentrically, making them unrel...