English
Related papers

Related papers: Enhancing Spatial Reasoning in Multimodal Large La…

200 papers

Large-scale point cloud semantic segmentation is an important task in 3D computer vision, which is widely applied in autonomous driving, robotics, and virtual reality. Current large-scale point cloud semantic segmentation methods usually…

Computer Vision and Pattern Recognition · Computer Science 2024-01-22 Ziyin Zeng , Yongyang Xu , Zhong Xie , Wei Tang , Jie Wan , Weichao Wu

Open-Vocabulary Semantic Segmentation (OVSS) assigns pixel-level labels from an open set of categories, requiring generalization to unseen and unlabelled objects. Using vision-language models (VLMs) to correlate local image patches with…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Jiayi Lin , Jiabo Huang , Shaogang Gong

Despite the significant improvements achieved by large language models (LLMs) in English reasoning tasks, these models continue to struggle with multilingual reasoning. Recent studies leverage a full-parameter and two-stage training…

Computation and Language · Computer Science 2025-01-08 Yuchun Fan , Yongyu Mu , Yilin Wang , Lei Huang , Junhao Ruan , Bei Li , Tong Xiao , Shujian Huang , Xiaocheng Feng , Jingbo Zhu

Vision-language models (VLMs) have demonstrated remarkable capabilities in understanding and reasoning about visual content, but significant challenges persist in tasks requiring cross-viewpoint understanding and spatial reasoning. We…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Dingming Li , Hongxing Li , Zixuan Wang , Yuchen Yan , Hang Zhang , Siqi Chen , Guiyang Hou , Shengpei Jiang , Wenqi Zhang , Yongliang Shen , Weiming Lu , Yueting Zhuang

In the field of SLAM (Simultaneous Localization And Mapping) for robot navigation, mapping the environment is an important task. In this regard the Lidar sensor can produce near accurate 3D map of the environment in the format of point…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Aritra Mukherjee , Sourya Dipta Das , Jasorsi Ghosh , Ananda S. Chowdhury , Sanjoy Kumar Saha

Generative Recommendation (GR) has emerged as a transformative paradigm with its end-to-end generation advantages. However, existing GR methods primarily focus on direct Semantic ID (SID) generation from interaction sequences, failing to…

Information Retrieval · Computer Science 2026-05-19 Zihao Guo , Jian Wang , Ruxin Zhou , Youhua Liu , Jiawei Guo , Jun Zhao , Xiaoxiao Xu , Yongqi Liu , Kaiqiao Zhan

Semantic segmentation has emerged as a pivotal area of study in computer vision, offering profound implications for scene understanding and elevating human-machine interactions across various domains. While 2D semantic segmentation has…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Aditya Krishnan , Jayneel Vora , Prasant Mohapatra

Reasoning segmentation enables open-set object segmentation via implicit text queries, therefore serving as a foundation for embodied agents that should operate autonomously in real-world environments. However, existing methods for…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Yiqing Shen , Mathias Unberath

Humans build viewpoint-independent cognitive maps through navigation, enabling intuitive reasoning about object permanence and spatial relations. We argue that multimodal large language models (MLLMs), despite extensive video training, lack…

Machine Learning · Computer Science 2025-12-02 Jacob Thompson , Emiliano Garcia-Lopez , Yonatan Bisk

We introduce a new task, Referring and Reasoning for Selective Masks (R2SM), which extends text-guided segmentation by incorporating mask-type selection driven by user intent. This task challenges vision-language models to determine whether…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yu-Lin Shih , Wei-En Tai , Cheng Sun , Yu-Chiang Frank Wang , Hwann-Tzong Chen

Reasoning segmentation increasingly employs reinforcement learning to generate explanatory reasoning chains that guide Multimodal Large Language Models. While these geometric rewards are primarily confined to guiding the final localization,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Tao Yang , Qing Zhou , Yanliang Li , Qi Wang

Spatial intelligence is a critical frontier for Multimodal Large Language Models (MLLMs), empowering them to comprehend the physical world. Drawing inspiration from human perception mechanisms, prior studies attempt to construct a spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yibin Huang , Wang Xu , Wanyue Zhang , Helu Zhi , Jingjing Huang , Yangbin Xu , Yangang Sun , Conghui Zhu , Tiejun Zhao

The ability to understand and reason about spatial relationships between objects in images is an important component of visual reasoning. This skill rests on the ability to recognize and localize objects of interest and determine their…

Computation and Language · Computer Science 2024-10-14 Navid Rajabi , Jana Kosecka

Spatial reasoning is a core component of human cognition, enabling individuals to perceive, comprehend, and interact with the physical world. It relies on a nuanced understanding of spatial structures and inter-object relationships, serving…

Artificial Intelligence · Computer Science 2025-08-27 Zesen Lyu , Dandan Zhang , Wei Ye , Fangdi Li , Zhihang Jiang , Yao Yang

Semantic segmentation of LiDAR point clouds has been widely studied in recent years, with most existing methods focusing on tackling this task using a single scan of the environment. However, leveraging the temporal stream of observations…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Enxu Li , Sergio Casas , Raquel Urtasun

Point-cloud semantic segmentation underpins a wide range of critical applications. Although recent deep architectures and large-scale datasets have driven impressive closed-set performance, these models struggle to recognize or properly…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Wang Fang , Shirin Rahimi , Olivia Bennett , Sophie Carter , Mitra Hassani , Xu Lan , Omid Javadi , Lucas Mitchell

Spatial intelligence is crucial for vision--language models (VLMs) in the physical world, yet many benchmarks evaluate largely unconstrained scenes where models can exploit 2D shortcuts. We introduce SSI-Bench, a VQA benchmark for spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Chen Yang , Guanxin Lin , Youquan He , Peiyao Chen , Guanghe Liu , Yufan Mo , Zhouyuan Xu , Linhao Wang , Guohui Zhang , Zihang Zhang , Shenxiang Zeng , Chen Wang , Jiansheng Fan

3D object grounding localizes referred objects in a 3D scene from natural language. Unified instance-centric 3D-LLMs aim to solve grounding together with dialog, QA, and captioning, yet many rely on a single pointer-style grounding decision…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Jiawei Li , Ziyi Liu , Weijie Shi , Long Chen , Jiajie Xu , Xiaofang Zhou

Due to their inherent complexity, reasoning tasks have long been regarded as rigorous benchmarks for assessing the capabilities of machine learning models, especially large language models (LLMs). Although humans can solve these tasks with…

Artificial Intelligence · Computer Science 2026-03-30 Yunlong Deng , Boyang Sun , Yan Li , Lingjing Kong , Zeyu Tang , Kun Zhang , Guangyi Chen

Multi-view visual reasoning is essential for intelligent systems that must understand complex environments from sparse and discrete viewpoints, yet existing research has largely focused on single-image or temporally dense video settings. In…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Fucai Ke , Zhixi Cai , Boying Li , Long Chen , Beibei Lin , Weiqing Wang , Pari Delir Haghighi , Gholamreza Haffari , Hamid Rezatofighi