中文
相关论文

相关论文: SpatialTree: How Spatial Abilities Branch Out in M…

200 篇论文

The ability to understand and reason about spatial relationships between objects in images is an important component of visual reasoning. This skill rests on the ability to recognize and localize objects of interest and determine their…

计算与语言 · 计算机科学 2024-10-14 Navid Rajabi , Jana Kosecka

Humans are born with vision-based 4D spatial-temporal intelligence, which enables us to perceive and reason about the evolution of 3D space over time from purely visual inputs. Despite its importance, this capability remains a significant…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Xingyilang Yin , Chengzhengxu Li , Jiahao Chang , Chi-Man Pun , Xiaodong Cun

Multimodal large language models (MLLMs) have achieved remarkable progress in vision-language tasks, but they continue to struggle with spatial understanding. Existing spatial MLLMs often rely on explicit 3D inputs or architecture-specific…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Hunar Batra , Haoqin Tu , Hardy Chen , Yuanze Lin , Cihang Xie , Ronald Clark

The Theory of Multiple Intelligences underscores the hierarchical nature of cognitive capabilities. To advance Spatial Artificial Intelligence, we pioneer a psychometric framework defining five Basic Spatial Abilities (BSAs) in Visual…

计算机视觉与模式识别 · 计算机科学 2025-08-06 Wenrui Xu , Dalin Lyu , Weihang Wang , Jie Feng , Chen Gao , Yong Li

Spatial reasoning is a key capability in the field of artificial intelligence, especially crucial in areas such as robotics, computer vision, and natural language understanding. However, evaluating the ability of multimodal large language…

人工智能 · 计算机科学 2025-11-25 Rui Xu , Dakuan Lu , Zicheng Zhao , Xiaoyu Tan , Xintao Wang , Siyu Yuan , Jiangjie Chen , Yinghui Xu

Multi-modal large language models (MLLMs) have rapidly advanced in visual tasks, yet their spatial understanding remains limited to single images, leaving them ill-suited for physical-world applications that require multi-frame reasoning.…

计算机视觉与模式识别 · 计算机科学 2026-05-25 Runsen Xu , Weiyao Wang , Hao Tang , Xingyu Chen , Xiaodong Wang , Fu-Jen Chu , Matt Feiszli , Kevin J. Liang

Genuine spatial reasoning relies on the capacity to construct and manipulate coherent internal spatial representations, often conceptualized as mental models, rather than merely processing surface linguistic associations. While large…

人工智能 · 计算机科学 2026-03-04 Peiyao Jiang , Zequn Qin , Xi Li

Spatial understanding remains a weakness of Large Vision-Language Models (LVLMs). Existing supervised fine-tuning (SFT) and recent reinforcement learning with verifiable rewards (RLVR) pipelines depend on costly supervision, specialized…

计算机视觉与模式识别 · 计算机科学 2025-11-26 Yuhong Liu , Beichen Zhang , Yuhang Zang , Yuhang Cao , Long Xing , Xiaoyi Dong , Haodong Duan , Dahua Lin , Jiaqi Wang

Spatial reasoning is a key aspect of cognitive psychology and remains a bottleneck for current vision-language models (VLMs). While extensive research has aimed to evaluate or improve VLMs' understanding of basic spatial relations, such as…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Mengdi Jia , Zekun Qi , Shaochen Zhang , Wenyao Zhang , Xinqiang Yu , Jiawei He , He Wang , Li Yi

We propose SpatialLLM, a novel approach advancing spatial intelligence tasks in complex urban scenes. Unlike previous methods requiring geographic analysis tools or domain expertise, SpatialLLM is a unified language model directly…

计算机视觉与模式识别 · 计算机科学 2025-05-28 Jiabin Chen , Haiping Wang , Jinpeng Li , Yuan Liu , Zhen Dong , Bisheng Yang

Humans can imagine and manipulate visual images mentally, a capability known as spatial visualization. While many multi-modal benchmarks assess reasoning on visible visual information, the ability to infer unseen relationships through…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Siting Wang , Minnan Pei , Luoyang Sun , Cheng Deng , Yuchen Li , Kun Shao , Zheng Tian , Haifeng Zhang , Jun Wang

Multi-step spatial reasoning entails understanding and reasoning about spatial relationships across multiple sequential steps, which is crucial for tackling complex real-world applications, such as robotic manipulation, autonomous…

人工智能 · 计算机科学 2025-06-23 Kexian Tang , Junyao Gao , Yanhong Zeng , Haodong Duan , Yanan Sun , Zhening Xing , Wenran Liu , Kaifeng Lyu , Kai Chen

Multilingual Alignment is an effective and representative paradigm to enhance LLMs' multilingual capabilities, which transfers the capabilities from the high-resource languages to the low-resource languages. Meanwhile, some research on…

计算与语言 · 计算机科学 2026-04-02 Shimao Zhang , Zhejian Lai , Xiang Liu , Shuaijie She , Xiao Liu , Yeyun Gong , Shujian Huang , Jiajun Chen

Humans possess spatial reasoning abilities that enable them to understand spaces through multimodal observations, such as vision and sound. Large multimodal reasoning models extend these abilities by learning to perceive and reason, showing…

Humans naturally understand 3D spatial relationships, enabling complex reasoning like predicting collisions of vehicles from different directions. Current large multimodal models (LMMs), however, lack of this capability of 3D spatial…

计算机视觉与模式识别 · 计算机科学 2025-06-11 Wufei Ma , Luoxin Ye , Celso M de Melo , Jieneng Chen , Alan Yuille

Spatial reasoning is an essential problem in embodied AI research. Efforts to enhance spatial reasoning abilities through supplementary spatial data and fine-tuning have proven limited and ineffective when addressing complex embodied tasks,…

While Multi-Modal Large Language Models (MLLMs) demonstrate impressive capabilities in general reasoning, their embodied spatial intelligence remains hampered by a "Cartesian Illusion" - a reliance on text-based probability distributions…

人工智能 · 计算机科学 2026-05-19 Yajing Zhou , Xiangyu Kong

Skill composition is the ability to combine previously learned skills to solve new tasks. As neural networks acquire increasingly complex skills during their pretraining, it is not clear how successfully they can compose them. In this…

计算与语言 · 计算机科学 2026-03-10 Paula Ontalvilla , Aitor Ormazabal , Gorka Azkune

Human-level agentic intelligence extends beyond low-level geometric perception, evolving from recognizing where things are to understanding what they are for. While existing benchmarks effectively evaluate the geometric perception…

Spatiotemporal reasoning plays a key role in Cyber-Physical Systems (CPS). Despite advances in Large Language Models (LLMs) and Large Reasoning Models (LRMs), their capacity to reason about complex spatiotemporal signals remains…

人工智能 · 计算机科学 2026-01-13 Pengrui Quan , Brian Wang , Kang Yang , Liying Han , Mani Srivastava