中文
相关论文

相关论文: GeoProg3D: Compositional Visual Reasoning for City…

200 篇论文

Recent advances in large multimodal models suggest that explicit reasoning mechanisms play a critical role in improving model reliability, interpretability, and cross-modal alignment. While such reasoning-centric approaches have been proven…

计算机视觉与模式识别 · 计算机科学 2026-02-12 Tianjiao Yu , Xinzhuo Li , Yifan Shen , Yuanzhe Liu , Ismini Lourentzou

Compositional visual reasoning has emerged as a key research frontier in multimodal AI, aiming to endow machines with the human-like ability to decompose visual scenes, ground intermediate concepts, and perform multi-step logical inference.…

Geolocation, the task of identifying an image's location, requires complex reasoning and is crucial for navigation, monitoring, and cultural preservation. However, current methods often produce coarse, imprecise, and non-interpretable…

计算机视觉与模式识别 · 计算机科学 2026-01-07 Zirui Song , Jingpu Yang , Yuan Huang , Jonathan Tonglet , Zeyu Zhang , Tao Cheng , Meng Fang , Iryna Gurevych , Xiuying Chen

Understanding open-vocabulary 3D scenes with Gaussian-based representations remains challenging due to fragmented and spatially inconsistent semantic predictions across multi-view observations. In this paper, we present OpenGaFF, a novel…

计算机视觉与模式识别 · 计算机科学 2026-05-25 Kunyi Li , Michael Niemeyer , Sen Wang , Stefano Gasperini , Nassir Navab , Federico Tombari

Multimodal Large Language Models (MLLMs) exhibit impressive capabilities across a variety of tasks, especially when equipped with carefully designed visual prompts. However, existing studies primarily focus on logical reasoning and visual…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Dingning Liu , Cheng Wang , Peng Gao , Renrui Zhang , Xinzhu Ma , Yuan Meng , Zhihui Wang

Open-vocabulary 3D visual grounding and reasoning aim to localize objects in a scene based on implicit language descriptions, even when they are occluded. This ability is crucial for tasks such as vision-language navigation and autonomous…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Zhenyang Liu , Yikai Wang , Sixiao Zheng , Tongying Pan , Longfei Liang , Yanwei Fu , Xiangyang Xue

Empowered by large-scale training, vision-language models (VLMs) achieve strong image and video understanding, yet their ability to perform spatial reasoning in both static scenes and dynamic videos remains limited. Recent advances try to…

计算机视觉与模式识别 · 计算机科学 2026-03-30 Shihua Zhang , Qiuhong Shen , Shizun Wang , Tianbo Pan , Xinchao Wang

Geospatial predictions are crucial for diverse fields such as disaster management, urban planning, and public health. Traditional machine learning methods often face limitations when handling unstructured or multi-modal data like street…

计算与语言 · 计算机科学 2024-11-25 Zongrong Li , Junhao Xu , Siqin Wang , Yifan Wu , Haiyang Li

With the widespread adoption of large language models (LLMs) in code generation tasks, geospatial code generation has emerged as a critical frontier in the integration of artificial intelligence and geoscientific analysis. This trend…

软件工程 · 计算机科学 2025-10-09 Guanyu Chen , Haoyue Jiao , Shuyang Hou , Ziqi Liu , Lutong Xie , Shaowen Wu , Huayi Wu , Xuefeng Guan , Zhipeng Gui

AI-assisted coding has rapidly reshaped software practice and research workflows, yet today's models still struggle to produce correct code for complex 3D geometric vision. If models could reliably write such code, the research of our…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Wenyi Li , Renkai Luo , Yue Yu , Huan-ang Gao , Mingju Gao , Li Yuan , Chaoyou Fu , Hao Zhao

Evaluating code generation models for 3D spatial reasoning requires executing generated code in realistic environments and assessing outputs beyond surface-level correctness. We introduce a platform VoxelCode, for analyzing code generation…

机器学习 · 计算机科学 2026-04-06 Yan Zheng , Florian Bordes

Although Multimodal Large Language Models have achieved remarkable progress, they still struggle with complex 3D spatial reasoning due to the reliance on 2D visual priors. Existing approaches typically mitigate this limitation either…

计算机视觉与模式识别 · 计算机科学 2026-04-09 Jiahua Chen , Qihong Tang , Weinong Wang , Qi Fan

Existing Large Vision-Language Models (LVLMs) excel at matching concepts across multi-modal inputs but struggle with compositional concepts and high-level relationships between entities. This paper introduces Progressive multi-granular…

计算机视觉与模式识别 · 计算机科学 2024-12-20 Quang-Hung Le , Long Hoang Dang , Ngan Le , Truyen Tran , Thao Minh Le

Despite recent advances on multi-modal models, 3D spatial reasoning remains a challenging task for state-of-the-art open-source and proprietary models. Recent studies explore data-driven approaches and achieve enhanced spatial reasoning…

计算机视觉与模式识别 · 计算机科学 2025-06-11 Wufei Ma , Yu-Cheng Chou , Qihao Liu , Xingrui Wang , Celso de Melo , Jianwen Xie , Alan Yuille

The development of web-based geospatial dashboards for risk analysis and decision support is often challenged by the difficulty in visualization of big, multi-dimensional environmental data, implementation complexity, and limited…

人机交互 · 计算机科学 2025-11-27 Haowen Xu , Jose Tupayachi , Xiao-Ying Yu

Vision-Language Models (VLMs) still lack robustness in spatial intelligence, demonstrating poor performance on spatial understanding and reasoning tasks. We attribute this gap to the absence of a visual geometry learning process capable of…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Wenbo Hu , Jingli Lin , Yilin Long , Yunlong Ran , Lihan Jiang , Yifan Wang , Chenming Zhu , Runsen Xu , Tai Wang , Jiangmiao Pang

3D Visual Grounding (3DVG) focuses on locating objects in 3D scenes based on natural language descriptions, serving as a fundamental task for embodied AI and robotics. Recent advances in Multi-modal Large Language Models (MLLMs) have…

计算机视觉与模式识别 · 计算机科学 2025-12-02 Beining Xu , Siting Zhu , Zhao Jin , Junxian Li , Hesheng Wang

Embedding a language field in a 3D representation enables richer semantic understanding of spatial environments by linking geometry with descriptive meaning. This allows for a more intuitive human-computer interaction, enabling querying or…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Shai Krakovsky , Gal Fiebelman , Sagie Benaim , Hadar Averbuch-Elor

While Vision-Language Models (VLMs) exhibit exceptional 2D visual understanding, their ability to comprehend and reason about 3D space--a cornerstone of spatial intelligence--remains superficial. Current methodologies attempt to bridge this…

计算机视觉与模式识别 · 计算机科学 2026-02-25 Haoyi Jiang , Liu Liu , Xinjie Wang , Yonghao He , Wei Sui , Zhizhong Su , Wenyu Liu , Xinggang Wang

Geometry problem-solving demands advanced reasoning abilities to process multimodal inputs and employ mathematical knowledge effectively. Vision-language models (VLMs) have made significant progress in various multimodal tasks. Yet, they…

计算与语言 · 计算机科学 2024-10-18 Aditya Sharma , Aman Dalmia , Mehran Kazemi , Amal Zouaq , Christopher J. Pal