中文
相关论文

相关论文: 3D Primitives are a Spatial Language for VLMs

200 篇论文

Vision language models (VLMs) perform well on many tasks but often fail at spatial reasoning, which is essential for navigation and interaction with physical environments. Many spatial reasoning tasks depend on fundamental two-dimensional…

计算机视觉与模式识别 · 计算机科学 2025-10-03 Yihong Tang , Ao Qu , Zhaokai Wang , Dingyi Zhuang , Zhaofeng Wu , Wei Ma , Shenhao Wang , Yunhan Zheng , Zhan Zhao , Jinhua Zhao

Vision-Language Models (VLMs) demonstrate impressive capabilities across multimodal tasks, yet exhibit systematic spatial reasoning failures, achieving only 49% (CLIP) to 54% (BLIP-2) accuracy on basic directional relationships. For safe…

计算机视觉与模式识别 · 计算机科学 2026-01-21 Muhammad Imran , Yugyung Lee

Recent advancements in Vision-Language (VL) research have sparked new benchmarks for complex visual reasoning, challenging models' advanced reasoning ability. Traditional Vision-Language Models (VLMs) perform well in visual perception tasks…

计算机视觉与模式识别 · 计算机科学 2024-09-24 Zhiyuan Li , Dongnan Liu , Chaoyi Zhang , Heng Wang , Tengfei Xue , Weidong Cai

Recent Vision-Language Models (VLMs) have demonstrated impressive multimodal comprehension and reasoning capabilities, yet they often struggle with trivially simple visual tasks. In this work, we focus on the domain of basic 2D Euclidean…

计算机视觉与模式识别 · 计算机科学 2025-05-27 Hyunsik Chae , Seungwoo Yoon , Jaden Park , Chloe Yewon Chun , Yongin Cho , Mu Cai , Yong Jae Lee , Ernest K. Ryu

Vision Language Models (VLMs) have demonstrated remarkable potential in multimodal reasoning, yet they inherently suffer from spatial blindness and logical hallucinations when interpreting densely structured engineering content, such as…

多智能体系统 · 计算机科学 2026-03-25 Guanyuan Pan , Shuai Wang , Yugui Lin , Tiansheng Zhou , Pietro Liò , Zhenxin Zhao , Yaqi Wang

Large Vision Language Models (LVLMs) excel at semantic understanding but struggle with fine grained spatial grounding, as the model must implicitly infer complex geometry without ever producing a spatial interpretation. We present…

计算机视觉与模式识别 · 计算机科学 2026-03-20 Yuchen Li , Amanmeet Garg , Shalini Chaudhuri , Rui Zhao , Garin Kessler

Vision-Language Models (VLMs) are expected to be capable of reasoning with commonsense knowledge as human beings. One example is that humans can reason where and when an image is taken based on their knowledge. This makes us wonder if,…

计算机视觉与模式识别 · 计算机科学 2024-01-01 Gengyuan Zhang , Yurui Zhang , Kerui Zhang , Volker Tresp

Spatial intelligence spans a rich suite of abilities, including visualising and transforming shapes, mentally rotating objects, judging relational positions and containment, and estimating numerosity. However, it still remains a critical…

计算机视觉与模式识别 · 计算机科学 2025-11-20 Shijie Lian , Changti Wu , Laurence Tianruo Yang , Hang Yuan , Bin Yu , Lei Zhang , Kai Chen

Spatio-physical reasoning, a foundation capability for understanding the real physics world, is a critical step towards building robust world models. While recent vision language models (VLMs) have shown remarkable progress in specialized…

计算机视觉与模式识别 · 计算机科学 2025-08-15 Tiancheng Han , Yunfei Gao , Yong Li , Wuzhou Yu , Qiaosheng Zhang , Wenqi Shao

Recent advances in 3D scene-language understanding have leveraged Large Language Models (LLMs) for 3D reasoning by transferring their general reasoning ability to 3D multi-modal contexts. However, existing methods typically adopt standard…

计算机视觉与模式识别 · 计算机科学 2026-03-25 Yerim Jeon , Miso Lee , WonJun Moon , Jae-Pil Heo

Vision-language models (VLMs) hold promise for enhancing visualization tools, but effective human-AI collaboration hinges on a shared perceptual understanding of visual content. Prior studies assessed VLM visualization literacy through…

人机交互 · 计算机科学 2025-11-10 Péter Ferenc Gyarmati , Manfred Klaffenböck , Laura Koesten , Torsten Möller

Achieving human-like reasoning in deep learning models for complex tasks in unknown environments remains a critical challenge in embodied intelligence. While advanced vision-language models (VLMs) excel in static scene understanding, their…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Jinzhou Tang , Jusheng zhang , Sidi Liu , Waikit Xiu , Qinhan Lv , Xiying Li

While Multimodal Large Language Models demonstrate impressive semantic capabilities, they often suffer from spatial blindness, struggling with fine-grained geometric reasoning and physical dynamics. Existing solutions typically rely on…

计算机视觉与模式识别 · 计算机科学 2026-03-20 Xianjin Wu , Dingkang Liang , Tianrui Feng , Kui Xia , Yumeng Zhang , Xiaofan Li , Xiao Tan , Xiang Bai

Code has emerged as a precise and executable medium for reasoning and action in the agent era. Yet, progress has largely focused on language-centric tasks such as program synthesis and debugging, leaving visual-centric coding underexplored.…

计算机视觉与模式识别 · 计算机科学 2025-11-05 Kevin Qinghong Lin , Yuhao Zheng , Hangyu Ran , Dantong Zhu , Dongxing Mao , Linjie Li , Philip Torr , Alex Jinpeng Wang

Spatial reasoning in vision language models (VLMs) remains fragile when semantics hinge on subtle temporal or geometric cues. We introduce a synthetic benchmark that probes two complementary skills: situational awareness (recognizing…

计算机视觉与模式识别 · 计算机科学 2026-01-23 Pascal Benschop , Justin Dauwels , Jan van Gemert

Vision-Language Models (VLMs) have made significant strides in static image understanding but continue to face critical hurdles in spatiotemporal reasoning. A major bottleneck is "multi-image reasoning hallucination", where a massive…

Score Distillation Sampling (SDS) enables high-quality text-to-3D generation by supervising 3D models through the denoising of multi-view 2D renderings, using a pretrained text-to-image diffusion model to align with the input prompt and…

计算机视觉与模式识别 · 计算机科学 2025-09-22 Weimin Bai , Yubo Li , Weijian Luo , Wenzheng Chen , He Sun

Large language models (LLMs) and vision language models (VLMs), such as DeepSeek R1,OpenAI o3, and Gemini 2.5 Pro, have demonstrated remarkable reasoning capabilities across logical inference, problem solving, and decision making. However,…

人工智能 · 计算机科学 2025-11-19 Xiaoxing Lian , Aidong Yang , Jun Zhu , Peng Wang , Yue Zhang

3D vision-language (VL) reasoning has gained significant attention due to its potential to bridge the 3D physical world with natural language descriptions. Existing approaches typically follow task-specific, highly specialized paradigms.…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Hao Liu , Yanni Ma , Yan Liu , Haihong Xiao , Ying He

We present a simple experiment that exposes a fundamental limitation in vision-language models (VLMs): the inability to accurately localize filled cells in binary grids when those cells lack textual identity. We generate fifteen 15x15 grids…

计算机视觉与模式识别 · 计算机科学 2026-02-24 Yuval Levental