中文
相关论文

相关论文: Reasoning with Pixel-level Precision: QVLM Archite…

200 篇论文

Quantitative reasoning is a critical skill to analyze data, yet the assessment of such ability remains limited. To address this gap, we introduce the Quantitative Reasoning with Data (QRData) benchmark, aiming to evaluate Large Language…

计算与语言 · 计算机科学 2024-06-11 Xiao Liu , Zirui Wu , Xueqing Wu , Pan Lu , Kai-Wei Chang , Yansong Feng

Visual Spatial Reasoning (VSR) is a core human cognitive ability and a critical requirement for advancing embodied intelligence and autonomous systems. Despite recent progress in Vision-Language Models (VLMs), achieving human-level VSR…

Vision Language Models (VLMs) have achieved remarkable progress in multimodal tasks, yet they often struggle with visual arithmetic, seemingly simple capabilities like object counting or length comparison, which are essential for relevant…

人工智能 · 计算机科学 2025-05-27 Kung-Hsiang Huang , Can Qin , Haoyi Qiu , Philippe Laban , Shafiq Joty , Caiming Xiong , Chien-Sheng Wu

Large Language Model-based Vision-Language Models (LLM-based VLMs) have demonstrated impressive results in various vision-language understanding tasks. However, how well these VLMs can see image detail beyond the semantic level remains…

计算机视觉与模式识别 · 计算机科学 2024-08-08 Chenhui Gou , Abdulwahab Felemban , Faizan Farooq Khan , Deyao Zhu , Jianfei Cai , Hamid Rezatofighi , Mohamed Elhoseiny

Vision-language models (VLMs) achieve strong performance on spatial reasoning benchmarks, yet it remains unclear whether this reflects structured 3D understanding or reliance on statistical shortcuts in natural images. We introduce a…

计算机视觉与模式识别 · 计算机科学 2026-05-29 Cheolhong Min , Jaeyun Jung , Daeun Lee , Hyeonseong Jeon , Yu Su , Jonathan Tremblay , Chan Hee Song , Jaesik Park

3D Visual Grounding (3DVG) focuses on locating objects in 3D scenes based on natural language descriptions, serving as a fundamental task for embodied AI and robotics. Recent advances in Multi-modal Large Language Models (MLLMs) have…

计算机视觉与模式识别 · 计算机科学 2025-12-02 Beining Xu , Siting Zhu , Zhao Jin , Junxian Li , Hesheng Wang

Embodied intelligence, a grand challenge in artificial intelligence, is fundamentally constrained by the limited spatial understanding and reasoning capabilities of current models. Prevailing efforts to address this through enhancing…

Despite strong performance on vision-language tasks, Multimodal Large Language Models (MLLMs) struggle with mathematical problem-solving, with both open-source and state-of-the-art models falling short of human performance on visual-math…

计算机视觉与模式识别 · 计算机科学 2025-08-26 William Rudman , Michal Golovanevsky , Amir Bar , Vedant Palit , Yann LeCun , Carsten Eickhoff , Ritambhara Singh

Vision-Language Models (VLMs) increasingly power high-stakes applications, from medical imaging to autonomous systems, yet they routinely hallucinate, confidently describing content not present in the input. We investigate the root causes…

计算机视觉与模式识别 · 计算机科学 2026-05-18 Harshvardhan Saini , Samyak Jha , Yiming Tang , Dianbo Liu

Humans possess the remarkable skill of Visual Perception, the ability to see and understand the seen, helping them make sense of the visual world and, in turn, reason. Multimodal Large Language Models (MLLM) have recently achieved…

计算机视觉与模式识别 · 计算机科学 2023-12-25 Jitesh Jain , Jianwei Yang , Humphrey Shi

Vector-Quantized Image Modeling (VQIM) is a fundamental research problem in image synthesis, which aims to represent an image with a discrete token sequence. Existing studies effectively address this problem by learning a discrete codebook…

计算机视觉与模式识别 · 计算机科学 2024-03-18 Baoquan Zhang , Huaibin Wang , Luo Chuyao , Xutao Li , Liang Guotao , Yunming Ye , Xiaochen Qi , Yao He

Recent advances in Vision-Language Models (VLMs) have achieved impressive progress in multimodal mathematical reasoning. Yet, how much visual information truly contributes to reasoning remains unclear. Existing benchmarks report strong…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Yuandong Wang , Yao Cui , Yuxin Zhao , Zhen Yang , Yangfu Zhu , Zhenzhou Shao

Large Vision Language Models (LVLMs) excel at semantic understanding but struggle with fine grained spatial grounding, as the model must implicitly infer complex geometry without ever producing a spatial interpretation. We present…

计算机视觉与模式识别 · 计算机科学 2026-03-20 Yuchen Li , Amanmeet Garg , Shalini Chaudhuri , Rui Zhao , Garin Kessler

Current large vision-language models (LVLMs) typically employ a connector module to link visual features with text embeddings of large language models (LLMs) and use end-to-end training to achieve multi-modal understanding in a unified…

人工智能 · 计算机科学 2025-08-14 Zixian Guo , Ming Liu , Qilong Wang , Zhilong Ji , Jinfeng Bai , Lei Zhang , Wangmeng Zuo

While Vision-Language Models (VLMs) show significant promise for end-to-end autonomous driving by leveraging the common sense embedded in language models, their reliance on 2D image cues for complex scene understanding and decision-making…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Weijie Wei , Zhipeng Luo , Ling Feng , Venice Erin Liong

Despite significant advancements in Large Vision-Language Models (LVLMs)' capabilities, existing pixel-grounding models operate in single-image settings, limiting their ability to perform detailed, fine-grained comparisons across multiple…

计算机视觉与模式识别 · 计算机科学 2025-12-02 Muntasir Wahed , Kiet A. Nguyen , Adheesh Sunil Juvekar , Xinzhuo Li , Xiaona Zhou , Vedant Shah , Tianjiao Yu , Pinar Yanardag , Ismini Lourentzou

Vision-language models (VLMs) exhibit a striking paradox: they can generate executable code that reconstructs a 3D scene from geometric primitives with correct object counts, classes, and approximate positions, yet the same models fail at…

计算机视觉与模式识别 · 计算机科学 2026-05-14 Junze Liu , Kun Qian , Florian Dubost , Kai Zhong , Arvind Srinivasan , Nan Chen , Anping Wang , Sam Zhang , Alejandro Mottini , Qingjun Cui , Tian Wang

Vision Language Models (VLMs) exhibit persistent hallucinations in counting tasks, with accuracy substantially lower than other visual reasoning tasks (excluding sentiment). This phenomenon persists even in state-of-the-art…

计算机视觉与模式识别 · 计算机科学 2026-03-12 Boyuan Chen , Minghao Shao , Siddharth Garg , Ramesh Karri , Muhammad Shafique

Vision-Language Models (VLMs) have become a central focus of today's AI community, owing to their impressive abilities gained from training on large-scale vision-language data from the Web. These models have demonstrated strong performance…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Xuyang Guo , Zekai Huang , Zhenmei Shi , Zhao Song , Jiahao Zhang

Humans naturally possess the spatial reasoning ability to form and manipulate images and structures of objects in space. There is an increasing effort to endow Vision-Language Models (VLMs) with similar spatial reasoning capabilities.…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Jiahuan Zhang , Shunwen Bai , Tianheng Wang , Kaiwen Guo , Kai Han , Guozheng Rao , Kaicheng Yu