中文
相关论文

相关论文: GazeVLM: Active Vision via Internal Attention Cont…

200 篇论文

Humans perceive and reason about their surroundings in four dimensions by building persistent, structured internal representations that encode semantic meaning, spatial layout, and temporal dynamics. These multimodal memories enable them to…

计算机视觉与模式识别 · 计算机科学 2025-12-19 Tin Stribor Sohn , Maximilian Dillitzer , Jason J. Corso , Eric Sax

Vision-Language Models (VLMs) have recently shown promising advancements in sequential decision-making tasks through task-specific fine-tuning. However, common fine-tuning methods, such as Supervised Fine-Tuning (SFT) and Reinforcement…

计算与语言 · 计算机科学 2025-03-26 Haoqiang Kang , Enna Sachdeva , Piyush Gupta , Sangjae Bae , Kwonjoon Lee

Vision-language models (VLMs) show promise for autonomous driving but often lack transparent reasoning capabilities that are critical for safety. We investigate whether explicitly modeling reasoning during fine-tuning enhances VLM…

计算机视觉与模式识别 · 计算机科学 2025-04-16 Amirhosein Chahe , Lifeng Zhou

Vision-Language Models (VLMs) have made significant strides in static image understanding but continue to face critical hurdles in spatiotemporal reasoning. A major bottleneck is "multi-image reasoning hallucination", where a massive…

MLLMs require high-resolution visual inputs for fine-grained tasks like document understanding and dense scene perception. However, current global resolution scaling paradigms indiscriminately flood the quadratic self-attention mechanism…

计算机视觉与模式识别 · 计算机科学 2026-04-09 Yuheng Shi , Xiaohuan Pei , Linfeng Wen , Minjing Dong , Chang Xu

We present GLM-4.1V-Thinking, GLM-4.5V, and GLM-4.6V, a family of vision-language models (VLMs) designed to advance general-purpose multimodal understanding and reasoning. In this report, we share our key findings in the development of the…

Recent advancements in Large Vision-Language Models have showcased remarkable capabilities. However, they often falter when confronted with complex reasoning tasks that humans typically address through visual aids and deliberate,…

计算与语言 · 计算机科学 2025-04-15 Yikun Wang , Siyin Wang , Qinyuan Cheng , Zhaoye Fei , Liang Ding , Qipeng Guo , Dacheng Tao , Xipeng Qiu

Interleaved reasoning paradigms enhance Multimodal Large Language Models (MLLMs) with visual feedback but are hindered by the prohibitive computational cost of re-encoding pixel-dense images. A promising alternative, latent visual…

计算与语言 · 计算机科学 2026-01-22 Shuai Dong , Siyuan Wang , Xingyu Liu , Chenglin Li , Haowen Hou , Zhongyu Wei

Multimodal Large Language Models (MLLMs) have achieved remarkable success, yet they remain prone to perception-related hallucinations in fine-grained tasks. This vulnerability arises from a fundamental limitation: their reasoning is largely…

计算机视觉与模式识别 · 计算机科学 2026-04-17 Jiazhou Zhou , Yucheng Chen , Hongyang Li , Qing Jiang , Hu Zhou , Ying-Cong Chen , Lei Zhang

Vision-language models (VLMs) are widely assumed to exhibit in-context learning (ICL), a property similar to that of their language-only counterparts. While recent work suggests VLMs can perform multimodal ICL (MM-ICL), studies show they…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Chengyue Huang , Yuchen Zhu , Sichen Zhu , Jingyun Xiao , Moises Andrade , Shivang Chopra , Zsolt Kira

Recent advances in text-only large language models (LLMs), such as DeepSeek-R1, demonstrate remarkable reasoning ability. However, these models remain fragile or entirely incapable when extended to multi-modal tasks. Existing approaches…

多智能体系统 · 计算机科学 2025-10-30 Weijia Zhang , Zijia Liu , Haoru Li , Haoqi Chen , Jiaxuan You

The remarkable reasoning capability of large language models (LLMs) stems from cognitive behaviors that emerge through reinforcement with verifiable rewards. This work investigates how to transfer this principle to Multimodal LLMs (MLLMs)…

Multimodal large language models (MLLMs) have achieved remarkable success in general perception, yet complex multi-step visual reasoning remains a persistent challenge. Although recent agentic approaches incorporate tool use, they often…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Zhiwei Ning , Xuanang Gao , Jiaxi Cao , Gengming Zhang , Shengnan Ma , Wenwen Tong , Hanming Deng , Jie Yang , Wei Liu

The current success of modern visual reasoning systems is arguably attributed to cross-modality attention mechanisms. However, in deliberative reasoning such as in VQA, attention is unconstrained at each step, and thus may serve as a…

计算机视觉与模式识别 · 计算机科学 2022-05-26 Thao Minh Le , Vuong Le , Sunil Gupta , Svetha Venkatesh , Truyen Tran

Emerging embodied AI applications, such as wearable cameras and autonomous agents, have underscored the need for robust reasoning from first person video streams. We introduce EgoVLM, a vision-language model specifically designed to…

计算机视觉与模式识别 · 计算机科学 2025-06-04 Ashwin Vinod , Shrey Pandit , Aditya Vavre , Linshen Liu

While language reasoning models excel in many tasks, visual reasoning remains challenging for current large multimodal models (LMMs). As a result, most LMMs default to verbalizing perceptual content into text, a strong limitation for tasks…

计算机视觉与模式识别 · 计算机科学 2026-03-27 André G. Viveiros , Nuno Gonçalves , Matthias Lindemann , André Martins

We present HaoMo Vision-Language Model (HMVLM), an end-to-end driving framework that implements the slow branch of a cognitively inspired fast-slow architecture. A fast controller outputs low-level steering, throttle, and brake commands,…

计算机视觉与模式识别 · 计算机科学 2025-06-09 Daming Wang , Yuhao Song , Zijian He , Kangliang Chen , Xing Pan , Lu Deng , Weihao Gu

In the field of multimodal chain-of-thought (CoT) reasoning, existing approaches predominantly rely on reasoning on pure language space, which inherently suffers from language bias and is largely confined to math or science domains. This…

计算机视觉与模式识别 · 计算机科学 2026-05-04 Jiacong Wang , Zijian Kang , Haochen Wang , Haiyong Jiang , Jiawen Li , Bohong Wu , Ya Wang , Jiao Ran , Xiao Liang , Chao Feng , Jun Xiao

Reasoning has emerged as a pivotal capability in Large Language Models (LLMs). Through Reinforcement Learning (RL), typically Group Relative Policy Optimization (GRPO), these models are able to solve complex tasks such as mathematics and…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Xinyu Tian , Shu Zou , Zhaoyuan Yang , Mengqi He , Fabian Waschkowski , Lukas Wesemann , Peter Tu , Jing Zhang

Vision language models (VLMs) are increasingly capable of reasoning over images, but robust visual reasoning often requires re-grounding intermediate steps in the underlying visual evidence. Recent approaches typically rely on external…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Zeru Shi , Kai Mei , Yihao Quan , Dimitris N. Metaxas , Ruixiang Tang