中文
相关论文

相关论文: Act2See: Emergent Active Visual Perception for Vid…

200 篇论文

Recent advancements in Multimodal Large Language Models (MLLMs) have significantly enhanced cross-modal understanding and reasoning by incorporating Chain-of-Thought (CoT) reasoning in the semantic space. Building upon this, recent studies…

计算机视觉与模式识别 · 计算机科学 2026-04-10 Chengzhi Liu , Yuzhe Yang , Yue Fan , Qingyue Wei , Sheng Liu , Xin Eric Wang

Recent advancements in Vision-Language (VL) research have sparked new benchmarks for complex visual reasoning, challenging models' advanced reasoning ability. Traditional Vision-Language Models (VLMs) perform well in visual perception tasks…

计算机视觉与模式识别 · 计算机科学 2024-09-24 Zhiyuan Li , Dongnan Liu , Chaoyi Zhang , Heng Wang , Tengfei Xue , Weidong Cai

Recent advancements in reasoning capability of Multimodal Large Language Models (MLLMs) demonstrate its effectiveness in tackling complex visual tasks. However, existing MLLM-based Video Anomaly Detection (VAD) methods remain limited to…

计算机视觉与模式识别 · 计算机科学 2025-05-27 Chao Huang , Benfeng Wang , Jie Wen , Chengliang Liu , Wei Wang , Li Shen , Xiaochun Cao

Video understanding requires not only visual recognition but also complex reasoning. While Vision-Language Models (VLMs) demonstrate impressive capabilities, they typically process videos largely in a single-pass manner with limited support…

计算机视觉与模式识别 · 计算机科学 2025-11-19 Hong Gao , Yiming Bao , Xuezhen Tu , Yutong Xu , Yue Jin , Yiyang Mu , Bin Zhong , Linan Yue , Min-Ling Zhang

Vision-Language Models (VLMs) show promise for autonomous driving, yet their struggle with hallucinations, inefficient reasoning, and limited real-world validation hinders accurate perception and robust step-by-step reasoning. To overcome…

Current research on Vision-Language-Action (VLA) models predominantly focuses on enhancing generalization through established reasoning techniques. While effective, these improvements invariably increase computational complexity and…

计算机视觉与模式识别 · 计算机科学 2026-03-06 Riccardo Andrea Izzo , Gianluca Bardaro , Matteo Matteucci

Chain-of-Thought (CoT) techniques have significantly enhanced reasoning in Vision-Language Models (VLMs). Extending this paradigm, Visual CoT integrates explicit visual edits, such as cropping or annotating regions of interest, into the…

机器学习 · 计算机科学 2025-09-30 Chunxue Xu , Yiwei Wang , Yujun Cai , Bryan Hooi , Songze Li

Recent multimodal large language models (MLLMs) have advanced video understanding, yet most still "think about videos" ie once a video is encoded, reasoning unfolds entirely in text, treating visual input as a static context. This passive…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Hanoona Rasheed , Mohammed Zumri , Muhammad Maaz , Ming-Hsuan Yang , Fahad Shahbaz Khan , Salman Khan

Vision-language-action models (VLAs) have shown potential in leveraging pretrained vision-language models and diverse robot demonstrations for learning generalizable sensorimotor control. While this paradigm effectively utilizes large-scale…

Large Vision-Language Models (LVLMs) face a fundamental dilemma in video reasoning: they are caught between the prohibitive computational costs of verbose reasoning and the hallucination risks of efficient, ungrounded approaches. To resolve…

计算机视觉与模式识别 · 计算机科学 2026-01-13 Yanxiang Huang , Guohua Gao , Zhaoyang Wei , Jianyuan Ni

Current video understanding models excel at recognizing "what" is happening but fall short in high-level cognitive tasks like causal reasoning and future prediction, a limitation rooted in their lack of commonsense world knowledge. To…

计算机视觉与模式识别 · 计算机科学 2025-12-30 L'ea Dubois , Klaus Schmidt , Chengyu Wang , Ji-Hoon Park , Lin Wang , Santiago Munoz

Large vision-language models (VLMs) fine-tuned on specialized visual instruction-following data have exhibited impressive language reasoning capabilities across various scenarios. However, this fine-tuning paradigm may not be able to…

人工智能 · 计算机科学 2024-10-10 Yuexiang Zhai , Hao Bai , Zipeng Lin , Jiayi Pan , Shengbang Tong , Yifei Zhou , Alane Suhr , Saining Xie , Yann LeCun , Yi Ma , Sergey Levine

Multi-modal large language models (MLLMs) have achieved remarkable capabilities by integrating visual perception with language understanding, enabling applications such as image-grounded dialogue, visual question answering, and scientific…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Tianyi Bai , Zengjie Hu , Fupeng Sun , Jiantao Qiu , Yizhen Jiang , Guangxin He , Bohan Zeng , Conghui He , Binhang Yuan , Wentao Zhang

Vision language models (VLMs) are increasingly capable of reasoning over images, but robust visual reasoning often requires re-grounding intermediate steps in the underlying visual evidence. Recent approaches typically rely on external…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Zeru Shi , Kai Mei , Yihao Quan , Dimitris N. Metaxas , Ruixiang Tang

While Reinforcement Learning with Verifiable Reward (RLVR) significantly advances image reasoning in Large Vision-Language Models (LVLMs), its application to complex video reasoning remains underdeveloped. This gap stems primarily from a…

计算机视觉与模式识别 · 计算机科学 2025-10-02 Congzhi Zhang , Zhibin Wang , Yinchao Ma , Jiawei Peng , Yihan Wang , Qiang Zhou , Jun Song , Bo Zheng

Vision-Language-Action (VLA) tasks require reasoning over complex visual scenes and executing adaptive actions in dynamic environments. While recent studies on reasoning VLAs show that explicit chain-of-thought (CoT) can improve…

计算机视觉与模式识别 · 计算机科学 2026-02-25 Chi-Pin Huang , Yunze Man , Zhiding Yu , Min-Hung Chen , Jan Kautz , Yu-Chiang Frank Wang , Fu-En Yang

Video temporal grounding is an emerging topic aiming to identify specific clips within videos. In addition to pre-trained video models, contemporary methods utilize pre-trained vision-language models (VLM) to capture detailed…

计算机视觉与模式识别 · 计算机科学 2024-08-14 Yubin Wang , Xinyang Jiang , De Cheng , Dongsheng Li , Cairong Zhao

The advent of Vision-Language Models (VLMs) has significantly advanced end-to-end autonomous driving, demonstrating powerful reasoning abilities for high-level behavior planning tasks. However, existing methods are often constrained by a…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Weicheng Zheng , Xiaofei Mao , Nanfei Ye , Pengxiang Li , Kun Zhan , Xianpeng Lang , Hang Zhao

Large vision-language models (LVLMs) have witnessed significant progress on visual understanding tasks. However, they often prioritize language knowledge over image information on visual reasoning tasks, incurring performance degradation.…

计算机视觉与模式识别 · 计算机科学 2025-10-16 Jingqi Zhou , Sheng Wang , Jingwei Dong , Kai Liu , Lei Li , Jiahui Gao , Jiyue Jiang , Lingpeng Kong , Chuan Wu

Although current large Vision-Language Models (VLMs) have advanced in multimodal understanding and reasoning, their fundamental perceptual and reasoning abilities remain limited. Specifically, even on simple jigsaw tasks, existing VLMs…