中文
相关论文

相关论文: Semantic and Visual Evidence for Efficient Long-Vi…

200 篇论文

Video reasoning models are a core component of egocentric and embodied agents. However, standard benchmarks for assessing models provide only evaluation of the output (e.g. the answer to a question), without evaluation of intermediate…

计算机视觉与模式识别 · 计算机科学 2026-05-18 Arsha Nagrani , Jasper Uijilings , Shyamal Buch , Tobias Weyand , Sudheendra Vijayanarasimhan , Bo Hu , Ramin Mehran , David A Ross , Cordelia Schmid

Multimodal large language models have become a popular topic in deep visual understanding due to many promising real-world applications. However, hour-long video understanding, spanning over one hour and containing tens of thousands of…

计算机视觉与模式识别 · 计算机科学 2025-05-14 Heqing Zou , Tianze Luo , Guiyang Xie , Victor Xiao Jie Zhang , Fengmao Lv , Guangcong Wang , Junyang Chen , Zhuochen Wang , Hansheng Zhang , Huaijian Zhang

Human intelligence requires correctness and robustness, with the former being foundational for the latter. In video understanding, correctness ensures the accurate interpretation of visual content, and robustness maintains consistent…

计算机视觉与模式识别 · 计算机科学 2025-07-22 Yuanhan Zhang , Yunice Chew , Yuhao Dong , Aria Leo , Bo Hu , Ziwei Liu

Understanding of video creativity and content often varies among individuals, with differences in focal points and cognitive levels across different ages, experiences, and genders. There is currently a lack of research in this area, and…

计算机视觉与模式识别 · 计算机科学 2024-09-06 Minghui Wu , Chenxu Zhao , Anyang Su , Donglin Di , Tianyu Fu , Da An , Min He , Ya Gao , Meng Ma , Kun Yan , Ping Wang

Empowered by Large Language Models (LLMs), recent advancements in Video-based LLMs (VideoLLMs) have driven progress in various video understanding tasks. These models encode video representations through pooling or query aggregation over a…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Yuetian Weng , Mingfei Han , Haoyu He , Xiaojun Chang , Bohan Zhuang

The sequential structure of videos poses a challenge to the ability of multimodal large language models (MLLMs) to locate multi-frame evidence and conduct multimodal reasoning. However, existing video benchmarks mainly focus on…

计算机视觉与模式识别 · 计算机科学 2025-06-05 Kejian Zhu , Zhuoran Jin , Hongbang Yuan , Jiachun Li , Shangqing Tu , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

With recent advancements in video backbone architectures, combined with the remarkable achievements of large language models (LLMs), the analysis of long-form videos spanning tens of minutes has become both feasible and increasingly…

计算机视觉与模式识别 · 计算机科学 2026-02-23 Yuxiao Chen , Jue Wang , Zhikang Zhang , Jingru Yi , Xu Zhang , Yang Zou , Zhaowei Cai , Jianbo Yuan , Xinyu Li , Hao Yang , Davide Modolo

Medical vision--language models (VLMs) have shown strong potential for medical visual question answering (VQA), yet their reasoning remains largely text-centric: images are encoded once as static context, and subsequent inference is…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Suyang Xi , Songtao Hu , Yuxiang Lai , Wangyun Dan , Yaqi Liu , Shansong Wang , Xiaofeng Yang

Chain-of-thought (CoT) reasoning has been highly successful in solving complex tasks in natural language processing, and recent multimodal large language models (MLLMs) have extended this paradigm to video reasoning. However, these models…

计算机视觉与模式识别 · 计算机科学 2025-12-11 Yiwu Zhong , Zi-Yuan Hu , Yin Li , Liwei Wang

Recent advancements in Large Language Models (LLMs) have led to the development of Video Large Multi-modal Models (Video-LMMs) that can handle a wide range of video understanding tasks. These models have the potential to be deployed in…

计算机视觉与模式识别 · 计算机科学 2024-05-10 Muhammad Uzair Khattak , Muhammad Ferjad Naeem , Jameel Hassan , Muzammal Naseer , Federico Tombari , Fahad Shahbaz Khan , Salman Khan

Video multimodal large language models (Video-MLLMs) have achieved remarkable progress in video understanding. However, they remain vulnerable to hallucination-producing content inconsistent with or unrelated to video inputs. Previous video…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Hao Lu , Jiahao Wang , Yaolun Zhang , Ruohui Wang , Xuanyu Zheng , Yepeng Tang , Dahua Lin , Lewei Lu

Recent progress in multimodal large language models (MLLMs) has led to a surge of benchmarks for long-video reasoning. However, most existing benchmarks rely on localized cues and fail to capture narrative reasoning, the ability to track…

计算机视觉与模式识别 · 计算机科学 2026-03-23 Rahul Jain , Keval Doshi , Burak Uzkent , Garin Kessler

Detecting evidence within the context is a key step in the process of reasoning task. Evaluating and enhancing the capabilities of LLMs in evidence detection will strengthen context-based reasoning performance. This paper proposes a…

Visual reasoning is central to human cognition, enabling individuals to interpret and abstractly understand their environment. Although recent Multimodal Large Language Models (MLLMs) have demonstrated impressive performance across language…

计算机视觉与模式识别 · 计算机科学 2025-03-17 Jing Bi , Junjia Guo , Susan Liang , Guangyu Sun , Luchuan Song , Yunlong Tang , Jinxi He , Jiarui Wu , Ali Vosoughi , Chen Chen , Chenliang Xu

Humans can robustly localize visual evidence and provide grounded answers even in noisy environments by identifying critical cues and then relating them to the full context in a bottom-up manner. Inspired by this, we propose DeepScan, a…

计算机视觉与模式识别 · 计算机科学 2026-03-05 Yangfu Li , Hongjian Zhan , Jiawei Chen , Yuning Gong , Qi Liu , Yue Lu

Language models (LMs) and their extension, vision-language models (VLMs), have achieved remarkable performance across various tasks. However, they still struggle with complex reasoning tasks that require multimodal or multilingual…

机器学习 · 计算机科学 2025-07-09 Wenyi Wu , Zixuan Song , Kun Zhou , Yifei Shao , Zhiting Hu , Biwei Huang

Next-generation visual assistants, such as smart glasses, embodied agents, and always-on life-logging systems, must reason over an entire day or more of continuous visual experience. In ultra-long video settings, relevant information is…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Ziyang Wang , Yue Zhang , Shoubin Yu , Ce Zhang , Zengqi Zhao , Jaehong Yoon , Hyunji Lee , Gedas Bertasius , Mohit Bansal

Multimodal large language models (MLLMs) often struggle to ground reasoning in perceptual evidence. We present a systematic study of perception strategies-explicit, implicit, visual, and textual-across four multimodal benchmarks and two…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Yizhuo Ding , Mingkang Chen , Zhibang Feng , Tong Xiao , Wanying Qu , Wenqi Shao , Yanwei Fu

Long-form video reasoning remains a major challenge for Video Large Language Models (Video LLMs), as static uniform frame sampling leads to information dilution and obscures critical evidence. Furthermore, existing pixel-space video…

计算机视觉与模式识别 · 计算机科学 2025-10-20 Xuchen Li , Xuzhao Li , Shiyu Hu , Kaiqi Huang

Video understanding represents the most challenging frontier in computer vision, requiring models to reason about complex spatiotemporal relationships, long-term dependencies, and multimodal evidence. The recent emergence of Video-Large…