English
Related papers

Related papers: Advancing Adaptive Multi-Stage Video Anomaly Reaso…

200 papers

Even in the era of rapid advances in large models, video understanding remains a highly challenging task. Compared to texts or images, videos commonly contain more information with redundancy, requiring large models to properly allocate…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Shiwen Cao , Zhaoxing Zhang , Junming Jiao , Juyi Qiao , Guowen Song , Rong Shen , Xiangbing Meng

Understanding long-form video content presents significant challenges due to its temporal complexity and the substantial computational resources required. In this work, we propose an agent-based approach to enhance both the efficiency and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Sullam Jeoung , Goeric Huybrechts , Bhavana Ganesh , Aram Galstyan , Sravan Bodapati

Video Anomaly Detection (VAD) systems can autonomously monitor and identify disturbances, reducing the need for manual labor and associated costs. However, current VAD systems are often limited by their superficial semantic understanding of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Jiaqi Tang , Hao Lu , Ruizheng Wu , Xiaogang Xu , Ke Ma , Cheng Fang , Bin Guo , Jiangbo Lu , Qifeng Chen , Ying-Cong Chen

Logical image understanding involves interpreting and reasoning about the relationships and consistency within an image's visual content. This capability is essential in applications such as industrial inspection, where logical anomaly…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Er Jin , Qihui Feng , Yongli Mou , Stefan Decker , Gerhard Lakemeyer , Oliver Simons , Johannes Stegmaier

Current multimodal large language models (MLLMs) struggle with hour-level video understanding, facing significant challenges not only in modeling the substantial information volume of long videos but also in overcoming the memory wall and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Hong Gao , Yiming Bao , Xuezhen Tu , Bin Zhong , Linan Yue , Minling Zhang

Object-aware reasoning in vision-language tasks poses significant challenges for current models, particularly in handling unseen objects, reducing hallucinations, and capturing fine-grained relationships in complex visual scenes. To address…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Antonio Carlos Rivera , Anthony Moore , Steven Robinson

Despite the advancements made in Vision Large Language Models (VLLMs), like text Large Language Models (LLMs), they have limitations in addressing questions that require real-time information or are knowledge-intensive. Indiscriminately…

Computation and Language · Computer Science 2025-08-26 Zhuo Chen , Xinyu Wang , Yong Jiang , Zhen Zhang , Xinyu Geng , Pengjun Xie , Fei Huang , Kewei Tu

Multimodal large language models via reinforcement learning (RL) have demonstrated remarkable capabilities in complex visual reasoning tasks, yet they remain limited in long-horizon multimodal scenarios, often suffering from visual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Chenghao Li , Fusheng Hao , Xikai Zhang , Likang Xiao , Yanwei Ren , Fuxiang Wu , Quan Chen , Liu Liu

Most existing video-and-language (VidL) research focuses on a single dataset, or multiple datasets of a single task. In reality, a truly useful VidL system is expected to be easily generalizable to diverse tasks, domains, and datasets. To…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Linjie Li , Jie Lei , Zhe Gan , Licheng Yu , Yen-Chun Chen , Rohit Pillai , Yu Cheng , Luowei Zhou , Xin Eric Wang , William Yang Wang , Tamara Lee Berg , Mohit Bansal , Jingjing Liu , Lijuan Wang , Zicheng Liu

Anomaly detection in complex industrial environments poses unique challenges, particularly in contexts characterized by data sparsity and evolving operational conditions. Predictive maintenance (PdM) in such settings demands methodologies…

Machine Learning · Computer Science 2025-03-12 Alicia Russell-Gilbert , Sudip Mittal , Shahram Rahimi , Maria Seale , Joseph Jabour , Thomas Arnold , Joshua Church

We propose a novel framework for open-ended video question answering that enhances reasoning depth and robustness in complex real-world scenarios, as benchmarked on the CVRR-ES dataset. Existing Video-Large Multimodal Models (Video-LMMs)…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Jun Xie , Zhaoran Zhao , Xiongjun Guan , Yingjian Zhu , Hongzhu Yi , Xinming Wang , Feng Chen , Zhepeng Wang

Video anomaly detection (VAD) is a critical yet challenging task due to the complex and diverse nature of real-world scenarios. Previous methods typically rely on domain-specific training data and manual adjustments when applying to new…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Zhiwei Yang , Chen Gao , Mike Zheng Shou

Large vision-language models (VLMs) have made significant strides in 2D visual understanding tasks, sparking interest in extending these capabilities to 3D scene understanding. However, current 3D VLMs often struggle with robust reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Ting Huang , Zeyu Zhang , Hao Tang

This paper addresses the critical and underexplored challenge of long video understanding with low computational budgets. We propose LongVideo-R1, an active, reasoning-equipped multimodal large language model (MLLM) agent designed for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Jihao Qiu , Lingxi Xie , Xinyue Huo , Qi Tian , Qixiang Ye

Vision-Language Models (VLMs) have achieved remarkable progress in multimodal reasoning tasks through enhanced chain-of-thought capabilities. However, this advancement also introduces novel safety risks, as these models become increasingly…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Yinan Xia , Yilei Jiang , Yingshui Tan , Xiaoyong Zhu , Xiangyu Yue , Bo Zheng

Complex video reasoning remains a significant challenge for Multimodal Large Language Models (MLLMs), as current R1-based methodologies often prioritize text-centric reasoning derived from text-based and image-based developments. In video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Bo Fang , Yuxin Song , Qiangqiang Wu , Haoyuan Sun , Wenhao Wu , Antoni B. Chan

Comprehending long videos remains a significant challenge for Large Multi-modal Models (LMMs). Current LMMs struggle to process even minutes to hours videos due to their lack of explicit memory and retrieval mechanisms. To address this…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Sameer Malik , Moyuru Yamada , Ayush Singh , Dishank Aggarwal

Current video understanding models excel at recognizing "what" is happening but fall short in high-level cognitive tasks like causal reasoning and future prediction, a limitation rooted in their lack of commonsense world knowledge. To…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 L'ea Dubois , Klaus Schmidt , Chengyu Wang , Ji-Hoon Park , Lin Wang , Santiago Munoz

Video Anomaly Detection (VAD) is a fundamental challenge in computer vision, particularly due to the open-set nature of anomalies. While recent training-free approaches utilizing Vision-Language Models (VLMs) have shown promise, they…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Lokman Bekit , Hamza Karim , Nghia T Nguyen , Yasin Yilmaz

Multimodal Large Language Models have achieved strong performance in single-video understanding, yet their ability to reason across multiple videos remains limited. Existing approaches typically concatenate multiple videos into a single…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yue Zhang , Liqiang Jing , Jia Li , Yapeng Tian , Xinya Du , Yunhui Guo , Vibhav Gogate