English
Related papers

Related papers: LATERN: Test-Time Context-Aware Explainable Video …

200 papers

Current Large Language Models (LLMs) and Vision-Language Large Models (LVLMs) excel in single-turn tasks but face significant challenges in multi-turn interactions requiring deep contextual understanding and complex visual reasoning, often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Weijie Shen , Xinrui Wang , Yuanqi Nie , Apiradee Boonmee

Existing semi-supervised video anomaly detection (VAD) methods often struggle with detecting complex anomalies involving object interactions and generally lack explainability. To overcome these limitations, we propose a novel VAD framework…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Furkan Mumcu , Michael J. Jones , Anoop Cherian , Yasin Yilmaz

Towards open-ended Video Anomaly Detection (VAD), existing methods often exhibit biased detection when faced with challenging or unseen events and lack interpretability. To address these drawbacks, we propose Holmes-VAD, a novel framework…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Huaxin Zhang , Xiaohao Xu , Xiang Wang , Jialong Zuo , Chuchu Han , Xiaonan Huang , Changxin Gao , Yuehuan Wang , Nong Sang

Human action recognition often struggles with deep semantic understanding, complex contextual information, and fine-grained distinction, limitations that traditional methods frequently encounter when dealing with diverse video data.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Jingwei Peng , Zhixuan Qiu , Boyu Jin , Surasakdi Siripong

Video Anomaly Detection (VAD) automates the identification of unusual events, such as security threats in surveillance videos. In real-world applications, VAD models must effectively operate in cross-domain settings, identifying rare…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Yashika Jain , Ali Dabouei , Min Xu

Despite the remarkable success of Vision-Language Models (VLMs), their performance on a range of complex visual tasks is often hindered by a "visual processing bottleneck": a propensity to lose grounding in visual evidence and exhibit a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Xinlei Yu , Chengming Xu , Guibin Zhang , Zhangquan Chen , Yudong Zhang , Yongbo He , Peng-Tao Jiang , Jiangning Zhang , Xiaobin Hu , Shuicheng Yan

Semantic segmentation networks have achieved significant success under the assumption of independent and identically distributed data. However, these networks often struggle to detect anomalies from unknown semantic classes due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Liangyu Zhong , Joachim Sicking , Fabian Hüger , Hanno Gottschalk

Understanding the content of events occurring in the video and their inherent temporal logic is crucial for video-text retrieval. However, web-crawled pre-training datasets often lack sufficient event information, and the widely adopted…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Zongyang Ma , Ziqi Zhang , Yuxin Chen , Zhongang Qi , Chunfeng Yuan , Bing Li , Yingmin Luo , Xu Li , Xiaojuan Qi , Ying Shan , Weiming Hu

Anomaly detection has attracted considerable search attention. However, existing anomaly detection databases encounter two major problems. Firstly, they are limited in scale. Secondly, training sets contain only video-level labels…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Boyang Wan , Wenhui Jiang , Yuming Fang , Zhiyuan Luo , Guanqun Ding

In recent years, considerable research has been conducted on vision-language models that handle both image and text data; these models are being applied to diverse downstream tasks, such as "image-related chat," "image recognition by…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Kosuke Sakurai , Tatsuya Ishii , Ryotaro Shimizu , Linxin Song , Masayuki Goto

Integrating vision models into large language models (LLMs) has sparked significant interest in creating vision-language foundation models, especially for video understanding. Recent methods often utilize memory banks to handle untrimmed…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Sakib Reza , Xiyun Song , Heather Yu , Zongfang Lin , Mohsen Moghaddam , Octavia Camps

CCTV safety monitoring demands anomaly detectors combine reliable clip-level accuracy with predictable per-clip latency despite weak supervision. This work investigates compact vision-language models (VLMs) as practical detectors for this…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Kirill Borodin , Kirill Kondrashov , Nikita Vasiliev , Ksenia Gladkova , Inna Larina , Mikhail Gorodnichev , Grach Mkrtchian

We introduce Text-based Explainable Video Anomaly Detection (TbVAD), a language-driven framework for weakly supervised video anomaly detection that performs anomaly detection and explanation entirely within the textual domain. Unlike…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Hari Lee

AI-driven video analytics has become increasingly important across diverse domains. However, existing systems are often constrained to specific, predefined tasks, limiting their adaptability in open-ended analytical scenarios. The recent…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Yuxuan Yan , Shiqi Jiang , Ting Cao , Yifan Yang , Qianqian Yang , Yuanchao Shu , Yuqing Yang , Lili Qiu

Vision-language models (VLMs) have emerged as powerful tools for enabling automated traffic analysis; however, current approaches often demand substantial computational resources and struggle with fine-grained spatio-temporal understanding.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Tinh-Anh Nguyen-Nhu , Triet Dao Hoang Minh , Dat To-Thanh , Phuc Le-Gia , Tuan Vo-Lan , Tien-Huy Nguyen

Vision-Language Models (VLMs) often yield inconsistent descriptions of the same object across viewpoints, hindering the ability of embodied agents to construct consistent semantic representations over time. Previous methods resolved…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Tommaso Galliena , Stefano Rosa , Tommaso Apicella , Pietro Morerio , Alessio Del Bue , Lorenzo Natale

The collection and detection of video anomaly data has long been a challenging problem due to its rare occurrence and spatio-temporal scarcity. Existing video anomaly detection (VAD) methods under perform in open-world scenarios. Key…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zunkai Dai , Ke Li , Jiajia Liu , Jie Yang , Yuanyuan Qiao

Current vision-language models (VLMs) still exhibit inferior performance on knowledge-intensive tasks, primarily due to the challenge of accurately encoding all the associations between visual objects and scenes to their corresponding…

Computation and Language · Computer Science 2024-10-16 Jingyuan Qi , Zhiyang Xu , Rulin Shao , Yang Chen , Jin Di , Yu Cheng , Qifan Wang , Lifu Huang

Weakly supervised video anomaly detection (WS-VAD) involves identifying the temporal intervals that contain anomalous events in untrimmed videos, where only video-level annotations are provided as supervisory signals. However, a key…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yu Wang , Shengjie Zhao

Understanding and reasoning over long videos pose significant challenges for large video language models (LVLMs) due to the difficulty in processing intensive video tokens beyond context window and retaining long-term sequential…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Xiaoqian Shen , Wenxuan Zhang , Jun Chen , Mohamed Elhoseiny