English
Related papers

Related papers: Leveraging Multimodal LLM Descriptions of Activity…

200 papers

The collection and detection of video anomaly data has long been a challenging problem due to its rare occurrence and spatio-temporal scarcity. Existing video anomaly detection (VAD) methods under perform in open-world scenarios. Key…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zunkai Dai , Ke Li , Jiajia Liu , Jie Yang , Yuanyuan Qiao

Multimodal large language models (MLLMs) have demonstrated impressive general competence in video understanding, yet their reliability for real-world Video Anomaly Detection (VAD) remains largely unexplored. Unlike conventional pipelines…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Shanle Yao , Armin Danesh Pazho , Narges Rashvand , Hamed Tabkhi

Video Anomaly Detection (VAD) aims to locate events that deviate from normal patterns in videos. Traditional approaches often rely on extensive labeled data and incur high computational costs. Recent tuning-free methods based on Multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Zhaolin Cai , Fan Li , Ziwei Zheng , Haixia Bi , Lijun He

Video anomaly detection (VAD) is crucial for video analysis and surveillance in computer vision. However, existing VAD models rely on learned normal patterns, which makes them difficult to apply to diverse environments. Consequently, users…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Sunghyun Ahn , Youngwan Jo , Kijung Lee , Sein Kwon , Inpyo Hong , Sanghyun Park

Human action recognition often struggles with deep semantic understanding, complex contextual information, and fine-grained distinction, limitations that traditional methods frequently encounter when dealing with diverse video data.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Jingwei Peng , Zhixuan Qiu , Boyu Jin , Surasakdi Siripong

Video anomaly understanding (VAU) aims to provide detailed interpretation and semantic comprehension of anomalous events within videos, addressing limitations of traditional methods that focus solely on detecting and localizing anomalies.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Ying Cheng , Yu-Ho Lin , Min-Hung Chen , Fu-En Yang , Shang-Hong Lai

Video anomaly detection (VAD) has been paid increasing attention due to its potential applications, its current dominant tasks focus on online detecting anomalies% at the frame level, which can be roughly interpreted as the binary or…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Peng Wu , Jing Liu , Xiangteng He , Yuxin Peng , Peng Wang , Yanning Zhang

The rapid advancement of vision-language models (VLMs) has established a new paradigm in video anomaly detection (VAD): leveraging VLMs to simultaneously detect anomalies and provide comprehendible explanations for the decisions. Existing…

Artificial Intelligence · Computer Science 2025-04-02 Muchao Ye , Weiyang Liu , Pan He

In this paper, we investigate the use of multimodal large language models (MLLMs) for generating virtual activities, leveraging the integration of vision-language modalities to enable the interpretation of virtual environments. Our approach…

Human-Computer Interaction · Computer Science 2025-11-13 Changyang Li , Qingan Yan , Minyoung Kim , Zhan Li , Yi Xu , Lap-Fai Yu

Understanding abnormal events in videos is a vital and challenging task that has garnered significant attention in a wide range of applications. Although current video understanding Multi-modal Large Language Models (MLLMs) are capable of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Yingxian Chen , Jiahui Liu , Ruidi Fan , Yanwei Li , Chirui Chang , Shizhen Zhao , Wilton W. T. Fok , Xiaojuan Qi , Yik-Chung Wu

The fusion of language and vision in large vision-language models (LVLMs) has revolutionized deep learning-based object detection by enhancing adaptability, contextual reasoning, and generalization beyond traditional architectures. This…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Ranjan Sapkota , Manoj Karkee

Time series anomaly detection (TSAD) has been a long-standing pillar problem in Web-scale systems and online infrastructures, such as service reliability monitoring, system fault diagnosis, and performance optimization. Large language…

Computation and Language · Computer Science 2026-02-18 Xiongxiao Xu , Haoran Wang , Yueqing Liang , Philip S. Yu , Yue Zhao , Kai Shu

Recent breakthroughs in Multimodal Large Language Models (MLLMs) have gained significant recognition within the deep learning community, where the fusion of the Video Foundation Models (VFMs) and Large Language Models(LLMs) has proven…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Quan Zhang , Jinwei Fang , Rui Yuan , Xi Tang , Yuxin Qi , Ke Zhang , Chun Yuan

Video anomaly detection (VAD) is essential for enhancing safety and security by identifying unusual events across different environments. Existing VAD benchmarks, however, are primarily designed for general-purpose scenarios, neglecting the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Xinyi Zhao , Congjing Zhang , Pei Guo , Wei Li , Lin Chen , Chaoyue Zhao , Shuai Huang

Traditional approaches to safety event analysis in autonomous systems have relied on complex machine learning models and extensive datasets for high accuracy and reliability. However, the advent of Multimodal Large Language Models (MLLMs)…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Mohammad Abu Tami , Huthaifa I. Ashqar , Mohammed Elhenawy

Video anomaly detection (VAD) with weak supervision has achieved remarkable performance in utilizing video-level labels to discriminate whether a video frame is normal or abnormal. However, current approaches are inherently limited to a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Peng Wu , Xuerong Zhou , Guansong Pang , Yujia Sun , Jing Liu , Peng Wang , Yanning Zhang

The robust causal capability of Multimodal Large Language Models (MLLMs) hold the potential of detecting defective objects in Industrial Anomaly Detection (IAD). However, most traditional IAD methods lack the ability to provide multi-turn…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Zewen Li , Zitong Yu , Qilang Ye , Weicheng Xie , Wei Zhuo , Linlin Shen

Detecting visual anomalies in diverse, multi-class real-world images is a significant challenge. We introduce \ours, a novel unsupervised multi-class visual anomaly detection framework. It integrates a Latent Diffusion Model (LDM) with a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Samet Hicsonmez , Abd El Rahman Shabayek , Djamila Aouada

Time series anomaly detection (TSAD) plays a crucial role in various industries by identifying atypical patterns that deviate from standard trends, thereby maintaining system integrity and enabling prompt response measures. Traditional TSAD…

Computation and Language · Computer Science 2024-05-27 Jun Liu , Chaoyun Zhang , Jiaxu Qian , Minghua Ma , Si Qin , Chetan Bansal , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang

Weakly supervised video anomaly detection (WS-VAD) involves identifying the temporal intervals that contain anomalous events in untrimmed videos, where only video-level annotations are provided as supervisory signals. However, a key…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yu Wang , Shengjie Zhao