English
Related papers

Related papers: Unlocking Vision-Language Models for Video Anomaly…

200 papers

As Vision-Language Models (VLMs) demonstrate increasing capabilities across real-world applications such as code generation and chatbot assistance, ensuring their safety has become paramount. Unlike traditional Large Language Models (LLMs),…

Artificial Intelligence · Computer Science 2025-06-23 Peiyuan Tang , Haojie Xin , Xiaodong Zhang , Jun Sun , Qin Xia , Zijiang Yang

As powerful pre-trained vision-language models (VLMs) like CLIP gain prominence, numerous studies have attempted to combine VLMs for downstream tasks. Among these, prompt learning has been validated as an effective method for adapting to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Yu Du , Tong Niu , Rong Zhao

Anomaly detection in computational workflows is critical for ensuring system reliability and security. However, traditional rule-based methods struggle to detect novel anomalies. This paper leverages large language models (LLMs) for…

Software Engineering · Computer Science 2024-07-26 Hongwei Jin , George Papadimitriou , Krishnan Raghavan , Pawel Zuk , Prasanna Balaprakash , Cong Wang , Anirban Mandal , Ewa Deelman

Few-shot action recognition in videos is challenging for its lack of supervision and difficulty in generalizing to unseen actions. To address this task, we propose a simple yet effective method, called knowledge prompting, which leverages…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Yuheng Shi , Xinxiao Wu , Hanxi Lin

Inspired by the success of vision-language methods (VLMs) in zero-shot classification, recent works attempt to extend this line of work into object detection by leveraging the localization ability of pre-trained VLMs and generating pseudo…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Yanxin Long , Jianhua Han , Runhui Huang , Xu Hang , Yi Zhu , Chunjing Xu , Xiaodan Liang

With the increasing adoption of video anomaly detection in intelligent surveillance domains, conventional visual-based detection approaches often struggle with information insufficiency and high false-positive rates in complex environments.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Peng Wu , Wanshun Su , Guansong Pang , Yujia Sun , Qingsen Yan , Peng Wang , Yanning Zhang

Semantic segmentation networks have achieved significant success under the assumption of independent and identically distributed data. However, these networks often struggle to detect anomalies from unknown semantic classes due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Liangyu Zhong , Joachim Sicking , Fabian Hüger , Hanno Gottschalk

Visual explanation (attention)-guided learning uses not only labels but also explanations to guide model reasoning process. While visual attention-guided learning has shown promising results, it requires a large number of explanation…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Yifei Zhang , Siyi Gu , Bo Pan , Guangji Bai , Meikang Qiu , Xiaofeng Yang , Liang Zhao

Vision-language models (VLMs) offer flexible object detection through natural language prompts but suffer from performance variability depending on prompt phrasing. In this paper, we introduce a method for automated prompt refinement using…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Lucas Choi , Ross Greer

Recent advancements in reasoning capability of Multimodal Large Language Models (MLLMs) demonstrate its effectiveness in tackling complex visual tasks. However, existing MLLM-based Video Anomaly Detection (VAD) methods remain limited to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Chao Huang , Benfeng Wang , Jie Wen , Chengliang Liu , Wei Wang , Li Shen , Xiaochun Cao

Existing Video Anomaly Detection (VAD) methods typically rely on task-specific training, leading to strong domain dependency and high training costs. Moreover, most existing methods output only scalar anomaly scores, providing limited…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Hyeongmuk Lim , Youngbum Hur

The vision-language model has brought great improvement to few-shot industrial anomaly detection, which usually needs to design of hundreds of prompts through prompt engineering. For automated scenarios, we first use conventional prompt…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Xiaofan Li , Zhizhong Zhang , Xin Tan , Chengwei Chen , Yanyun Qu , Yuan Xie , Lizhuang Ma

Anomaly detection in surveillance videos remains a challenging task due to the diversity of abnormal events, class imbalance, and scene-dependent visual clutter. To address these issues, we propose a robust deep learning framework that…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Mohammad Ali Etemadi Naeen , Hoda Mohammadzade , Saeed Bagheri Shouraki

Understanding abnormal events in videos is a vital and challenging task that has garnered significant attention in a wide range of applications. Although current video understanding Multi-modal Large Language Models (MLLMs) are capable of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Yingxian Chen , Jiahui Liu , Ruidi Fan , Yanwei Li , Chirui Chang , Shizhen Zhao , Wilton W. T. Fok , Xiaojuan Qi , Yik-Chung Wu

We investigate the efficacy of visual prompting to adapt large-scale models in vision. Following the recent approach from prompt tuning and adversarial reprogramming, we learn a single image perturbation such that a frozen model prompted…

Computer Vision and Pattern Recognition · Computer Science 2022-06-06 Hyojin Bahng , Ali Jahanian , Swami Sankaranarayanan , Phillip Isola

Automated video surveillance with Large Vision-Language Models is limited by their inherent bias towards normality, often failing to detect crimes. While Chain-of-Thought reasoning strategies show significant potential for improving…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Pedro Domingos , João Pereira , Vasco Lopes , João Neves , David Semedo

Benefiting from generalizability of vision-language models (VLMs) such as CLIP, many zero-/few-shot anomaly detection (AD) approaches have achieved impressive detection performance across various datasets. Nevertheless, they require…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Yi Zhang , Jiawen Zhu , Lele Fu , Guansong Pang

Detecting anomalous hazards in visual data, particularly in video streams, is a critical challenge in autonomous driving. Existing models often struggle with unpredictable, out-of-label hazards due to their reliance on predefined object…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Shashank Shriram , Srinivasa Perisetla , Aryan Keskar , Harsha Krishnaswamy , Tonko Emil Westerhof Bossen , Andreas Møgelmose , Ross Greer

Deep generative models can create remarkably photorealistic fake images while raising concerns about misinformation and copyright infringement, known as deepfake threats. Deepfake detection technique is developed to distinguish between real…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 You-Ming Chang , Chen Yeh , Wei-Chen Chiu , Ning Yu

The recent trend in the Large Vision and Language model has brought a new change in how information extraction systems are built. VLMs have set a new benchmark with their State-of-the-art techniques in understanding documents and building…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Dipankar Medhi