中文
相关论文

相关论文: Unlocking Vision-Language Models for Video Anomaly…

200 篇论文

Recent vision language models (VLMs) like CLIP have demonstrated impressive anomaly detection performance under significant distribution shift by utilizing high-level semantic information through text prompts. However, these models often…

计算机视觉与模式识别 · 计算机科学 2026-02-12 Nadeem Nazer , Hongkuan Zhou , Lavdim Halilaj , Ylli Sadikaj , Steffen Staab

Autonomous driving systems remain critically vulnerable to the long-tail of rare, out-of-distribution semantic anomalies. While VLMs have emerged as promising tools for perception, their application in anomaly detection remains largely…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Roberto Brusnicki , David Pop , Yuan Gao , Mattia Piccinini , Johannes Betz

CCTV safety monitoring demands anomaly detectors combine reliable clip-level accuracy with predictable per-clip latency despite weak supervision. This work investigates compact vision-language models (VLMs) as practical detectors for this…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Kirill Borodin , Kirill Kondrashov , Nikita Vasiliev , Ksenia Gladkova , Inna Larina , Mikhail Gorodnichev , Grach Mkrtchian

Weakly supervised video anomaly detection (WS-VAD) involves identifying the temporal intervals that contain anomalous events in untrimmed videos, where only video-level annotations are provided as supervisory signals. However, a key…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Yu Wang , Shengjie Zhao

Vision-language models (VLMs) pre-trained on web-scale datasets have demonstrated remarkable capabilities on downstream tasks when fine-tuned with minimal data. However, many VLMs rely on proprietary data and are not open-source, which…

计算与语言 · 计算机科学 2024-05-15 Shihong Liu , Zhiqiu Lin , Samuel Yu , Ryan Lee , Tiffany Ling , Deepak Pathak , Deva Ramanan

Video Anomaly Detection (VAD) can play a key role in spotting unusual activities in video footage. VAD is difficult to use in real-world settings due to the dynamic nature of human actions, environmental variations, and domain shifts.…

计算机视觉与模式识别 · 计算机科学 2025-08-13 Shanle Yao , Ghazal Alinezhad Noghre , Armin Danesh Pazho , Hamed Tabkhi

The application of deep learning in visual anomaly detection has gained widespread popularity due to its potential use in quality control and manufacturing. Current standard methods are Unsupervised, where a clean dataset is utilised to…

计算机视觉与模式识别 · 计算机科学 2024-10-04 Shaurya Gupta , Neil Gautam , Anurag Malyala

This paper presents AutoHint, a novel framework for automatic prompt engineering and optimization for Large Language Models (LLM). While LLMs have demonstrated remarkable ability in achieving high-quality annotation in various tasks, the…

计算与语言 · 计算机科学 2023-08-10 Hong Sun , Xue Li , Yinchuan Xu , Youkow Homma , Qi Cao , Min Wu , Jian Jiao , Denis Charles

Prompt ensembling of Large Language Model (LLM) generated category-specific prompts has emerged as an effective method to enhance zero-shot recognition ability of Vision-Language Models (VLMs). To obtain these category-specific prompts, the…

计算机视觉与模式识别 · 计算机科学 2024-08-08 M. Jehanzeb Mirza , Leonid Karlinsky , Wei Lin , Sivan Doveh , Jakub Micorek , Mateusz Kozinski , Hilde Kuehne , Horst Possegger

Large Vision-Language Models (VLMs) are increasingly being regarded as foundation models that can be instructed to solve diverse tasks by prompting, without task-specific training. We examine the seemingly obvious question: how to…

计算机视觉与模式识别 · 计算机科学 2026-02-09 Niccolo Avogaro , Thomas Frick , Mattia Rigotti , Andrea Bartezzaghi , Filip Janicki , Cristiano Malossi , Konrad Schindler , Roy Assaf

Video anomaly detection (VAD) aims to temporally locate abnormal events in a video. Existing works mostly rely on training deep models to learn the distribution of normality with either video-level supervision, one-class supervision, or in…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Luca Zanella , Willi Menapace , Massimiliano Mancini , Yiming Wang , Elisa Ricci

Large language models (LLMs) have demonstrated exceptional capabilities in text understanding, which has paved the way for their expansion into video LLMs (Vid-LLMs) to analyze video data. However, current Vid-LLMs struggle to…

计算机视觉与模式识别 · 计算机科学 2026-02-04 Ming Nie , Dan Ding , Chunwei Wang , Yuanfan Guo , Jianhua Han , Hang Xu , Li Zhang

We propose Consistency-guided Prompt learning (CoPrompt), a new fine-tuning method for vision-language models. Our approach improves the generalization of large foundation models when fine-tuned on downstream tasks in a few-shot setting.…

计算机视觉与模式识别 · 计算机科学 2024-08-06 Shuvendu Roy , Ali Etemad

Universal visual anomaly detection aims to identify anomalies from novel or unseen vision domains without additional fine-tuning, which is critical in open scenarios. Recent studies have demonstrated that pre-trained vision-language models…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Bin-Bin Gao , Yue Zhou , Jiangtao Yan , Yuezhi Cai , Weixi Zhang , Meng Wang , Jun Liu , Yong Liu , Lei Wang , Chengjie Wang

Video anomaly detection (VAD) aims to automatically identify events that deviate from normal patterns in untrimmed surveillance videos. Existing methods universally depend on large-scale annotations or task-specific training procedures,…

计算机视觉与模式识别 · 计算机科学 2026-05-11 Chao Huang , Penfei Wei , Wei Wang , Jie Wen , Zhihua Wang , Li Shen , Wenqi Ren , Xiaochun Cao

Recent advancements in language-model-based video understanding have been progressing at a remarkable pace, spurred by the introduction of Large Language Models (LLMs). However, the focus of prior research has been predominantly on devising…

计算机视觉与模式识别 · 计算机科学 2023-12-06 Yizhou Wang , Ruiyi Zhang , Haoliang Wang , Uttaran Bhattacharya , Yun Fu , Gang Wu

Fine-grained action recognition (FGAR) aims to identify subtle and distinctive differences among fine-grained action categories. However, current recognition methods often capture coarse-grained motion patterns but struggle to identify…

计算机视觉与模式识别 · 计算机科学 2025-11-27 Baoli Sun , Yihan Wang , Xinzhu Ma , Zhihui Wang , Kun Lu , Zhiyong Wang

Vision-language models (VLMs) have become central to tasks such as visual question answering, image captioning, and text-to-image generation. However, their outputs are highly sensitive to prompt variations, which can reveal vulnerabilities…

计算机视觉与模式识别 · 计算机科学 2026-02-02 Aarush Noheria , Yuguang Yao

Vision-language models (VLMs), such as CLIP, have shown strong generalization under zero-shot settings, yet adapting them to downstream tasks with limited supervision remains a significant challenge. Existing multi-modal prompt learning…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Silin Cheng , Kai Han

Vision-language tasks, such as VQA, SNLI-VE, and VCR are challenging because they require the model's reasoning ability to understand the semantics of the visual world and natural language. Supervised methods working for vision-language…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Zhecan Wang , Rui Sun , Haoxuan You , Noel Codella , Kai-Wei Chang , Shih-Fu Chang