English
Related papers

Related papers: VMAD: Visual-enhanced Multimodal Large Language Mo…

200 papers

Video Anomaly Detection (VAD) can play a key role in spotting unusual activities in video footage. VAD is difficult to use in real-world settings due to the dynamic nature of human actions, environmental variations, and domain shifts.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Shanle Yao , Ghazal Alinezhad Noghre , Armin Danesh Pazho , Hamed Tabkhi

Recent advancements have enhanced the capability of Multimodal Large Language Models (MLLMs) to comprehend multi-image information. However, existing benchmarks primarily evaluate answer correctness, overlooking whether models genuinely…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Pengfei Wang , Guohai Xu , Weinong Wang , Junjie Yang , Jie Lou , Yunhua Xue

Large multimodal models (LMMs) exhibit strong task generalization capabilities, offering new opportunities for zero-shot visual anomaly segmentation (ZSAS). However, existing LMM-based segmentation approaches still face fundamental…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Zhen Qu , Xian Tao , Xiaoyi Bao , Dingrong Wang , ShiChen Qu , Zhengtao Zhang , Xingang Wang

Vision-Language Models (VLMs) have demonstrated impressive multimodal capabilities in learning joint representations of visual and textual data, making them powerful tools for tasks such as Compositional Zero-Shot Learning (CZSL). CZSL…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Kyle Stein , Arash Mahyari , Guillermo Francia , Eman El-Sheikh

Multimodal large language models (MLLMs) can enrich industrial anomaly detection with semantic descriptions and anomaly reasoning, but they still lag specialist anomaly detectors in binary detection accuracy. Existing approaches address…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Xiaomeng Peng , Xilang Huang , Seon Han Choi

Anomaly detection (AD) plays a pivotal role in numerous web-based applications, including malware detection, anti-money laundering, device failure detection, and network fault analysis. Most methods, which rely on unsupervised learning, are…

Machine Learning · Computer Science 2024-02-07 Haihong Zhao , Chenyi Zi , Yang Liu , Chen Zhang , Yan Zhou , Jia Li

Video anomaly detection (VAD) aims to detect anomalies that deviate from what is expected. In open-world scenarios, the expected events may change as requirements change. For example, not wearing a mask may be considered abnormal during a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Zihao Liu , Xiaoyu Wu , Jianqin Wu , Xuxu Wang , Linlin Yang

Accurate video moment retrieval (VMR) requires universal visual-textual correlations that can handle unknown vocabulary and unseen scenes. However, the learned correlations are likely either biased when derived from a limited amount of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Dezhao Luo , Jiabo Huang , Shaogang Gong , Hailin Jin , Yang Liu

Recent advances in visual industrial anomaly detection have demonstrated exceptional performance in identifying and segmenting anomalous regions while maintaining fast inference speeds. However, anomaly classification-distinguishing…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Sassan Mokhtar , Arian Mousakhan , Silvio Galesso , Jawad Tayyub , Thomas Brox

Zero-shot anomaly detection (ZSAD) has gained increasing attention in medical imaging as a way to identify abnormalities without task-specific supervision, but most advances remain limited to 2D datasets. Extending ZSAD to 3D medical images…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Tai Le-Gia , Jaehyun Ahn

Effective cross-modal retrieval is essential for applications like information retrieval and recommendation systems, particularly in specialized domains such as manufacturing, where product information often consists of visual samples…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Francesco Giuliari , Asif Khan Pattan , Mohamed Lamine Mekhalfi , Fabio Poiesi

Traditional defect classification approaches are facing with two barriers. (1) Insufficient training data and unstable data quality. Collecting sufficient defective sample is expensive and time-costing, consequently leading to dataset…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Chih-Chung Hsu , Chia-Ming Lee , Chun-Hung Sun , Kuang-Ming Wu

Anomaly detection in computational workflows is critical for ensuring system reliability and security. However, traditional rule-based methods struggle to detect novel anomalies. This paper leverages large language models (LLMs) for…

Software Engineering · Computer Science 2024-07-26 Hongwei Jin , George Papadimitriou , Krishnan Raghavan , Pawel Zuk , Prasanna Balaprakash , Cong Wang , Anirban Mandal , Ewa Deelman

Recent advancements in large-scale visual-language pre-trained models have led to significant progress in zero-/few-shot anomaly detection within natural image domains. However, the substantial domain divergence between natural and medical…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Chaoqin Huang , Aofan Jiang , Jinghao Feng , Ya Zhang , Xinchao Wang , Yanfeng Wang

In recent years, multimodal large language models (MLLMs) have made significant strides by training on vast high-quality image-text datasets, enabling them to generally understand images well. However, the inherent difficulty in explicitly…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Yuanze Lin , Yunsheng Li , Dongdong Chen , Weijian Xu , Ronald Clark , Philip Torr , Lu Yuan

Zero-shot anomaly detection (ZSAD) offers potential for identifying anomalies in medical imaging without task-specific training. In this paper, we evaluate CLIP-based models, originally developed for industrial tasks, on brain tumor…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Aldo Marzullo , Marta Bianca Maria Ranzini

Weakly Supervised Monitoring Anomaly Detection (WSMAD) utilizes weak supervision learning to identify anomalies, a critical task for smart city monitoring. However, existing multimodal approaches often fail to meet the real-time and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Wen-Dong Jiang , Chih-Yung Chang , Hsiang-Chuan Chang , Ji-Yuan Chen , Diptendu Sinha Roy

Object detection traditionally relies on fixed category sets, requiring costly re-training to handle novel objects. While Open-World and Open-Vocabulary Object Detection (OWOD and OVOD) improve flexibility, OWOD lacks semantic labels for…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Furkan Mumcu , Michael J. Jones , Anoop Cherian , Yasin Yilmaz

Training-free video anomaly detection (VAD) has recently emerged as a scalable alternative to supervised approaches, yet existing methods largely rely on static prompting and geometry-agnostic feature fusion. As a result, anomaly inference…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Ali Zia , Usman Ali , Muhammad Umer Ramzan , Hamza Abid , Abdul Rehman , Wei Xiang

Reliable anomaly detection is essential for ensuring the safety of autonomous robots, particularly when conventional detection systems based on vision or LiDAR become unreliable in adverse or unpredictable conditions. In such scenarios,…

Robotics · Computer Science 2025-05-12 Yizhuo Yang , Jiulin Zhao , Xinhang Xu , Kun Cao , Shenghai Yuan , Lihua Xie