English
Related papers

Related papers: VLMDiff: Leveraging Vision-Language Models for Mul…

200 papers

In recent years, the emergence of models capable of generating images from text has attracted considerable interest, offering the possibility of creating realistic images from text descriptions. Yet these advances have also raised concerns…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Mamadou Keita , Wassim Hamidouche , Hassen Bougueffa , Abdenour Hadid , Abdelmalik Taleb-Ahmed

Vision-Language Models (VLMs) such as CLIP are trained on large amounts of image-text pairs, resulting in remarkable generalization across several data distributions. However, in several cases, their expensive training and data…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Sravanti Addepalli , Ashish Ramayee Asokan , Lakshay Sharma , R. Venkatesh Babu

As one of the most successful generative models, diffusion models have demonstrated remarkable efficacy in synthesizing high-quality images. These models learn the underlying high-dimensional data distribution in an unsupervised manner.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Min Hou , Yueying Wu , Chang Xu , Yu-Hao Huang , Chenxi Bai , Le Wu , Jiang Bian

The impressive achievements of generative models in creating high-quality videos have raised concerns about digital integrity and privacy vulnerabilities. Recent works of AI-generated content detection have been widely studied in the image…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Qingyuan Liu , Yun-Yun Tsai , Ruijian Zha , Victoria Li , Pengyuan Shi , Chengzhi Mao , Junfeng Yang

Diffusion models (DMs) have become the new trend of generative models and have demonstrated a powerful ability of conditional synthesis. Among those, text-to-image diffusion models pre-trained on large-scale image-text pairs are highly…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Wenliang Zhao , Yongming Rao , Zuyan Liu , Benlin Liu , Jie Zhou , Jiwen Lu

Building state-of-the-art Vision-Language Models (VLMs) with strong captioning capabilities typically necessitates training on billions of high-quality image-text pairs, requiring millions of GPU hours. This paper introduces the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Tiezheng Zhang , Yitong Li , Yu-cheng Chou , Jieneng Chen , Alan Yuille , Chen Wei , Junfei Xiao

A recent endeavor in one class of video anomaly detection is to leverage diffusion models and posit the task as a generation problem, where the diffusion model is trained to recover normal patterns exclusively, thus reporting abnormal…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Hang Zhou , Jiale Cai , Yuteng Ye , Yonghui Feng , Chenxing Gao , Junqing Yu , Zikai Song , Wei Yang

The introduction of diffusion models in anomaly detection has paved the way for more effective and accurate image reconstruction in pathologies. However, the current limitations in controlling noise granularity hinder diffusion models'…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Cosmin I. Bercea , Michael Neumayr , Daniel Rueckert , Julia A. Schnabel

As the real propagation environment becomes in creasingly complex and dynamic, millimeter wave beam prediction faces huge challenges. However, the powerful cross modal representation capability of vision-language model (VLM) provides a…

Signal Processing · Electrical Eng. & Systems 2025-08-18 Ji Wang , Bin Tang , Jian Xiao , Qimei Cui , Xingwang Li , Tony Q. S. Quek

Recent advances in multimodal large language models (MLLMs) have enabled image-based question-answering capabilities. However, a key limitation is the use of CLIP as the visual encoder; while it can capture coarse global information, it…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Vatsal Agarwal , Matthew Gwilliam , Gefen Kohavi , Eshan Verma , Daniel Ulbricht , Abhinav Shrivastava

Explainable anomaly detection methods often have the capability to identify and spatially localise anomalies within an image but lack the capability to differentiate the type of anomaly. Furthermore, they often require the costly training…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Alex George , Lyudmila Mihaylova , Sean Anderson

This paper explores the utility of diffusion-based models for anomaly detection, focusing on their efficacy in identifying deviations in both compact and high-resolution datasets. Diffusion-based architectures, including Denoising Diffusion…

Machine Learning · Computer Science 2024-12-11 Aryan Bhosale , Samrat Mukherjee , Biplab Banerjee , Fabio Cuzzolin

Large language models (LLMs) have demonstrated that large-scale pretraining enables systems to adapt rapidly to new problems with little supervision in the language domain. This success, however, has not translated as effectively to the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Pablo Acuaviva , Aram Davtyan , Mariam Hassan , Sebastian Stapf , Ahmad Rahimi , Alexandre Alahi , Paolo Favaro

Digital watermarking is essential for securing generated images from diffusion models. Accurate watermark evaluation is critical for algorithm development, yet existing methods have significant limitations: they lack a unified framework for…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Zijin Yang , Yu Sun , Kejiang Chen , Jiawei Zhao , Jun Jiang , Weiming Zhang , Nenghai Yu

Video Anomaly Detection (VAD) is a fundamental challenge in computer vision, particularly due to the open-set nature of anomalies. While recent training-free approaches utilizing Vision-Language Models (VLMs) have shown promise, they…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Lokman Bekit , Hamza Karim , Nghia T Nguyen , Yasin Yilmaz

Recently, the application of diffusion probabilistic models has advanced speech enhancement through generative approaches. However, existing diffusion-based methods have focused on the generation process in high-dimensional waveform or…

Sound · Computer Science 2025-01-20 Shengkui Zhao , Zexu Pan , Kun Zhou , Yukun Ma , Chong Zhang , Bin Ma

Image anomaly detection plays a vital role in applications such as industrial quality inspection and medical imaging, where it directly contributes to improving product quality and system reliability. However, existing methods often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Zekang Weng , Jinjin Shi , Jinwei Wang , Zeming Han

Vision-language models (VLMs) have enabled strong zero-shot classification through image-text alignment. Yet, their purely visual inference capabilities remain under-explored. In this work, we conduct a comprehensive evaluation of both…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Illia Volkov , Nikita Kisel , Klara Janouskova , Jiri Matas

The collection and detection of video anomaly data has long been a challenging problem due to its rare occurrence and spatio-temporal scarcity. Existing video anomaly detection (VAD) methods under perform in open-world scenarios. Key…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zunkai Dai , Ke Li , Jiajia Liu , Jie Yang , Yuanyuan Qiao

Novel Class Discovery aims to utilise prior knowledge of known classes to classify and discover unknown classes from unlabelled data. Existing NCD methods for images primarily rely on visual features, which suffer from limitations such as…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Yuetong Su , Baoguo Wei , Xinyu Wang , Xu Li , Lixin Li