English
Related papers

Related papers: DetDiffusion: Synergizing Generative and Perceptiv…

200 papers

The availability of data is limited in some fields, especially for object detection tasks, where it is necessary to have correctly labeled bounding boxes around each object. A notable example of such data scarcity is found in the domain of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Matteo Paiano , Stefano Martina , Carlotta Giannelli , Filippo Caruso

Object detectors often suffer a decrease in performance due to the large domain gap between the training data (source domain) and real-world data (target domain). Diffusion-based generative models have shown remarkable abilities in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Boyong He , Yuxiang Ji , Zhuoyue Tan , Liaoni Wu

Deep learning-based food image classification enables precise identification of food categories, further facilitating accurate nutritional analysis. However, real-world food images often show a skewed distribution, with some food types…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 GaYeon Koh , Hyun-Jic Oh , Jeonghyun Noh , Won-Ki Jeong

Diffusion models have demonstrated remarkable efficacy in generating high-quality samples. Existing diffusion-based image restoration algorithms exploit pre-trained diffusion models to leverage data priors, yet they still preserve elements…

Image and Video Processing · Electrical Eng. & Systems 2024-08-07 Hongjie Wu , Linchao He , Mingqin Zhang , Dongdong Chen , Kunming Luo , Mengting Luo , Ji-Zhe Zhou , Hu Chen , Jiancheng Lv

Generative models such as Generative Adversarial Networks (GANs) and Variational Auto-Encoders (VAEs) are widely utilized to model the generative process of user interactions. However, these generative models suffer from intrinsic…

Information Retrieval · Computer Science 2025-06-26 Wenjie Wang , Yiyan Xu , Fuli Feng , Xinyu Lin , Xiangnan He , Tat-Seng Chua

This paper explores the challenges and benefits of a trainable destruction process in diffusion samplers -- diffusion-based generative models trained to sample an unnormalised density without access to data samples. Contrary to the majority…

We introduce a general framework for solving partial differential equations (PDEs) using generative diffusion models. In particular, we focus on the scenarios where we do not have the full knowledge of the scene necessary to apply classical…

Machine Learning · Computer Science 2024-11-04 Jiahe Huang , Guandao Yang , Zichen Wang , Jeong Joon Park

Denoising diffusion probabilistic models (DDPMs) have been proven capable of synthesizing high-quality images with remarkable diversity when trained on large amounts of data. However, to our knowledge, few-shot image generation tasks have…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Jingyuan Zhu , Huimin Ma , Jiansheng Chen , Jian Yuan

Diffusion-based data augmentation (DiffDA) has emerged as a promising approach to improving classification performance under data scarcity. However, existing works vary significantly in task configurations, model choices, and experimental…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Zekun Li , Yinghuan Shi , Yang Gao , Dong Xu

This report presents the comprehensive implementation, evaluation, and optimization of Denoising Diffusion Probabilistic Models (DDPMs) and Denoising Diffusion Implicit Models (DDIMs), which are state-of-the-art generative models. During…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Jaineet Shah , Michael Gromis , Rickston Pinto

Despite the notable accomplishments of deep object detection models, a major challenge that persists is the requirement for extensive amounts of training data. The process of procuring such real-world data is a laborious undertaking, which…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Roy Voetman , Maya Aghaei , Klaas Dijkstra

Recently, large-scale diffusion models, e.g., Stable diffusion and DallE2, have shown remarkable results on image synthesis. On the other hand, large-scale cross-modal pre-trained models (e.g., CLIP, ALIGN, and FILIP) are competent for…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Runhui Huang , Jianhua Han , Guansong Lu , Xiaodan Liang , Yihan Zeng , Wei Zhang , Hang Xu

Effectively addressing the challenge of industrial Anomaly Detection (AD) necessitates an ample supply of defective samples, a constraint often hindered by their scarcity in industrial contexts. This paper introduces a novel algorithm…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Hanxi Li , Zhengxun Zhang , Hao Chen , Lin Wu , Bo Li , Deyin Liu , Mingwen Wang

Deep generative models have been studied and developed primarily in the context of natural images and computer vision. This has spurred the development of (Bayesian) methods that use these generative models for inverse problems in image…

Signal Processing · Electrical Eng. & Systems 2025-04-17 Tristan S. W. Stevens , Jeroen Overdevest , Oisín Nolan , Wessel L. van Nierop , Ruud J. G. van Sloun , Yonina C. Eldar

Synthetic data generation is an important application of machine learning in the field of medical imaging. While existing approaches have successfully applied fine-tuned diffusion models for synthesizing medical images, we explore potential…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Lakshmi Nair

Despite the tremendous success of diffusion generative models in text-to-image generation, replicating this success in the domain of image compression has proven difficult. In this paper, we demonstrate that diffusion can significantly…

Image and Video Processing · Electrical Eng. & Systems 2024-03-11 Emiel Hoogeboom , Eirikur Agustsson , Fabian Mentzer , Luca Versari , George Toderici , Lucas Theis

Large-scale generative models have achieved remarkable advancements in various visual tasks, yet their application to shadow removal in images remains challenging. These models often generate diverse, realistic details without adequate…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Xinjie Li , Yang Zhao , Dong Wang , Yuan Chen , Li Cao , Xiaoping Liu

Diffusion models have achieved state-of-the-art synthesis quality on both visual and audio tasks, and recent works further adapt them to textual data by diffusing on the embedding space. In this paper, we conduct systematic studies of the…

Computation and Language · Computer Science 2024-04-23 Zhujin Gao , Junliang Guo , Xu Tan , Yongxin Zhu , Fang Zhang , Jiang Bian , Linli Xu

Generative foundation models like Stable Diffusion comprise a diverse spectrum of knowledge in computer vision with the potential for transfer learning, e.g., via generating data to train student models for downstream tasks. This could…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Leonhard Hennicke , Christian Medeiros Adriano , Holger Giese , Jan Mathias Koehler , Lukas Schott

In this work we study how diffusion-based generative models produce high-dimensional data, such as an image, by implicitly relying on a manifestation of a low-dimensional set of latent abstractions, that guide the generative process. We…

Machine Learning · Computer Science 2024-10-07 Giulio Franzese , Mattia Martini , Giulio Corallo , Paolo Papotti , Pietro Michiardi