English
Related papers

Related papers: Gradpaint: Gradient-Guided Inpainting with Diffusi…

200 papers

Denoising diffusion probabilistic models (DDPMs) can be utilized to recover a clean signal from its degraded observation(s) by conditioning the model on the degraded signal. The degraded signals are themselves contaminated versions of the…

Image and Video Processing · Electrical Eng. & Systems 2025-06-10 Ching-Hua Lee , Chouchang Yang , Jaejin Cho , Yashas Malur Saidutta , Rakshith Sharma Srinivasa , Yilin Shen , Hongxia Jin

Analysis of galaxy--galaxy strong lensing systems is strongly dependent on any prior assumptions made about the appearance of the source. Here we present a method of imposing a data-driven prior / regularisation for source galaxies based on…

Instrumentation and Methods for Astrophysics · Physics 2022-11-09 Konstantin Karchev , Noemi Anau Montel , Adam Coogan , Christoph Weniger

The vast applications of deep generative models are anchored in three core capabilities -- generating new instances, reconstructing inputs, and learning compact representations -- across various data types, such as discrete text/protein…

Machine Learning · Computer Science 2024-06-06 Guangyi Liu , Yu Wang , Zeyu Feng , Qiyu Wu , Liping Tang , Yuan Gao , Zhen Li , Shuguang Cui , Julian McAuley , Zichao Yang , Eric P. Xing , Zhiting Hu

Segmentation masks of pathological areas are useful in many medical applications, such as brain tumour and stroke management. Moreover, healthy counterfactuals of diseased images can be used to enhance radiologists' training files and to…

Image and Video Processing · Electrical Eng. & Systems 2024-10-02 Alessandro Fontanella , Grant Mair , Joanna Wardlaw , Emanuele Trucco , Amos Storkey

The problem of inpainting involves reconstructing the missing areas of an image. Inpainting has many applications, such as reconstructing old damaged photographs or removing obfuscations from images. In this paper we present the directional…

Computer Vision and Pattern Recognition · Computer Science 2015-11-12 Jan Deriu , Rolf Jagerman , Kai-En Tsay

Diffusion models have emerged as highly effective techniques for inpainting, however, they remain constrained by slow sampling rates. While recent advances have enhanced generation quality, they have also increased sampling time, thereby…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Tsiry Mayet , Pourya Shamsolmoali , Simon Bernard , Eric Granger , Romain Hérault , Clement Chatelain

Medical image segmentation is a challenging task, made more difficult by many datasets' limited size and annotations. Denoising diffusion probabilistic models (DDPM) have recently shown promise in modelling the distribution of natural…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Margherita Rosnati , Melanie Roschewitz , Ben Glocker

Simulation-based approaches to microstructure generation can suffer from a variety of limitations, such as high memory usage, long computational times, and difficulties in generating complex geometries. Generative machine learning models…

Graphics · Computer Science 2025-03-10 Nathan Hoffman , Cashen Diniz , Dehao Liu , Theron Rodgers , Anh Tran , Mark Fuge

We present a comprehensive comparative study of three generative modeling paradigms: Denoising Diffusion Probabilistic Models (DDPM), Conditional Flow Matching (CFM), and MeanFlow. While DDPM and CFM require iterative sampling, MeanFlow…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Umang Agarwal , Rudraksh Sangore , Sumit Laddha

In recent years, diffusion models (DMs) have become a popular method for generating synthetic data. By achieving samples of higher quality, they quickly became superior to generative adversarial networks (GANs) and the current…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Denisa Qosja , Simon Wagner , Daniel O'Hagan

Generative diffusion processes are an emerging and effective tool for image and speech generation. In the existing methods, the underlying noise distribution of the diffusion process is Gaussian noise. However, fitting distributions with…

Signal Processing · Electrical Eng. & Systems 2021-10-13 Eliya Nachmani , Robin San Roman , Lior Wolf

With the incredible results achieved from generative pre-trained transformers (GPT) and diffusion models, generative AI (GenAI) is envisioned to yield remarkable breakthroughs in various industrial and academic domains. In this paper, we…

Information Theory · Computer Science 2023-09-19 Mehdi Letafati , Samad Ali , Matti Latva-aho

Diffusion-based generative models have recently emerged as powerful solutions for high-quality synthesis in multiple domains. Leveraging the bidirectional Markov chains, diffusion probabilistic models generate samples by inferring the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Mengyi Zhao , Mengyuan Liu , Bin Ren , Shuling Dai , Nicu Sebe

Diffusion Probabilistic Methods are employed for state-of-the-art image generation. In this work, we present a method for extending such models for performing image segmentation. The method learns end-to-end, without relying on a…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Tomer Amit , Tal Shaharbany , Eliya Nachmani , Lior Wolf

Image dehazing is quite challenging in dense-haze scenarios, where quite less original information remains in the hazy image. Though previous methods have made marvelous progress, they still suffer from information loss in content and color…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Hu Yu , Jie Huang , Kaiwen Zheng , Feng Zhao

Manipulating transparent objects presents significant challenges due to the complexities introduced by their reflection and refraction properties, which considerably hinder the accurate estimation of their 3D shapes. To address these…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Haoxiao Wang , Kaichen Zhou , Binrui Gu , Zhiyuan Feng , Weijie Wang , Peilin Sun , Yicheng Xiao , Jianhua Zhang , Hao Dong

Constructing a highly accurate handwritten OCR system requires large amounts of representative training data, which is both time-consuming and expensive to collect. To mitigate the issue, we propose a denoising diffusion probabilistic model…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Haisong Ding , Bozhi Luan , Dongnan Gui , Kai Chen , Qiang Huo

Image synthesis has seen significant advancements with the advent of diffusion-based generative models like Denoising Diffusion Probabilistic Models (DDPM) and text-to-image diffusion models. Despite their efficacy, there is a dearth of…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Ruipeng Ma , Jinhao Duan , Fei Kong , Xiaoshuang Shi , Kaidi Xu

Text-to-image generative models have attracted rising attention for flexible image editing via user-specified descriptions. However, text descriptions alone are not enough to elaborate the details of subjects, often compromising the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Xin Zhang , Jiaxian Guo , Paul Yoo , Yutaka Matsuo , Yusuke Iwasawa

Diffusion Probabilistic Models (DPMs) have emerged as the de facto approach for high-fidelity image synthesis, operating diffusion processes on continuous VAE latent, which significantly differ from the text generation methods employed by…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Xiaoping Wu , Jie Hu , Xiaoming Wei