English
Related papers

Related papers: Score-based Denoising Diffusion with Non-Isotropic…

200 papers

Creating noise from data is easy; creating data from noise is generative modeling. We present a stochastic differential equation (SDE) that smoothly transforms a complex data distribution to a known prior distribution by slowly injecting…

Machine Learning · Computer Science 2021-02-11 Yang Song , Jascha Sohl-Dickstein , Diederik P. Kingma , Abhishek Kumar , Stefano Ermon , Ben Poole

Diffusion-based Deep Generative Models (DDGMs) offer state-of-the-art performance in generative modeling. Their main strength comes from their unique setup in which a model (the backward diffusion process) is trained to reverse the forward…

Machine Learning · Computer Science 2022-06-02 Kamil Deja , Anna Kuzina , Tomasz Trzciński , Jakub M. Tomczak

Probabilistic regression models the entire predictive distribution of a response variable, offering richer insights than classical point estimates and directly allowing for uncertainty quantification. While diffusion-based generative models…

Machine Learning · Computer Science 2025-10-07 Carlo Kneissl , Christopher Bülte , Philipp Scholl , Gitta Kutyniok

Denoising diffusion models have proven to be a flexible and effective paradigm for generative modelling. Their recent extension to infinite dimensional Euclidean spaces has allowed for the modelling of stochastic processes. However, many…

Score-based generative models (SGMs) are a powerful class of generative models that exhibit remarkable empirical performance. Score-based generative modelling (SGM) consists of a ``noising'' stage, whereby a diffusion is used to gradually…

Machine Learning · Computer Science 2022-11-23 Valentin De Bortoli , Emile Mathieu , Michael Hutchinson , James Thornton , Yee Whye Teh , Arnaud Doucet

Building on recent advances in image generation, we present a fully data-driven approach to rendering markup into images. The approach is based on diffusion models, which parameterize the distribution of data using a sequence of denoising…

Machine Learning · Computer Science 2022-10-12 Yuntian Deng , Noriyuki Kojima , Alexander M. Rush

We propose a novel deep network architecture for image\\ denoising based on a Gaussian Conditional Random Field (GCRF) model. In contrast to the existing discriminative denoising methods that train a separate model for each noise level, the…

Computer Vision and Pattern Recognition · Computer Science 2015-11-13 Raviteja Vemulapalli , Oncel Tuzel , Ming-Yu Liu

Iterative generative models, such as noise conditional score networks and denoising diffusion probabilistic models, produce high quality samples by gradually denoising an initial noise vector. However, their denoising process has many…

Machine Learning · Computer Science 2021-01-08 Eric Luhman , Troy Luhman

Score-based generative models have emerged as alternatives to generative adversarial networks (GANs) and normalizing flows for tasks involving learning and sampling from complex image distributions. In this work we investigate the ability…

Cosmology and Nongalactic Astrophysics · Physics 2022-11-23 Nayantara Mudur , Douglas P. Finkbeiner

Score-based model research in the last few years has produced state of the art generative models by employing Gaussian denoising score-matching (DSM). However, the Gaussian noise assumption has several high-dimensional limitations,…

Machine Learning · Computer Science 2022-04-13 Jacob Deasy , Nikola Simidjievski , Pietro Liò

Image denoising is an important problem in low-level vision and serves as a critical module for many image recovery tasks. Anisotropic diffusion is a wide family of image denoising approaches with promising performance. However, traditional…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Xinran Qin , Yuhui Quan , Ruotao Xu , Hui Ji

Diffusion models that can generate high-quality data from randomly sampled Gaussian noises have become the mainstream generative method in both academia and industry. Are randomly sampled Gaussian noises equally good for diffusion models?…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Zipeng Qi , Lichen Bai , Haoyi Xiong , Zeke Xie

We present a concise, self-contained derivation of diffusion-based generative models. Starting from basic properties of Gaussian distributions (densities, quadratic expectations, re-parameterisation, products, and KL divergences), we…

Machine Learning · Computer Science 2025-11-18 Sepehr Maleki , Negar Pourmoazemi

Real-world image denoising is an extremely important image processing problem, which aims to recover clean images from noisy images captured in natural environments. In recent years, diffusion models have achieved very promising results in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Cheng Yang , Lijing Liang , Zhixun Su

Denoising diffusion models have emerged as a powerful tool for various image generation and editing tasks, facilitating the synthesis of visual content in an unconditional or input-conditional manner. The core idea behind them is learning…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Yi Huang , Jiancheng Huang , Yifan Liu , Mingfu Yan , Jiaxi Lv , Jianzhuang Liu , Wei Xiong , He Zhang , Liangliang Cao , Shifeng Chen

Currently, applying diffusion models in pixel space of high resolution images is difficult. Instead, existing approaches focus on diffusion in lower dimensional spaces (latent diffusion), or have multiple super-resolution levels of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Emiel Hoogeboom , Jonathan Heek , Tim Salimans

Being the most cutting-edge generative methods, diffusion methods have shown great advances in wide generation tasks. Among them, graph generation attracts significant research attention for its broad application in real life. In our…

Machine Learning · Computer Science 2024-07-17 Hongyang Chen , Can Xu , Lingyu Zheng , Qiang Zhang , Xuemin Lin

A wide variety of deep generative models has been developed in the past decade. Yet, these models often struggle with simultaneously addressing three key requirements including: high sample quality, mode coverage, and fast sampling. We call…

Machine Learning · Computer Science 2022-04-06 Zhisheng Xiao , Karsten Kreis , Arash Vahdat

In recent years, deep learning models have been successfully employed for augmenting low-resolution cosmological simulations with small-scale information, a task known as "super-resolution". So far, these cosmological super-resolution…

Cosmology and Nongalactic Astrophysics · Physics 2024-11-14 Andreas Schanz , Florian List , Oliver Hahn

Most existing theoretical investigations of the accuracy of diffusion models, albeit significant, assume the score function has been approximated to a certain accuracy, and then use this a priori bound to control the error of generation.…

Machine Learning · Computer Science 2024-10-29 Yuqing Wang , Ye He , Molei Tao