English
Related papers

Related papers: Generative modelling with jump-diffusions

200 papers

The theory of sparse stochastic processes offers a broad class of statistical models to study signals. In this framework, signals are represented as realizations of random processes that are solution of linear stochastic differential…

Probability · Mathematics 2017-02-17 Julien Fageot , Virginie Uhlmann , Michael Unser

Denoising diffusion models have become ubiquitous for generative modeling. The core idea is to transport the data distribution to a Gaussian by using a diffusion. Approximate samples from the data distribution are then obtained by…

Standard diffusion models involve an image transform -- adding Gaussian noise -- and an image restoration operator that inverts this degradation. We observe that the generative behavior of diffusion models is not strongly dependent on the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Arpit Bansal , Eitan Borgnia , Hong-Min Chu , Jie S. Li , Hamid Kazemi , Furong Huang , Micah Goldblum , Jonas Geiping , Tom Goldstein

We present a concise derivation for several influential score-based diffusion models that relies on only a few textbook results. Diffusion models have recently emerged as powerful tools for generating realistic, synthetic signals --…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Chicago Y. Park , Michael T. McCann , Cristina Garcia-Cardona , Brendt Wohlberg , Ulugbek S. Kamilov

Score-based diffusion models are a highly effective method for generating samples from a distribution of images. We consider scenarios where the training data comes from a noisy version of the target distribution, and present an efficiently…

Machine Learning · Statistics 2025-09-30 Dennis Elbrächter , Giovanni S. Alberti , Matteo Santacesaria

We propose a framework to perform Bayesian inference using conditional score-based diffusion models to solve a class of inverse problems in mechanics involving the inference of a specimen's spatially varying material properties from noisy…

We propose DiffSep, a new single channel source separation method based on score-matching of a stochastic differential equation (SDE). We craft a tailored continuous time diffusion-mixing process starting from the separated sources and…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-03 Robin Scheibler , Youna Ji , Soo-Whan Chung , Jaeuk Byun , Soyeon Choe , Min-Seok Choi

Drifting models train one-step generators by optimizing a kernel-induced mean-shift discrepancy between the data and model distributions, with Laplace kernels used by default in practice. At each point, this discrepancy compares the…

Machine Learning · Computer Science 2026-05-18 Chieh-Hsin Lai , Bac Nguyen , Naoki Murata , Yuhta Takida , Toshimitsu Uesaka , Yuki Mitsufuji , Stefano Ermon , Molei Tao

Diffusion probabilistic models have demonstrated an outstanding capability to model natural images and raw audio waveforms through a paired diffusion and reverse processes. The unique property of the reverse process (namely, eliminating…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-23 Yen-Ju Lu , Yu Tsao , Shinji Watanabe

Geophysical inverse problems are often ill-posed and admit multiple solutions. Conventional discriminative methods typically yield a single deterministic solution, which fails to model the posterior distribution, cannot generate diverse…

Score diffusion methods can learn probability densities from samples. The score of the noise-corrupted density is estimated using a deep neural network, which is then used to iteratively transport a Gaussian white noise density to a target…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Zahra Kadkhodaie , Stéphane Mallat , Eero P. Simoncelli

Diffusion models have attracted a lot of attention in recent years. These models view speech generation as a continuous-time process. For efficient training, this process is typically restricted to additive Gaussian noising, which is…

Machine Learning · Computer Science 2025-10-14 Xiaozhou Tan , Minghui Zhao , Anton Ragni

Diffusion-based generative models learn to iteratively transfer unstructured noise to a complex target distribution as opposed to Generative Adversarial Networks (GANs) or the decoder of Variational Autoencoders (VAEs) which produce samples…

Machine Learning · Computer Science 2022-10-26 Sarthak Mittal , Guillaume Lajoie , Stefan Bauer , Arash Mehrjou

While diffusion models have shown great success in image generation, their noise-inverting generative process does not explicitly consider the structure of images, such as their inherent multi-scale nature. Inspired by diffusion models and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Severi Rissanen , Markus Heinonen , Arno Solin

Score-based Generative Models (SGMs) have demonstrated exceptional synthesis outcomes across various tasks. However, the current design landscape of the forward diffusion process remains largely untapped and often relies on physical…

Machine Learning · Computer Science 2023-10-13 Kushagra Pandey , Stephan Mandt

Score-based generative models, which transform noise into data by learning to reverse a diffusion process, have become a cornerstone of modern generative AI. This paper contributes to establishing theoretical guarantees for the probability…

Machine Learning · Statistics 2025-02-03 Jiaqi Tang , Yuling Yan

Diffusion models that can generate high-quality data from randomly sampled Gaussian noises have become the mainstream generative method in both academia and industry. Are randomly sampled Gaussian noises equally good for diffusion models?…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Zipeng Qi , Lichen Bai , Haoyi Xiong , Zeke Xie

Diffusion models have been recently studied as powerful generative inverse problem solvers, owing to their high quality reconstructions and the ease of combining existing iterative solvers. However, most works focus on solving simple linear…

Machine Learning · Statistics 2025-10-06 Hyungjin Chung , Jeongsol Kim , Michael T. Mccann , Marc L. Klasky , Jong Chul Ye

Score-based diffusion models demonstrate superior performance in generative tasks but encounter fundamental bottlenecks in inverse problems due to the analytical intractability of the time-dependent likelihood score. To bridge this gap, we…

Optimization and Control · Mathematics 2026-05-28 Boyang Zhang , Zhiguo Wang , Ya-Feng Liu

Score-based generative models (SGMs) are powerful tools to sample from complex data distributions. Their underlying idea is to (i) run a forward process for time $T_1$ by adding noise to the data, (ii) estimate its score function, and (iii)…

Machine Learning · Computer Science 2024-06-06 Francesco Pedrotti , Jan Maas , Marco Mondelli