English
Related papers

Related papers: Generative diffusion in very large dimensions

200 papers

We investigate statistical properties of a likelihood approach to nonparametric estimation of a singular distribution using deep generative models. More specifically, a deep generative model is used to model high-dimensional data that are…

Machine Learning · Statistics 2023-03-29 Minwoo Chae , Dongha Kim , Yongdai Kim , Lizhen Lin

In this study we develop dimension-reduction techniques to accelerate diffusion model inference in the context of synthetic data generation. The idea is to integrate compressed sensing into diffusion models (hence, CSDM): First, compress…

Machine Learning · Statistics 2025-09-30 Zhengyi Guo , Jiatu Li , Wenpin Tang , David D. Yao

Inverse problems aim to determine parameters from observations, a crucial task in engineering and science. Lately, generative models, especially diffusion models, have gained popularity in this area for their ability to produce realistic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Gabriel della Maggiora , Luis Alberto Croquevielle , Nikita Deshpande , Harry Horsley , Thomas Heinis , Artur Yakimovich

In this work, we look at Score-based generative models (also called diffusion generative models) from a geometric perspective. From a new view point, we prove that both the forward and backward process of adding noise and generating from…

Machine Learning · Computer Science 2023-02-10 Sandesh Ghimire , Jinyang Liu , Armand Comas , Davin Hill , Aria Masoomi , Octavia Camps , Jennifer Dy

We train a generative diffusion model (DM) to simulate ultra-relativistic heavy-ion collisions from end to end. The model takes initial entropy density profiles as input and produces two-dimensional final particle spectra, successfully…

Nuclear Theory · Physics 2025-10-14 Jing-An Sun , Li Yan , Charles Gale , Sangyong Jeon

In a preliminary attempt to address the problem of data scarcity in physics-based machine learning, we introduce a novel methodology for data generation in physics-based simulations. Our motivation is to overcome the limitations posed by…

Fluid Dynamics · Physics 2023-06-21 Rucha Apte , Sheel Nidhan , Rishikesh Ranade , Jay Pathak

This study evaluates the potential of generative models, trained on historical ERA5 reanalysis data, for simulating windstorms over the UK. Four generative models, including a standard GAN, a WGAN-GP, a U-net diffusion model, and a…

Atmospheric and Oceanic Physics · Physics 2025-01-28 Yee Chun Tsoi , Kieran M. R. Hunt , Len Shaffrey , Atta Badii , Richard Dixon , Ludovico Nicotina

Deep generative models such as GANs, normalizing flows, and diffusion models are powerful regularizers for inverse problems. They exhibit great potential for helping reduce ill-posedness and attain high-quality results. However, the latent…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Dongzhuo Li

Modern Generative Adversarial Networks are capable of creating artificial, photorealistic images from latent vectors living in a low-dimensional learned latent space. It has been shown that a wide range of images can be projected into this…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Jonas Wulff , Antonio Torralba

Identifying model parameters from observed configurations poses a fundamental challenge in data science, especially with limited data. Recently, diffusion models have emerged as a novel paradigm in generative machine learning, capable of…

Data Analysis, Statistics and Probability · Physics 2025-03-14 Yechan Lim , Sangwon Lee , Junghyo Jo

We derive a novel generative model from iterative Gaussian posterior inference. By treating the generated sample as an unknown variable, we can formulate the sampling process in the language of Bayesian probability. Our model uses a…

Machine Learning · Computer Science 2026-01-28 Marten Lienen , Marcel Kollovieh , Stephan Günnemann

Deep generative models provide a systematic way to learn nonlinear data distributions, through a set of latent variables and a nonlinear "generator" function that maps latent points into the input space. The nonlinearity of the generator…

Machine Learning · Statistics 2021-12-14 Georgios Arvanitidis , Lars Kai Hansen , Søren Hauberg

The latest developments in Artificial Intelligence include diffusion generative models, quite popular tools which can produce original images both unconditionally and, in some cases, conditioned by some inputs provided by the user. Apart…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Stefano Scotta , Alberto Messina

We present a class of diffusion-based algorithms to draw samples from high-dimensional probability distributions given their unnormalized densities. Ideally, our methods can transport samples from a Gaussian distribution to a specified…

Machine Learning · Computer Science 2025-02-04 Anand Jerry George , Nicolas Macris

Denoising diffusion models are a powerful type of generative models used to capture complex distributions of real-world signals. However, their applicability is limited to scenarios where training samples are readily available, which is not…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Ayush Tewari , Tianwei Yin , George Cazenavette , Semon Rezchikov , Joshua B. Tenenbaum , Frédo Durand , William T. Freeman , Vincent Sitzmann

Inverse design refers to the problem of optimizing the input of an objective function in order to enact a target outcome. For many real-world engineering problems, the objective function takes the form of a simulator that predicts how the…

Diffusion models have attained prominence for their ability to synthesize a probability distribution for a given dataset via a diffusion process, enabling the generation of new data points with high fidelity. However, diffusion processes…

Machine Learning · Computer Science 2024-11-25 Shervin Khalafi , Dongsheng Ding , Alejandro Ribeiro

Two-dimensional array-based datasets are pervasive in a variety of domains. Current approaches for generative modeling have typically been limited to conventional image datasets and performed in the pixel domain which do not explicitly…

Machine Learning · Computer Science 2021-07-12 Hoda Shajari , Jaemoon Lee , Sanjay Ranka , Anand Rangarajan

Generative diffusion models have emerged as a powerful class of models in machine learning, yet a unified theoretical understanding of their operation is still developing. This paper provides an integrated perspective on generative…

Machine Learning · Statistics 2026-03-27 Dejan Stancevic , Luca Ambrogioni

Over the last years, deep learning methods have become an increasingly popular choice to solve tasks from the field of inverse problems. Many of these new data-driven methods have produced impressive results, although most only give point…

Image and Video Processing · Electrical Eng. & Systems 2021-10-28 Alexander Denker , Maximilian Schmidt , Johannes Leuschner , Peter Maass