English
Related papers

Related papers: Understanding DDPM Latent Codes Through Optimal Tr…

200 papers

Through Diffusion Models (DMs), we have made significant advances in generating high-quality images. Our exploration of these models delves deeply into their core operational principles by systematically investigating key aspects across…

Machine Learning · Computer Science 2024-02-22 Karam Ghanem , Danilo Bzdok

Denoising diffusion probabilistic models (DDPM) are a class of generative models which have recently been shown to produce excellent samples. We show that with a few simple modifications, DDPMs can also achieve competitive log-likelihoods…

Machine Learning · Computer Science 2021-02-22 Alex Nichol , Prafulla Dhariwal

Deep learning models in the Earth Observation domain heavily rely on the availability of large-scale accurately labeled satellite imagery. However, obtaining and labeling satellite imagery is a resource-intensive endeavor. While generative…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Orkhan Baghirli , Hamid Askarov , Imran Ibrahimli , Ismat Bakhishov , Nabi Nabiyev

As a widely recognized approach to deep generative modeling, Variational Auto-Encoders (VAEs) still face challenges with the quality of generated images, often presenting noticeable blurriness. This issue stems from the unrealistic…

Machine Learning · Computer Science 2023-05-22 Georgios Batzolis , Jan Stanczuk , Carola-Bibiane Schönlieb

Score-based diffusion models have achieved remarkable empirical success in generating high-quality samples from target data distributions. Among them, the Denoising Diffusion Probabilistic Model (DDPM) is one of the most widely used…

Machine Learning · Statistics 2025-12-16 Yuchen Jiao , Yuchen Zhou , Gen Li

Diffusion maps approximate the generator of Langevin dynamics from simulation data. They afford a means of identifying the slowly-evolving principal modes of high-dimensional molecular systems. When combined with a biasing mechanism,…

Data Analysis, Statistics and Probability · Physics 2020-07-01 Zofia Trstanova , Ben Leimkuhler , Tony Lelièvre

Diffusion Probabilistic Models (DPMs) have shown a powerful capacity of generating high-quality image samples. Recently, diffusion autoencoders (Diff-AE) have been proposed to explore DPMs for representation learning via autoencoding. Their…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Zijian Zhang , Zhou Zhao , Zhijie Lin

The blooming diffusion probabilistic models (DPMs) have garnered significant interest due to their impressive performance and the elegant inspiration they draw from physics. While earlier DPMs relied upon the Markovian assumption, recent…

Artificial Intelligence · Computer Science 2023-12-12 Bowen Sun , Shibao Zheng

Denoising diffusion probabilistic models are currently becoming the leading paradigm of generative modeling for many important data modalities. Being the most prevalent in the computer vision community, diffusion models have also recently…

Machine Learning · Computer Science 2024-10-08 Akim Kotelnikov , Dmitry Baranchuk , Ivan Rubachev , Artem Babenko

When deploying a trained machine learning model in the real world, it is inevitable to receive inputs from out-of-distribution (OOD) sources. For instance, in continual learning settings, it is common to encounter OOD samples due to the…

Machine Learning · Computer Science 2024-01-23 Chuanwen Feng , Wenlong Chen , Ao Ke , Yilong Ren , Xike Xie , S. Kevin Zhou

In recent years, diffusion models (DMs) have become a popular method for generating synthetic data. By achieving samples of higher quality, they quickly became superior to generative adversarial networks (GANs) and the current…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Denisa Qosja , Simon Wagner , Daniel O'Hagan

Computed tomography (CT) serves as an effective tool for lung cancer screening, diagnosis, treatment, and prognosis, providing a rich source of features to quantify temporal and spatial tumor changes. Nonetheless, the diversity of CT…

Image and Video Processing · Electrical Eng. & Systems 2023-10-10 Md Selim , Jie Zhang , Faraneh Fathi , Michael A. Brooks , Ge Wang , Guoqiang Yu , Jin Chen

Recent findings for optimal transport maps between distribution functions sharing the same copula show that componentwise the solution is the optimal map between marginal distributions. This is an important discovery since in the…

Probability · Mathematics 2020-07-15 Novin Ghaffari , Stephen Walker

Dimension reduction techniques usually lose information in the sense that reconstructed data are not identical to the original data. However, we argue that it is possible to have reconstructed data identically distributed as the original…

Machine Learning · Statistics 2026-05-15 Xinwei Shen , Nicolai Meinshausen

Several problems in machine learning are naturally expressed as the design and analysis of time-evolving probability distributions. This includes sampling via diffusion methods, optimizing the weights of neural networks, and analyzing the…

Optimization and Control · Mathematics 2026-05-28 Gabriel Peyré

Medical image segmentation is a challenging task, made more difficult by many datasets' limited size and annotations. Denoising diffusion probabilistic models (DDPM) have recently shown promise in modelling the distribution of natural…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Margherita Rosnati , Melanie Roschewitz , Ben Glocker

In this paper, we study the diffusability (learnability) of variational autoencoders (VAE) in latent diffusion. First, we show that pixel-space diffusion trained with an MSE objective is inherently biased toward learning low and mid spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Mang Ning , Mingxiao Li , Le Zhang , Lanmiao Liu , Matthew B. Blaschko , Albert Ali Salah , Itir Onal Ertugrul

In this paper, we introduce a novel approach for autonomous driving trajectory generation by harnessing the complementary strengths of diffusion probabilistic models (a.k.a., diffusion models) and transformers. Our proposed framework,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Chen Yang , Yangfan He , Aaron Xuxiang Tian , Dong Chen , Jianhui Wang , Tianyu Shi , Arsalan Heydarian , Pei Liu

In this work, we present a theoretical and computational framework for constructing stochastic transport maps between probability distributions using diffusion processes. We begin by proving that the time-marginal distribution of the sum of…

Probability · Mathematics 2025-03-27 Xicheng Zhang

Textual network embedding leverages rich text information associated with the network to learn low-dimensional vectorial representations of vertices. Rather than using typical natural language processing (NLP) approaches, recent research…

Computation and Language · Computer Science 2019-01-15 Xinyuan Zhang , Yitong Li , Dinghan Shen , Lawrence Carin