English
Related papers

Related papers: Deep Generative Learning via Schr\"{o}dinger Bridg…

200 papers

There are two types of deep generative models: explicit and implicit. The former defines an explicit density form that allows likelihood inference; while the latter targets a flexible transformation from random noise to generated samples.…

Machine Learning · Computer Science 2021-10-27 Qitian Wu , Rui Gao , Hongyuan Zha

Creating noise from data is easy; creating data from noise is generative modeling. We present a stochastic differential equation (SDE) that smoothly transforms a complex data distribution to a known prior distribution by slowly injecting…

Machine Learning · Computer Science 2021-02-11 Yang Song , Jascha Sohl-Dickstein , Diederik P. Kingma , Abhishek Kumar , Stefano Ermon , Ben Poole

Modern distribution matching algorithms for training diffusion or flow models directly prescribe the time evolution of the marginal distributions between two boundary distributions. In this work, we consider a generalized distribution…

Auto encoding models have been extensively studied in recent years. They provide an efficient framework for sample generation, as well as for analysing feature learning. Furthermore, they are efficient in performing interpolations between…

Machine Learning · Statistics 2021-03-30 Adam Lindhe , Carl Ringqvist , Henrik Hult

Diffusion-based generative models have achieved promising results recently, but raise an array of open questions in terms of conceptual understanding, theoretical analysis, algorithm improvement and extensions to discrete, structured,…

Machine Learning · Computer Science 2022-09-01 Xingchao Liu , Lemeng Wu , Mao Ye , Qiang Liu

We give algorithms with provable guarantees that learn a class of deep nets in the generative model view popularized by Hinton and others. Our generative model is an $n$ node multilayer neural net that has degree at most $n^{\gamma}$ for…

Machine Learning · Computer Science 2013-10-25 Sanjeev Arora , Aditya Bhaskara , Rong Ge , Tengyu Ma

We introduce a generative learning framework to model high-dimensional parametric systems using gradient guidance and virtual observations. We consider systems described by Partial Differential Equations (PDEs) discretized with structured…

Machine Learning · Computer Science 2024-08-02 Han Gao , Sebastian Kaltenbach , Petros Koumoutsakos

We propose an Euler particle transport (EPT) approach for generative learning. The proposed approach is motivated by the problem of finding an optimal transport map from a reference distribution to a target distribution characterized by the…

Machine Learning · Computer Science 2020-12-14 Yuan Gao , Jian Huang , Yuling Jiao , Jin Liu , Xiliang Lu , Zhijian Yang

In this paper, we propose a novel self-supervised transfer learning method called \underline{\textbf{D}}istribution \underline{\textbf{M}}atching (DM), which drives the representation distribution toward a predefined reference distribution…

Machine Learning · Statistics 2025-07-03 Yuling Jiao , Wensen Ma , Defeng Sun , Hansheng Wang , Yang Wang

It is a crucial challenge to reconstruct population dynamics using unlabeled samples from distributions at coarse time intervals. Recent approaches such as flow-based models or Schr\"odinger Bridge (SB) models have demonstrated appealing…

Machine Learning · Statistics 2023-10-06 Tianrong Chen , Guan-Horng Liu , Molei Tao , Evangelos A. Theodorou

Imitation learning with diffusion models has advanced robotic control by capturing the multi-modal action distributions. However, existing methods typically treat observations only as high-level conditions to the denoising network, rather…

Artificial Intelligence · Computer Science 2026-02-05 Zhaoyang Liu , Mokai Pan , Zhongyi Wang , Kaizhen Zhu , Haotao Lu , Haipeng Zhang , Jingya Wang , Ye Shi

Denoising diffusion models have recently emerged as a powerful class of generative models. They provide state-of-the-art results, not only for unconditional simulation, but also when used to solve conditional simulation problems arising in…

Machine Learning · Statistics 2022-06-28 Yuyang Shi , Valentin De Bortoli , George Deligiannidis , Arnaud Doucet

Score-based generative models can effectively learn the distribution of data by estimating the gradient of the distribution. Due to the multi-step denoising characteristic, researchers have recently considered combining score-based…

Machine Learning · Computer Science 2024-12-17 Changyuan Zhao , Hongyang Du , Guangyuan Liu , Dusit Niyato

A generative model based on a continuous-time normalizing flow between any pair of base and target probability densities is proposed. The velocity field of this flow is inferred from the probability current of a time-dependent density that…

Machine Learning · Computer Science 2023-03-10 Michael S. Albergo , Eric Vanden-Eijnden

We introduce a novel generative model for the representation of joint probability distributions of a possibly large number of discrete random variables. The approach uses measure transport by randomized assignment flows on the statistical…

Machine Learning · Statistics 2025-01-15 Bastian Boll , Daniel Gonzalez-Alvarado , Stefania Petra , Christoph Schnörr

Building on the remarkable achievements in generative sampling of natural images, we propose an innovative challenge, potentially overly ambitious, which involves generating samples of entire multivariate time series that resemble images.…

We propose a deep generative approach to sampling from a conditional distribution based on a unified formulation of conditional distribution and generalized nonparametric regression function using the noise-outsourcing lemma. The proposed…

Statistics Theory · Mathematics 2021-10-22 Xingyu Zhou , Yuling Jiao , Jin Liu , Jian Huang

We introduce Midpoint Generative Models (MGM), a principled framework for training one-step generative models. MGM is based on a simple symmetry of Flow Matching with linear interpolation: when the two endpoint distributions coincide, the…

Machine Learning · Computer Science 2026-05-29 Daniil Shlenskii , Nikita Gushchin , Lev Novitskiy , Dmitry V. Dylov , Alexander Korotin

Generative models can be categorized into two types: explicit generative models that define explicit density forms and allow exact likelihood inference, such as score-based diffusion models (SDMs) and normalizing flows; implicit generative…

Machine Learning · Statistics 2023-07-06 Jingwei Zhang , Han Shi , Jincheng Yu , Enze Xie , Zhenguo Li

In this paper, we study the Schr\"odinger Bridge Problem (SBP), which is central to entropic optimal transport. For general reference processes and begin--endpoint distributions, we propose a forward-reverse iterative Monte Carlo procedure…

Machine Learning · Statistics 2025-07-02 Denis Belomestny , John. Schoenmakers
‹ Prev 1 3 4 5 6 7 10 Next ›