English
Related papers

Related papers: Multitask Learning with Stochastic Interpolants

200 papers

A class of generative models that unifies flow-based and diffusion-based methods is introduced. These models extend the framework proposed in Albergo and Vanden-Eijnden (2023), enabling the use of a broad class of continuous-time stochastic…

Machine Learning · Computer Science 2025-10-10 Michael S. Albergo , Nicholas M. Boffi , Eric Vanden-Eijnden

Generative models inspired by dynamical transport of measure -- such as flows and diffusions -- construct a continuous-time map between two probability densities. Conventionally, one of these is the target density, only accessible through…

Machine Learning · Computer Science 2024-09-24 Michael S. Albergo , Mark Goldstein , Nicholas M. Boffi , Rajesh Ranganath , Eric Vanden-Eijnden

Although diffusion models have successfully extended to function-valued data, stochastic interpolants -- which offer a flexible way to bridge arbitrary distributions -- remain limited to finite-dimensional settings. This work bridges this…

Machine Learning · Statistics 2026-02-03 James Boran Yu , RuiKang OuYang , Julien Horwood , José Miguel Hernández-Lobato

Sequential models like recurrent neural networks and transformers have become standard for probabilistic multivariate time series forecasting across various domains. Despite their strengths, they struggle with capturing high-dimensional…

Machine Learning · Computer Science 2024-10-07 Yu Chen , Marin Biloš , Sarthak Mittal , Wei Deng , Kashif Rasul , Anderson Schneider

Given a set of $K$ probability densities, we consider the multimarginal generative modeling problem of learning a joint distribution that recovers these densities as marginals. The structure of this joint distribution should identify…

Machine Learning · Computer Science 2023-10-06 Michael S. Albergo , Nicholas M. Boffi , Michael Lindsey , Eric Vanden-Eijnden

Generative models have recently emerged as powerful surrogates for physical systems, demonstrating increased accuracy, stability, and/or statistical fidelity. Most approaches rely on iteratively denoising a Gaussian, a choice that may not…

Machine Learning · Computer Science 2025-10-01 Anthony Zhou , Alexander Wikner , Amaury Lancelin , Pedram Hassanzadeh , Amir Barati Farimani

We propose a framework for probabilistic forecasting of dynamical systems based on generative modeling. Given observations of the system state over time, we formulate the forecasting problem as sampling from the conditional distribution of…

Machine Learning · Computer Science 2024-08-29 Yifan Chen , Mark Goldstein , Mengjian Hua , Michael S. Albergo , Nicholas M. Boffi , Eric Vanden-Eijnden

In this paper, we propose a general methodology for sampling from un-normalized densities defined on Riemannian manifolds, with a particular focus on multi-modal targets that remain challenging for existing sampling methods. Inspired by the…

Machine Learning · Statistics 2026-02-03 Alain Durmus , Maxence Noble , Thibaut Pellerin

Generative models based on dynamical equations such as flows and diffusions offer exceptional sample quality, but require computationally expensive numerical integration during inference. The advent of consistency models has enabled…

Machine Learning · Computer Science 2025-06-04 Nicholas M. Boffi , Michael S. Albergo , Eric Vanden-Eijnden

A generative model based on a continuous-time normalizing flow between any pair of base and target probability densities is proposed. The velocity field of this flow is inferred from the probability current of a time-dependent density that…

Machine Learning · Computer Science 2023-03-10 Michael S. Albergo , Eric Vanden-Eijnden

Existing image generation models face critical challenges regarding the trade-off between computation and fidelity. Specifically, models relying on a pretrained Variational Autoencoder (VAE) suffer from information loss, limited detail, and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Chenrui Ma , Xi Xiao , Tianyang Wang , Xiao Wang , Yanning Shen

Stochastic interpolants unify flows and diffusions, popular generative modeling frameworks. A primary hyperparameter in these methods is the interpolation schedule that determines how to bridge a standard Gaussian base measure to an…

Machine Learning · Statistics 2026-02-04 Gabriel Damsholt , Jes Frellsen , Susanne Ditlevsen

Auto encoding models have been extensively studied in recent years. They provide an efficient framework for sample generation, as well as for analysing feature learning. Furthermore, they are efficient in performing interpolations between…

Machine Learning · Statistics 2021-03-30 Adam Lindhe , Carl Ringqvist , Henrik Hult

Stochastic Interpolants (SI) is a powerful framework for generative modeling, capable of flexibly transforming between two probability distributions. However, its use in jointly optimized latent variable models remains unexplored as it…

Machine Learning · Computer Science 2026-04-23 Saurabh Singh , Dmitry Lagun

Diffusion bridge models and stochastic interpolants enable high-quality image-to-image (I2I) translation by creating paths between distributions in pixel space. However, the proliferation of techniques based on incompatible mathematical…

Machine Learning · Computer Science 2025-07-04 Shaorong Zhang , Yuanbin Cheng , Greg Ver Steeg

We present a class of diffusion-based algorithms to draw samples from high-dimensional probability distributions given their unnormalized densities. Ideally, our methods can transport samples from a Gaussian distribution to a specified…

Machine Learning · Computer Science 2025-02-04 Anand Jerry George , Nicolas Macris

We develop a kernel method for generative modeling within the stochastic interpolant framework, replacing neural network training with linear systems. The drift of the generative SDE is $\hat b_t(x) = \nabla\phi(x)^\top\eta_t$, where…

Most existing generative models are limited to learning a single probability distribution from the training data and cannot generalize to novel distributions for unseen data. An architecture that can generate samples from both trained…

Machine Learning · Computer Science 2024-10-16 Xinyu Liao , Aoyang Qin , Jacob Seidman , Junqi Wang , Wei Wang , Paris Perdikaris

Stochastic simulators are ubiquitous in many fields of applied sciences and engineering. In the context of uncertainty quantification and optimization, a large number of simulations is usually necessary, which becomes intractable for…

Computation · Statistics 2022-02-09 X. Zhu , B. Sudret

We propose a conditional stochastic interpolation (CSI) method for learning conditional distributions. CSI is based on estimating probability flow equations or stochastic differential equations that transport a reference distribution to the…

Machine Learning · Statistics 2025-08-26 Ding Huang , Jian Huang , Ting Li , Guohao Shen
‹ Prev 1 2 3 10 Next ›