English
Related papers

Related papers: Lipschitz-Guided Design of Interpolation Schedules…

200 papers

Although diffusion models have successfully extended to function-valued data, stochastic interpolants -- which offer a flexible way to bridge arbitrary distributions -- remain limited to finite-dimensional settings. This work bridges this…

Machine Learning · Statistics 2026-02-03 James Boran Yu , RuiKang OuYang , Julien Horwood , José Miguel Hernández-Lobato

Motivated by the computational difficulties incurred by popular deep learning algorithms for the generative modeling of temporal densities, we propose a cheap alternative which requires minimal hyperparameter tuning and scales favorably to…

Machine Learning · Statistics 2023-10-13 Jonah Botvinick-Greenhouse , Yunan Yang , Romit Maulik

We present a novel backward It{\^o}-Ventzell formula and an extension of the Aleeksev-Gr\"obner interpolating formula to stochastic flows. We also present some natural spectral conditions that yield direct and simple proofs of time uniform…

Probability · Mathematics 2021-05-05 Pierre del Moral , Sumeetpal Sidhu Singh

This paper examines the asymptotic convergence properties of Lipschitz interpolation methods within the context of bounded stochastic noise. In the first part of the paper, we establish probabilistic consistency guarantees of the classical…

Optimization and Control · Mathematics 2023-10-12 Julien Walden Huang , Stephen Roberts , Jan-Peter Calliess

We develop a kernel method for generative modeling within the stochastic interpolant framework, replacing neural network training with linear systems. The drift of the generative SDE is $\hat b_t(x) = \nabla\phi(x)^\top\eta_t$, where…

We develop a principled framework for analyzing and designing noise schedules in diffusion models. We show that one can recast this design problem as an optimal control problem, whose state is the Fisher information of the diffusion process…

Machine Learning · Computer Science 2026-05-22 Seo Taek Kong , Weina Wang , R. Srikant

One classical measure of the quality of an interpolating function is its Lipschitz constant. In this paper we consider interpolants with additional smoothness requirements, in particular that their derivatives be Lipschitz. We show that…

Classical Analysis and ODEs · Mathematics 2016-04-15 Matthew J. Hirn

Diffusion models have emerged as powerful tools for generative modeling, demonstrating exceptional capability in capturing target data distributions from large datasets. However, fine-tuning these massive models for specific downstream…

Machine Learning · Computer Science 2025-09-01 Yinbin Han , Meisam Razaviyayn , Renyuan Xu

We propose a new simple and explicit numerical scheme for time-homogeneous stochastic differential equations. The scheme is based on sampling increments at each time step from a skew-symmetric probability distribution, with the level of…

Probability · Mathematics 2025-07-08 Yuga Iguchi , Samuel Livingstone , Nikolas Nüsken , Giorgos Vasdekis , Rui-Yang Zhang

Due to the ease of training, ability to scale, and high sample quality, diffusion models (DMs) have become the preferred option for generative modeling, with numerous pre-trained models available for a wide variety of datasets. Containing…

Machine Learning · Computer Science 2024-01-17 Weijian Luo , Tianyang Hu , Shifeng Zhang , Jiacheng Sun , Zhenguo Li , Zhihua Zhang

This paper is about the construction of displacement interpolations on a discrete metric graph. Our approach is based on the approximation of any optimal transport problem whose cost function is a distance on a discrete graph by a sequence…

Metric Geometry · Mathematics 2022-09-05 Christian Léonard

This paper considers binary classification of high-dimensional features under a postulated model with a low-dimensional latent Gaussian mixture structure and non-vanishing noise. A generalized least squares estimator is used to estimate the…

Machine Learning · Statistics 2023-03-30 Xin Bing , Marten Wegkamp

Sequential models like recurrent neural networks and transformers have become standard for probabilistic multivariate time series forecasting across various domains. Despite their strengths, they struggle with capturing high-dimensional…

Machine Learning · Computer Science 2024-10-07 Yu Chen , Marin Biloš , Sarthak Mittal , Wei Deng , Kashif Rasul , Anderson Schneider

Diffusion models have emerged as the de facto choice for generating high-quality visual signals across various domains. However, training a single model to predict noise across various levels poses significant challenges, necessitating…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Tiankai Hang , Shuyang Gu , Xin Geng , Baining Guo

Most modern bridge-diffusion methods achieve finite-time transport by specifying an interpolation, Schr\"odinger-bridge, or stochastic-control objective and then learning the associated score or drift field with a neural network. In…

Machine Learning · Computer Science 2026-05-06 Michael Chertkov

We consider large random graphs with prescribed degrees, such as those generated by the configuration model. In the regime where the empirical degree distribution approaches a limit $\mu$ with finite mean, we establish the systematic…

Probability · Mathematics 2019-02-20 Justin Salez

We establish a connection between stochastic optimal control and generative models based on stochastic differential equations (SDEs), such as recently developed diffusion probabilistic models. In particular, we derive a…

Machine Learning · Computer Science 2024-03-27 Julius Berner , Lorenz Richter , Karen Ullrich

We propose a novel generative model for time series based on Schr{\"o}dinger bridge (SB) approach. This consists in the entropic interpolation via optimal transport between a reference probability measure on path space and a target measure…

Optimization and Control · Mathematics 2023-04-12 Mohamed Hamdouche , Pierre Henry-Labordere , Huyên Pham

Generative models for sequential data often struggle with sparsely sampled and high-dimensional trajectories, typically reducing the learning of dynamics to pairwise transitions. We propose Interpolative Multi-Marginal Flow Matching…

We propose an inference-time scaling approach for pretrained flow models. Recently, inference-time scaling has gained significant attention in LLMs and diffusion models, improving sample quality or better aligning outputs with user…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Jaihoon Kim , Taehoon Yoon , Jisung Hwang , Minhyuk Sung