English
Related papers

Related papers: Lipschitz-Guided Design of Interpolation Schedules…

200 papers

Inference-time steering enables pretrained diffusion/flow models to be adapted to new tasks without retraining. A widely used approach is the ratio-of-densities method, which defines a time-indexed target path by reweighting…

Artificial Intelligence · Computer Science 2025-12-12 Ziseok Lee , Minyeong Hwang , Sanghyun Jo , Wooyeol Lee , Jihyung Ko , Young Bin Park , Jae-Mun Choi , Eunho Yang , Kyungsu Kim

Stochastic differential equations (SDEs) are a fundamental tool for modelling dynamic processes, including gene regulatory networks (GRNs), contaminant transport, financial markets, and image generation. However, learning the underlying SDE…

We consider the long-time behavior of an explicit tamed Euler scheme applied to a class of stochastic differential equations driven by additive noise, under a one-sided Lipschitz continuity condition. The setting encompasses drift…

Numerical Analysis · Mathematics 2020-10-02 Charles-Edouard Bréhier

An invertible function is bi-Lipschitz if both the function and its inverse have bounded Lipschitz constants. Nowadays, most Normalizing Flows are bi-Lipschitz by design or by training to limit numerical errors (among other things). In this…

Machine Learning · Computer Science 2024-03-08 Alexandre Verine , Benjamin Negrevergne , Fabrice Rossi , Yann Chevaleyre

Diffusion generative models synthesize samples by discretizing reverse-time dynamics driven by a learned score (or denoiser). Existing convergence analyses of diffusion models typically scale at least linearly with the ambient dimension,…

Machine Learning · Computer Science 2026-01-30 Ahmad Aghapour , Erhan Bayraktar , Ziqing Zhang

This paper proposes two linear projection methods for supervised dimension reduction using only the first and second-order statistics. The methods, each catering to a different parameter regime, are derived under the general Gaussian model…

Information Theory · Computer Science 2024-08-13 Biao Chen , Joshua Kortje

We develop stochastic mixed finite element methods for spatially adaptive simulations of fluid-structure interactions when subject to thermal fluctuations. To account for thermal fluctuations, we introduce a discrete fluctuation-dissipation…

Mesoscale and Nanoscale Physics · Physics 2023-02-28 Pat Plunkett , Jon Hu , Chris Siefert , Paul J. Atzberger

Spatial fields in the Earth and environmental sciences are often available at multiple scales or resolutions. While coarse-scale data (e.g., from global circulation models) are often abundant, they lack the local detail provided by…

Methodology · Statistics 2026-04-01 Alejandro Calle-Saldarriaga , Paul F. V. Wiemann , Matthias Katzfuss

We present a nonlinear interpolation technique for parametric fields that exploits optimal transportation of coherent structures of the solution to achieve accurate performance. The approach generalizes the nonlinear interpolation procedure…

Numerical Analysis · Mathematics 2023-10-09 Simona Cucchiara , Angelo Iollo , Tommaso Taddei , Haysam Telib

Denoising diffusion models (DDMs) offer a flexible framework for sampling from high dimensional data distributions. DDMs generate a path of probability distributions interpolating between a reference Gaussian distribution and a data…

Machine Learning · Statistics 2024-12-12 Christopher Williams , Andrew Campbell , Arnaud Doucet , Saifuddin Syed

We argue that the theory and practice of diffusion-based generative models are currently unnecessarily convoluted and seek to remedy the situation by presenting a design space that clearly separates the concrete design choices. This lets us…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Tero Karras , Miika Aittala , Timo Aila , Samuli Laine

We study the problem of preemptive scheduling of n equal-length jobs with given release times on m identical parallel machines. The objective is to minimize the average flow time. Recently, Brucker and Kravchenko proved that the optimal…

Data Structures and Algorithms · Computer Science 2007-05-23 Philippe Baptiste , Marek Chrobak , Christoph Durr , Francis Sourd

Diffusion models have become the go-to method for large-scale generative models in real-world applications. These applications often involve data distributions confined within bounded domains, typically requiring ad-hoc thresholding…

Machine Learning · Statistics 2024-01-09 Wei Deng , Yu Chen , Nicole Tianjiao Yang , Hengrong Du , Qi Feng , Ricky T. Q. Chen

This paper studies sampling error bounds for denoising diffusion probabilistic models (DDPMs) in the 2-Wasserstein distance. Our contributions are threefold. (i) Under general Lipschitz-type conditions on the score function and for a broad…

Machine Learning · Statistics 2026-05-19 Yuta Koike

On the basis of input-output time-domain data collected from a complex simulator, this paper proposes a constructive methodology to infer a reduced-order linear, bilinear or quadratic time invariant dynamical model reproducing the…

Dynamical Systems · Mathematics 2020-12-15 Charles Poussot-Vassal , Tiphaine Sabatier , Claire Sarrat , Pierre Vuillemin

Normalizing flows are a class of flexible deep generative models that offer easy likelihood computation. Despite their empirical success, there is little theoretical understanding of their expressiveness. In this work, we study residual…

Machine Learning · Computer Science 2021-06-28 Zhifeng Kong , Kamalika Chaudhuri

We study the problem of detecting the onset of path splitting in stochastic interpolation between probability distributions. This question is especially subtle when the target distribution is nonconvex or supported on disconnected…

Dynamical Systems · Mathematics 2026-03-18 Chunhai Jiao , Jin Guo , Haoyan Zhang , Jinqiao Duan , Ting Gao

Schedule-Free SGD, proposed in [Defazio et al., 2024], achieves optimal convergence rates without requiring the training horizon in advance, by replacing learning rate schedules with a principled form of iterate averaging. However, the…

Machine Learning · Computer Science 2026-05-13 Dimitris Oikonomou , Matthew Buchholz , Yuen-Man Pun , Robert M. Gower , Nicolas Loizou

At the core of modern generative modeling frameworks, including diffusion models, score-based models, and flow matching, is the task of transforming a simple prior distribution into a complex target distribution through stochastic paths in…

Machine Learning · Computer Science 2026-03-20 Sophia Tang

We consider a stochastic version of the proximal point algorithm for optimization problems posed on a Hilbert space. A typical application of this is supervised learning. While the method is not new, it has not been extensively analyzed in…

Optimization and Control · Mathematics 2021-09-28 Monika Eisenmann , Tony Stillfjord , Måns Williamson