English
Related papers

Related papers: Lipschitz-Guided Design of Interpolation Schedules…

200 papers

Diffusion models, which employ stochastic differential equations to sample images through integrals, have emerged as a dominant class of generative models. However, the rationality of the diffusion process itself receives limited attention,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Zhantao Yang , Ruili Feng , Han Zhang , Yujun Shen , Kai Zhu , Lianghua Huang , Yifei Zhang , Yu Liu , Deli Zhao , Jingren Zhou , Fan Cheng

We introduce and study a class of probabilistic generative models, where the latent object is a finite-dimensional diffusion process on a finite time interval and the observed variable is drawn conditionally on the terminal point of the…

Probability · Mathematics 2019-06-03 Belinda Tzen , Maxim Raginsky

Generative Flow Networks (GFlowNets) are amortized inference models designed to sample from unnormalized distributions over composable objects, with applications in generative modeling for tasks in fields such as causal discovery, NLP, and…

Machine Learning · Computer Science 2026-04-13 Tiago da Silva , Eliezer de Souza da Silva , Diego Mesquita

This paper demonstrates the robustness of Lipschitz-regularized $\alpha$-divergences as objective functionals in generative modeling, showing they enable stable learning across a wide range of target distributions with minimal assumptions.…

Machine Learning · Statistics 2025-09-09 Ziyu Chen , Hyemin Gu , Markos A. Katsoulakis , Luc Rey-Bellet , Wei Zhu

Statistical learning under distributional drift remains poorly characterized, especially in closed-loop settings where learning alters the data-generating law. We introduce an intrinsic drift budget $C_T$ that quantifies cumulative…

Machine Learning · Computer Science 2026-05-19 Sofiya Zaichyk

The numerical simulation of multiphase flows involving dispersed components with large scale disparities, such as the collisions between millimeter-sized bubbles and micron-sized mineral particles in flotation, poses a significant…

Fluid Dynamics · Physics 2026-05-21 Linfeng Jiang , Enrico Calzavarini , Dominik Krug

Capturing data from dynamic processes through cross-sectional measurements is seen in many fields, such as computational biology. Trajectory inference deals with the challenge of reconstructing continuous processes from such observations.…

Machine Learning · Computer Science 2025-03-12 Amartya Banerjee , Harlin Lee , Nir Sharon , Caroline Moosmüller

We consider the problem of minimizing a differentiable function with locally Lipschitz continuous gradient on a stratified set and present a first-order algorithm designed to find a stationary point of that problem. Our assumptions on the…

Optimization and Control · Mathematics 2023-03-29 Guillaume Olikier , Kyle A. Gallivan , P. -A. Absil

The main goal of this paper is to present results of comparison study for the level set and direct Lagrangian methods for computing evolution of the Willmore flow of embedded planar curves. To perform such a study we construct new numerical…

Numerical Analysis · Mathematics 2007-10-30 Michal Benes , Karol Mikula , Tomas Oberhuber , Daniel Sevcovic

We study optimal transportation of measures on compact manifolds for costs defined from convex Lagrangians. We prove that optimal transportation can be interpolated by measured Lipschitz laminations, or geometric currents. The methods are…

Dynamical Systems · Mathematics 2007-05-23 Patrick Bernard , Boris Buffoni

We propose a new algorithm for solving multistage stochastic mixed integer linear programming (MILP) problems with complete continuous recourse. In a similar way to cutting plane methods, we construct nonlinear Lipschitz cuts to build lower…

Optimization and Control · Mathematics 2019-05-24 Shabbir Ahmed , Filipe Goulart Cabral , Bernardo Freitas Paulo da Costa

Generative modeling can be formulated as learning a mapping f such that its pushforward distribution matches the data distribution. The pushforward behavior can be carried out iteratively at inference time, for example in diffusion and…

Machine Learning · Computer Science 2026-02-09 Mingyang Deng , He Li , Tianhong Li , Yilun Du , Kaiming He

We present and analyze an algorithm for optimizing smooth and convex or strongly convex objectives using minibatch stochastic gradient estimates. The algorithm is optimal with respect to its dependence on both the minibatch size and minimum…

Machine Learning · Computer Science 2021-10-27 Blake Woodworth , Nathan Srebro

Several problems in machine learning are naturally expressed as the design and analysis of time-evolving probability distributions. This includes sampling via diffusion methods, optimizing the weights of neural networks, and analyzing the…

Optimization and Control · Mathematics 2026-05-28 Gabriel Peyré

A new moving mesh scheme based on the Lagrange-Galerkin method for the approximation of the one-dimensional convection-diffusion equation is studied. The mesh movement, which is prescribed by a discretized dynamical system for the nodal…

Numerical Analysis · Mathematics 2024-02-26 Kharisma Surya Putri , Tatsuki Mizuochi , Niklas Kolbe , Hirofumi Notsu

We present a scalable technique for upper bounding the Lipschitz constant of generative models. We relate this quantity to the maximal norm over the set of attainable vector-Jacobian products of a given generative model. We approximate this…

Machine Learning · Computer Science 2021-07-07 Matt Jordan , Alexandros G. Dimakis

We propose a general framework for optimizing noise schedules in diffusion models, applicable to both training and sampling. Our method enforces a constant rate of change in the probability distribution of diffused data throughout the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Shuntaro Okada , Kenji Doi , Ryota Yoshihashi , Hirokatsu Kataoka , Tomohiro Tanaka

Diffusion-based samplers -- Score Based Diffusions, Bridge Diffusions and Path Integral Diffusions -- match a target at terminal time, but the real leverage comes from choosing the schedule that governs the intermediate-time dynamics. We…

Machine Learning · Computer Science 2025-12-16 Michael Chertkov , Hamidreza Behjoo

We establish global well-posedness and convergence of the score-based generative models (SGM) under minimal general assumptions of initial data for score estimation. For the smooth case, we start from a Lipschitz bound of the score function…

Machine Learning · Computer Science 2024-05-28 Connor Mooney , Zhongjian Wang , Jack Xin , Yifeng Yu

This paper studies a stochastic model that describes the evolution of vehicle densities in a road network. It is consistent with the class of (deterministic) kinematic wave models, which describe traffic flows on the basis of conservation…

Probability · Mathematics 2021-02-11 Michel Mandjes , Jaap Storm