English
Related papers

Related papers: Lipschitz Singularities in Diffusion Models

200 papers

Diffusion models have emerged as preeminent contenders in the realm of generative models. Distinguished by their distinctive sequential generative processes, characterized by hundreds or even thousands of timesteps, diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Haojun Sun , Chen Tang , Zhi Wang , Yuan Meng , Jingyan jiang , Xinzhu Ma , Wenwu Zhu

In this work we propose a nonlinear stabilization technique for convection-diffusion-reaction and pure transport problems discretized with space-time isogeometric analysis. The stabilization is based on a graph-theoretic artificial…

Numerical Analysis · Computer Science 2019-11-18 Jesús Bonilla , Santiago Badia

Diffusion Models (DMs) have achieved great success in image generation and other fields. By fine sampling through the trajectory defined by the SDE/ODE solver based on a well-trained score model, DMs can generate remarkable high-quality…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Bowen Zheng , Tianming Yang

Discrete diffusion models have emerged as powerful tools for high-quality data generation. Despite their success in discrete spaces, such as text generation tasks, the acceleration of discrete diffusion models remains under-explored. In…

Machine Learning · Computer Science 2024-12-09 Zixiang Chen , Huizhuo Yuan , Yongqian Li , Yiwen Kou , Junkai Zhang , Quanquan Gu

Flow-based methods for sampling and generative modeling use continuous-time dynamical systems to represent a {transport map} that pushes forward a source measure to a target measure. The introduction of a time axis provides considerable…

Machine Learning · Statistics 2025-06-19 Panos Tsimpos , Zhi Ren , Jakob Zech , Youssef Marzouk

Distilling latent diffusion models (LDMs) into ones that are fast to sample from is attracting growing research interest. However, the majority of existing methods face two critical challenges: (1) They hinge on long training using a huge…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Qingsong Xie , Zhenyi Liao , Zhijie Deng , Chen chen , Haonan Lu

The introduction of diffusion models in anomaly detection has paved the way for more effective and accurate image reconstruction in pathologies. However, the current limitations in controlling noise granularity hinder diffusion models'…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Cosmin I. Bercea , Michael Neumayr , Daniel Rueckert , Julia A. Schnabel

The well-posedness for SDEs with singularity in both space and distribution variables is derived, where the interacting drift term is bounded and Lipschitz continuous under total variation distance and the diffusion term is allowed to be…

Probability · Mathematics 2025-07-25 Xing Huang

Latent diffusion models (LDMs) achieve state-of-the-art performance across various tasks, including image generation and video synthesis. However, they generally lack robustness, a limitation that remains not fully explored in current…

Machine Learning · Computer Science 2025-06-10 Boris Martirosyan , Alexey Karmanov

This paper examines the asymptotic convergence properties of Lipschitz interpolation methods within the context of bounded stochastic noise. In the first part of the paper, we establish probabilistic consistency guarantees of the classical…

Optimization and Control · Mathematics 2023-10-12 Julien Walden Huang , Stephen Roberts , Jan-Peter Calliess

We show that, for any spatially discretized system of reaction-diffusion, the approximate solution given by the explicit Euler time-discretization scheme converges to the exact time-continuous solution, provided that diffusion coefficient…

Optimization and Control · Mathematics 2019-12-12 Adrien Le Coënt , Laurent Fribourg

Diffusion Models (DMs) have demonstrated state-of-the-art performance in content generation without requiring adversarial training. These models are trained using a two-step process. First, a forward - diffusion - process gradually adds…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Anwaar Ulhaq , Naveed Akhtar

Timestep distillation is an effective approach for improving the generation efficiency of diffusion models. The Consistency Model (CM), as a trajectory-based framework, demonstrates significant potential due to its strong theoretical…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Bao Tang , Shuai Zhang , Yueting Zhu , Jijun Xiang , Xin Yang , Li Yu , Wenyu Liu , Xinggang Wang

The need of fast distributed solvers for optimization problems in networked systems has motivated the recent development of the Fast-Lipschitz optimization framework. In such an optimization, problems satisfying certain qualifying…

Optimization and Control · Mathematics 2016-11-17 Martin Jakobsson , Carlo Fischione , Pradeep Chathuranga Weeraddana

We investigate the well-posedness of the fast diffusion equation (FDE) in a wide class of noncompact Riemannian manifolds. Existence and uniqueness of solutions for globally integrable initial data was established in [5]. However, in the…

Analysis of PDEs · Mathematics 2020-03-30 Gabriele Grillo , Matteo Muratori , Fabio Punzo

We consider the long-time behavior of an explicit tamed Euler scheme applied to a class of stochastic differential equations driven by additive noise, under a one-sided Lipschitz continuity condition. The setting encompasses drift…

Numerical Analysis · Mathematics 2020-10-02 Charles-Edouard Bréhier

We provide full theoretical guarantees for the convergence behaviour of diffusion-based generative models under the assumption of strongly log-concave data distributions while our approximating class of functions used for score estimation…

Machine Learning · Computer Science 2025-02-18 Stefano Bruno , Ying Zhang , Dong-Young Lim , Ömer Deniz Akyildiz , Sotirios Sabanis

Diffusion models have emerged as powerful generative frameworks by progressively adding noise to data through a forward process and then reversing this process to generate realistic samples. While these models have achieved strong…

Machine Learning · Computer Science 2025-03-04 Xingzhuo Guo , Yu Zhang , Baixu Chen , Haoran Xu , Jianmin Wang , Mingsheng Long

We investigate stochastic averaging theory for locally Lipschitz discrete-time nonlinear systems with stochastic perturbation and its applications to convergence analysis of discrete-time stochastic extremum seeking algorithms. Firstly, by…

Optimization and Control · Mathematics 2015-02-18 Shu-Jun Liu , Miroslav Krstic

For optimal control of diffusions under several criteria, due to computational or analytical reasons, many studies have a apriori assumed control policies to be Lipschitz or smooth, often with no rigorous analysis on whether this…

Optimization and Control · Mathematics 2024-05-28 Somnath Pradhan , Serdar Yuksel