English
Related papers

Related papers: Expressivity of Bi-Lipschitz Normalizing Flows: A …

200 papers

Eliciting a high-dimensional probability distribution from an expert via noisy judgments is notoriously challenging, yet useful for many applications, such as prior elicitation and reward modeling. We introduce a method for eliciting the…

Machine Learning · Computer Science 2024-10-17 Petrus Mikkola , Luigi Acerbi , Arto Klami

We show that normalising flows become pathological when used to model targets whose supports have complicated topologies. In this scenario, we prove that a flow must become arbitrarily numerically noninvertible in order to approximate the…

Machine Learning · Statistics 2021-04-26 Rob Cornish , Anthony L. Caterini , George Deligiannidis , Arnaud Doucet

Normalizing flows define a probability distribution by an explicit invertible transformation $\boldsymbol{\mathbf{z}}=f(\boldsymbol{\mathbf{x}})$. In this work, we present implicit normalizing flows (ImpFlows), which generalize normalizing…

Machine Learning · Statistics 2021-03-18 Cheng Lu , Jianfei Chen , Chongxuan Li , Qiuhao Wang , Jun Zhu

Score Distillation Sampling (SDS) and its variants have been widely used for text-to-3D generation by distilling 2D image diffusion priors. However, the standard SDS objective is prone to severe mode collapse, frequently yielding…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Rohith Ramanan , A. N. Rajagopalan

Optimal transport (OT) provides effective tools for comparing and mapping probability measures. We propose to leverage the flexibility of neural networks to learn an approximate optimal transport map. More precisely, we present a new and…

Machine Learning · Computer Science 2022-07-06 Florentin Coeurdoux , Nicolas Dobigeon , Pierre Chainais

Diffusion probabilistic models excel at sampling new images from learned distributions. Originally motivated by drift-diffusion concepts from physics, they apply image perturbations such as noise and blur in a forward process that results…

Image and Video Processing · Electrical Eng. & Systems 2024-06-07 Pascal Peter

This paper studies a stochastic model that describes the evolution of vehicle densities in a road network. It is consistent with the class of (deterministic) kinematic wave models, which describe traffic flows on the basis of conservation…

Probability · Mathematics 2021-02-11 Michel Mandjes , Jaap Storm

We construct both normal and anomalous deterministic biased diffusions to obtain the Einstein relation for their time-averaged transport coefficients. We find that the difference of the generalized Lyapunov exponent between biased and…

Statistical Mechanics · Physics 2013-05-30 Takuma Akimoto

Flow matching has emerged as a simulation-free alternative to diffusion-based generative modeling, producing samples by solving an ODE whose time-dependent velocity field is learned along an interpolation between a simple source…

Machine Learning · Statistics 2026-04-10 Shivam Kumar , Yixin Wang , Lizhen Lin

Deterministic flow models, such as rectified flows, offer a general framework for learning a deterministic transport map between two distributions, realized as the vector field for an ordinary differential equation (ODE). However, they are…

Machine Learning · Computer Science 2024-10-04 Saurabh Singh , Ian Fischer

Score-based diffusion models, while achieving minimax optimality for sampling, are often hampered by slow sampling speeds due to the high computational burden of score function evaluations. Despite the recent remarkable empirical advances…

Machine Learning · Computer Science 2025-02-27 Gen Li , Changxiao Cai

We study the problem of sampling from a probability distribution $\pi$ on $\rset^d$ which has a density \wrt\ the Lebesgue measure known up to a normalization factor $x \mapsto \rme^{-U(x)} / \int_{\rset^d} \rme^{-U(y)} \rmd y$. We analyze…

Statistics Theory · Mathematics 2019-09-17 M. Barkhagen , N. H. Chau , É. Moulines , M. Rásonyi , S. Sabanis , Y. Zhang

We study the quantitative convergence of drift-diffusion PDEs that arise as Wasserstein gradient flows of linearly convex functions over the space of probability measures on ${\mathbb R}^d$. In this setting, the objective is in general not…

Optimization and Control · Mathematics 2025-07-17 Lénaïc Chizat , Maria Colombo , Xavier Fernández-Real

Score distillation of 2D diffusion models has proven to be a powerful mechanism to guide 3D optimization, for example enabling text-based 3D generation or single-view reconstruction. A common limitation of existing score distillation…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Yanbo Xu , Jayanth Srinivasa , Gaowen Liu , Shubham Tulsiani

Normalizing flows model probability distributions by learning invertible transformations that transfer a simple distribution into complex distributions. Since the architecture of ResNet-based normalizing flows is more flexible than that of…

Machine Learning · Computer Science 2022-10-18 Byeongkeun Ahn , Chiyoon Kim , Youngjoon Hong , Hyunwoo J. Kim

We consider It\^o SDE $\d X_t=\sum_{j=1}^m A_j(X_t) \d w_t^j + A_0(X_t) \d t$ on $\R^d$. The diffusion coefficients $A_1,..., A_m$ are supposed to be in the Sobolev space $W_\text{loc}^{1,p} (\R^d)$ with $p>d$, and to have linear growth;…

Probability · Mathematics 2010-01-19 Shizan Fang , Dejun Luo , Anto Thalmaier

We study the local convergence of diffusive mean-field systems, including Wasserstein gradient flows, min-max dynamics, and multi-species games. We establish exponential local convergence in $\chi^2$-divergence with sharp rates, under two…

Optimization and Control · Mathematics 2026-02-13 Guillaume Wang , Lénaïc Chizat

Continuous normalizing flows (CNFs) are a generative method for learning probability distributions, which is based on ordinary differential equations. This method has shown remarkable empirical success across various applications, including…

Machine Learning · Statistics 2024-04-02 Yuan Gao , Jian Huang , Yuling Jiao , Shurong Zheng

Diffusion models (DMs), which enable both image generation from noise and inversion from data, have inspired powerful unpaired image-to-image (I2I) translation algorithms. However, they often require a larger number of neural function…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Jeongsol Kim , Beomsu Kim , Jong Chul Ye

Recent advances in diffusion models have demonstrated their remarkable ability to capture complex image distributions, but the geometric properties of the learned data manifold remain poorly understood. We address this gap by introducing a…

Machine Learning · Computer Science 2025-10-13 Simone Azeglio , Arianna Di Bernardo