English
Related papers

Related papers: Optimal transport natural gradient for statistical…

200 papers

Computing optimal transport maps between high-dimensional and continuous distributions is a challenging problem in optimal transport (OT). Generative adversarial networks (GANs) are powerful generative models which have been successfully…

Machine Learning · Computer Science 2019-06-25 Jacob Leygonie , Jennifer She , Amjad Almahairi , Sai Rajeswar , Aaron Courville

Bayesian inference problems require sampling or approximating high-dimensional probability distributions. The focus of this paper is on the recently introduced Stein variational gradient descent methodology, a class of algorithms that rely…

Machine Learning · Statistics 2023-02-14 A. Duncan , N. Nuesken , L. Szpruch

Wasserstein distributionally robust optimization (WDRO) strengthens statistical learning under model uncertainty by minimizing the local worst-case risk within a prescribed ambiguity set. Although WDRO has been extensively studied in…

Machine Learning · Statistics 2025-11-12 Changyu Liu , Yuling Jiao , Junhui Wang , Jian Huang

In this paper, we propose a novel numerical scheme to optimize the gradient flows for learning energy-based models (EBMs). From a perspective of physical simulation, we redefine the problem of approximating the gradient flow utilizing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Yang Wu , Pengxu Wei , Liang Lin

Natural Gradient Descent, a second-degree optimization method motivated by the information geometry, makes use of the Fisher Information Matrix instead of the Hessian which is typically used. However, in many cases, the Fisher Information…

Machine Learning · Computer Science 2023-03-10 Rajesh Shrestha

We study the problem of estimating a sequence of evolving probability distributions from historical data, where the underlying distribution changes over time in a nonstationary and nonparametric manner. To capture gradual changes, we…

Optimization and Control · Mathematics 2025-12-16 Edward J. Anderson , Dominic S. T. Keehan

In this work, we propose a numerical method to compute the Wasserstein Hamiltonian flow (WHF), which is a Hamiltonian system on the probability density manifold. Many well-known PDE systems can be reformulated as WHFs. We use parameterized…

Numerical Analysis · Mathematics 2023-07-18 Hao Wu , Shu Liu , Xiaojing Ye , Haomin Zhou

In this paper, we propose a new method to measure the probabilistic robustness of stochastic jump linear system with respect to both the initial state uncertainties and the randomness in switching. Wasserstein distance which defines a…

Systems and Control · Computer Science 2014-10-03 Kooktae Lee , Abhishek Halder , Raktim Bhattacharya

We study the least-energy way to reshape a probability distribution when motion is constrained to a horizontal bundle, that is, optimal transport and distribution steering in sub-Riemannian geometry, motivated by density control over…

Optimization and Control · Mathematics 2026-05-18 Daniel Owusu Adu , Karthik Elamvazhuthi , Bahman Gharesifard

Optimal transport has found widespread applications in signal processing and machine learning. Among its many equivalent formulations, optimal transport seeks to reconstruct a random variable/vector with a prescribed distribution at the…

Information Theory · Computer Science 2025-03-06 Jun Chen , Jia Wang , Ruibin Li , Han Zhou , Wei Dong , Huan Liu , Yuanhao Yu

This paper presents a new approach to the classical problem of quantifying posterior contraction rates (PCRs) in Bayesian statistics. Our approach relies on Wasserstein distance, and it leads to two main contributions which improve on the…

Statistics Theory · Mathematics 2022-05-03 Emanuele Dolera , Stefano Favaro , Edoardo Mainini

Wasserstein geometry and information geometry are two important structures introduced in a manifold of probability distributions. The former is defined by using the transportation cost between two distributions, so it reflects the metric…

Statistics Theory · Mathematics 2020-03-13 Shun-ichi Amari

We study the problem of optimal transport in tropical geometry and define the Wasserstein-$p$ distances in the continuous metric measure space setting of the tropical projective torus. We specify the tropical metric -- a combinatorial…

Optimization and Control · Mathematics 2021-05-18 Wonjun Lee , Wuchen Li , Bo Lin , Anthea Monod

We present a computationally efficient framework, called $\texttt{FlowDRO}$, for solving flow-based distributionally robust optimization (DRO) problems with Wasserstein uncertainty sets while aiming to find continuous worst-case…

Machine Learning · Computer Science 2024-02-27 Chen Xu , Jonghyeok Lee , Xiuyuan Cheng , Yao Xie

In this paper, we propose Wasserstein Isometric Mapping (Wassmap), a nonlinear dimensionality reduction technique that provides solutions to some drawbacks in existing global nonlinear dimensionality reduction algorithms in imaging…

Machine Learning · Computer Science 2023-02-22 Keaton Hamm , Nick Henscheid , Shujie Kang

Wasserstein 1 optimal transport maps provide a natural correspondence between points from two probability distributions, $\mu$ and $\nu$, which is useful in many applications. Available algorithms for computing these maps do not appear to…

Optimization and Control · Mathematics 2022-11-03 Tristan Milne , Étienne Bilocq , Adrian Nachman

In many applications in statistics and machine learning, the availability of data samples from multiple possibly heterogeneous sources has become increasingly prevalent. On the other hand, in distributionally robust optimization, we seek…

Machine Learning · Statistics 2022-05-31 Tim Tsz-Kit Lau , Han Liu

Let $M$ be a complete connected Riemannian manifold. For $n \geq 0$, we endow the Wasserstein space $P^{(n)}_2(M) = P_2(\ldots P_2(M)\ldots)$, equipped with the Wasserstein distance $W_2$, with a variational structure that generalizes the…

Optimization and Control · Mathematics 2025-12-04 Christophe Vauthier

We introduce LOT Wassmap, a computationally feasible algorithm to uncover low-dimensional structures in the Wasserstein space. The algorithm is motivated by the observation that many datasets are naturally interpreted as probability…

Machine Learning · Computer Science 2023-02-16 Alexander Cloninger , Keaton Hamm , Varun Khurana , Caroline Moosmüller

We introduce $\textit{Stein transport}$, a novel methodology for Bayesian inference designed to efficiently push an ensemble of particles along a predefined curve of tempered probability distributions. The driving vector field is chosen…

Machine Learning · Statistics 2024-12-02 Nikolas Nüsken
‹ Prev 1 8 9 10 Next ›