English
Related papers

Related papers: Regularised optimal self-transport is approximate …

200 papers

We study Monge's optimal transportation problem, where the cost is given by optimal control cost. We prove the existence and uniqueness of an optimal map under certain regularity conditions on the Lagrangian, absolute continuity of the…

Optimization and Control · Mathematics 2007-11-24 Andrei Agrachev , Paul Lee

This work presents a mathematical treatment of the relation between Self-Organizing Maps (SOMs) and Gaussian Mixture Models (GMMs). We show that energy-based SOM models can be interpreted as performing gradient descent, minimizing an…

Machine Learning · Computer Science 2020-09-25 Alexander Gepperth , Benedikt Pfülb

In this paper, we develop a simulation-based framework for regularized logistic regression, exploiting two novel results for scale mixtures of normals. By carefully choosing a hierarchical model for the likelihood by one type of mixture,…

Methodology · Statistics 2015-03-17 Robert B. Gramacy , Nicholas G. Polson

The optimal transport (OT) problem has gained significant traction in modern machine learning for its ability to: (1) provide versatile metrics, such as Wasserstein distances and their variants, and (2) determine optimal couplings between…

Machine Learning · Computer Science 2024-10-18 Xinran Liu , Rocío Díaz Martín , Yikun Bai , Ashkan Shahbazi , Matthew Thorpe , Akram Aldroubi , Soheil Kolouri

Regularization by the Shannon entropy enables us to efficiently and approximately solve optimal transport problems on a finite set. This paper is concerned with regularized optimal transport problems via Bregman divergence. We introduce the…

Optimization and Control · Mathematics 2025-04-10 Keiichi Morikuni , Koya Sakakibara , Asuka Takatsu

Optimal transport maps define a one-to-one correspondence between probability distributions, and as such have grown popular for machine learning applications. However, these maps are generally defined on empirical observations and cannot be…

Statistics Theory · Mathematics 2021-02-18 Lucas de Lara , Alberto González-Sanz , Jean-Michel Loubes

Optimal transport has emerged as a fundamental methodology with applications spanning multiple research areas in recent years. However, the convergence rate of the empirical estimator to its population counterpart suffers from the curse of…

Statistics Theory · Mathematics 2025-10-06 Jiaping Yang , Yunxin Zhang

This paper presents a unified framework for smooth convex regularization of discrete optimal transport problems. In this context, the regularized optimal transport turns out to be equivalent to a matrix nearness problem with respect to…

Machine Learning · Statistics 2018-07-17 Arnaud Dessein , Nicolas Papadakis , Jean-Luc Rouas

We study optimal transport for stationary stochastic processes taking values in finite spaces. In order to reflect the stationarity of the underlying processes, we restrict attention to stationary couplings, also known as joinings. The…

Statistics Theory · Mathematics 2021-12-13 Kevin O'Connor , Kevin McGoff , Andrew B Nobel

Classical optimal transport problem seeks a transportation map that preserves the total mass betwenn two probability distributions, requiring their mass to be the same. This may be too restrictive in certain applications such as color or…

Machine Learning · Statistics 2020-06-15 Laetitia Chapel , Mokhtar Z. Alaya , Gilles Gasso

This paper presents an adaptive online distributed optimal control approach that is applicable to optimal planning for very-large-scale robotics systems in highly uncertain environments. This approach is developed based on the optimal mass…

Multiagent Systems · Computer Science 2020-03-17 Pingping Zhu , Chang Liu , Silvia Ferrari

The Gromov--Wasserstein problem is a non-convex optimization problem over the polytope of transportation plans between two probability measures supported on two spaces, each equipped with a cost function evaluating similarities between…

Optimization and Control · Mathematics 2024-07-30 Théo Dumont , Théo Lacombe , François-Xavier Vialard

We study the semi-discrete formulation of one-dimensional partial optimal transport with quadratic cost, where a probability density is partially transported to a finite sum of Dirac masses of smaller total mass. This problem arises…

Optimization and Control · Mathematics 2025-09-11 Adrien Cances , Hugo Leclerc

In this paper, we study convergence properties of the gradient Expectation-Maximization algorithm \cite{lange1995gradient} for Gaussian Mixture Models for general number of clusters and mixing coefficients. We derive the convergence rate…

Statistics Theory · Mathematics 2017-12-05 Bowei Yan , Mingzhang Yin , Purnamrita Sarkar

Functional lifting methods provide a tool for approximating solutions of difficult non-convex problems by embedding them into a larger space. In this work, we investigate a mathematically rigorous formulation based on embedding into the…

Optimization and Control · Mathematics 2020-07-07 Thomas Vogt , Roland Haase , Danielle Bednarski , Jan Lellmann

Spatial generalized linear mixed models (SGLMMs) are popular and flexible models for non-Gaussian spatial data. They are useful for spatial interpolations as well as for fitting regression models that account for spatial dependence, and are…

Methodology · Statistics 2021-10-26 Yawen Guan , Murali Haran

The goal of regression and classification methods in supervised learning is to minimize the empirical risk, that is, the expectation of some loss function quantifying the prediction error under the empirical distribution. When facing scarce…

Optimization and Control · Mathematics 2019-07-15 Soroosh Shafieezadeh-Abadeh , Daniel Kuhn , Peyman Mohajerin Esfahani

We propose a new framework for formulating optimal transport distances between Markov chains. Previously known formulations studied couplings between the entire joint distribution induced by the chains, and derived solutions via a reduction…

Machine Learning · Computer Science 2024-06-17 Sergio Calo , Anders Jonsson , Gergely Neu , Ludovic Schwartz , Javier Segovia-Aguas

We introduce fast algorithms for generalized unnormalized optimal transport. To handle densities with different total mass, we consider a dynamic model, which mixes the $L^p$ optimal transport with $L^p$ distance. For $p=1$, we derive the…

Numerical Analysis · Mathematics 2021-04-07 Wonjun Lee , Rongjie Lai , Wuchen Li , Stanley Osher

The Gromov-Wasserstein (GW) distance is frequently used in machine learning to compare distributions across distinct metric spaces. Despite its utility, it remains computationally intensive, especially for large-scale problems. Recently, a…

Machine Learning · Statistics 2024-10-01 Antoine Salmona , Julie Delon , Agnès Desolneux