English
Related papers

Related papers: Scalable Approximate Algorithms for Optimal Transp…

200 papers

Flow models transform data gradually from one modality (e.g. noise) onto another (e.g. images). Such models are parameterized by a time-dependent velocity field, trained to fit segments connecting pairs of source and target points. When the…

Machine Learning · Computer Science 2025-10-01 Stephen Zhang , Alireza Mousavi-Hosseini , Michal Klein , Marco Cuturi

Optimal transport (OT) theory provides powerful tools to compare probability measures. However, OT is limited to nonnegative measures having the same mass, and suffers serious drawbacks about its computation and statistics. This leads to…

Machine Learning · Statistics 2021-01-26 Tam Le , Truyen Nguyen

Linear regression studies the problem of estimating a model parameter $\beta^* \in \mathbb{R}^p$, from $n$ observations $\{(y_i,\mathbf{x}_i)\}_{i=1}^n$ from linear model $y_i = \langle \mathbf{x}_i,\beta^* \rangle + \epsilon_i$. We…

Machine Learning · Statistics 2015-05-14 Xinyang Yi , Zhaoran Wang , Constantine Caramanis , Han Liu

The elastic net penalty is frequently employed in high-dimensional statistics for parameter regression and variable selection. It is particularly beneficial compared to lasso when the number of predictors greatly surpasses the number of…

Machine Learning · Statistics 2024-12-06 Yanyun Ding , Zhenghua Yao , Peili Li , Yunhai Xiao

The majority of machine learning methods can be regarded as the minimization of an unavailable risk function. To optimize the latter, given samples provided in a streaming fashion, we define a general stochastic Newton algorithm and its…

Statistics Theory · Mathematics 2023-06-30 Claire Boyer , Antoine Godichon-Baggioni

Optimal transport (OT) is a central framework for modeling distribution shifts. Because OT compares distributions directly in input space, a well-designed ground metric between observations is essential to ensure that the optimizer does not…

Machine Learning · Computer Science 2026-05-07 Philip Naumann , Jacob Kauffmann , Klaus-Robert Müller , Grégoire Montavon

We develop a fast and reliable method for solving large-scale optimal transport (OT) problems at an unprecedented combination of speed and accuracy. Built on the celebrated Douglas-Rachford splitting technique, our method tackles the…

Optimization and Control · Mathematics 2021-10-25 Vien V. Mai , Jacob Lindbäck , Mikael Johansson

A sequence of works in unconstrained online convex optimisation have investigated the possibility of adapting simultaneously to the norm $U$ of the comparator and the maximum norm $G$ of the gradients. In full generality, matching upper and…

Machine Learning · Computer Science 2022-06-16 Jack J. Mayo , Hédi Hadiji , Tim van Erven

This study introduces a novel approach for estimating plane-wave coefficients in sound field reconstruction, specifically addressing challenges posed by error-in-variable phase perturbations. Such systematic errors typically arise from…

Signal Processing · Electrical Eng. & Systems 2026-02-06 Yuyang Liu , Johan Karlsson , Filip Elvander

Pansharpening, a pivotal task in remote sensing for fusing high-resolution panchromatic and multispectral imagery, has garnered significant research interest. Recent advancements employing diffusion models based on stochastic differential…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Zihan Cao , Yu Zhong , Liang-Jian Deng

Optimal transport (OT) compares probability distributions by computing a meaningful alignment between their samples. CO-optimal transport (COOT) takes this comparison further by inferring an alignment between features as well. While this…

Optimal transport (OT) has recently found widespread interest in machine learning. It allows to define novel distances between probability measures, which have shown promise in several applications. In this work, we discuss how to…

Machine Learning · Computer Science 2021-10-11 Bamdev Mishra , N T V Satyadev , Hiroyuki Kasai , Pratik Jawanpuria

This paper studies the convergence rates of optimal transport (OT) map estimators, a topic of growing interest in statistics, machine learning, and various scientific fields. Despite recent advancements, existing results rely on regularity…

Statistics Theory · Mathematics 2024-12-12 Yizhe Ding , Runze Li , Lingzhou Xue

We consider the minimization of submodular functions subject to ordering constraints. We show that this optimization problem can be cast as a convex optimization problem on a space of uni-dimensional measures, with ordering constraints…

Machine Learning · Computer Science 2017-07-31 Francis Bach

In this paper, a novel convexification approach for Small-Signal Stability Constraint Optimal Power Flow (SSSC-OPF) has been presented that does not rely on eigenvalue analysis. The proposed methodology is based on the sufficient condition…

Optimization and Control · Mathematics 2021-09-17 Parikshit Pareek , Hung D. Nguyen

We propose several adaptive algorithmic methods for problems of non-smooth convex optimization. The first of them is based on a special artificial inexactness. Namely, the concept of inexact ($ \delta, \Delta, L$)-model of objective…

Optimization and Control · Mathematics 2020-08-25 Fedor Stonyakin

We propose a new framework for formulating optimal transport distances between Markov chains. Previously known formulations studied couplings between the entire joint distribution induced by the chains, and derived solutions via a reduction…

Machine Learning · Computer Science 2024-06-17 Sergio Calo , Anders Jonsson , Gergely Neu , Ludovic Schwartz , Javier Segovia-Aguas

We propose a novel approach based on optimal transport (OT) for tackling the problem of highly mixed data in blind hyperspectral unmixing. Our method constrains the distribution of the estimated abundance matrix to resemble a targeted…

Image and Video Processing · Electrical Eng. & Systems 2025-09-26 D. Doutsas , B. Figliuzzi

Combining different models is a widely used paradigm in machine learning applications. While the most common approach is to form an ensemble of models and average their individual predictions, this approach is often rendered infeasible by…

Machine Learning · Computer Science 2023-05-17 Sidak Pal Singh , Martin Jaggi

We present a novel reduced-order Model (ROM) that leverages optimal transport (OT) theory and displacement interpolation to enhance the representation of nonlinear dynamics in complex systems. While traditional ROM techniques face…

Numerical Analysis · Mathematics 2024-11-14 Moaad Khamlich , Federico Pichi , Michele Girfoglio , Annalisa Quaini , Gianluigi Rozza