English
Related papers

Related papers: Stabilized Sparse Scaling Algorithms for Entropy R…

200 papers

We investigate a dynamic inverse problem using a regularization which implements the so-called Wasserstein-$1$ distance. It naturally extends well-known static problems such as lasso or total variation regularized problems to a (temporally)…

Optimization and Control · Mathematics 2025-12-05 Marcello Carioni , Julius Lohmann

We propose the Entropic-regularized Robust Optimal Transport (E-ROBOT) framework, a novel method that combines the robustness of ROBOT with the computational and statistical benefits of entropic regularization. We show that, rooted in the…

Machine Learning · Statistics 2025-09-16 Davide La Vecchia , Hang Liu

Computational optimal transport (OT) has recently emerged as a powerful framework with applications in various fields. In this paper we focus on a relaxation of the original OT problem, the entropic OT problem, which allows to implement…

Probability · Mathematics 2025-10-06 Giacomo Greco , Maxence Noble , Giovanni Conforti , Alain Durmus

Many tasks in machine learning and signal processing can be solved by minimizing a convex function of a measure. This includes sparse spikes deconvolution or training a neural network with a single hidden layer. For these problems, we study…

Optimization and Control · Mathematics 2018-10-30 Lenaic Chizat , Francis Bach

Inverse problems arise in a wide spectrum of applications in fields ranging from engineering to scientific computation. Connected with the rise of interest in inverse problems is the development and analysis of regularization methods, such…

Numerical Analysis · Mathematics 2025-05-12 Abinash Nayak

We propose to tackle the problem of understanding the effect of regularization in Sinkhorn algotihms. In the case of Gaussian distributions we provide a closed form for the regularized optimal transport which enables to provide a better…

Statistics Theory · Mathematics 2020-06-16 Eustasio del Barrio , Jean-Michel Loubes

The optimization problems with a sparsity constraint is a class of important global optimization problems. A typical type of thresholding algorithms for solving such a problem adopts the traditional full steepest descent direction or…

Optimization and Control · Mathematics 2021-07-20 Nan Meng , Yun-Bin Zhao , Michal Kocvara

This paper improves the state-of-the-art rate of a first-order algorithm for solving entropy regularized optimal transport. The resulting rate for approximating the optimal transport (OT) has been improved from…

Optimization and Control · Mathematics 2023-01-25 Yiling Luo , Yiling Xie , Xiaoming Huo

Scaling problems have a rich and diverse history, and thereby have found numerous applications in several fields of science and engineering. For instance, the matrix scaling problem has had applications ranging from theoretical computer…

Data Structures and Algorithms · Computer Science 2018-08-30 Ankit Garg , Rafael Oliveira

Computing the Wasserstein barycenter of a set of probability measures under the optimal transport metric can quickly become prohibitive for traditional second-order algorithms, such as interior-point methods, as the support size of the…

Optimization and Control · Mathematics 2020-01-22 Dongdong Ge , Haoyue Wang , Zikai Xiong , Yinyu Ye

This chapter describes techniques for the numerical resolution of optimal transport problems. We will consider several discretizations of these problems, and we will put a strong focus on the mathematical analysis of the algorithms to solve…

Numerical Analysis · Mathematics 2020-03-03 Quentin Merigot , Boris Thibert

Sparsity-constrained optimization underlies many problems in signal processing, statistics, and machine learning. State-of-the-art hard-thresholding (HT) algorithms rely on an appropriately selected continuous step-size parameter to ensure…

Machine Learning · Statistics 2026-05-13 Jin Zhu , Junxian Zhu , Zezhi Wang , Borui Tang , Hongmei Lin , Xueqin Wang

In recent years, hardware implementations of Ising machines have emerged as a viable alternative to quantum computing for solving hard optimization problems among other applications. Unlike quantum hardware, dense connectivity can be…

Numerical simulations including magnetic fields have become important in many fields of astrophysics. Evolution of magnetic fields by the constrained transport algorithm preserves magnetic divergence to machine precision, and thus…

Astrophysics · Physics 2009-11-13 Jason Maron , Mordecai-Mark Mac Low , Jeffrey Oishi

The kernel herding algorithm is used to construct quadrature rules in a reproducing kernel Hilbert space (RKHS). While the computational efficiency of the algorithm and stability of the output quadrature formulas are advantages of this…

Numerical Analysis · Mathematics 2022-07-18 Kazuma Tsuji , Ken'ichiro Tanaka

Flexible Bayesian models are typically constructed using limits of large parametric models with a multitude of parameters that are often uninterpretable. In this article, we offer a novel alternative by constructing an exponentially tilted…

Methodology · Statistics 2023-03-20 Abhisek Chakraborty , Anirban Bhattacharya , Debdeep Pati

In this work, we propose a sparse transformer architecture that incorporates prior information about the underlying data distribution directly into the transformer structure of the neural network. The design of the model is motivated by a…

Machine Learning · Computer Science 2025-10-21 Fuqun Han , Stanley Osher , Wuchen Li

Semi-discrete optimal transport (SOT), which maps a continuous probability measure to a discrete one, is a fundamental problem with wide-ranging applications. Entropic regularization is often employed to solve the SOT problem, leading to a…

Numerical Analysis · Mathematics 2025-08-01 Moaad Khamlich , Francesco Romor , Gianluigi Rozza

Optimal transportation provides a means of lifting distances between points on a geometric domain to distances between signals over the domain, expressed as probability distributions. On a graph, transportation problems can be used to…

Optimization and Control · Mathematics 2018-03-26 Montacer Essid , Justin Solomon

This work presents a method for information fusion in source localization applications. The method utilizes the concept of optimal mass transport in order to construct estimates of the spatial spectrum using a convex barycenter formulation.…

Signal Processing · Electrical Eng. & Systems 2018-11-20 Filip Elvander , Isabel Haasler , Andreas Jakobsson , Johan Karlsson