English
Related papers

Related papers: Stabilized Sparse Scaling Algorithms for Entropy R…

200 papers

We develop a discretisation of the semigeostrophic rotating shallow water equations, based upon their optimal transport formulation. This takes the form of a Moreau-Yoshida regularisation of the Wasserstein metric. Solutions of the optimal…

Numerical Analysis · Mathematics 2025-07-23 Jean-David Benamou , Colin J. Cotter , Jacob J. M. Francis , Hugo Malamut

We consider inference (filtering) problems over probabilistic graphical models with aggregate data generated by a large population of individuals. We propose a new efficient belief propagation type algorithm over tree-structured graphs with…

Machine Learning · Computer Science 2020-10-06 Rahul Singh , Isabel Haasler , Qinsheng Zhang , Johan Karlsson , Yongxin Chen

This paper describes an angular adaptivity algorithm for Boltzmann transport applications which for the first time shows evidence of $\mathcal{O}(n)$ scaling in both runtime and memory usage, where $n$ is the number of adapted angles. This…

Computational Physics · Physics 2020-01-29 S. Dargaville , A. G. Buchan , R. P. Smedley-Stevenson , P. N Smith , C. C. Pain

\emph{Optimal Transport} (OT) has emerged as an important computational tool in machine learning and computer vision, providing a geometrical framework for studying probability measures. OT unfortunately suffers from the curse of…

Machine Learning · Computer Science 2021-02-08 Anton Mallasto

We present a new perspective on the celebrated Sinkhorn algorithm by showing that is a special case of incremental/stochastic mirror descent. In order to see this, one should simply plug Kullback-Leibler divergence in both mirror map and…

Machine Learning · Computer Science 2019-09-17 Konstantin Mishchenko

We develop a highly scalable optimization method called "hierarchical group-thresholding" for solving a multi-task regression model with complex structured sparsity constraints on both input and output spaces. Despite the recent emergence…

Machine Learning · Statistics 2012-08-16 Seunghak Lee , Eric P. Xing

The need to reason about uncertainty in large, complex, and multi-modal datasets has become increasingly common across modern scientific environments. The ability to transform samples from one distribution $P$ to another distribution $Q$…

Machine Learning · Statistics 2018-11-30 Diego A. Mesa , Justin Tantiongloc , Marcela Mendoza , Todd P. Coleman

The success of the compressed sensing paradigm has shown that a substantial reduction in sampling and storage complexity can be achieved in certain linear and non-adaptive estimation problems. It is therefore an advisable strategy for…

Information Theory · Computer Science 2014-08-27 Peter Jung , Philipp Walk

Modern vision generators transport a base distribution to data through time-indexed measures, implemented as deterministic flows (ODEs) or stochastic diffusions (SDEs). Despite strong empirical performance, standard flow-matching objectives…

Machine Learning · Computer Science 2026-02-27 Chika Maduabuchi

The optimal transport barycenter (a.k.a. Wasserstein barycenter) is a fundamental notion of averaging that extends from the Euclidean space to the Wasserstein space of probability distributions. Computation of the unregularized barycenter…

Machine Learning · Statistics 2025-05-27 Kaheon Kim , Rentian Yao , Changbo Zhu , Xiaohui Chen

In this work we collect and compare to each other many different numerical methods for regularized regression problem and for the problem of projection on a hyperplane. Such problems arise, for example, as a subproblem of demand matrix…

We show that the discrete Sinkhorn algorithm - as applied in the setting of Optimal Transport on a compact manifold - converges to the solution of a fully non-linear parabolic PDE of Monge-Ampere type, in a large-scale limit. The latter…

Analysis of PDEs · Mathematics 2020-06-29 Robert J. Berman

We describe a compatible finite element discretisation for the shallow water equations on the rotating sphere, concentrating on integrating consistent upwind stabilisation into the framework. Although the prognostic variables are velocity…

Numerical Analysis · Mathematics 2018-10-17 J. Shipton , T. H. Gibson , C. J. Cotter

The recent literature on first order methods for smooth optimization shows that significant improvements on the practical convergence behaviour can be achieved with variable stepsize and scaling for the gradient, making this class of…

Numerical Analysis · Mathematics 2015-06-17 Silvia Bonettini , Alessandro Benfenati , Valeria Ruggiero

We present a framework to simultaneously align and smooth data in the form of multiple point clouds sampled from unknown densities with support in a d-dimensional Euclidean space. This work is motivated by applications in bioinformatics…

Methodology · Statistics 2019-08-28 Jérémie Bigot , Elsa Cazelles , Nicolas Papadakis

The ability to compare two degenerate probability distributions (i.e. two probability distributions supported on two distinct low-dimensional manifolds living in a much higher-dimensional space) is a crucial problem arising in the…

Machine Learning · Statistics 2017-10-23 Aude Genevay , Gabriel Peyré , Marco Cuturi

We consider accelerated versions of the operator Sinkhorn iteration (OSI) for solving scaling problems for completely positive maps. Based on the interpretation of OSI as alternating fixed point iteration, it has been recently proposed to…

Optimization and Control · Mathematics 2026-03-16 Henrik Eisenmann , Tasuku Soma , Xun Tang , André Uschmajew

This paper presents a new algorithmic framework for computing sparse solutions to large-scale linear discrete ill-posed problems. The approach is motivated by recent perspectives on iteratively reweighted norm schemes, viewed through the…

Numerical Analysis · Mathematics 2025-02-05 Lucas Onisk , Malena Sabaté Landman

Large scale optimization problems are ubiquitous in machine learning and data analysis and there is a plethora of algorithms for solving such problems. Many of these algorithms employ sub-sampling, as a way to either speed up the…

Optimization and Control · Mathematics 2016-02-29 Farbod Roosta-Khorasani , Michael W. Mahoney

Kernel-based methods for support vector machines (SVM) have shown highly advantageous performance in various applications. However, they may incur prohibitive computational costs for large-scale sample datasets. Therefore, data reduction…

Optimization and Control · Mathematics 2021-04-27 Shenglong Zhou
‹ Prev 1 8 9 10 Next ›