English
Related papers

Related papers: Approximation and Structured Prediction with Spars…

200 papers

We consider sampling from a Gibbs distribution by evolving finitely many particles. We propose a preconditioned version of a recently proposed noise-free sampling method, governed by approximating the score function with the numerically…

Machine Learning · Statistics 2026-05-18 Hong Ye Tan , Stanley Osher , Wuchen Li

We present a new optimization-based structure-preserving model order reduction (MOR) method for port-Hamiltonian descriptor systems (pH-DAEs) with differentiation index two. Our method is based on a novel parameterization that allows us to…

Systems and Control · Electrical Eng. & Systems 2022-06-09 Tim Moser , Paul Schwerdtner , Volker Mehrmann , Matthias Voigt

We present an adaptive sampling strategy for the optimization-based structure preserving model order reduction (MOR) algorithm developed in [Schwerdtner, P. and Voigt, M. (2020). Structure preserving model order reduction by parameter…

Systems and Control · Electrical Eng. & Systems 2021-06-23 Paul Schwerdtner , Matthias Voigt

Sparse estimation methods are aimed at using or obtaining parsimonious representations of data or models. They were first dedicated to linear variable selection but numerous extensions have now emerged such as structured sparsity or kernel…

Machine Learning · Computer Science 2011-11-24 Francis Bach , Rodolphe Jenatton , Julien Mairal , Guillaume Obozinski

This paper discusses the efficiency of Hybrid Primal-Dual (HPD) type algorithms to approximate solve discrete Optimal Transport (OT) and Wasserstein Barycenter (WB) problems, with and without entropic regularization. Our first contribution…

Optimization and Control · Mathematics 2022-09-01 Antonin Chambolle , Juan Pablo Contreras

We consider the problem of sparse coding, where each sample consists of a sparse linear combination of a set of dictionary atoms, and the task is to learn both the dictionary elements and the mixing coefficients. Alternating minimization is…

Machine Learning · Computer Science 2014-07-30 Alekh Agarwal , Animashree Anandkumar , Prateek Jain , Praneeth Netrapalli

Scaling algorithms for entropic transport-type problems have become a very popular numerical method, encompassing Wasserstein barycenters, multi-marginal problems, gradient flows and unbalanced transport. However, a standard implementation…

Optimization and Control · Mathematics 2019-02-12 Bernhard Schmitzer

In high-dimensional settings, sparse structures are critical for efficiency in term of memory and computation complexity. For a linear system, to find the sparsest solution provided with an over-complete dictionary of features directly is…

Machine Learning · Statistics 2020-07-09 Yiping Jiang , Tianshi Chen

In this paper we propose to perform model ensembling in a multiclass or a multilabel learning setting using Wasserstein (W.) barycenters. Optimal transport metrics, such as the Wasserstein distance, allow incorporating semantic side…

Machine Learning · Computer Science 2019-02-14 Pierre Dognin , Igor Melnyk , Youssef Mroueh , Jerret Ross , Cicero Dos Santos , Tom Sercu

We study metric projections onto cones in the Wasserstein space of probability measures, defined by stochastic orders. Dualities for backward and forward projections are established under general conditions. Dual optimal solutions and their…

Probability · Mathematics 2021-10-12 Young-Heon Kim , Yuan Long Ruan

When solving linear systems arising from PDE discretizations, iterative methods (such as Conjugate Gradient, GMRES, or MINRES) are often the only practical choice. To converge in a small number of iterations, however, they have to be…

Numerical Analysis · Mathematics 2021-02-05 Bazyli Klockiewicz , Eric Darve

We study sparse recovery with structured random measurement matrices having independent, identically distributed, and uniformly bounded rows and with a nontrivial covariance structure. This class of matrices arises from random sampling of…

Information Theory · Computer Science 2020-05-15 Simone Brugiapaglia , Sjoerd Dirksen , Hans Christian Jung , Holger Rauhut

B\'ezier simplex fitting algorithms have been recently proposed to approximate the Pareto set/front of multi-objective continuous optimization problems. These new methods have shown to be successful at approximating various shapes of Pareto…

Machine Learning · Computer Science 2021-04-14 Akinori Tanaka , Akiyoshi Sannai , Ken Kobayashi , Naoki Hamada

We consider probabilistic models for sequential observations which exhibit gradual transitions among a finite number of states. We are particularly motivated by applications such as human activity analysis where observed accelerometer time…

Machine Learning · Computer Science 2023-09-22 Kevin C. Cheng , Shuchin Aeron , Michael C. Hughes , Eric L. Miller

We consider a multimarginal optimal transport, which includes as a particular case the Wasserstein barycenter problem. In this problem one has to find an optimal coupling between $m$ probability measures, which amounts to finding a tensor…

Optimization and Control · Mathematics 2020-09-11 Nazarii Tupitsa , Pavel Dvurechensky , Alexander Gasnikov , César A. Uribe

We develop a general theory to address a consensus-based combination of estimations in a parallelized or distributed estimation setting. Taking into account the possibility of very discrepant estimations, instead of a full consensus we…

Methodology · Statistics 2017-05-12 P. C. Álvarez-Esteban , E. del Barrio , J. A. Cuesta-Albertos , C. Matrán

We consider machine learning techniques to develop low-latency approximate solutions to a class of inverse problems. More precisely, we use a probabilistic approach for the problem of recovering sparse stochastic signals that are members of…

Information Theory · Computer Science 2016-09-06 Steffen Limmer , Sławomir Stańczak

This paper studies the sparse identification problem of unknown sparse parameter vectors in stochastic dynamic systems. Firstly, a novel sparse identification algorithm is proposed, which can generate sparse estimates based on least squares…

Optimization and Control · Mathematics 2024-04-02 Ziming Wang , Xinghua Zhu

We introduce LOT Wassmap, a computationally feasible algorithm to uncover low-dimensional structures in the Wasserstein space. The algorithm is motivated by the observation that many datasets are naturally interpreted as probability…

Machine Learning · Computer Science 2023-02-16 Alexander Cloninger , Keaton Hamm , Varun Khurana , Caroline Moosmüller

We propose a novel approach to the problem of multilevel clustering, which aims to simultaneously partition data in each group and discover grouping patterns among groups in a potentially large hierarchically structured corpus of data. Our…

Machine Learning · Statistics 2017-06-14 Nhat Ho , XuanLong Nguyen , Mikhail Yurochkin , Hung Hai Bui , Viet Huynh , Dinh Phung