English
Related papers

Related papers: Shrunk subspaces via operator Sinkhorn iteration

200 papers

In this paper, we analyze the convergence of a distributed Robbins-Monro algorithm for both constrained and unconstrained optimization in multi-agent systems. The algorithm searches for local minima of a (nonconvex) objective function which…

Information Theory · Computer Science 2011-04-20 Pascal Bianchi , Jérémie Jakubowicz

In this work, we deal with rank-constrained integer least-squares optimization problems arising in low-rank matrix factorization related applications. We propose a solution for constrained integer least-squares problem subject to equality,…

Optimization and Control · Mathematics 2018-11-06 Arun Ayyar , Nirav Bhatt

We study the $\ell_0$-Low Rank Approximation Problem, where the goal is, given an $m \times n$ matrix $A$, to output a rank-$k$ matrix $A'$ for which $\|A'-A\|_0$ is minimized. Here, for a matrix $B$, $\|B\|_0$ denotes the number of its…

Data Structures and Algorithms · Computer Science 2018-10-02 Karl Bringmann , Pavel Kolev , David P. Woodruff

The purpose of this work is to develop a framework to calibrate signed datasets so as to be consistent with specified marginals by suitably extending the Schr\"odinger-Fortet-Sinkhorn paradigm. Specifically, we seek to revise…

Machine Learning · Statistics 2023-08-24 Anqi Dong , Tryphon T. Georgiou , Allen Tannenbaum

The Wasserstein metric is broadly used in optimal transport for comparing two probabilistic distributions, with successful applications in various fields such as machine learning, signal processing, seismic inversion, etc. Nevertheless, the…

Optimization and Control · Mathematics 2022-02-22 Qichen Liao , Jing Chen , Zihao Wang , Bo Bai , Shi Jin , Hao Wu

Low-rank representation~(LRR) has been a significant method for segmenting data that are generated from a union of subspaces. It is, however, known that solving the LRR program is challenging in terms of time complexity and memory…

Machine Learning · Statistics 2017-10-24 Jie Shen , Ping Li , Huan Xu

In this work, we consider the matrix completion problem, where the objective is to reconstruct a low-rank matrix from a few observed entries. A commonly employed approach involves nuclear norm minimization. For this method to succeed, the…

Signal Processing · Electrical Eng. & Systems 2024-06-25 Hamideh. Sadat Fazael Ardakani , Sajad Daei , Arash Amini , Mikael Skoglund , Gabor Fodor

In this study, we consider the numerical solution of large systems of linear equations obtained from the stochastic Galerkin formulation of stochastic partial differential equations. We propose an iterative algorithm that exploits the…

Numerical Analysis · Mathematics 2016-05-18 Kookjin Lee , Howard C. Elman

For any given metric space, obtaining an offline optimal solution to the classical $k$-server problem can be reduced to solving a minimum-cost partial bipartite matching between two point sets $A$ and $B$ within that metric space. For…

Computational Geometry · Computer Science 2025-04-09 Sharath Raghvendra , Pouyan Shirzadian , Rachita Sowle

The explicit split-operator algorithm is often used for solving the linear and nonlinear time-dependent Schr\"{o}dinger equations. However, when applied to certain nonlinear time-dependent Schr\"{o}dinger equations, this algorithm loses…

Chemical Physics · Physics 2024-09-26 Julien Roulet , Jiří Vaníček

Low rank approximation is an important tool used in many applications of signal processing and machine learning. Recently, randomized sketching algorithms were proposed to effectively construct low rank approximations and obtain approximate…

Information Theory · Computer Science 2018-09-11 Shashanka Ubaru , Arya Mazumdar , Yousef Saad

We introduce in this paper a novel strategy for efficiently approximating the Sinkhorn distance between two discrete measures. After identifying neglectable components of the dual solution of the regularized Sinkhorn problem, we propose to…

Machine Learning · Statistics 2020-01-22 Mokhtar Z. Alaya , Maxime Bérar , Gilles Gasso , Alain Rakotomamonjy

Positive semi-definite matrices commonly occur as normal matrices of least squares problems in statistics or as kernel matrices in machine learning and approximation theory. They are typically large and dense. Thus algorithms to solve…

Numerical Analysis · Mathematics 2020-12-01 Markus Hegland , Frank deHoog

The subspace approximation problem Subspace($k$,$p$) asks for a $k$-dimensional linear subspace that fits a given set of points optimally, where the error for fitting is a generalization of the least squares fit and uses the $\ell_{p}$ norm…

Data Structures and Algorithms · Computer Science 2011-01-04 Amit Deshpande , Kasturi Varadarajan , Madhur Tulsiani , Nisheeth K. Vishnoi

Machine learning and artificial intelligence algorithms typically require large amount of data for training. This means that for nonlinear aeroelastic applications, where small training budgets are driven by the high computational burden…

Motivated by the philosophy and phenomenal success of compressed sensing, the problem of reconstructing a matrix from a sampling of its entries has attracted much attention recently. Such a problem can be viewed as an information-theoretic…

Information Theory · Computer Science 2009-05-15 Zhisu Zhu , Anthony Man-Cho So , Yinyu Ye

We consider the nonlinear inverse problem of learning a transition operator $\mathbf{A}$ from partial observations at different times, in particular from sparse observations of entries of its powers…

Information Theory · Computer Science 2022-12-02 Christian Kümmerle , Mauro Maggioni , Sui Tang

Let $f:2^{E} \rightarrow \mathbb{Z}_+$ be a submodular function on a ground set $E = [n]$, and let $P(f)$ denote its extended polymatroid. Given a direction $d \in \mathbb{Z}^n$ with at least one positive entry, the line search problem is…

Optimization and Control · Mathematics 2026-03-10 Swati Gupta , Alec Zhu

In this paper we present a novel non-parametric method of simplifying piecewise linear curves and we apply this method as a statistical approximation of structure within sequential data in the plane. We consider the problem of minimizing…

Computational Geometry · Computer Science 2012-05-31 Stephane Durocher , Alexandre Leblanc , Jason Morrison , Matthew Skala

We formalize the problem of selecting the optimal set of options for planning as that of computing the smallest set of options so that planning converges in less than a given maximum of value-iteration passes. We first show that the problem…

Artificial Intelligence · Computer Science 2019-03-19 Yuu Jinnai , David Abel , D Ellis Hershkowitz , Michael Littman , George Konidaris