English
Related papers

Related papers: Vector-wise Joint Diagonalization of Almost Commut…

200 papers

We provide sufficient conditions for quantitative convergence of the iterates of proximal splitting algorithms for minimizing a sum of functions on a metric space. The theory does not assume that the functions have common minima, nor does…

Optimization and Control · Mathematics 2026-05-06 D. Russell Luke , Mahshid Mirhashemi

Stochastic variance reduction algorithms have recently become popular for minimizing the average of a large, but finite number of loss functions. The present paper proposes a Riemannian stochastic quasi-Newton algorithm with variance…

Machine Learning · Computer Science 2017-09-19 Hiroyuki Kasai , Hiroyuki Sato , Bamdev Mishra

We present an algorithm for minimizing a sum of functions that combines the computational efficiency of stochastic gradient descent (SGD) with the second order curvature information leveraged by quasi-Newton methods. We unify these…

Machine Learning · Computer Science 2014-12-02 Jascha Sohl-Dickstein , Ben Poole , Surya Ganguli

We show that any $n\times m$ matrix $A$ can be approximated in operator norm by a submatrix with a number of columns of order the stable rank of $A$. This improves on existing results by removing an extra logarithmic factor in the size of…

Functional Analysis · Mathematics 2018-07-19 Omer Friedland , Pierre Youssef

In this paper we develop a Jacobi-type algorithm for the approximate diagonalization of tensors of order $d\geq3$ via tensor trace maximization. For a general tensor this is an alternating least squares algorithm and the rotation matrices…

Numerical Analysis · Mathematics 2024-03-20 Erna Begovic , Ana Boksic

We give a simple approximation algorithm for a common generalization of many previously studied extensions of the maximum size stable matching problem with ties. These generalizations include the existence of critical vertices in the graph,…

Data Structures and Algorithms · Computer Science 2024-02-23 Gergely Csáji

We propose a communication efficient quasi-Newton method for large-scale multi-agent convex composite optimization. We assume the setting of a network of agents that cooperatively solve a global minimization problem with strongly convex…

Optimization and Control · Mathematics 2022-02-18 Yichuan Li , Petros G. Voulgaris , Nikolaos M. Freris

Building on the blueprint from Goemans and Williamson (1995) for the Max-Cut problem, we construct a polynomial-time approximation algorithm for orthogonally constrained quadratic optimization problems. First, we derive a semidefinite…

Optimization and Control · Mathematics 2026-03-17 Ryan Cory-Wright , Jean Pauphilet

In this paper we take a quasi-Newton approach to nonlinear eigenvalue problems (NEPs) of the type $M(\lambda)v=0$, where $M:\mathbb{C}\rightarrow\mathbb{C}^{n\times n}$ is a holomorphic function. We investigate which types of approximations…

Numerical Analysis · Mathematics 2017-03-01 Elias Jarlebring , Antti Koskela , Giampaolo Mele

In this paper a two-sided, parallel Kogbetliantz-type algorithm for the hyperbolic singular value decomposition (HSVD) of real and complex square matrices is developed, with a single assumption that the input matrix, of order $n$, admits…

Numerical Analysis · Mathematics 2022-05-10 Vedran Novaković , Sanja Singer

Finding the k-medianin a network involves identifying a subset of k vertices that minimize the total distance to all other vertices in a graph. This problem has been extensively studied in computer science, graph theory, operations…

Data Structures and Algorithms · Computer Science 2023-12-14 Roldan Pozo

We survey recent progress on efficient algorithms for approximately diagonalizing a square complex matrix in the models of rational (variable precision) and finite (floating point) arithmetic. This question has been studied across several…

Symbolic Computation · Computer Science 2023-05-19 Nikhil Srivastava

Despite there being significant work on developing spectral, and metric embedding based approximation algorithms for hypergraph generalizations of conductance, little is known regarding the approximability of hypergraph partitioning…

Data Structures and Algorithms · Computer Science 2023-07-27 Antares Chen , Lorenzo Orecchia , Erasmo Tani

This paper aims at solving the Hermitian SDC problem, i.e., that of \textit{simultaneously diagonalizing via $*$-congruence} a collection of finitely many (not need pairwise commute) Hermitian matrices. Theoretically, we provide some…

Numerical Analysis · Mathematics 2020-11-17 T. H. Le , T. N. Nguyen

We introduce the concept of Almost-Companion Matrix (ACM) by relaxing the non-derogatory property of the standard Companion Matrix (CM). That is, we define an ACM as a matrix whose characteristic polynomial coincides with a given monic and…

Quantum Physics · Physics 2023-02-22 L. A. Markovich , A. Migliore , A. Messina

Computing many eigenpairs of the Schr{\"o}dinger operator presents a computational bottleneck in large-scale quantum simulations due to the global communication overhead of explicit orthogonalization. To address this issue, we propose a…

Numerical Analysis · Mathematics 2026-05-26 Shengyue Wang , Aihui Zhou

Randomized sampling has recently been demonstrated to be an efficient technique for computing approximate low-rank factorizations of matrices for which fast methods for computing matrix vector products are available. This paper describes an…

Numerical Analysis · Mathematics 2008-06-17 Per-Gunnar Martinsson

This paper aims to present a fairly accessible generalization of several symmetric Gauss-Seidel decomposition based multi-block proximal alternating direction methods of multipliers (ADMMs) for convex composite optimization problems. The…

Optimization and Control · Mathematics 2020-06-09 Liang Chen , Defeng Sun , Kim-Chuan Toh , Ning Zhang

We demonstrate an implementation for an approximate rank-k SVD factorization, combining well-known randomized projection techniques with previously known paralel solutions in order to compute steps of the random projection based SVD…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-04 Burak Bayramli

We give a $2^{n+o(n)}$-time and space randomized algorithm for solving the exact Closest Vector Problem (CVP) on $n$-dimensional Euclidean lattices. This improves on the previous fastest algorithm, the deterministic…

Data Structures and Algorithms · Computer Science 2019-01-28 Divesh Aggarwal , Daniel Dadush , Noah Stephens-Davidowitz