English
Related papers

Related papers: Vector-wise Joint Diagonalization of Almost Commut…

200 papers

A question going back to Halmos asks when two approximately commuting matrices of a certain kind are close to exactly commuting matrices of the same kind. It has long been known that there is a winding number obstruction for approximately…

Operator Algebras · Mathematics 2025-12-22 Adam Dor-On , Lucas Hall , Ilya Kachkovskiy

Almost-commuting matrices with respect to the normalized Hilbert-Schmidt norm are considered. Normal almost commuting matrices are proved to be near commuting.

Algebraic Geometry · Mathematics 2010-02-17 Lev Glebsky

Computing the top eigenvectors of a matrix is a problem of fundamental interest to various fields. While the majority of the literature has focused on analyzing the reconstruction error of low-rank matrices associated with the retrieved…

Machine Learning · Computer Science 2022-02-17 Ruo-Chun Tzeng , Po-An Wang , Florian Adriaens , Aristides Gionis , Chi-Jen Lu

SVD (singular value decomposition) is one of the basic tools of machine learning, allowing to optimize basis for a given matrix. However, sometimes we have a set of matrices $\{A_k\}_k$ instead, and would like to optimize a single common…

Machine Learning · Computer Science 2022-04-19 Jarek Duda

We explore the connection between two problems that have arisen independently in the signal processing and related fields: the estimation of the geometric mean of a set of symmetric positive definite (SPD) matrices and their approximate…

Differential Geometry · Mathematics 2015-05-28 Marco Congedo , Bijan Afsari , Alexandre Barachant , Maher Moakher

We develop a supersymmetric field theoretical description of the Gaussian ensemble of the almost diagonal Hermitian Random Matrices. The matrices have independent random entries H_{ij} with parametrically small off-diagonal elements…

Disordered Systems and Neural Networks · Physics 2016-09-07 Oleg Yevtushenko , Alexander Ossipov

The results on Vandermonde-like matrices were introduced as a generalization of polynomial Vandermonde matrices, and the displacement structure of these matrices was used to derive an inversion formula. In this paper we first present a fast…

Numerical Analysis · Mathematics 2014-01-10 Sirani M. Perera , Grigory Bonik , Vadim Olshevsky

In this paper, we consider the exact/approximate general joint block diagonalization (GJBD) problem of a matrix set $\{A_i\}_{i=0}^p$ ($p\ge 1$), where a nonsingular matrix $W$ (often referred to as diagonalizer) needs to be found such that…

Numerical Analysis · Mathematics 2017-04-20 Yunfeng Cai , Guanghui Cheng , Decai Shi

We propose a new joint image reconstruction method by recovering edge directly from observed data. More specifically, we reformulate joint image reconstruction with vectorial total-variation regularization as an $l_1$ minimization problem…

Numerical Analysis · Mathematics 2017-12-11 Yunmei Chen , Ruogu Fang , Xiaojing Ye

This paper concerns exact linesearch quasi-Newton methods for minimizing a quadratic function whose Hessian is positive definite. We show that by interpreting the method of conjugate gradients as a particular exact linesearch quasi-Newton…

Optimization and Control · Mathematics 2017-08-23 Anders Forsgren , Tove Odland

We present a Bayesian scheme for the approximate diagonalisation of several square matrices which are not necessarily symmetric. A Gibbs sampler is derived to simulate samples of the common eigenvectors and the eigenvalues for these…

Computation · Statistics 2012-06-22 Mingjun Zhong , Mark Girolami

We consider the problem of approximate joint triangularization of a set of noisy jointly diagonalizable real matrices. Approximate joint triangularizers are commonly used in the estimation of the joint eigenstructure of a set of matrices,…

Numerical Analysis · Computer Science 2016-07-05 Nicolo Colombo , Nikos Vlassis

By using the Hadamard matrix product concept, this paper introduces two generalized matrix formulation forms of numerical analogue of nonlinear differential operators. The SJT matrix-vector product approach is found to be a simple,…

Computational Engineering, Finance, and Science · Computer Science 2024-09-21 W. Chen

In this paper, we propose a quasi-Newton method for solving smooth and monotone nonlinear equations, including unconstrained minimization and minimax optimization as special cases. For the strongly monotone setting, we establish two global…

Optimization and Control · Mathematics 2024-10-04 Ruichen Jiang , Aryan Mokhtari

Optimization problems with composite functions consist of an objective function which is the sum of a smooth and a (convex) nonsmooth term. This particular structure is exploited by the class of proximal gradient methods and some of their…

Optimization and Control · Mathematics 2022-10-17 Christian Kanzow , Theresa Lechner

In this document, some elements of the theory and algorithmics corresponding to the existence and computability of approximate joint eigenpairs for finite collections of matrices with applications to model order reduction, are presented.…

Numerical Analysis · Mathematics 2022-10-21 Terry A. Loring , Fredy Vides

We propose new algorithms for singular value decomposition (SVD) of very large-scale matrices based on a low-rank tensor approximation technique called the tensor train (TT) format. The proposed algorithms can compute several dominant…

Numerical Analysis · Mathematics 2016-02-11 Namgil Lee , Andrzej Cichocki

A new method to represent and approximate rotation matrices is introduced. The method represents approximations of a rotation matrix $Q$ with linearithmic complexity, i.e. with $\frac{1}{2}n\lg(n)$ rotations over pairs of coordinates,…

Machine Learning · Computer Science 2014-04-30 Michael Mathieu , Yann LeCun

We describe an algorithm that, given any full-rank matrix A having fewer rows than columns, can rapidly compute the orthogonal projection of any vector onto the null space of A, as well as the orthogonal projection onto the row space of A,…

Numerical Analysis · Computer Science 2011-05-26 Vladimir Rokhlin , Mark Tygert

In this paper, the proximal point algorithm for quasi-convex minimization problem in nonpositive curvature metric spaces is studied. We prove $\Delta$-convergence of the generated sequence to a critical point (which is defined in the text)…

Functional Analysis · Mathematics 2016-11-08 Hadi Khatibzadeh , Vahid Mohebbi