English
Related papers

Related papers: Geometrical inverse preconditioning for symmetric …

200 papers

This paper considers the minimization of a general objective function $f(X)$ over the set of rectangular $n\times m$ matrices that have rank at most $r$. To reduce the computational burden, we factorize the variable $X$ into a product of…

Information Theory · Computer Science 2018-07-04 Zhihui Zhu , Qiuwei Li , Gongguo Tang , Michael B. Wakin

We consider using gradient descent to minimize the nonconvex function $f(X)=\phi(XX^{T})$ over an $n\times r$ factor matrix $X$, in which $\phi$ is an underlying smooth convex cost function defined over $n\times n$ matrices. While only a…

Optimization and Control · Mathematics 2025-04-22 Gavin Zhang , Salar Fattahi , Richard Y. Zhang

The affine inverse eigenvalue problem consists of identifying a real symmetric matrix with a prescribed set of eigenvalues in an affine space. Due to its ubiquity in applications, various instances of the problem have been widely studied in…

Optimization and Control · Mathematics 2019-11-07 Utkan Candogan , Yong Sheng Soh , Venkat Chandrasekaran

We consider an automatic construction of locally optimal preconditioners for positive definite linear systems. To achieve this goal, we introduce a differentiable loss function that does not explicitly include the estimation of minimal…

Numerical Analysis · Mathematics 2022-05-14 Vladimir Fanaskov , Ivan Oseledets

We study a class of parametrizations of convex cones of positive semidefinite matrices with prescribed zeros. Each such cone corresponds to a graph whose non-edges determine the prescribed zeros. Each parametrization in this class is a…

Algebraic Geometry · Mathematics 2012-02-13 Mathias Drton , Josephine Yu

We propose a two-level nested preconditioned iterative scheme for solving sparse linear systems of equations in which the coefficient matrix is symmetric and indefinite with relatively small number of negative eigenvalues. The proposed…

Numerical Analysis · Computer Science 2019-01-29 Murat Manguoglu , Volker Mehrmann

A symmetric matrix $A$ is completely positive (CP) if there exists an entrywise nonnegative matrix $V$ such that $A = V V ^T$. In this paper, we study the CP-matrix approximation problem of projecting a matrix onto the intersection of a set…

Optimization and Control · Mathematics 2014-11-05 Jinyan Fan , Anwa Zhou

Adaptive regularization methods pre-multiply a descent direction by a preconditioning matrix. Due to the large number of parameters of machine learning problems, full-matrix preconditioning methods are prohibitively expensive. We show how…

Machine Learning · Computer Science 2020-11-19 Naman Agarwal , Brian Bullins , Xinyi Chen , Elad Hazan , Karan Singh , Cyril Zhang , Yi Zhang

Toral automorphisms, represented by unimodular integer matrices, are investigated with respect to their symmetries and reversing symmetries. We characterize the symmetry groups of GL(n,Z) matrices with simple spectrum through their…

Dynamical Systems · Mathematics 2019-07-16 Michael Baake , John A. G. Roberts

We investigate how to solve smooth matrix optimization problems with general linear inequality constraints on the eigenvalues of a symmetric matrix. We present solution methods to obtain exact global minima for linear objective functions,…

Optimization and Control · Mathematics 2025-07-23 Casey Garner , Gilad Lerman , Shuzhong Zhang

We consider the approximation of the inverse of the finite element stiffness matrix in the data sparse $\mathcal{H}$-matrix format. For a large class of shape regular but possibly non-uniform meshes including graded meshes, we prove that…

Numerical Analysis · Mathematics 2024-07-25 Niklas Angleitner , Markus Faustmann , Jens Markus Melenk

A class of preconditioners is introduced to enhance geometry optimisation and transition state search of molecular systems. We start from the Hessian of molecular mechanical terms, decompose it and retain only its positive definite part to…

Chemical Physics · Physics 2018-04-06 Letif Mones , Gabor Csanyi , Christoph Ortner

A new generalized cyclic symmetric structure in the factor matrices of polyadic decompositions of matrix multiplication tensors for non-square matrix multiplication is proposed to reduce the number of variables in the optimization problem…

Numerical Analysis · Mathematics 2025-03-19 Charlotte Vermeylen , Marc Van Barel

In this paper we consider linear systems with dense-matrices which arise from numerical solution of boundary integral equations. Such matrices can be well-approximated with $\mathcal{H}^2$-matrices. We propose several new preconditioners…

Numerical Analysis · Mathematics 2014-12-04 Daria Sushnikova , Ivan V. Oseledets

This work aims to accelerate the convergence of proximal gradient methods used to solve regularized linear inverse problems. This is achieved by designing a polynomial-based preconditioner that targets the eigenvalue spectrum of the normal…

The geometric mean of two matrices is considered and analyzed from a computational viewpoint. Some useful theoretical properties are derived and an analysis of the conditioning is performed. Several numerical algorithms based on different…

Numerical Analysis · Mathematics 2012-01-04 Bruno Iannazzo

We investigate the symmetric inverse M-matrix problem from a geometric perspective. The central question in this geometric context is, which conditions on the k-dimensional facets of an n-simplex S guarantee that S has no obtuse dihedral…

Rings and Algebras · Mathematics 2015-12-10 Jan Brandts , Apo Cihangir

Several preconditioned AOR methods have been proposed to solve system of linear equations $Ax=b$, where $A \in \mathbb{R}^{n \times n}$ is a unit Z-matrix. The aim of this paper is to give a comparison result for a class of preconditioners…

Numerical Analysis · Mathematics 2014-04-09 Davod Khojasteh Salkuyeh , Mohsen Hasani , Fatemeh Panjeh Ali Beik

We prove that the inverse of a positive-definite matrix can be approximated by a weighted-sum of a small number of matrix exponentials. Combining this with a previous result [OSV12], we establish an equivalence between matrix inversion and…

Data Structures and Algorithms · Computer Science 2016-08-23 Sushant Sachdeva , Nisheeth K. Vishnoi

In this paper, we investigate the generalized low rank approximation to the symmetric positive semidefinite matrix in the Frobenius norm: $$\underset{ rank(X)\leq k}{\min} \sum^m_{i=1}\left \Vert A_i - B_i XB_i^T \right \Vert^2_F,$$ where…

Optimization and Control · Mathematics 2019-12-24 Haixia Chang , Chunmei Li , Qionghui Huang