English
Related papers

Related papers: Spectral Methods for Matrices and Tensors

200 papers

We give new algorithms based on the sum-of-squares method for tensor decomposition. Our results improve the best known running times from quasi-polynomial to polynomial for several problems, including decomposing random overcomplete…

Data Structures and Algorithms · Computer Science 2016-10-07 Tengyu Ma , Jonathan Shi , David Steurer

Phase retrieval refers to algorithmic methods for recovering a signal from its phaseless measurements. Local search algorithms that work directly on the non-convex formulation of the problem have been very popular recently. Due to the…

Information Theory · Computer Science 2020-03-06 Rishabh Dudeja , Milad Bakhshizadeh , Junjie Ma , Arian Maleki

We consider the problem of estimating the spectral norm of a matrix using only matrix-vector products. We propose a new Counterbalance estimator that provides upper bounds on the norm and derive probabilistic guarantees on its…

Numerical Analysis · Mathematics 2025-06-19 Alexey Naumov , Maxim Rakhuba , Denis Ryapolov , Sergey Samsonov

In the present paper we investigate methods related to both the Singular Spectrum Analysis (SSA) and subspace-based methods in signal processing. We describe common and specific features of these methods and consider different kinds of…

Methodology · Statistics 2011-07-21 Nina Golyandina

We describe a general approach for computing generators for elimination ideals associated with matrix and hypermatrix spectral decomposition constraints. We derive from these generators iterative procedures for approximating the spectral…

Spectral Theory · Mathematics 2015-03-24 Edinah K. Gnang

Multi-index models provide a popular framework to investigate the learnability of functions with low-dimensional structure and, also due to their connections with neural networks, they have been object of recent intensive study. In this…

Machine Learning · Statistics 2025-06-11 Filip Kovačević , Yihan Zhang , Marco Mondelli

Predictive State Representations (PSRs) are powerful techniques for modelling dynamical systems, which represent a state as a vector of predictions about future observable events (tests). In PSRs, one of the fundamental problems is the…

Machine Learning · Computer Science 2016-12-30 Yunlong Liu , Hexing Zhu

In this paper we propose new techniques to sample arbitrary third-order tensors, with an objective of speeding up tensor algorithms that have recently gained popularity in machine learning. Our main contribution is a new way to select, in a…

Machine Learning · Statistics 2015-02-23 Srinadh Bhojanapalli , Sujay Sanghavi

Matrix congruence extends naturally to the setting of tensors. We apply methods from tensor decomposition, algebraic geometry and numerical optimization to this group action. Given a tensor in the orbit of another tensor, we compute a…

Numerical Analysis · Mathematics 2018-11-26 Max Pfeffer , Anna Seigal , Bernd Sturmfels

Tensors play a central role in many modern machine learning and signal processing applications. In such applications, the target tensor is usually of low rank, i.e., can be expressed as a sum of a small number of rank one tensors. This…

Machine Learning · Statistics 2015-05-18 Parikshit Shah , Nikhil Rao , Gongguo Tang

Tensor network contraction is a fundamental mathematical operation that generalizes the dot product and matrix multiplication. It finds applications in numerous domains, such as database systems, graph theory, machine learning, probability…

Data Structures and Algorithms · Computer Science 2026-03-10 Mike Heddes , Igor Nunes , Tony Givargis , Alex Nicolau

Singular values of a data in a matrix form provide insights on the structure of the data, the effective dimensionality, and the choice of hyper-parameters on higher-level data analysis tools. However, in many practical applications such as…

Machine Learning · Statistics 2017-03-21 Ashish Khetan , Sewoong Oh

We develop spectral methods for ODEs and operator eigenvalue problems that are based on a least-squares formulation of the problem. The key tool is a method for rectangular generalized eigenvalue problems, which we extend to quasimatrices…

Numerical Analysis · Mathematics 2021-09-14 Behnam Hashemi , Yuji Nakatsukasa

Clustering is the problem of separating a set of objects into groups (called clusters) so that objects within the same cluster are more similar to each other than to those in different clusters. Spectral clustering is a now well-known…

Machine Learning · Computer Science 2012-11-16 B. Cung , T. Jin , J. Ramirez , A. Thompson , C. Boutsidis , D. Needell

Pseudospectra and structured pseudospectra are important tools for the analysis of matrices. Their computation, however, can be very demanding for all but small matrices. A new approach to compute approximations of pseudospectra and…

Numerical Analysis · Mathematics 2016-11-16 Silvia Noschese , Lothar Reichel

The wave equation for vectors and symmetric tensors in spherical coordinates is studied under the divergence-free constraint. We describe a numerical method, based on the spectral decomposition of vector/tensor components onto spherical…

General Relativity and Quantum Cosmology · Physics 2009-11-23 Jerome Novak , Jean-Louis Cornou , Nicolas Vasset

In our article we consider some algebraical methods which may be useful in some inverse spectral problems. The reconstraction of the matrix from its minors is considered.

Commutative Algebra · Mathematics 2007-05-23 A. V. Mouftakhov

Many common methods for data analysis rely on linear algebra. We provide new results connecting data analysis error to numerical accuracy, which leads to the first meaningful stopping criterion for two way spectral partitioning. More…

Numerical Analysis · Computer Science 2016-02-03 James P. Fairbanks , Geoffrey D. Sanders , David A. Bader

We consider the 2D quasi-periodic scattering problem in optics, which has been modelled by a boundary value problem governed by Helmholtz equation with transparent boundary conditions. A spectral collocation method and a tensor product…

Numerical Analysis · Mathematics 2015-07-14 Kui Du

An essential ingredient of a spectral method is the choice of suitable bases for test and trial spaces. On complex domains, these bases are harder to devise, necessitating the use of domain partitioning techniques such as the spectral…

Numerical Analysis · Mathematics 2021-11-17 Saad Qadeer , Ehssan Nazockdast , Boyce E. Griffith