English
Related papers

Related papers: Structure and approximation properties of Laplacia…

200 papers

Low-rank matrix approximations, such as the truncated singular value decomposition and the rank-revealing QR decomposition, play a central role in data analysis and scientific computing. This work surveys and extends recent research which…

Numerical Analysis · Mathematics 2014-04-29 Nathan Halko , Per-Gunnar Martinsson , Joel A. Tropp

We show that Laplacian and symmetric diagonally dominant (SDD) matrices can be well approximated by linear-sized sparse Cholesky factorizations. We show that these matrices have constant-factor approximations of the form $L L^{T}$, where…

Data Structures and Algorithms · Computer Science 2015-08-14 Yin Tat Lee , Richard Peng , Daniel A. Spielman

Sparse tensor best rank-1 approximation (BR1Approx), which is a sparsity generalization of the dense tensor BR1Approx, and is a higher-order extension of the sparse matrix BR1Approx, is one of the most important problems in sparse tensor…

Numerical Analysis · Mathematics 2022-07-15 Xianpeng Mao , Yuning Yang

We consider the problem of estimation of a low-rank matrix from a limited number of noisy rank-one projections. In particular, we propose two fast, non-convex \emph{proper} algorithms for matrix recovery and support them with rigorous…

Machine Learning · Statistics 2017-05-23 Mohammadreza Soltani , Chinmay Hegde

In this article, we present a family of numerical approaches to solve high-dimensional linear non-symmetric problems. The principle of these methods is to approximate a function which depends on a large number of variates by a sum of tensor…

Functional Analysis · Mathematics 2012-10-26 Eric Cances , Virginie Ehrlacher , Tony Lelievre

In this study, we consider the numerical solution of large systems of linear equations obtained from the stochastic Galerkin formulation of stochastic partial differential equations. We propose an iterative algorithm that exploits the…

Numerical Analysis · Mathematics 2016-05-18 Kookjin Lee , Howard C. Elman

The statistical leverage scores of a matrix $A$ are the squared row-norms of the matrix containing its (top) left singular vectors and the coherence is the largest leverage score. These quantities are of interest in recently-popular…

Data Structures and Algorithms · Computer Science 2012-12-06 Petros Drineas , Malik Magdon-Ismail , Michael W. Mahoney , David P. Woodruff

Hierarchical matrices approximate a given matrix by a decomposition into low-rank submatrices that can be handled efficiently in factorized form. $\mathcal{H}^2$-matrices refine this representation following the ideas of fast multipole…

Numerical Analysis · Mathematics 2024-04-24 Steffen Börm

Matrices are exceptionally useful in various fields of study as they provide a convenient framework to organize and manipulate data in a structured manner. However, modern matrices can involve billions of elements, making their storage and…

Machine Learning · Computer Science 2023-10-18 Rajarshi Saha , Varun Srivastava , Mert Pilanci

Applying Gaussian processes (GPs) to very large datasets remains a challenge due to limited computational scalability. Matrix structures, such as the Kronecker product, can accelerate operations significantly, but their application commonly…

The proposed article aims at offering a comprehensive tutorial for the computational aspects of structured matrix and tensor factorization. Unlike existing tutorials that mainly focus on {\it algorithmic procedures} for a small set of…

Signal Processing · Electrical Eng. & Systems 2023-07-19 Xiao Fu , Nico Vervliet , Lieven De Lathauwer , Kejun Huang , Nicolas Gillis

We analyze effective approximation of unitary matrices. In our formulation, a unitary matrix is represented as a product of rotations in two-dimensional subspaces, so-called Givens rotations. Instead of the quadratic dimension dependence…

Optimization and Control · Mathematics 2019-05-16 Thomas Frerix , Joan Bruna

The multiplication of matrices is an important arithmetic operation in computational mathematics. In the context of hierarchical matrices, this operation can be realized by the multiplication of structured block-wise low-rank matrices,…

Numerical Analysis · Mathematics 2018-05-24 Jürgen Dölz , Helmut Harbrecht , Michael D. Multerer

Several graph data mining, signal processing, and machine learning downstream tasks rely on information related to the eigenvectors of the associated adjacency or Laplacian matrix. Classical eigendecomposition methods are powerful when the…

Machine Learning · Statistics 2026-03-23 Mohammad Eini , Abdullah Karaaslanli , Vassilis Kalantzis , Panagiotis A. Traganitis

A grid-overlay finite difference method is proposed for the numerical approximation of the fractional Laplacian on arbitrary bounded domains. The method uses an unstructured simplicial mesh and an overlay uniform grid for the underlying…

Numerical Analysis · Mathematics 2024-04-08 Weizhang Huang , Jinye Shen

Structured low-rank approximation is the problem of minimizing a weighted Frobenius distance to a given matrix among all matrices of fixed rank in a linear space of matrices. We study exact solutions to this problem by way of computational…

Optimization and Control · Mathematics 2017-02-23 Giorgio Ottaviani , Pierre-Jean Spaenlehauer , Bernd Sturmfels

Low rank approximation is an important tool used in many applications of signal processing and machine learning. Recently, randomized sketching algorithms were proposed to effectively construct low rank approximations and obtain approximate…

Information Theory · Computer Science 2018-09-11 Shashanka Ubaru , Arya Mazumdar , Yousef Saad

Tucker decomposition is the cornerstone of modern machine learning on tensorial data analysis, which have attracted considerable attention for multiway feature extraction, compressive sensing, and tensor completion. The most challenging…

Machine Learning · Computer Science 2015-05-12 Qibin Zhao , Liqing Zhang , Andrzej Cichocki

Efficiently representing real world data in a succinct and parsimonious manner is of central importance in many fields. We present a generalized greedy pursuit framework, allowing us to efficiently solve structured matrix factorization…

Machine Learning · Computer Science 2016-02-15 Rajiv Khanna , Michael Tschannen , Martin Jaggi

We present a class of fast subspace tracking algorithms based on orthogonal iterations for structured matrices/pencils that can be represented as small rank perturbations of unitary matrices. The algorithms rely upon an updated data sparse…

Numerical Analysis · Mathematics 2021-04-23 Roberto Bevilacqua , Gianna M. Del Corso , Luca Gemignani