English
Related papers

Related papers: Second order accurate distributed eigenvector comp…

200 papers

High-dimensional vector autoregression with measurement error is frequently encountered in a large variety of scientific and business applications. In this article, we study statistical inference of the transition matrix under this model.…

Methodology · Statistics 2020-09-18 Xiang Lyu , Jian Kang , Lexin Li

We focus here on a class of fourth-order parabolic equations that can be written as a system of second-order equations by introducing an auxiliary variable. We design a novel second-order fully discrete mixed finite element method to…

Numerical Analysis · Mathematics 2020-08-28 Sana Keita , Abdelaziz Beljadid , Yves Bourgault

We review the problem of how to compute the spectral density of sparse symmetric random matrices, i.e. weighted adjacency matrices of undirected graphs. Starting from the Edwards-Jones formula, we illustrate the milestones of this line of…

Statistical Mechanics · Physics 2021-08-11 Vito A R Susca , Pierpaolo Vivo , Reimer Kühn

Let A be a self-adjoint operator acting on a Hilbert space. The notion of second order spectrum of A relative to a given finite-dimensional subspace L has been studied recently in connection with the phenomenon of spectral pollution in the…

Spectral Theory · Mathematics 2010-08-17 Lyonell Boulton , Michael Strauss

In this paper the asymptotic distributions are exactly solved for linearly independent solutions considering problems of the second order and for the coefficients of asymptotic destribution the recurent formulas are obtained. Further, using…

Mathematical Physics · Physics 2007-05-23 Yu. A. Mamedov , H. I. Ahmadov

Second-order partial differential equations in non-divergence form are considered. Equations of this kind typically arise as subproblems for the solution of Hamilton-Jacobi-Bellman equations in the context of stochastic optimal control, or…

Numerical Analysis · Mathematics 2020-08-13 Jan Blechschmidt , Roland Herzog , Max Winkler

This paper investigates a statistical procedure for testing the equality of two independent estimated covariance matrices when the number of potentially dependent data vectors is large and proportional to the size of the vectors, that is,…

Statistics Theory · Mathematics 2020-03-09 Rémy Mariétan , Stephan Morgenthaler

We propose and investigate two new methods to approximate $f({\bf A}){\bf b}$ for large, sparse, Hermitian matrices ${\bf A}$. The main idea behind both methods is to first estimate the spectral density of ${\bf A}$, and then find…

Numerical Analysis · Computer Science 2018-08-30 Li Fan , David I Shuman , Shashanka Ubaru , Yousef Saad

This work aims at estimating inverse autocovariance matrices of long memory processes admitting a linear representation. A modified Cholesky decomposition is used in conjunction with an increasing order autoregressive model to achieve this…

Statistics Theory · Mathematics 2016-03-18 Ching-Kang Ing , Hai-Tang Chiou , Meihui Guo

We consider the problem of estimating the spectral norm of a matrix using only matrix-vector products. We propose a new Counterbalance estimator that provides upper bounds on the norm and derive probabilistic guarantees on its…

Numerical Analysis · Mathematics 2025-06-19 Alexey Naumov , Maxim Rakhuba , Denis Ryapolov , Sergey Samsonov

This paper offers a review of numerical methods for computation of the eigenvalues of Hermitian matrices and the singular values of general and some classes of structured matrices. The focus is on the main principles behind the methods that…

Numerical Analysis · Mathematics 2020-06-05 Zlatko Drmač

Based on the spectral divide-and-conquer algorithm by Nakatsukasa and Higham [SIAM J. Sci. Comput., 35(3): A1325-A1349, 2013], we propose a new algorithm for computing all the eigenvalues and eigenvectors of a symmetric banded matrix. For…

Numerical Analysis · Mathematics 2018-01-22 Ana Šušnjara , Daniel Kressner

We study two spiked models of random matrices under general frameworks corresponding respectively to additive deformation of random symmetric matrices and multiplicative perturbation of random covariance matrices. In both cases, the…

Probability · Mathematics 2020-10-14 Nathan Noiry

Spectral clustering is a novel clustering method which can detect complex shapes of data clusters. However, it requires the eigen decomposition of the graph Laplacian matrix, which is proportion to $O(n^3)$ and thus is not suitable for…

Machine Learning · Computer Science 2013-07-02 Nguyen Lu Dang Khoa , Sanjay Chawla

Optimization in machine learning, both theoretical and applied, is presently dominated by first-order gradient methods such as stochastic gradient descent. Second-order optimization methods, that involve second derivatives and/or second…

Machine Learning · Computer Science 2021-03-08 Rohan Anil , Vineet Gupta , Tomer Koren , Kevin Regan , Yoram Singer

Improving upon results of Rudelson and Vershynin, we establish delocalization bounds for eigenvectors of independent-entry random matrices. In particular, we show that with high probability every eigenvector is delocalized, meaning any…

Probability · Mathematics 2019-02-01 Kyle Luh , Sean O'Rourke

In this work, we address the problem of Hessian inversion bias in distributed second-order optimization algorithms. We introduce a novel shrinkage-based estimator for the resolvent of gram matrices which is asymptotically unbiased, and…

Optimization and Control · Mathematics 2024-02-06 Fangzhao Zhang , Mert Pilanci

We introduce a new random matrix model called distance covariance matrix in this paper, whose normalized trace is equivalent to the distance covariance. We first derive a deterministic limit for the eigenvalue distribution of the distance…

Statistics Theory · Mathematics 2021-05-18 Weiming Li , Qinwen Wang , Jianfeng Yao

In this note, we present an algorithm that yields many new methods for constructing doubly stochastic and symmetric doubly stochastic matrices for the inverse eigenvalue problem. In addition, we introduce new open problems in this area that…

Spectral Theory · Mathematics 2012-02-15 Bassam Mourad , Hassan Abbas , Ayman Mourad , Ahmad Ghaddar , Issam Kaddoura

We propose a novel sparse sliced inverse regression method based on random projections in a large $p$ small $n$ setting. Embedded in a generalized eigenvalue framework, the proposed approach finally reduces to parallel execution of…

Methodology · Statistics 2023-08-04 Jia Zhang , Runxiong Wu , Xin Chen