English
Related papers

Related papers: A simple extrapolation method for clustered eigenv…

200 papers

The smallest eigenvalues and the associated eigenvectors (i.e., eigenpairs) of a graph Laplacian matrix have been widely used for spectral clustering and community detection. However, in real-life applications the number of clusters or…

Social and Information Networks · Computer Science 2018-01-24 Pin-Yu Chen , Baichuan Zhang , Mohammad Al Hasan , Alfred O. Hero

We describe a strategy for solving nonlinear eigenproblems numerically. Our approach is based on the approximation of a vector-valued function, defined as solution of a non-homogeneous version of the eigenproblem. This approximation step is…

Numerical Analysis · Mathematics 2023-12-06 Davide Pradovera

In this paper, we propose, analyze and demonstrate a dynamic momentum method to accelerate power and inverse power iterations with minimal computational overhead. The method can be applied to real diagonalizable matrices, is provably…

Numerical Analysis · Mathematics 2024-07-08 Christian Austin , Sara Pollock , Yunrong Zhu

We study the task of clustering in directed networks. We show that using the eigenvalue/eigenvector decomposition of the adjacency matrix is simpler than all common methods which are based on a combination of data regularization and SVD…

Machine Learning · Computer Science 2021-02-08 Simon Coste , Ludovic Stephan

In this paper, we derive an asymptotic error expansion for the eigenvalue approximations by the lowest order Raviart-Thomas mixed finite element method for the general second order elliptic eigenvalue problems. Extrapolation based on such…

Numerical Analysis · Mathematics 2011-01-11 Hehu Xie

A method is suggested allowing for the improvement of accuracy of self-similar factor and root approximants, constructed from asymptotic series. The method is based on performing a power transform of the given asymptotic series, with the…

Statistical Mechanics · Physics 2007-05-23 S. Gluzman , V. I. Yukalov

We present a principled spectral approach to the well-studied constrained clustering problem. It reduces clustering to a generalized eigenvalue problem on Laplacians. The method works in nearly-linear time and provides concrete guarantees…

Social and Information Networks · Computer Science 2016-01-20 Mihai Cucuringu , Ioannis Koutis , Sanjay Chawla

An efficient proximal-gradient-based method, called proximal extrapolated gradient method, is designed for solving monotone variational inequality in Hilbert space. The proposed method extends the acceptable range of parameters to obtain…

Optimization and Control · Mathematics 2019-12-05 Xiaokai Chang , Sanyang Liu , Jianchao Bai , Jun Yang

Partitioning a graph into groups of vertices such that those within each group are more densely connected than vertices assigned to different groups, known as graph clustering, is often used to gain insight into the organisation of large…

Machine Learning · Statistics 2014-01-28 Charanpal Dhanjal , Romaric Gaudel , Stéphan Clémençon

Motivated by the recent demonstration of its use as a tool for the detection and characterization of phase-shape correlations in multivariate time series, we show that eigenvalue decomposition can also be applied to a matrix of indices of…

Data Analysis, Statistics and Probability · Physics 2008-09-03 Carsten Allefeld , Markus Müller , Jürgen Kurths

We analyse convergence of a micro-macro acceleration method for the Monte Carlo simulation of stochastic differential equations with time-scale separation between the (fast) evolution of individual trajectories and the (slow) evolution of…

Numerical Analysis · Mathematics 2018-01-08 Tony Lelièvre , Giovanni Samaey , Przemysław Zieliński

In this paper we explore acceleration techniques for large scale nonconvex optimization problems with special focuses on deep neural networks. The extrapolation scheme is a classical approach for accelerating stochastic gradient descent for…

Machine Learning · Statistics 2018-05-18 Guangzeng Xie , Yitan Wang , Shuchang Zhou , Zhihua Zhang

A simple and efficient variational method is introduced to accelerate the convergence of the eigenenergy computations for a Hamiltonian H with singular potentials. Closed-form analytic expressions in N dimensions are obtained for the matrix…

Mathematical Physics · Physics 2009-11-10 Nasser Saad , Richard L. Hall , Qutaibeh D. Katatbeh

A self-learning algebraic multigrid method for dominant and minimal singular triplets and eigenpairs is described. The method consists of two multilevel phases. In the first, multiplicative phase (setup phase), tentative singular triplets…

Numerical Analysis · Mathematics 2011-02-07 Hans De Sterck

Efficient solution of the lowest eigenmodes is studied for a family of related eigenvalue problems with common $2\times 2$ block structure. It is assumed that the upper diagonal block varies between different versions while the lower…

Numerical Analysis · Mathematics 2020-06-19 Antti Hannukainen , Jarmo Malinen , Antti Ojalammi

This paper investigates the eigenvalue computation problem of the dual quaternion Hermitian matrix closely related to multi-agent group control. Recently, power method was proposed by Cui and Qi in Journal of Scientific Computing, 100…

Numerical Analysis · Mathematics 2025-05-22 Yongjun Chen , Liping Zhang

The power method is one of the most fundamental tools for extracting top principal components from data through low-rank matrix approximation. Yet, when the target rank is large, the cost of matrix multiplication associated with this…

Numerical Analysis · Mathematics 2026-05-12 Shabarish Chenakkod , Michał Dereziński

We propose in this paper a proximal and contraction method for solving a convex mixed variational inequality problem in a real Hilbert space. To accelerate the convergence of our proposed method, we incorporate an inertial extrapolation…

Optimization and Control · Mathematics 2025-11-25 Chidi Elijah Nwakpa , Austine Efut Ofem , Kalu Okam Okorie , Chinedu Izuchukwu , Chibueze Christian Okeke

We present a novel method to estimate the dominant eigenvalue and eigenvector pair of any non-negative real matrix via graph infection. The key idea in our technique lies in approximating the solution to the first-order matrix ordinary…

Numerical Analysis · Mathematics 2023-05-09 Kaiyuan Yang , Li Xia , Y. C. Tay

This paper deals with speeding up the convergence of a class of two-step iterative methods for solving linear systems of equations. To implement the acceleration technique, the residual norm associated with computed approximations for each…

Numerical Analysis · Mathematics 2024-04-24 Fatemeh P. A. Beik , Michele Benzi , Mehdi Najafi-Kalyani