English
Related papers

Related papers: A Novel Skew-Hamiltonian Isotropic Lanczos Algorit…

200 papers

The problem of phase synchronization is to estimate the phases (angles) of a complex unit-modulus vector $z$ from their noisy pairwise relative measurements $C = zz^* + \sigma W$, where $W$ is a complex-valued Gaussian random matrix. The…

Optimization and Control · Mathematics 2018-04-10 Yiqiao Zhong , Nicolas Boumal

Clustering short text embeddings is a foundational task in natural language processing, yet remains challenging due to the need to specify the number of clusters in advance. We introduce a scalable spectral method that estimates the number…

Machine Learning · Computer Science 2025-11-26 Nikita Neveditsin , Pawan Lingras , Vijay Mago

We develop an accelerated gradient descent algorithm on the Grassmann manifold to compute the subspace spanned by a number of leading eigenvectors of a symmetric positive semi-definite matrix. This has a constant cost per iteration and a…

Optimization and Control · Mathematics 2024-06-27 Foivos Alimisis , Simon Vary , Bart Vandereycken

The central importance of large scale eigenvalue problems in scientific computation necessitates the development of massively parallel algorithms for their solution. Recent advances in dense numerical linear algebra have enabled the routine…

Numerical Analysis · Mathematics 2020-05-08 David B. Williams-Young , Paul G. Beckman , Chao Yang

Spectral clustering is a well-known technique which identifies $k$ clusters in an undirected graph with weight matrix $W\in\mathbb{R}^{n\times n}$ by exploiting its graph Laplacian $L(W)$, whose eigenvalues $0=\lambda_1\leq \lambda_2 \leq…

Numerical Analysis · Mathematics 2023-06-08 Nicola Guglielmi , Stefano Sicilia

The computation of the Log-determinant of large, sparse, symmetric positive definite (SPD) matrices is essential in many scientific computational fields such as numerical linear algebra and machine learning. In low dimensions, Cholesky is…

Numerical Analysis · Mathematics 2026-03-19 Verlon Roel Mbingui , Antoine Tambue , Issa Karambal

Sparse PCA (SPCA) is a fundamental model in machine learning and data analytics, which has witnessed a variety of application areas such as finance, manufacturing, biology, healthcare. To select a prespecified-size principal submatrix from…

Machine Learning · Statistics 2020-08-31 Yongchun Li , Weijun Xie

In this paper, we introduce a primal-dual algorithmic framework for solving Symmetric Cone Programs (SCPs), a versatile optimization model that unifies and extends Linear, Second-Order Cone (SOCP), and Semidefinite Programming (SDP). Our…

Optimization and Control · Mathematics 2024-05-16 Jiaqi Zheng , Antonios Varvitsiotis , Tiow-Seng Tan , Wayne Lin

While there is no lack of efficient Krylov subspace solvers for Hermitian systems, there are few for complex symmetric, skew symmetric, or skew Hermitian systems, which are increasingly important in modern applications including quantum…

Mathematical Software · Computer Science 2014-01-14 Sou-Cheng , Choi

Principal component analysis (PCA) is a widely used dimension reduction technique in machine learning and multivariate statistics. To improve the interpretability of PCA, various approaches to obtain sparse principal direction loadings have…

Data Structures and Algorithms · Computer Science 2021-06-07 Agniva Chowdhury , Petros Drineas , David P. Woodruff , Samson Zhou

In this paper, we consider a class of optimization problems constrained to the generalized Stiefel manifold. Such problems are fundamental to a wide range of real-world applications, including generalized canonical correlation analysis,…

Optimization and Control · Mathematics 2026-02-06 Linshuo Jiang , Nachuan Xiao , Xin Liu

Principal Component Analysis (PCA) is a widely utilized technique for dimensionality reduction; however, its inherent lack of interpretability-stemming from dense linear combinations of all feature-limits its applicability in many domains.…

Machine Learning · Computer Science 2025-04-01 Loc Hoang Tran

We consider the approximation of $B^T (A+sI)^{-1} B$ for large s.p.d. $A\in\mathbb{R}^{n\times n}$ with dense spectrum and $B\in\mathbb{R}^{n\times p}$, $p\ll n$. We target the computations of Multiple-Input Multiple-Output (MIMO) transfer…

Numerical Analysis · Mathematics 2025-04-18 Vladimir Druskin , Jörn Zimmerling

A thick-restart Lanczos type algorithm is proposed for Hermitian $J$-symmetric matrices. Since Hermitian $J$-symmetric matrices possess doubly degenerate spectra or doubly multiple eigenvalues with a simple relation between the degenerate…

Numerical Analysis · Mathematics 2020-09-14 Ken-Ichi Ishikawa , Tomohiro Sogabe

In this paper, we propose a new trace finite element method for the {Laplace-Beltrami} eigenvalue problem. The method is proposed directly on a smooth manifold which is implicitly given by a level-set function and require high order…

Numerical Analysis · Mathematics 2022-01-17 Song Lu , Xianmin Xu

We propose an efficient numerical method for a non-selfadjoint Steklov eigenvalue problem. The Lagrange finite element is used for discretization. The convergence is proved using the spectral perturbation theory for compact operators. The…

Numerical Analysis · Mathematics 2018-04-10 Juan Liu , Jiguang Sun , Tiara Turner

We present a novel technique for sparse principal component analysis. This method, named Eigenvectors from Eigenvalues Sparse Principal Component Analysis (EESPCA), is based on the formula for computing squared eigenvector loadings of a…

Methodology · Statistics 2022-05-12 H. Robert Frost

Del Castillo and Zhao (2020, 2021, 2022, 2024) have recently proposed a new methodology for the Statistical Process Control (SPC) of discrete parts whose 3-dimensional (3D) geometrical data are acquired with non-contact sensors. The…

Applications · Statistics 2025-10-20 Yulin An , Xueqi Zhao , Enrique del Castillo

We present a new method for computing the lowest few eigenvalues and the corresponding eigenvectors of a nuclear many-body Hamiltonian represented in a truncated configuration interaction subspace, i.e., the no-core shell model (NCSM). The…

Computational Physics · Physics 2024-07-16 Dong Min Roh , Esmond Ng , Chao Yang , Dean Lee , Pieter Maris , James P. Vary

We consider computing the $k$-th eigenvalue and its corresponding eigenvector of a generalized Hermitian eigenvalue problem of $n\times n$ large sparse matrices. In electronic structure calculations, several properties of materials, such as…

Numerical Analysis · Mathematics 2018-08-01 Dongjin Lee , Takeo Hoshi , Tomohiro Sogabe , Yuto Miyatake , Shao-Liang Zhang