English
Related papers

Related papers: An Inverse-free Truncated Rayleigh-Ritz Method for…

200 papers

We study the problem of recovery of matrices that are simultaneously low rank and row and/or column sparse. Such matrices appear in recent applications in cognitive neuroscience, imaging, computer vision, macroeconomics, and genetics. We…

Machine Learning · Statistics 2019-04-11 Ming Yu , Varun Gupta , Mladen Kolar

Solving the generalized eigenvalue problem is a useful method for finding energy eigenstates of large quantum systems. It uses projection onto a set of basis states which are typically not orthogonal. One needs to invert a matrix whose…

Nuclear Theory · Physics 2023-04-05 Caleb Hicks , Dean Lee

We study random eigenvalue problems in the context of spectral stochastic finite elements. In particular, given a parameter-dependent, symmetric positive-definite matrix operator, we explore the performance of algorithms for computing its…

Numerical Analysis · Mathematics 2016-03-09 Bedřich Sousedík , Howard C. Elman

All graphs considered are simple and undirected. The Inverse Eigenvalue Problem of a Graph $G$ (IEP-G) aims to find all possible spectra for matrices whose $(i,j)-$entry, for $i\neq j$, is nonzero precisely when $i$ is adjacent to $j$. A…

Combinatorics · Mathematics 2023-03-20 Roberto C. Díaz , Ana I. Julio

In this paper, we consider the sparse eigenvalue problem wherein the goal is to obtain a sparse solution to the generalized eigenvalue problem. We achieve this by constraining the cardinality of the solution to the generalized eigenvalue…

Machine Learning · Statistics 2009-10-13 Bharath Sriperumbudur , David Torres , Gert Lanckriet

This paper presents an in-depth analysis of the generalized isotonic recursive partitioning (GIRP) algorithm for fitting isotonic models under separable convex losses, proposed by Luss and Rosset [J. Comput. Graph. Statist., 23 (2014), pp.…

Machine Learning · Statistics 2024-01-12 Joong-Ho Won , Jihan Jung

Radiation symmetry evaluation is critical to the laser driven Inertial Confinement Fusion (ICF), which is usually done by solving a view-factor equation model. The model is nonlinear, and the number of equations can be very large when the…

Signal Processing · Electrical Eng. & Systems 2019-08-20 Yanfeng Zhang

We study the generalized finite element methods (GFEMs) for the second-order elliptic eigenvalue problem with an interface in 1D. The linear stable generalized finite element methods (SGFEM) were recently developed for the elliptic source…

Numerical Analysis · Mathematics 2018-10-25 Quanling Deng , Victor Calo

In this paper, the estimation problem for sparse reduced rank regression (SRRR) model is considered. The SRRR model is widely used for dimension reduction and variable selection with applications in signal processing, econometrics, etc. The…

Machine Learning · Statistics 2018-03-21 Ziping Zhao , Daniel P. Palomar

Sparse linear regression is one of the classic problems in the field of statistics, which has deep connections and high intersections with optimization, computation, and machine learning. To address the effective handling of…

Methodology · Statistics 2025-08-04 Peili Li , Zhuomei Li , Yunhai Xiao , Chao Ying , Zhou Yu

Inverse problems are paramount in Science and Engineering. In this paper, we consider the setup of Statistical Inverse Problem (SIP) and demonstrate how Stochastic Gradient Descent (SGD) algorithms can be used in the linear SIP setting. We…

Machine Learning · Statistics 2022-11-29 Yuri R. Fonseca , Yuri F. Saporito

Non-convex sparsity-inducing penalties have recently received considerable attentions in sparse learning. Recent theoretical investigations have demonstrated their superiority over the convex counterparts in several sparse learning…

Machine Learning · Computer Science 2013-03-20 Pinghua Gong , Changshui Zhang , Zhaosong Lu , Jianhua Huang , Jieping Ye

This paper proposes an efficient method for computing partial eigenvalues of large sparse matrices what can be called the inexact inverse power method (IIPM). It is similar to the inexact Rayleigh quotient method and inexact Jacobi-Davidson…

Numerical Analysis · Mathematics 2017-01-12 Yuquan Sun , Fanghui Gong , Igor V. Ovchinnikov , Kang L. Wang

We present a framework to solve non-linear eigenvalue problems suitable for a Finite Element discretization. The implementation is based on the open-source finite element software GetDP and the open-source library SLEPc. As template…

Computational Physics · Physics 2020-12-24 Guillaume Demésy , André Nicolet , Boris Gralak , Christophe Geuzaine , Carmen Campos , Jose E. Roman

The problem of estimating sparse eigenvectors of a symmetric matrix attracts a lot of attention in many applications, especially those with high dimensional data set. While classical eigenvectors can be obtained as the solution of a…

Machine Learning · Statistics 2016-11-03 Konstantinos Benidis , Ying Sun , Prabhu Babu , Daniel P. Palomar

The Stochastic Extragradient (SEG) method is one of the most popular algorithms for solving finite-sum min-max optimization and variational inequality problems (VIPs) appearing in various machine learning tasks. However, existing…

Optimization and Control · Mathematics 2024-10-11 Konstantinos Emmanouilidis , René Vidal , Nicolas Loizou

Sparse representation-based classification (SRC), proposed by Wright et al., seeks the sparsest decomposition of a test sample over the dictionary of training samples, with classification to the most-contributing class. Because it assumes…

Computer Vision and Pattern Recognition · Computer Science 2018-06-05 Chelsea Weaver , Naoki Saito

This article proposes an efficient numerical method for solving nonlinear partial differential equations (PDEs) based on sparse Gaussian processes (SGPs). Gaussian processes (GPs) have been extensively studied for solving PDEs by…

Numerical Analysis · Mathematics 2023-08-09 Rui Meng , Xianjin Yang

Randomized iterative algorithms have attracted much attention in recent years because they can approximately solve large-scale linear systems of equations without accessing the entire coefficient matrix. In this paper, we propose two novel…

Numerical Analysis · Mathematics 2021-10-22 Kui Du , Xiao-Hui Sun

Optimization over the set of matrices $X$ that satisfy $X^\top B X = I_p$, referred to as the generalized Stiefel manifold, appears in many applications involving sampled covariance matrices such as the canonical correlation analysis (CCA),…

Machine Learning · Computer Science 2025-11-11 Simon Vary , Pierre Ablin , Bin Gao , P. -A. Absil