English
Related papers

Related papers: Theory and numerics of subspace approximation of e…

200 papers

Reliable and efficient computation of the pseudospectral abscissa in the large-scale setting is still not settled. Unlike the small-scale setting where there are globally convergent criss-cross algorithms, all algorithms in the large-scale…

Numerical Analysis · Mathematics 2025-06-09 Waqar Ahmed , Emre Mengi

Kernel-based methods in Numerical Analysis have the advantage of yielding optimal recovery processes in the "native" Hilbert space $\calh$ in which they are reproducing. Continuous kernels on compact domains have an expansion into…

Numerical Analysis · Mathematics 2018-10-09 Gabriele Santin , Robert Schaback

A type of parallel augmented subspace scheme for eigenvalue problems is proposed by using coarse space in the multigrid method. With the help of coarse space in multigrid method, solving the eigenvalue problem in the finest space is…

Numerical Analysis · Mathematics 2020-08-19 Fei Xu , Hehu Xie , Ning Zhang

Quantum subspace diagonalization methods are an exciting new class of algorithms for solving large\rev{-}scale eigenvalue problems using quantum computers. Unfortunately, these methods require the solution of an ill-conditioned generalized…

Quantum Physics · Physics 2023-06-16 Ethan N. Epperly , Lin Lin , Yuji Nakatsukasa

We perform a comprehensive numerical study of the effect of approximation-theoretical results for neural networks on practical learning problems in the context of numerical analysis. As the underlying model, we study the…

Numerical Analysis · Mathematics 2020-04-28 Moritz Geist , Philipp Petersen , Mones Raslan , Reinhold Schneider , Gitta Kutyniok

In recent years, various subspace algorithms have been developed to handle large-scale optimization problems. Although existing subspace Newton methods require fewer iterations to converge in practice, the matrix operations and full…

Optimization and Control · Mathematics 2024-06-05 Taisei Miyaishi , Ryota Nozawa , Pierre-Louis Poirion , Akiko Takeda

We propose subspace methods for 3-parameter eigenvalue problems. Such problems arise when separation of variables is applied to separable boundary value problems; a particular example is the Helmholtz equation in ellipsoidal and…

Numerical Analysis · Mathematics 2023-09-18 Michiel E. Hochstenbach , Karl Meerbergen , Emre Mengi , Bor Plestenjak

We propose a new randomized optimization method for high-dimensional problems which can be seen as a generalization of coordinate descent to random subspaces. We show that an adaptive sampling strategy for the random subspace significantly…

Optimization and Control · Mathematics 2019-12-19 Jonathan Lacotte , Mert Pilanci , Marco Pavone

We first consider the problem of approximating a few eigenvalues of a rational matrix-valued function closest to a prescribed target. It is assumed that the proper rational part of the rational matrix-valued function is expressed in the…

Numerical Analysis · Mathematics 2022-01-10 Rifqi Aziz , Emre Mengi , Matthias Voigt

This work is concerned with approximating the smallest eigenvalue of a parameter-dependent Hermitian matrix $A(\mu)$ for many parameter values $\mu \in \mathbb{R}^P$. The design of reliable and efficient algorithms for addressing this task…

Numerical Analysis · Mathematics 2015-04-24 Petar Sirković , Daniel Kressner

Bilevel optimization problems are receiving increasing attention in machine learning as they provide a natural framework for hyperparameter optimization and meta-learning. A key step to tackle these problems is the efficient computation of…

Machine Learning · Statistics 2025-05-20 Riccardo Grazzi , Massimiliano Pontil , Saverio Salzo

We present a new numerical technique to solve large-scale eigenvalue problems. It is based on the projection technique, used in strongly correlated quantum many-body systems, where first an effective approximate model of smaller complexity…

Strongly Correlated Electrons · Physics 2015-05-19 Ralf Gamillscheg , Gundolf Haase , Wolfgang von der Linden

In this paper, we study an adaptive finite element method for multiple eigenvalue problems of a class of second order elliptic equations. By using some eigenspace approximation technology and its crucial property which is also presented in…

Numerical Analysis · Mathematics 2013-09-18 Xiaoying Dai , Lianhua He , Aihui Zhou

This paper deals with the problem of parameter estimation based on certain eigenspaces of the empirical covariance matrix of an observed multidimensional time series, in the case where the time series dimension and the observation window…

Probability · Mathematics 2012-08-22 Walid Hachem , Philippe Loubaton , X. Mestre , Jamal Najim , Pascal Vallet

In this paper, a new type of multi-level correction scheme is proposed for solving eigenvalue problems by finite element method. With this new scheme, the accuracy of eigenpair approximations can be improved after each correction step which…

Numerical Analysis · Mathematics 2011-07-04 Qun Lin , Hehu Xie

In this paper, we present a nonnested augmented subspace algorithm and its multilevel correction method for solving eigenvalue problems with curved interfaces. The augmented subspace algorithm and the corresponding multilevel correction…

Numerical Analysis · Mathematics 2020-11-17 Haikun Dang , Hehu Xie , Gang Zhao , Chenguang Zhou

We investigate numerically efficient approximations of eigenspaces associated to symmetric and general matrices. The eigenspaces are factored into a fixed number of fundamental components that can be efficiently manipulated (we consider…

Machine Learning · Computer Science 2021-09-29 Cristian Rusu , Lorenzo Rosasco

In this paper, some enhanced error estimates are derived for the augmented subspace methods which are designed for solving eigenvalue problems. We will show that the augmented subspace methods have the second order convergence rate which is…

Numerical Analysis · Mathematics 2021-06-02 Haikun Dang , Yifan Wang , Hehu Xie , Chenguang Zhou

This article deals with the efficient and certified numerical approximation of the smallest eigenvalue and the associated eigenspace of a large-scale parametric Hermitian matrix. For this aim, we rely on projection-based model order…

Numerical Analysis · Mathematics 2026-01-14 Mattia Manucci , Benjamin Stamm , Zhuoyao Zeng

Subspace methods are commonly used for finding approximate eigenvalues and singular values of large-scale matrices. Once a subspace is found, the Rayleigh-Ritz method (for symmetric eigenvalue problems) and Petrov-Galerkin projection (for…

Numerical Analysis · Mathematics 2025-10-07 Irina-Beatrice Haas , Yuji Nakatsukasa