English
Related papers

Related papers: An Improved Bound for the Nystrom Method for Large…

200 papers

A new method is presented for solving the momentum-space Schrodinger equation with a linear potential. The Lande-subtracted momentum space integral equation can be transformed into a matrix equation by the Nystrom method. The method…

High Energy Physics - Phenomenology · Physics 2009-11-07 Alfred Tang , John W. Norbury

Various methods in statistical learning build on kernels considered in reproducing kernel Hilbert spaces. In applications, the kernel is often selected based on characteristics of the problem and the data. This kernel is then employed to…

Machine Learning · Statistics 2024-03-12 Paul Dommel , Alois Pichler

In this paper, we study the Nystr{\"o}m type subsampling for large scale kernel methods to reduce the computational complexities of big data. We discuss the multi-penalty regularization scheme based on Nystr{\"o}m type subsampling which is…

Machine Learning · Statistics 2024-04-09 Abhishake Rastogi , Sivananthan Sampath

Kernel methods have achieved very good performance on large scale regression and classification problems, by using the Nystr\"om method and preconditioning techniques. The Nystr\"om approximation -- based on a subset of landmarks -- gives a…

Machine Learning · Computer Science 2020-02-21 Michaël Fanuel , Joachim Schreurs , Johan A. K. Suykens

We propose a continuous optimization algorithm for the Column Subset Selection Problem (CSSP) and Nystr\"om approximation. The CSSP and Nystr\"om method construct low-rank approximations of matrices based on a predetermined subset of…

Methodology · Statistics 2023-04-20 Anant Mathur , Sarat Moka , Zdravko Botev

This paper introduces the Nystr\"om PCG algorithm for solving a symmetric positive-definite linear system. The algorithm applies the randomized Nystr\"om method to form a low-rank approximation of the matrix, which leads to an efficient…

Numerical Analysis · Mathematics 2021-12-20 Zachary Frangella , Joel A. Tropp , Madeleine Udell

Spectral data is routinely broadened in order to improve appearance, approximate a higher sampling level or model experimental measurement effects. While there has been extensive work in the signal processing field to develop efficient…

Materials Science · Physics 2023-09-22 Jessica Farmer , Adam J. Jackson

Although the operator (spectral) norm is one of the most widely used metrics for covariance estimation, comparatively little is known about the fluctuations of error in this norm. To be specific, let $\hat\Sigma$ denote the sample…

Statistics Theory · Mathematics 2019-09-16 Miles E. Lopes , N. Benjamin Erichson , Michael W. Mahoney

In many areas of machine learning, it becomes necessary to find the eigenvector decompositions of large matrices. We discuss two methods for reducing the computational burden of spectral decompositions: the more venerable Nystom extension…

Machine Learning · Statistics 2011-07-22 Darren Homrighausen , Daniel J. McDonald

We adapt Stein's method of diffusion approximations, developed by Barbour, to the study of chaotic dynamical systems. We establish an error bound in the functional central limit theorem with respect to an integral probability metric of…

Dynamical Systems · Mathematics 2025-11-05 Juho Leppänen , Yuto Nakajima , Yushi Nakano

In this paper, we develop a relative error bound for nuclear norm regularized matrix completion, with the focus on the completion of full-rank matrices. Under the assumption that the top eigenspaces of the target matrix are incoherent, we…

Machine Learning · Computer Science 2024-05-30 Lijun Zhang , Tianbao Yang , Rong Jin , Zhi-Hua Zhou

The Column Subset Selection Problem (CSSP) and the Nystr\"om method are among the leading tools for constructing small low-rank approximations of large datasets in machine learning and scientific computing. A fundamental question in this…

Machine Learning · Computer Science 2020-12-22 Michał Dereziński , Rajiv Khanna , Michael W. Mahoney

The synchronous Nyquist folding generalized eigenvalue method (SNGEM) realizes full frequency/amplitude/phase estimation of multitone signals at extreme sub-Nyquist rates by jointly processing the original signals and their time…

Information Theory · Computer Science 2026-01-30 Huiguang Zhang

Recent works have derived neural networks with online correlation-based learning rules to perform \textit{kernel similarity matching}. These works applied existing linear similarity matching algorithms to nonlinear features generated with…

Neural and Evolutionary Computing · Computer Science 2022-04-18 Kyle Luther , H. Sebastian Seung

This paper studies a Nystr\"om type subsampling approach to large kernel learning methods in the misspecified case, where the target function is not assumed to belong to the reproducing kernel Hilbert space generated by the underlying…

Machine Learning · Statistics 2018-06-05 Shuai Lu , Peter Mathé , Sergiy Pereverzyev

Covariance matrix plays a central role in multivariate statistical analysis. Significant advances have been made recently on developing both theory and methodology for estimating large covariance matrices. However, a minimax theory has yet…

Statistics Theory · Mathematics 2010-10-20 T. Tony Cai , Cun-Hui Zhang , Harrison H. Zhou

We present algorithms that break the $\tilde O(nr)$-independence-query bound for the Matroid Intersection problem for the full range of $r$; where $n$ is the size of the ground set and $r\leq n$ is the size of the largest common independent…

Data Structures and Algorithms · Computer Science 2021-05-13 Joakim Blikstad

Kernel methods are used frequently in various applications of machine learning. For large-scale high dimensional applications, the success of kernel methods hinges on the ability to operate certain large dense kernel matrix K. An enormous…

Numerical Analysis · Mathematics 2021-12-30 Difeng Cai , James Nagy , Yuanzhe Xi

A novel matrix approximation problem is considered herein: observations based on a few fully sampled columns and quasi-polynomial structural side information are exploited. The framework is motivated by quantum chemistry problems wherein…

Signal Processing · Electrical Eng. & Systems 2023-05-23 Jeongmin Chae , Praneeth Narayanamurthy , Selin Bac , Shaama Mallikarjun Sharada , Urbashi Mitra

The CUR matrix decomposition is an important extension of Nystr\"{o}m approximation to a general matrix. It approximates any data matrix in terms of a small number of its columns and rows. In this paper we propose a novel randomized CUR…

Machine Learning · Computer Science 2012-10-05 Shusen Wang , Zhihua Zhang , Jian Li