English
Related papers

Related papers: The spectral norm error of the naive Nystrom exten…

200 papers

The Nystr\"om method is a popular choice for finding a low-rank approximation to a symmetric positive semi-definite matrix. The method can fail when applied to symmetric indefinite matrices, for which the error can be unboundedly large. In…

Numerical Analysis · Mathematics 2023-10-10 Taejun Park , Yuji Nakatsukasa

Symmetric positive semidefinite (SPSD) matrix approximation is an important problem with applications in kernel methods. However, existing SPSD matrix approximation methods such as the Nystr\"om method only have weak error bounds. In this…

Machine Learning · Computer Science 2016-05-23 Shusen Wang , Luo Luo , Zhihua Zhang

This paper is concerned with the low-rank approximation for large-scale nonsymmetric matrices. Inspired by the classical Nystrom method, which is a popular method to find the low-rank approximation for symmetric positive semidefinite…

Numerical Analysis · Mathematics 2024-10-30 Yatian Wang , Hua Xiang , Chi Zhang , Songling Zhang

In recent years, the spectral analysis of appropriately defined kernel matrices has emerged as a principled way to extract the low-dimensional structure often prevalent in high-dimensional data. Here we provide an introduction to spectral…

Machine Learning · Statistics 2010-04-20 Mohamed-Ali Belabbas , Patrick J. Wolfe

We analyze the Nystr\"om approximation of a positive definite kernel associated with a probability measure. We first prove an improved error bound for the conventional Nystr\"om approximation with i.i.d. sampling and singular-value…

Numerical Analysis · Mathematics 2023-05-24 Satoshi Hayakawa , Harald Oberhauser , Terry Lyons

The CUR matrix decomposition and the Nystr\"{o}m approximation are two important low-rank matrix approximation techniques. The Nystr\"{o}m method approximates a symmetric positive semidefinite matrix in terms of a small number of its…

Machine Learning · Computer Science 2013-10-02 Shusen Wang , Zhihua Zhang

In this paper, we consider the problem of column subset selection. We present a novel analysis of the spectral norm reconstruction for a simple randomized algorithm and establish a new bound that depends explicitly on the sampling…

Numerical Analysis · Mathematics 2015-05-05 Tianbao Yang , Lijun Zhang , Rong Jin , Shenghuo Zhu

We develop an improved bound for the approximation error of the Nystr\"{o}m method under the assumption that there is a large eigengap in the spectrum of kernel matrix. This is based on the empirical observation that the eigengap has a…

Machine Learning · Computer Science 2012-09-04 Mehrdad Mahdavi , Tianbao Yang , Rong Jin

The Nystrom method is an efficient technique used to speed up large-scale learning applications by generating low-rank approximations. Crucial to the performance of this technique is the assumption that a matrix can be well approximated by…

Machine Learning · Computer Science 2014-08-12 Ameet Talwalkar , Afshin Rostamizadeh

The Nystrom method is an efficient technique to speed up large-scale learning applications by generating low-rank approximations. Crucial to the performance of this technique is the assumption that a matrix can be well approximated by…

Artificial Intelligence · Computer Science 2010-04-13 Ameet Talwalkar , Afshin Rostamizadeh

Many kernel methods suffer from high time and space complexities and are thus prohibitive in big-data applications. To tackle the computational challenge, the Nystr\"om method has been extensively used to reduce time and space complexities…

Machine Learning · Computer Science 2014-04-02 Shusen Wang , Zhihua Zhang

Spectral clustering techniques are valuable tools in signal processing and machine learning for partitioning complex data sets. The effectiveness of spectral clustering stems from constructing a non-linear embedding based on creating a…

Machine Learning · Computer Science 2021-02-02 Farhad Pourkamali-Anaraki

Spectral clustering has shown a superior performance in analyzing the cluster structure. However, its computational complexity limits its application in analyzing large-scale data. To address this problem, many low-rank matrix approximating…

Machine Learning · Computer Science 2020-07-23 Djallel Bouneffouf

The Nystrom method is a popular technique that uses a small number of landmark points to compute a fixed-rank approximation of large kernel matrices that arise in machine learning problems. In practice, to ensure high quality…

Machine Learning · Statistics 2019-12-04 Farhad Pourkamali-Anaraki , Stephen Becker

The Nystr\"om method is a convenient heuristic method to obtain low-rank approximations to kernel matrices in nearly linear complexity. Existing studies typically use the method to approximate positive semidefinite matrices with low or…

Numerical Analysis · Mathematics 2023-07-13 Jianlin Xia

The Chernoff bound is an important inequality relation in probability theory. The original version of the Chernoff bound is to give an exponential decreasing bound on the tail distribution of sums of independent random variables. Recent…

Probability · Mathematics 2021-05-18 Shih Yu Chang

We develop two approaches for analyzing the approximation error bound for the Nystr\"{o}m method, one based on the concentration inequality of integral operator, and one based on the compressive sensing theory. We show that the…

Machine Learning · Computer Science 2015-09-28 Rong Jin , Tianbao Yang , Mehrdad Mahdavi , Yu-Feng Li , Zhi-Hua Zhou

A novel matrix approximation problem is considered herein: observations based on a few fully sampled columns and quasi-polynomial structural side information are exploited. The framework is motivated by quantum chemistry problems wherein…

Signal Processing · Electrical Eng. & Systems 2023-05-23 Jeongmin Chae , Praneeth Narayanamurthy , Selin Bac , Shaama Mallikarjun Sharada , Urbashi Mitra

We address the subset selection problem for matrices, where the goal is to select a subset of $k$ columns from a "short-and-fat" matrix $X \in \mathbb{R}^{m \times n}$, such that the pseudoinverse of the sampled submatrix has as small…

Numerical Analysis · Mathematics 2025-07-29 Ivan Kozyrev , Alexander Osinsky

In many areas of machine learning, it becomes necessary to find the eigenvector decompositions of large matrices. We discuss two methods for reducing the computational burden of spectral decompositions: the more venerable Nystom extension…

Machine Learning · Statistics 2011-07-22 Darren Homrighausen , Daniel J. McDonald
‹ Prev 1 2 3 10 Next ›