中文
相关论文

相关论文: The spectral norm error of the naive Nystrom exten…

200 篇论文

The Nystr\"om method is a popular choice for finding a low-rank approximation to a symmetric positive semi-definite matrix. The method can fail when applied to symmetric indefinite matrices, for which the error can be unboundedly large. In…

数值分析 · 数学 2023-10-10 Taejun Park , Yuji Nakatsukasa

Symmetric positive semidefinite (SPSD) matrix approximation is an important problem with applications in kernel methods. However, existing SPSD matrix approximation methods such as the Nystr\"om method only have weak error bounds. In this…

机器学习 · 计算机科学 2016-05-23 Shusen Wang , Luo Luo , Zhihua Zhang

This paper is concerned with the low-rank approximation for large-scale nonsymmetric matrices. Inspired by the classical Nystrom method, which is a popular method to find the low-rank approximation for symmetric positive semidefinite…

数值分析 · 数学 2024-10-30 Yatian Wang , Hua Xiang , Chi Zhang , Songling Zhang

In recent years, the spectral analysis of appropriately defined kernel matrices has emerged as a principled way to extract the low-dimensional structure often prevalent in high-dimensional data. Here we provide an introduction to spectral…

机器学习 · 统计学 2010-04-20 Mohamed-Ali Belabbas , Patrick J. Wolfe

We analyze the Nystr\"om approximation of a positive definite kernel associated with a probability measure. We first prove an improved error bound for the conventional Nystr\"om approximation with i.i.d. sampling and singular-value…

数值分析 · 数学 2023-05-24 Satoshi Hayakawa , Harald Oberhauser , Terry Lyons

The CUR matrix decomposition and the Nystr\"{o}m approximation are two important low-rank matrix approximation techniques. The Nystr\"{o}m method approximates a symmetric positive semidefinite matrix in terms of a small number of its…

机器学习 · 计算机科学 2013-10-02 Shusen Wang , Zhihua Zhang

In this paper, we consider the problem of column subset selection. We present a novel analysis of the spectral norm reconstruction for a simple randomized algorithm and establish a new bound that depends explicitly on the sampling…

数值分析 · 数学 2015-05-05 Tianbao Yang , Lijun Zhang , Rong Jin , Shenghuo Zhu

We develop an improved bound for the approximation error of the Nystr\"{o}m method under the assumption that there is a large eigengap in the spectrum of kernel matrix. This is based on the empirical observation that the eigengap has a…

机器学习 · 计算机科学 2012-09-04 Mehrdad Mahdavi , Tianbao Yang , Rong Jin

The Nystrom method is an efficient technique used to speed up large-scale learning applications by generating low-rank approximations. Crucial to the performance of this technique is the assumption that a matrix can be well approximated by…

机器学习 · 计算机科学 2014-08-12 Ameet Talwalkar , Afshin Rostamizadeh

The Nystrom method is an efficient technique to speed up large-scale learning applications by generating low-rank approximations. Crucial to the performance of this technique is the assumption that a matrix can be well approximated by…

人工智能 · 计算机科学 2010-04-13 Ameet Talwalkar , Afshin Rostamizadeh

Many kernel methods suffer from high time and space complexities and are thus prohibitive in big-data applications. To tackle the computational challenge, the Nystr\"om method has been extensively used to reduce time and space complexities…

机器学习 · 计算机科学 2014-04-02 Shusen Wang , Zhihua Zhang

Spectral clustering techniques are valuable tools in signal processing and machine learning for partitioning complex data sets. The effectiveness of spectral clustering stems from constructing a non-linear embedding based on creating a…

机器学习 · 计算机科学 2021-02-02 Farhad Pourkamali-Anaraki

Spectral clustering has shown a superior performance in analyzing the cluster structure. However, its computational complexity limits its application in analyzing large-scale data. To address this problem, many low-rank matrix approximating…

机器学习 · 计算机科学 2020-07-23 Djallel Bouneffouf

The Nystrom method is a popular technique that uses a small number of landmark points to compute a fixed-rank approximation of large kernel matrices that arise in machine learning problems. In practice, to ensure high quality…

机器学习 · 统计学 2019-12-04 Farhad Pourkamali-Anaraki , Stephen Becker

The Nystr\"om method is a convenient heuristic method to obtain low-rank approximations to kernel matrices in nearly linear complexity. Existing studies typically use the method to approximate positive semidefinite matrices with low or…

数值分析 · 数学 2023-07-13 Jianlin Xia

The Chernoff bound is an important inequality relation in probability theory. The original version of the Chernoff bound is to give an exponential decreasing bound on the tail distribution of sums of independent random variables. Recent…

概率论 · 数学 2021-05-18 Shih Yu Chang

We develop two approaches for analyzing the approximation error bound for the Nystr\"{o}m method, one based on the concentration inequality of integral operator, and one based on the compressive sensing theory. We show that the…

机器学习 · 计算机科学 2015-09-28 Rong Jin , Tianbao Yang , Mehrdad Mahdavi , Yu-Feng Li , Zhi-Hua Zhou

A novel matrix approximation problem is considered herein: observations based on a few fully sampled columns and quasi-polynomial structural side information are exploited. The framework is motivated by quantum chemistry problems wherein…

信号处理 · 电气工程与系统科学 2023-05-23 Jeongmin Chae , Praneeth Narayanamurthy , Selin Bac , Shaama Mallikarjun Sharada , Urbashi Mitra

We address the subset selection problem for matrices, where the goal is to select a subset of $k$ columns from a "short-and-fat" matrix $X \in \mathbb{R}^{m \times n}$, such that the pseudoinverse of the sampled submatrix has as small…

数值分析 · 数学 2025-07-29 Ivan Kozyrev , Alexander Osinsky

In many areas of machine learning, it becomes necessary to find the eigenvector decompositions of large matrices. We discuss two methods for reducing the computational burden of spectral decompositions: the more venerable Nystom extension…

机器学习 · 统计学 2011-07-22 Darren Homrighausen , Daniel J. McDonald
‹ 上一页 1 2 3 10 下一页 ›