English
Related papers

Related papers: Numerical Stability of the Nystr\"om Method

200 papers

Recently, Nystr\"{o}m method has proved its prominence empirically and theoretically in speeding up the training of kernel machines while retaining satisfactory performances and accuracy. So far, there are several different approaches…

Machine Learning · Computer Science 2021-09-21 Weida Li , Mingxia Liu , Daoqiang Zhang

Gaussian processes are frequently deployed as part of larger machine learning and decision-making systems, for instance in geospatial modeling, Bayesian optimization, or in latent Gaussian models. Within a system, the Gaussian process model…

Kernel methods underpin many of the most successful approaches in data science and statistics, and they allow representing probability measures as elements of a reproducing kernel Hilbert space without loss of information. Recently, the…

Machine Learning · Statistics 2025-03-19 Florian Kalinke , Zoltan Szabo , Bharath K. Sriperumbudur

We propose a method for the stabilisation of quantum computations (including quantum state storage). The method is based on the operation of projection into $\cal SYM$, the symmetric subspace of the full state space of $R$ redundant copies…

Kernel $k$-means clustering can correctly identify and extract a far more varied collection of cluster structures than the linear $k$-means clustering algorithm. However, kernel $k$-means clustering is computationally expensive when the…

Machine Learning · Computer Science 2019-02-12 Shusen Wang , Alex Gittens , Michael W. Mahoney

We give the first algorithm for kernel Nystr\"om approximation that runs in *linear time in the number of training points* and is provably accurate for all kernel matrices, without dependence on regularity or incoherence conditions. The…

Machine Learning · Computer Science 2017-11-06 Cameron Musco , Christopher Musco

Large-scale kernel ridge regression (KRR) is limited by the need to store a large kernel matrix K_t. To avoid storing the entire matrix K_t, Nystrom methods subsample a subset of columns of the kernel matrix, and efficiently find an…

Machine Learning · Computer Science 2026-04-23 Daniele Calandriello , Alessandro Lazaric , Michal Valko

We investigate the efficiency of k-means in terms of both statistical and computational requirements. More precisely, we study a Nystr\"om approach to kernel k-means. We analyze the statistical properties of the proposed method and show…

Machine Learning · Statistics 2019-08-28 Daniele Calandriello , Lorenzo Rosasco

A novel numerical method for solving inverse scattering problem with fixed-energy data is proposed. The method contains a new important concept: the stability index of the inversion problem. This is a number, computed from the data, which…

Mathematical Physics · Physics 2007-05-23 S. Gutman , A. G. Ramm , W. Scheid

State space subspace algorithms for input-output systems have been widely applied but also have a reasonably well-developedasymptotic theory dealing with consistency. However, guaranteeing the stability of the estimated system matrix is a…

Systems and Control · Electrical Eng. & Systems 2024-08-19 Xinhui Rong , Victor Solo

In this work, we systematically investigate linear multi-step methods for differential equations with memory. In particular, we focus on the numerical stability for multi-step methods. According to this investigation, we give some…

Numerical Analysis · Mathematics 2023-10-30 Guihong Wang , Yuqing Li , Tao Luo , Zheng Ma , Nung Kwan Yip , Guang Lin

Block Gram-Schmidt algorithms serve as essential kernels in many scientific computing applications, but for many commonly used variants, a rigorous treatment of their stability properties remains open. This work provides a comprehensive…

Numerical Analysis · Mathematics 2023-02-21 Erin Carson , Kathryn Lund , Miroslav Rozložník , Stephen Thomas

The recently developed data-driven eigenmatrix method shows very promising reconstruction accuracy in sparse recovery for a wide range of kernel functions and random sample locations. However, its current implementation can lead to…

Numerical Analysis · Mathematics 2024-05-15 Koung Hee Leem , Jun Liu , George Pelekanos

We study a relaxed version of the column-sampling problem for the Nystr\"om approximation of kernel matrices, where approximations are defined from multisets of landmark points in the ambient space; such multisets are referred to as…

Machine Learning · Statistics 2022-03-28 Matthew Hutchings , Bertrand Gauthier

We consider numerical instability that can be observed in simulations of localized solutions of the generalized nonlinear Schr\"odinger equation (NLS) by a split-step method where the linear part of the evolution is solved by a…

Pattern Formation and Solitons · Physics 2014-10-15 Taras I. Lakoba

In the setting of nonparametric regression, we propose and study a combination of stochastic gradient methods with Nystr\"om subsampling, allowing multiple passes over the data and mini-batches. Generalization error bounds for the studied…

Machine Learning · Statistics 2017-10-24 Junhong Lin , Lorenzo Rosasco

In this paper we measured the stability of stochastic gradient method (SGM) for learning an approximated Fourier primal support vector machine. The stability of an algorithm is considered by measuring the generalization error in terms of…

Signal Processing · Electrical Eng. & Systems 2018-04-24 Aven Samareh , Mahshid Salemi Parizi

In this paper we investigate a sub-diffusion equation for simulating the anomalous diffusion phenomenon in real physical environment. Based on an equivalent transformation of the original sub-diffusion equation followed by the use of a…

Numerical Analysis · Mathematics 2018-03-29 Zongze Yang , Jungang Wang , Yan Li , Yufeng Nie

Kernel methods have achieved very good performance on large scale regression and classification problems, by using the Nystr\"om method and preconditioning techniques. The Nystr\"om approximation -- based on a subset of landmarks -- gives a…

Machine Learning · Computer Science 2020-02-21 Michaël Fanuel , Joachim Schreurs , Johan A. K. Suykens

Ensuring the long-term reproducibility of data analyses requires results stability tests to verify that analysis results remain within acceptable variation bounds despite inevitable software updates and hardware evolutions. This paper…