English
Related papers

Related papers: Numerical Stability of the Nystr\"om Method

200 papers

Estimation of structure, such as in variable selection, graphical modelling or cluster analysis is notoriously difficult, especially for high-dimensional data. We introduce stability selection. It is based on subsampling in combination with…

Methodology · Statistics 2009-05-16 Nicolai Meinshausen , Peter Buehlmann

In this work we propose a novel method to ensure important entropy inequalities are satisfied semi-discretely when constructing reduced order models (ROMs) on nonlinear reduced manifolds. We are in particular interested in ROMs of systems…

Numerical Analysis · Mathematics 2024-07-18 Robin Klein , Benjamin Sanderse , Pedro Costa , Rene Pecnik , Ruud Henkes

We consider the numerical algorithm for the two-dimensional time-harmonic elastic wave scattering by unbounded rough surfaces with Dirichlet boundary condition. A Nystr\"{o}m method is proposed for the scattering problem based on the…

Numerical Analysis · Mathematics 2021-08-06 Jianliang Li , Xiaoli Liu , Bo Zhang , Haiwen Zhang

Kernel methods are used frequently in various applications of machine learning. For large-scale high dimensional applications, the success of kernel methods hinges on the ability to operate certain large dense kernel matrix K. An enormous…

Numerical Analysis · Mathematics 2021-12-30 Difeng Cai , James Nagy , Yuanzhe Xi

Quantum computation has made considerable progress in the last decade with multiple emerging technologies providing proof-of-principle experimental demonstrations of such calculations. However, these experimental demonstrations of quantum…

Quantum Physics · Physics 2022-09-27 Samudra Dasgupta , Travis S. Humble

Sensitivity to noise makes most of the current quantum computing schemes prone to error and nonscalable, allowing only for small proof-of-principle devices. Topologically-protected quantum computing aims at solving this problem by encoding…

Disordered Systems and Neural Networks · Physics 2013-12-17 Helmut G. Katzgraber , Ruben S. Andrist

We study the stability properties of nonlinear multi-task regression in reproducing Hilbert spaces with operator-valued kernels. Such kernels, a.k.a. multi-task kernels, are appropriate for learning prob- lems with nonscalar outputs like…

Machine Learning · Computer Science 2013-06-18 Julien Audiffren , Hachem Kadri

The Nystrom method has been popular for generating the low-rank approximation of kernel matrices that arise in many machine learning problems. The approximation quality of the Nystrom method depends crucially on the number of selected…

Machine Learning · Statistics 2016-12-21 Farhad Pourkamali-Anaraki , Stephen Becker

A hierarchical clustering method is stable if small perturbations on the data set produce small perturbations in the result. These perturbations are measured using the Gromov-Hausdorff metric. We study the problem of stability on…

Machine Learning · Computer Science 2013-11-21 A. Martínez-Pérez

We provide the first mathematically complete derivation of the Nystr\"om method for low-rank approximation of indefinite kernels and propose an efficient method for finding an approximate eigendecomposition of such kernel matrices. Building…

Machine Learning · Statistics 2019-06-03 Dino Oglic , Thomas Gärtner

This paper studies a Nystr\"om type subsampling approach to large kernel learning methods in the misspecified case, where the target function is not assumed to belong to the reproducing kernel Hilbert space generated by the underlying…

Machine Learning · Statistics 2018-06-05 Shuai Lu , Peter Mathé , Sergiy Pereverzyev

Numerical Analysts and scientists working in applications often observe that once they improve their techniques to get a better accuracy, some instability creeps in through the back door. This paper shows for a large class of numerical…

Numerical Analysis · Mathematics 2022-03-18 Robert Schaback

The CUR matrix decomposition and the Nystr\"{o}m approximation are two important low-rank matrix approximation techniques. The Nystr\"{o}m method approximates a symmetric positive semidefinite matrix in terms of a small number of its…

Machine Learning · Computer Science 2013-10-02 Shusen Wang , Zhihua Zhang

This paper is focuses on the computation of the positive moments of one-side correlated random Gram matrices. Closed-form expressions for the moments can be obtained easily, but numerical evaluation thereof is prone to numerical stability,…

Information Theory · Computer Science 2017-10-11 Khalil Elkhalil , Abla Kammoun , Tareq Y. Al-Naffouri , Mohamed-Slim Alouini

Model averaging techniques based on resampling methods (such as bootstrapping or subsampling) have been utilized across many areas of statistics, often with the explicit goal of promoting stability in the resulting output. We provide a…

Statistics Theory · Mathematics 2024-05-28 Jake A. Soloff , Rina Foygel Barber , Rebecca Willett

Deep learning (DL) has become an integral part of solutions to various important problems, which is why ensuring the quality of DL systems is essential. One of the challenges of achieving reliability and robustness of DL software is to…

Machine Learning · Computer Science 2022-02-09 E. Kloberdanz , K. G. Kloberdanz , W. Le

Nesterov's accelerated gradient method (NAG) is widely used in problems with machine learning background including deep learning, and is corresponding to a continuous-time differential equation. From this connection, the property of the…

Optimization and Control · Mathematics 2022-04-05 Yasong Feng , Weiguo Gao

There are recent shifts in demand for design controllers from simplified to complex model-based. Although simplification approaches are successful in many areas of engineering control systems, high-fidelity simulation-based control design,…

Systems and Control · Electrical Eng. & Systems 2024-02-15 Jongrae Kim

Nowadays we are witnessing a transformation of the business processes towards a more computation driven approach. The ever increasing usage of Machine Learning techniques is the clearest example of such trend. This sort of revolution is…

Machine Learning · Computer Science 2022-03-18 Giorgio Visani , Enrico Bagli , Federico Chesani , Alessandro Poluzzi , Davide Capuzzo

Symmetric positive semidefinite (SPSD) matrix approximation is an important problem with applications in kernel methods. However, existing SPSD matrix approximation methods such as the Nystr\"om method only have weak error bounds. In this…

Machine Learning · Computer Science 2016-05-23 Shusen Wang , Luo Luo , Zhihua Zhang
‹ Prev 1 3 4 5 6 7 10 Next ›