English
Related papers

Related papers: On landmark selection and sampling in high-dimensi…

200 papers

Pseudospectral analysis is fundamental for quantifying the sensitivity and transient behavior of nonnormal matrices, yet its computational cost scales cubically with dimension, rendering it prohibitive for large-scale systems. While…

Numerical Analysis · Mathematics 2026-02-03 Vladimir R. Kostic , Dragana Lj. Cvetkovic , Ljiljana Cvetkovic

The functional linear regression model has been widely studied and utilized for dealing with functional predictors. In this paper, we study the Nystr\"om subsampling method, a strategy used to tackle the computational complexities inherent…

Statistics Theory · Mathematics 2024-10-28 Naveen Gupta , Sivananthan Sampath

Data sites selected from modeling high-dimensional problems often appear scattered in non-paternalistic ways. Except for sporadic clustering at some spots, they become relatively far apart as the dimension of the ambient space grows. These…

Numerical Analysis · Mathematics 2021-09-28 Shao-Bo Lin , Xiangyu Chang , Xingping Sun

Low-rank modeling plays a pivotal role in signal processing and machine learning, with applications ranging from collaborative filtering, video surveillance, medical imaging, to dimensionality reduction and adaptive filtering. Many modern…

Machine Learning · Statistics 2018-05-04 Yudong Chen , Yuejie Chi

The ratio between two probability density functions is an important component of various tasks, including selection bias correction, novelty detection and classification. Recently, several estimators of this ratio have been proposed. Most…

Methodology · Statistics 2014-04-30 Rafael Izbicki , Ann B. Lee , Chad M. Schafer

Kernel-based subspace clustering, which addresses the nonlinear structures in data, is an evolving area of research. Despite noteworthy progressions, prevailing methodologies predominantly grapple with limitations relating to (i) the…

Machine Learning · Computer Science 2025-01-22 Kunpeng Xu , Lifei Chen , Shengrui Wang

Kernel methods are an extremely popular set of techniques used for many important machine learning and data analysis applications. In addition to having good practical performances, these methods are supported by a well-developed theory.…

Machine Learning · Statistics 2015-04-23 Shiva Prasad Kasiviswanathan , Mark Rudelson

We extend our work for compression of currents and varifolds to a compression algorithm for the embedded normal cycles representation of shape, restricted to the constant normal kernel case, using the Nystrom approximation in Reproducing…

Numerical Analysis · Mathematics 2026-05-26 Allen Paul , Neill Campbell , Tony Shardlow

This paper, broadly speaking, covers the use of randomness in two main areas: low-rank approximation and kernel methods. Low-rank approximation is very important in numerical linear algebra. Many applications depend on matrix decomposition…

Numerical Analysis · Mathematics 2020-08-12 Rishi Advani , Madison Crim , Sean O'Hagan

We reconsider randomized algorithms for the low-rank approximation of symmetric positive semi-definite (SPSD) matrices such as Laplacian and kernel matrices that arise in data analysis and machine learning applications. Our main results…

Machine Learning · Computer Science 2013-06-05 Alex Gittens , Michael W. Mahoney

The size of large, geo-located datasets has reached scales where visualization of all data points is inefficient. Random sampling is a method to reduce the size of a dataset, yet it can introduce unwanted errors. We describe a method for…

Human-Computer Interaction · Computer Science 2017-09-14 Yan Zheng , Yi Ou , Alexander Lex , Jeff M. Phillips

Nowadays, hyperspectral image classification widely copes with spatial information to improve accuracy. One of the most popular way to integrate such information is to extract hierarchical features from a multiscale segmentation. In the…

Computer Vision and Pattern Recognition · Computer Science 2016-06-17 Yanwei Cui , Laetitia Chapel , Sébastien Lefèvre

In recent years, deep learning has presented a great advance in hyperspectral image (HSI) classification. Particularly, long short-term memory (LSTM), as a special deep learning structure, has shown great ability in modeling long-term…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Wen-Shuai Hu , Heng-Chao Li , Lei Pan , Wei Li , Ran Tao , Qian Du

Recent neural architecture search (NAS) based approaches have made great progress in hyperspectral image (HSI) classification tasks. However, the architectures are usually optimized independently of the network weights, increasing searching…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Di Wang , Bo Du , Liangpei Zhang , Dacheng Tao

Dimensionality reduction (DR) on the manifold includes effective methods which project the data from an implicit relational space onto a vectorial space. Regardless of the achievements in this area, these algorithms suffer from the lack of…

Machine Learning · Computer Science 2019-09-23 Babak Hosseini , Barbara Hammer

By removing irrelevant and redundant features, feature selection aims to find a good representation of the original features. With the prevalence of unlabeled data, unsupervised feature selection has been proven effective in alleviating the…

Machine Learning · Computer Science 2024-03-25 Ziyuan Lin , Deanna Needell

Model reduction of large nonlinear systems often involves the projection of the governing equations onto linear subspaces spanned by carefully-selected modes. The criteria to select the modes relevant for reduction are usually…

Dynamical Systems · Mathematics 2021-03-18 Gergely Buza , Shobhit Jain , George Haller

A strategy to assist visualization and analysis of large and complex data sets is dimensionality reduction, with which one maps each data point into a low-dimensional manifold. However, various dimensionality reduction techniques are…

Physics and Society · Physics 2024-10-21 Chanon Thongprayoon , Naoki Masuda

Kernel methods provide a theoretically grounded framework for non-linear and non-parametric learning, with strong analytic foundations and statistical guarantees. Yet, their scalability has long been limited by prohibitive time and memory…

Machine Learning · Computer Science 2025-10-01 Maedeh Zarvandi , Michael Timothy , Theresa Wasserer , Debarghya Ghoshdastidar

We introduce a new approach to nonlinear sufficient dimension reduction in cases where both the predictor and the response are distributional data, modeled as members of a metric space. Our key step is to build universal kernels…

Methodology · Statistics 2023-04-26 Qi Zhang , Bing Li , Lingzhou Xue