English
Related papers

Related papers: On landmark selection and sampling in high-dimensi…

200 papers

The problem of dimension reduction is of increasing importance in modern data analysis. In this paper, we consider modeling the collection of points in a high dimensional space as a union of low dimensional subspaces. In particular we…

Machine Learning · Statistics 2020-06-12 Weiwei Li , Jan Hannig , Sayan Mukherjee

We propose a novel probabilistic dimensionality reduction framework that can naturally integrate the generative model and the locality information of data. Based on this framework, we present a new model, which is able to learn a smooth…

Machine Learning · Statistics 2016-10-18 Li Wang

Linear dimensionality reduction techniques are powerful tools for image analysis as they allow the identification of important features in a data set. In particular, nonnegative matrix factorization (NMF) has become very popular as it is…

Computer Vision and Pattern Recognition · Computer Science 2016-10-07 Gabriella Casalino , Nicolas Gillis

The input data features set for many data driven tasks is high-dimensional while the intrinsic dimension of the data is low. Data analysis methods aim to uncover the underlying low dimensional structure imposed by the low dimensional hidden…

Machine Learning · Computer Science 2019-01-30 Moshe Salhov , Ofir Lindenbaum , Yariv Aizenbud , Avi Silberschatz , Yoel Shkolnisky , Amir Averbuch

Thresholding--the pruning of nodes or edges based on their properties or weights--is an essential preprocessing tool for extracting interpretable structure from complex network data, yet existing methods face several key limitations.…

Social and Information Networks · Computer Science 2025-10-07 Adam Schroeder , Russell Funk , Jingyi Guan , Taylor Okonek , Lori Ziegelmeier

Analyzing high-dimensional data presents challenges due to the "curse of dimensionality'', making computations intensive. Dimension reduction techniques, categorized as linear or non-linear, simplify such data. Non-linear methods are…

Machine Learning · Statistics 2025-04-15 Praveen T. W. Hettige , Benjamin W. Ong

Sufficient dimension reduction is a powerful tool to extract core information hidden in the high-dimensional data and has potentially many important applications in machine learning tasks. However, the existing nonlinear sufficient…

Machine Learning · Computer Science 2022-10-11 Siqi Liang , Yan Sun , Faming Liang

In this work we show that the classification performance of high-dimensional structural MRI data with only a small set of training examples is improved by the usage of dimension reduction methods. We assessed two different dimension…

Machine Learning · Computer Science 2015-05-27 Andreas Grünauer , Markus Vincze

Convolutional neural networks (CNNs) are widely used for image recognition and text analysis, and have been suggested for application on one-dimensional data as a way to reduce the need for pre-processing steps. Pre-processing is an…

Machine Learning · Computer Science 2020-05-18 Ine L. Jernelv , Dag Roar Hjelme , Yuji Matsuura , Astrid Aksnes

In order to fully utilize "big data", it is often required to use "big models". Such models tend to grow with the complexity and size of the training data, and do not make strong parametric assumptions upfront on the nature of the…

Machine Learning · Statistics 2015-04-17 Vikas Sindhwani , Haim Avron

Many statistical estimation techniques for high-dimensional or functional data are based on a preliminary dimension reduction step, which consists in projecting the sample $\bX_1, \hdots, \bX_n$ onto the first $D$ eigenvectors of the…

Statistics Theory · Mathematics 2010-04-26 Gérard Biau , André Mas

Hyperspectral imagery is rich in spatial and spectral information. Using 3D-CNN can simultaneously acquire features of spatial and spectral dimensions to facilitate classification of features, but hyperspectral image information spectral…

Image and Video Processing · Electrical Eng. & Systems 2022-02-15 Guandong Li , Chunju Zhang

Deep learning (DL) models have achieved paradigm-changing performance in many fields with high dimensional data, such as images, audio, and text. However, the black-box nature of deep neural networks is a barrier not just to adoption in…

Machine Learning · Computer Science 2020-02-25 Parmita Mehta , Stephen Portillo , Magdalena Balazinska , Andrew Connolly

We preprocess the raw NMR spectrum and extract key characteristic features by using two different methodologies, called equidistant sampling and peak sampling for subsequent substructure pattern recognition; meanwhile may provide the…

Quantitative Methods · Quantitative Biology 2021-07-27 Chongcan Li , Yong Cong , Weihua Deng

In this paper, we propose Neural Spectrum Decomposition, a generic decomposition framework for dataset distillation. Unlike previous methods, we consider the entire dataset as a high-dimensional observation that is low-rank across all…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Shaolei Yang , Shen Cheng , Mingbo Hong , Haoqiang Fan , Xing Wei , Shuaicheng Liu

Spectral kernel methods are techniques for transforming data into a coordinate system that efficiently reveals the geometric structure - in particular, the "connectivity" - of the data. These methods depend on certain tuning parameters. We…

Methodology · Statistics 2008-11-04 Ann B. Lee , Larry Wasserman

Non-linear manifold learning enables high-dimensional data analysis, but requires out-of-sample-extension methods to process new data points. In this paper, we propose a manifold learning algorithm based on deep learning to create an…

Machine Learning · Statistics 2015-06-26 Gal Mishne , Uri Shaham , Alexander Cloninger , Israel Cohen

The Nystrom method is an efficient technique used to speed up large-scale learning applications by generating low-rank approximations. Crucial to the performance of this technique is the assumption that a matrix can be well approximated by…

Machine Learning · Computer Science 2014-08-12 Ameet Talwalkar , Afshin Rostamizadeh

The real-life data have a complex and non-linear structure due to their nature. These non-linearities and the large number of features can usually cause problems such as the empty-space phenomenon and the well-known curse of dimensionality.…

Machine Learning · Computer Science 2025-03-13 Kadir Özçoban , Murat Manguoğlu , Emrullah Fatih Yetkin

Spectral clustering refers to a family of unsupervised learning algorithms that compute a spectral embedding of the original data based on the eigenvectors of a similarity graph. This non-linear transformation of the data is both the key of…

Machine Learning · Computer Science 2019-01-30 Nicolas Tremblay , Andreas Loukas