English
Related papers

Related papers: Benchmarking Dimensionality Reduction Techniques f…

200 papers

This is a tutorial and survey paper on unification of spectral dimensionality reduction methods, kernel learning by Semidefinite Programming (SDP), Maximum Variance Unfolding (MVU) or Semidefinite Embedding (SDE), and its variants. We first…

Machine Learning · Statistics 2022-08-04 Benyamin Ghojogh , Ali Ghodsi , Fakhri Karray , Mark Crowley

In this paper, we present two pipelines in order to reduce the feature space for anomaly detection using the One Class SVM. As a first stage of both pipelines, we compare the performance of three convolutional autoencoders. We use the PCA…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Simon Bilik , Karel Horak

Self-supervised landmark estimation is a challenging task that demands the formation of locally distinct feature representations to identify sparse facial landmarks in the absence of annotated data. To tackle this task, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Kejia Yin , Varshanth R. Rao , Ruowei Jiang , Xudong Liu , Parham Aarabi , David B. Lindell

Dimensionality reduction is an important operation in information visualization, feature extraction, clustering, regression, and classification, especially for processing noisy high dimensional data. However, most existing approaches…

Machine Learning · Computer Science 2020-03-26 Zhenhua Shi , Dongrui Wu , Jian Huang , Yu-Kai Wang , Chin-Teng Lin

Singular value decomposition (SVD) based principal component analysis (PCA) breaks down in the high-dimensional and limited sample size regime below a certain critical eigen-SNR that depends on the dimensionality of the system and the…

Statistics Theory · Mathematics 2019-12-17 Arvind Prasadan , Raj Rao Nadakuditi , Debashis Paul

Spatial transcriptomics has revolutionized tissue analysis by simultaneously mapping gene expression, spatial topography, and histological context across consecutive tissue sections, enabling systematic investigation of spatial…

Applications · Statistics 2025-10-24 Meng Zhou , Shuangge Ma , Mengyun Wu

The central goal of this paper is to establish two commonly available dimensionality reduction (DR) methods i.e. t-distributed Stochastic Neighbor Embedding (t-SNE) and Multidimensional Scaling (MDS) in Matlab and to observe their…

Machine Learning · Computer Science 2020-11-19 Shadman Sakib , Md. Abu Bakr Siddique , Md. Abdur Rahman

Dimensionality reduction is a topic of recent interest. In this paper, we present the classification constrained dimensionality reduction (CCDR) algorithm to account for label information. The algorithm can account for multiple classes as…

Machine Learning · Statistics 2009-09-29 Raviv Raich , Jose A. Costa , Steven B. Damelin , Alfred O. Hero

Dense retrieval models have become a standard for state-of-the-art information retrieval. However, their high-dimensional, high-precision (float32) vector embeddings create significant storage and memory challenges for real-world…

Information Retrieval · Computer Science 2025-11-19 Satyanarayan Pati

Sparse principal component analysis (PCA) is a well-established dimensionality reduction technique that is often used for unsupervised feature selection (UFS). However, determining the regularization parameters is rather challenging, and…

Machine Learning · Computer Science 2025-04-07 Long Chen , Xianchao Xiu

In our "big data" age, the size and complexity of data is steadily increasing. Methods for dimension reduction are ever more popular and useful. Two distinct types of dimension reduction are "data-oblivious" methods such as random…

Statistics Theory · Mathematics 2021-03-30 Fan Yang , Sifan Liu , Edgar Dobriban , David P. Woodruff

Music Structure Analysis (MSA) aims to uncover the high-level organization of musical pieces. State-of-the-art methods are often based on supervised deep learning, but these methods are bottlenecked by the need for heavily annotated data…

Sound · Computer Science 2026-03-31 Axel Marmoret

In human-level NLP tasks, such as predicting mental health, personality, or demographics, the number of observations is often smaller than the standard 768+ hidden state sizes of each layer within modern transformer-based language models,…

Computation and Language · Computer Science 2023-06-05 Adithya V Ganesan , Matthew Matero , Aravind Reddy Ravula , Huy Vu , H. Andrew Schwartz

Real-world image degradation is often unknown, spatially non-uniform, and compositional, requiring all-in-one restoration models to adapt a single set of weights to diverse local corruption patterns without test-time degradation labels.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Haisen He , Xiangyu Zou , SongLin Dong , Heng Li , Yihong Gong , Zhiheng Ma

AI-enabled precision medicine promises a transformational improvement in healthcare outcomes by enabling data-driven personalized diagnosis, prognosis, and treatment. However, the well-known "curse of dimensionality" and the clustered…

Machine Learning · Computer Science 2023-05-19 Amanda M. Buch , Conor Liston , Logan Grosenick

Molecular simulations produce very high-dimensional data-sets with millions of data points. As analysis methods are often unable to cope with so many dimensions, it is common to use dimensionality reduction and clustering methods to reach a…

Machine Learning · Statistics 2017-11-03 Stefan Doerr , Igor Ariz-Extreme , Matthew J. Harvey , Gianni De Fabritiis

In this work, we have investigated a number of unsupervised learning methods for material segmentation in projection x-ray imaging with a spectral detector. A phantom containing two hard materials (glass, steel) and three soft materials…

Principal component analysis (PCA) is a classical method for dimensionality reduction based on extracting the dominant eigenvectors of the sample covariance matrix. However, PCA is well known to behave poorly in the ``large $p$, small $n$''…

Statistics Theory · Mathematics 2009-08-26 Arash A. Amini , Martin J. Wainwright

Data dimension reduction (DDR) is all about mapping data from high dimensions to low dimensions, various techniques of DDR are being used for image dimension reduction like Random Projections, Principal Component Analysis (PCA), the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Wisal Khan , Muhammad Turab , Waqas Ahmad , Syed Hasnat Ahmad , Kelash Kumar , Bin Luo

Dimensionality reduction is critical for deploying dense retrieval systems at scale, yet mainstream post-hoc methods face a fundamental trade-off: principal component analysis (PCA) preserves dominant variance but underutilizes…

Information Retrieval · Computer Science 2026-04-20 Yongkang Li , Panagiotis Eustratiadis , Evangelos Kanoulas