English
Related papers

Related papers: Empirical comparison between autoencoders and trad…

200 papers

We propose a modified, high-dimensional version of a recent dimension estimation procedure that determines the dimension via the introduction of augmented noise variables into the data. Our asymptotic results show that the proposal is…

Statistics Theory · Mathematics 2025-02-07 Una Radojicic , Joni Virta

In autonomous embedded systems, it is often vital to reduce the amount of actions taken in the real world and energy required to learn a policy. Training reinforcement learning agents from high dimensional image representations can be very…

Machine Learning · Computer Science 2019-03-26 Bharat Prakash , Mark Horton , Nicholas R. Waytowich , William David Hairston , Tim Oates , Tinoosh Mohsenin

We demonstrate that Principal Component Analysis (PCA), when applied in a structured manner, either to polar-transformed images or segment-wise to token sequences, enables extreme compression of neural models without sacrificing…

Computational Engineering, Finance, and Science · Computer Science 2025-08-07 Magnus Bengtsson

Nonlinear principal component analysis (NLPCA) via autoencoders has attracted attention in the dynamical systems community due to its larger compression rate when compared to linear principal component analysis (PCA). These model reduction…

Fluid Dynamics · Physics 2022-11-15 Simon Kneer , Taraneh Sayadi , Denis Sipp , Peter Schmid , Georgios Rigas

Retrieval-Augmented Generation (RAG) has emerged as a powerful paradigm for grounding large language models in external knowledge sources, improving the precision of agents responses. However, high-dimensional language model embeddings,…

Machine Learning · Computer Science 2025-04-14 Arman Khaledian , Amirreza Ghadiridehkordi , Nariman Khaledian

Studies of the degrees of freedom or "synergies" in musculoskeletal systems rely critically on algorithms to estimate the "dimension" of kinematic or neural data. Linear algorithms such as principal component analysis (PCA) are used almost…

Quantitative Methods · Quantitative Biology 2007-05-23 Robert H. Clewley , John M. Guckenheimer , Francisco J. Valero-Cuevas

High-dimensional image data often require dimensionality reduction before further analysis. This paper provides a purely analytical comparison of two linear techniques-Principal Component Analysis (PCA) and Singular Value Decomposition…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Michael Gyimadu , Gregory Bell , Ph. D

Approximate Nearest Neighbor Search (ANNS) on high-dimensional vectors has become a fundamental and essential component in various machine learning tasks. Recently, with the rapid development of deep learning models and the applications of…

Databases · Computer Science 2025-02-21 Zeyu Wang , Haoran Xiong , Qitong Wang , Zhenying He , Peng Wang , Themis Palpanas , Wei Wang

Because of high dimensionality, correlation among covariates, and noise contained in data, dimension reduction (DR) techniques are often employed to the application of machine learning algorithms. Principal Component Analysis (PCA), Linear…

Machine Learning · Statistics 2019-10-08 Katherine C. Kempfert , Yishi Wang , Cuixian Chen , Samuel W. K. Wong

In this short paper, a neural network that is able to form a low dimensional topological hidden representation is explained. The neural network can be trained as an autoencoder, a classifier or mix of both, and produces different low…

Machine Learning · Computer Science 2020-06-16 Pitoyo Hartono

In this work, we explore dimensionality reduction techniques for univariate and multivariate time series data. We especially conduct a comparison between wavelet decomposition and convolutional variational autoencoders for dimension…

Machine Learning · Computer Science 2022-04-26 William Todo , Beatrice Laurent , Jean-Michel Loubes , Merwann Selmani

Autoencoders are unsupervised neural networks that are used to process and compress input data and then reconstruct the data back to the original data size. This allows autoencoders to be used for different processing applications such as…

Machine Learning · Computer Science 2023-01-18 Murat Isik , Matthew Oldland , Lifeng Zhou

Recently neural network based approaches to knowledge-intensive NLP tasks, such as question answering, started to rely heavily on the combination of neural retrievers and readers. Retrieval is typically performed over a large textual…

Information Retrieval · Computer Science 2022-04-20 Vilém Zouhar , Marius Mosbach , Miaoran Zhang , Dietrich Klakow

Dense retrieval models have become a standard for state-of-the-art information retrieval. However, their high-dimensional, high-precision (float32) vector embeddings create significant storage and memory challenges for real-world…

Information Retrieval · Computer Science 2025-11-19 Satyanarayan Pati

Principal component analysis (PCA) is widely used for feature extraction and dimensionality reduction, with documented merits in diverse tasks involving high-dimensional data. Standard PCA copes with one dataset at a time, but it is…

Machine Learning · Computer Science 2019-01-30 Jia Chen , Gang Wang , Georgios B. Giannakis

Dimensionality reduction represents a critical preprocessing step in order to increase the efficiency and the performance of many hyperspectral imaging algorithms. However, dimensionality reduction algorithms, such as the Principal…

Machine Learning · Computer Science 2024-03-28 E. Martel , R. Lazcano , J. Lopez , D. Madroñal , R. Salvador , S. Lopez , E. Juarez , R. Guerra , C. Sanz , R. Sarmiento

Principal component analysis (PCA) is a classical method for dimensionality reduction based on extracting the dominant eigenvectors of the sample covariance matrix. However, PCA is well known to behave poorly in the ``large $p$, small $n$''…

Statistics Theory · Mathematics 2009-08-26 Arash A. Amini , Martin J. Wainwright

Multispectral imaging is an important technique for improving the readability of written or printed text where the letters have faded, either due to deliberate erasing or simply due to the ravages of time. Often the text can be read simply…

Computer Vision and Pattern Recognition · Computer Science 2018-07-20 Corneliu T. C. Arsene , Stephen Church , Mark Dickinson

Dimensionality reduction (DR) is an important technique for data exploration and knowledge discovery. However, most of the main DR methods are either linear (e.g., PCA), do not provide an explicit mapping between the original data and its…

Neural and Evolutionary Computing · Computer Science 2022-03-15 Thomas Uriot , Marco Virgolin , Tanja Alderliesten , Peter Bosman

Principal Component Analysis (PCA) is a fundamental data preprocessing tool in the world of machine learning. While PCA is often thought of as a dimensionality reduction method, the purpose of PCA is actually two-fold: dimension reduction…

Machine Learning · Computer Science 2023-01-25 Arpita Gang , Waheed U. Bajwa