English
Related papers

Related papers: Linear Dimensionality Reduction: Survey, Insights,…

200 papers

During the last decades, learning a low-dimensional space with discriminative information for dimension reduction (DR) has gained a surge of interest. However, it's not accessible for these DR methods to achieve satisfactory performance…

Machine Learning · Computer Science 2019-11-19 Xiangzhu Meng , Huibing Wang , Lin Feng

Fitting linear regression models can be computationally very expensive in large-scale data analysis tasks if the sample size and the number of variables are very large. Random projections are extensively used as a dimension reduction tool…

Statistics Theory · Mathematics 2017-01-20 Gian-Andrea Thanei , Christina Heinze , Nicolai Meinshausen

Dimensionality reduction is used as an important tool for unraveling the complexities of high-dimensional datasets in many fields of science, such as cell biology, chemical informatics, and physics. Visualizations of the dimensionally…

Human-Computer Interaction · Computer Science 2025-07-16 Dylan Cashman , Mark Keller , Hyeon Jeon , Bum Chul Kwon , Qianwen Wang

In order to avoid the curse of dimensionality, frequently encountered in Big Data analysis, there was a vast development in the field of linear and nonlinear dimension reduction techniques in recent years. These techniques (sometimes…

Graphics · Computer Science 2020-02-27 Barak Sober , David Levin

The performance of machine learning and pattern recognition algorithms generally depends on data representation. That is why, much of the current effort in performing machine learning algorithms goes into the design of preprocessing…

Machine Learning · Computer Science 2025-10-28 Fadi Dornaika , Ahmad Khoder , Abdelmalik Moujahid , Wassim Khoder

Array synthetic aperture radar (Array-SAR), also known as tomographic SAR (TomoSAR), has demonstrated significant potential for high-quality 3D mapping, particularly in urban areas.While deep learning (DL) methods have recently shown…

Image and Video Processing · Electrical Eng. & Systems 2024-12-24 Yu Ren , Xu Zhan , Yunqiao Hu , Xiangdong Ma , Liang Liu , Mou Wang , Jun Shi , Shunjun Wei , Tianjiao Zeng , Xiaoling Zhang

Because of high dimensionality, correlation among covariates, and noise contained in data, dimension reduction (DR) techniques are often employed to the application of machine learning algorithms. Principal Component Analysis (PCA), Linear…

Machine Learning · Statistics 2019-10-08 Katherine C. Kempfert , Yishi Wang , Cuixian Chen , Samuel W. K. Wong

The unprecedented prowess of measurement techniques provides a detailed, multi-scale look into the depths of living systems. Understanding these avalanches of high-dimensional data -- by distilling underlying principles and mechanisms --…

Other Quantitative Biology · Quantitative Biology 2021-08-16 Jean-Pierre Eckmann , Tsvi Tlusty

Scientists and engineers rely on accurate mathematical models to quantify the objects of their studies, which are often high-dimensional. Unfortunately, high-dimensional models are inherently difficult, i.e. when observations are sparse or…

Machine Learning · Computer Science 2018-02-13 Robert A. Bridges , Chris Felder , Chelsey Hoff

Clustering and dimensionality reduction have been crucial topics in machine learning and computer vision. Clustering high-dimensional data has been challenging for a long time due to the curse of dimensionality. For that reason, a more…

Machine Learning · Statistics 2026-04-16 Sida Liu , Yangzi Guo , Mingyuan Wang

In this work, we study distance metric learning (DML) for high dimensional data. A typical approach for DML with high dimensional data is to perform the dimensionality reduction first before learning the distance metric. The main…

Machine Learning · Computer Science 2015-09-16 Qi Qian , Rong Jin , Lijun Zhang , Shenghuo Zhu

In the last few decades both the volume of high-quality observing data on variable stars and common access to them have boomed; however the standard used methods of data processing and interpretation have lagged behind this progress. The…

Astrophysics · Physics 2007-11-29 Z. Mikulasek

We consider the problem of recovering elements of a low-dimensional model from linear measurements. From signal and image processing to inverse problems in data science, this question has been at the center of many applications. Lately,…

Signal Processing · Electrical Eng. & Systems 2025-05-15 Yann Traonmilin , Jean François Aujol , Antoine Guennec

While matrix variate regression models have been studied in many existing works, classical statistical and computational methods for the analysis of the regression coefficient estimation are highly affected by high dimensional and noisy…

Machine Learning · Statistics 2022-05-17 Hsin-Hsiung Huang , Feng Yu , Xing Fan , Teng Zhang

The problems of computational data processing involving regression, interpolation, reconstruction and imputation for multidimensional big datasets are becoming more important these days, because of the availability of data and their widely…

Methodology · Statistics 2017-03-22 Yuri K. Shestopaloff , Alexander Y. Shestopaloff

Deep neural networks have proved very successful on archetypal tasks for which large training sets are available, but when the training data are scarce, their performance suffers from overfitting. Many existing methods of reducing…

Computer Vision and Pattern Recognition · Computer Science 2017-11-17 Wei Zhu , Qiang Qiu , Jiaji Huang , Robert Calderbank , Guillermo Sapiro , Ingrid Daubechies

Dimension reduction and visualization is a staple of data analytics. Methods such as Principal Component Analysis (PCA) and Multidimensional Scaling (MDS) provide low dimensional (LD) projections of high dimensional (HD) data while…

Methodology · Statistics 2017-09-21 J. T. Fry , Matt Slifko , Scotland Leman

Why do deep neural networks (DNNs) benefit from very high dimensional parameter spaces? Their huge parameter complexities vs stunning performance in practice is all the more intriguing and not explainable using the standard theory of model…

Machine Learning · Computer Science 2025-06-12 Ke Sun , Frank Nielsen

While many phenomena in physics and engineering are formally high-dimensional, their long-time dynamics often live on a lower-dimensional manifold. The present work introduces an autoencoder framework that combines implicit regularization…

Machine Learning · Computer Science 2023-12-07 Kevin Zeng , Carlos E. Pérez De Jesús , Andrew J. Fox , Michael D. Graham

Low-rank modeling plays a pivotal role in signal processing and machine learning, with applications ranging from collaborative filtering, video surveillance, medical imaging, to dimensionality reduction and adaptive filtering. Many modern…

Machine Learning · Statistics 2018-05-04 Yudong Chen , Yuejie Chi