English
Related papers

Related papers: Sufficient Dimension Reduction for High-Dimensiona…

200 papers

This paper presents a comprehensive overview of several multidimensional reduction methods focusing on Multidimensional Principal Component Analysis (MPCA), Multilinear Orthogonal Neighborhood Preserving Projection (MONPP), Multidimensional…

Numerical Analysis · Mathematics 2026-01-05 Mohamed El Guide , Alaa El Ichi , Khalide Jbilou , Lothar Reichel , Hessah Alqahtani

In statistical learning, high covariate dimensionality poses challenges for robust prediction and inference. To address this challenge, supervised dimension reduction is often performed, where dependence on the outcome is maximized for a…

Methodology · Statistics 2018-08-24 Patrick Staples , Min Ouyang , Robert F. Dougherty , Gregory A. Ryslik , Paul Dagum

This paper presents an overview and comparative study of the state of the art in State-Order Reduction (SOR) and Scheduling Dimension Reduction (SDR) for Linear Parameter-Varying (LPV) State-Space (SS) models, comparing and benchmarking…

Systems and Control · Electrical Eng. & Systems 2024-04-03 E. Javier Olucha , Bogoljub Terzin , Amritam Das , Roland Tóth

Although deep learning (DL) methods are powerful for solving inverse problems, their reliance on high-quality training data is a major hurdle. This is significant in high-dimensional (dynamic/volumetric) magnetic resonance imaging (MRI),…

Image and Video Processing · Electrical Eng. & Systems 2024-05-24 Frederic Wang , Han Qi , Alfredo De Goyeneche , Reinhard Heckel , Michael Lustig , Efrat Shimron

Sliced inverse regression is a popular tool for sufficient dimension reduction, which replaces covariates with a minimal set of their linear combinations without loss of information on the conditional distribution of the response given the…

Machine Learning · Statistics 2018-09-18 Kean Ming Tan , Zhaoran Wang , Tong Zhang , Han Liu , R. Dennis Cook

Based on the theories of sliced inverse regression (SIR) and reproducing kernel Hilbert space (RKHS), a new approach RDSIR (RKHS-based Double SIR) to nonlinear dimension reduction for survival data is proposed and discussed. An…

Statistics Theory · Mathematics 2019-09-06 Wenquan Cui , Jianjun Xu , Yuehua Wu

We propose a supervised principal component regression method for relating functional responses with high dimensional predictors. Unlike the conventional principal component analysis, the proposed method builds on a newly defined expected…

Methodology · Statistics 2023-08-17 Xinyi Zhang , Qiang Sun , Dehan Kong

A variety of dimensionality reduction techniques have been applied for computations involving large matrices. The underlying matrix is randomly compressed into a smaller one, while approximately retaining many of its original properties. As…

Machine Learning · Computer Science 2021-06-17 Zhili Feng , Fred Roosta , David P. Woodruff

The central goal of this paper is to establish two commonly available dimensionality reduction (DR) methods i.e. t-distributed Stochastic Neighbor Embedding (t-SNE) and Multidimensional Scaling (MDS) in Matlab and to observe their…

Machine Learning · Computer Science 2020-11-19 Shadman Sakib , Md. Abu Bakr Siddique , Md. Abdur Rahman

We investigate nonparametric estimation of sliced inverse regression (SIR) via the $k$-nearest neighbors approach with a kernel. An estimator of the covariance matrix of the conditional expectation of the explanatory random vector given the…

Statistics Theory · Mathematics 2025-05-27 Luran Bengono Mintogo , Emmanuel de Dieu Nkou , Guy Martial Nkiet

The problem of finding a reduced dimensionality representation of categorical variables while preserving their most relevant characteristics is fundamental for the analysis of complex data. Specifically, given a co-occurrence matrix of two…

Machine Learning · Computer Science 2012-12-12 Amir Globerson , Gal Chechik , Naftali Tishby

We present a framework for supervised subspace tracking, when there are two time series $x_t$ and $y_t$, one being the high-dimensional predictors and the other being the response variables and the subspace tracking needs to take into…

Machine Learning · Computer Science 2015-09-02 Yao Xie , Ruiyang Song , Hanjun Dai , Qingbin Li , Le Song

A novel general framework is proposed in this paper for dimension reduction in regression to fill the gap between linear and fully nonlinear dimension reduction. The main idea is to transform first each of the raw predictors monotonically,…

Methodology · Statistics 2014-01-03 Tao Wang , Xu Guo , Peirong Xu , Lixing Zhu

In machine learning or statistics, it is often desirable to reduce the dimensionality of a sample of data points in a high dimensional space $\mathbb{R}^d$. This paper introduces a dimensionality reduction method where the embedding…

Machine Learning · Computer Science 2021-11-30 Michaël Fanuel , Antoine Aspeel , Jean-Charles Delvenne , Johan A. K. Suykens

A significant challenge to make learning techniques more suitable for general purpose use is to move beyond i) complete supervision, ii) low dimensional data, iii) a single task and single view per instance. Solving these challenges allows…

Machine Learning · Computer Science 2012-02-07 Buyue Qian , Xiang Wang , Ian Davidson

Regression aims at estimating the conditional mean of output given input. However, regression is not informative enough if the conditional density is multimodal, heteroscedastic, and asymmetric. In such a case, estimating the conditional…

Machine Learning · Computer Science 2014-04-29 Voot Tangkaratt , Ning Xie , Masashi Sugiyama

Kernel dimensionality reduction (KDR) algorithms find a low dimensional representation of the original data by optimizing kernel dependency measures that are capable of capturing nonlinear relationships. The standard strategy is to first…

Machine Learning · Statistics 2019-09-26 Chieh Wu , Jared Miller , Yale Chang , Mario Sznaier , Jennifer Dy

During the last decades, learning a low-dimensional space with discriminative information for dimension reduction (DR) has gained a surge of interest. However, it's not accessible for these DR methods to achieve satisfactory performance…

Machine Learning · Computer Science 2019-11-19 Xiangzhu Meng , Huibing Wang , Lin Feng

The graph embedding (GE) methods have been widely applied for dimensionality reduction of hyperspectral imagery (HSI). However, a major challenge of GE is how to choose proper neighbors for graph construction and explore the spatial…

Computer Vision and Pattern Recognition · Computer Science 2018-12-27 Hong Huang , Guangyao Shi , Haibo He , Yule Duan , Fulin Luo

Dimension reduction is an important tool for analyzing high-dimensional data. The predictor envelope is a method of dimension reduction for regression that assumes certain linear combinations of the predictors are immaterial to the…

Methodology · Statistics 2022-01-07 Paul May , Hossein Moradi Rekabdarkolaee