English
Related papers

Related papers: The R package psvmSDR: A Unified Algorithm for Suf…

200 papers

Data dimension reduction (DDR) is all about mapping data from high dimensions to low dimensions, various techniques of DDR are being used for image dimension reduction like Random Projections, Principal Component Analysis (PCA), the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Wisal Khan , Muhammad Turab , Waqas Ahmad , Syed Hasnat Ahmad , Kelash Kumar , Bin Luo

We explore two primary classes of approaches to dimensionality reduction (DR): Independent Dimensionality Reduction (IDR) and Simultaneous Dimensionality Reduction (SDR). In IDR methods, of which Principal Components Analysis is a…

Machine Learning · Statistics 2024-10-28 Eslam Abdelaleem , Ahmed Roman , K. Michael Martini , Ilya Nemenman

We consider the problem of sufficient dimensionality reduction (SDR), where the high-dimensional observation is transformed to a low-dimensional sub-space in which the information of the observations regarding the label variable is…

Machine Learning · Computer Science 2018-12-20 Ershad Banijamali , Amir-Hossein Karimi , Ali Ghodsi

We present a new methodology for sufficient dimension reduction (SDR). Our methodology derives directly from the formulation of SDR in terms of the conditional independence of the covariate $X$ from the response $Y$, given the projection of…

Statistics Theory · Mathematics 2009-08-14 Kenji Fukumizu , Francis R. Bach , Michael I. Jordan

We reformulate unsupervised dimension reduction problem (UDR) in the language of tempered distributions, i.e. as a problem of approximating an empirical probability density function by another tempered distribution, supported in a…

Statistics Theory · Mathematics 2022-11-08 Rustem Takhanov

The growing size of modern data brings many new challenges to existing statistical inference methodologies and theories, and calls for the development of distributed inferential approaches. This paper studies distributed inference for…

Machine Learning · Statistics 2019-10-01 Xiaozhou Wang , Zhuoyi Yang , Xi Chen , Weidong Liu

Analyzing relationships between objects is a pivotal problem within data science. In this context, Dimensionality reduction (DR) techniques are employed to generate smaller and more manageable data representations. This paper proposes a new…

Machine Learning · Statistics 2025-07-08 Rafael P. Eufrazio , Eduardo Fernandes Montesuma , Charles C. Cavalcante

In this work, we develop a new theory and method for sufficient dimension reduction (SDR) in single-index models, where SDR is a sub-field of supervised dimension reduction based on conditional independence. Our work is primarily motivated…

Machine Learning · Statistics 2024-05-31 Seungbeom Hong , Ilmun Kim , Jun Song

This paper introduces a new unsupervised method for dimensionality reduction via regression (DRR). The algorithm belongs to the family of invertible transforms that generalize Principal Component Analysis (PCA) by using curvilinear instead…

Machine Learning · Statistics 2016-02-02 Valero Laparra , Jesus Malo , Gustau Camps-Valls

We present a framework for supervised subspace tracking, when there are two time series $x_t$ and $y_t$, one being the high-dimensional predictors and the other being the response variables and the subspace tracking needs to take into…

Machine Learning · Computer Science 2015-09-02 Yao Xie , Ruiyang Song , Hanjun Dai , Qingbin Li , Le Song

Moment-based distributionally robust optimization (DRO) provides an optimization framework to integrate statistical information with traditional optimization approaches. Under this framework, one assumes that the underlying joint…

Optimization and Control · Mathematics 2023-11-01 Shiyi Jiang , Jianqiang Cheng , Kai Pan , Zuo-Jun Max Shen

We study the problem of robust estimation of the mean vector of a sub-Gaussian distribution. We introduce an estimator based on spectral dimension reduction (SDR) and establish a finite sample upper bound on its error that is…

Statistics Theory · Mathematics 2022-04-06 Amir-Hossein Bateni , Arshak Minasyan , Arnak S. Dalalyan

Sum of Ranking Differences (SRD) is a relatively novel, non-para-metric statistical procedure that has become increasingly popular recently. SRD compares solutions via a reference by applying a rank transformation on the input and…

Statistics Theory · Mathematics 2025-02-06 Balázs R. Sziklai , Attila Gere , Károly Héberger , Jochen Staudacher

Nowadays, massive datasets are typically dispersed across multiple locations, encountering dual challenges of high dimensionality and huge sample size. Therefore, it is necessary to explore sufficient dimension reduction (SDR) methods for…

Methodology · Statistics 2025-09-16 Hongying Li , Minyi Zhu , Yaqi Cao , Xinyi Xu

With the rapid development of data collection techniques, complex data objects that are not in the Euclidean space are frequently encountered in new statistical applications. Fr\'echet regression model (Peterson & M\"uller 2019) provides a…

Methodology · Statistics 2022-12-08 Qi Zhang , Lingzhou Xue , Bing Li

Sufficient dimension reduction (SDR) provides a framework for reducing the predictor space dimension in regression problems. We consider SDR in the context of deterministic functions of several variables such as those arising in computer…

Numerical Analysis · Mathematics 2017-10-09 Andrew Glaws , Paul G. Constantine

This paper investigates the connection between neural networks and sufficient dimension reduction (SDR), demonstrating that neural networks inherently perform SDR in regression tasks under appropriate rank regularizations. Specifically, the…

Machine Learning · Statistics 2024-12-30 Shuntuo Xu , Zhou Yu

Sufficient dimension reduction is a powerful tool to extract core information hidden in the high-dimensional data and has potentially many important applications in machine learning tasks. However, the existing nonlinear sufficient…

Machine Learning · Computer Science 2022-10-11 Siqi Liang , Yan Sun , Faming Liang

This paper studies the problem of dimension reduction, tailored to improving time series forecasting with high-dimensional predictors. We propose a novel Supervised Deep Dynamic Principal component analysis (SDDP) framework that…

Machine Learning · Statistics 2025-11-25 Zhanye Luo , Yuefeng Han , Xiufan Yu

In ordinary Dimensionality Reduction (DR), each data instance in a high dimensional space (original space), or on a distance matrix denoting original space distances, is mapped to (projected onto) one point in a low dimensional space…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Farshad Barahimi