English
Related papers

Related papers: Sufficient dimension reduction based on an ensembl…

200 papers

The state-of-the-art methods for estimating high-dimensional covariance matrices all shrink the eigenvalues of the sample covariance matrix towards a data-insensitive shrinkage target. The underlying shrinkage transformation is either…

Machine Learning · Statistics 2025-11-25 Man-Chung Yue , Yves Rychener , Daniel Kuhn , Viet Anh Nguyen

In this work we show that the classification performance of high-dimensional structural MRI data with only a small set of training examples is improved by the usage of dimension reduction methods. We assessed two different dimension…

Machine Learning · Computer Science 2015-05-27 Andreas Grünauer , Markus Vincze

We consider the smoothed version of sliced average variance estimation (SAVE) dimension reduction method for dealing with spatially dependent data that are observations of a strongly mixing random field. We propose kernel estimators for the…

Statistics Theory · Mathematics 2019-09-24 Mètolidji Moquilas Raymond Affossogbe , Guy Martial Nkiet , Carlos Ogouyandjou

The principal support vector machines method (Li et al., 2011) is a powerful tool for sufficient dimension reduction that replaces original predictors with their low-dimensional linear combinations without loss of information. However, the…

Machine Learning · Statistics 2019-12-02 Jun Jin , Chao Ying , Zhou Yu

Many statistical models seek relationship between variables via subspaces of reduced dimensions. For instance, in factor models, variables are roughly distributed around a low dimensional subspace determined by the loading matrix; in mixed…

Methodology · Statistics 2018-05-09 Jianqing Fan , Yiqiao Zhong

In supervised learning, training and test datasets are often sampled from distinct distributions. Domain adaptation techniques are thus required. Covariate shift adaptation yields good generalization performance when domains differ only by…

Machine Learning · Statistics 2022-01-11 Felipe Maia Polo , Renato Vicente

Sufficient dimension reduction aims for reduction of dimensionality of a regression without loss of information by replacing the original predictor with its lower-dimensional subspace. Partial (sufficient) dimension reduction arises when…

Methodology · Statistics 2019-09-27 Lu Li , Kai Tan , Xuerong Meggie Wen , Zhou Yu

Causal inference plays an important role in under standing the underlying mechanisation of the data generation process across various domains. It is challenging to estimate the average causal effect and individual causal effects from…

Data Structures and Algorithms · Computer Science 2023-01-05 Haoran Zhao , Yinghao Zhang , Debo Cheng , Chen Li , Zaiwen Feng

We introduce a principal support vector machine (PSVM) approach that can be used for both linear and nonlinear sufficient dimension reduction. The basic idea is to divide the response variables into slices and use a modified form of support…

Statistics Theory · Mathematics 2012-03-14 Bing Li , Andreas Artemiou , Lexin Li

When estimating the treatment effect in an observational study, we use a semiparametric locally efficient dimension reduction approach to assess both the treatment assignment mechanism and the average responses in both treated and…

Methodology · Statistics 2020-10-26 Trinetri Ghosh , Yanyuan Ma , Xavier de Luna

We consider a generalization of the criterion minimized by the K-means algorithm, where a neighborhood structure is used in the calculus of the variance. Such tool is used, for example with Kohonen maps, to measure the quality of the…

Statistics Theory · Mathematics 2008-02-22 Joseph Rynkiewicz

A theory of superefficiency and adaptation is developed under flexible performance measures which give a multiresolution view of risk and bridge the gap between pointwise and global estimation. This theory provides a useful benchmark for…

Statistics Theory · Mathematics 2007-06-13 T. Tony Cai , Mark G. Low

Meta-analysis is the aggregation of data from multiple studies to find patterns across a broad range relating to a particular subject. It is becoming increasingly useful to apply meta-analysis to summarize these studies being done across…

Methodology · Statistics 2023-10-25 Olivia Xiao , Stacy Wang , Min Chen

We address the problem of sufficient dimension reduction for feature matrices, which arises often in sensor network localization, brain neuroimaging, and electroencephalography analysis. In general, feature matrices have both row- and…

Methodology · Statistics 2023-03-09 Chanwoo Lee

The purpose of this study is to perform verification of the structural characteristics of high-resolution spatial forecasts without relying on an object identification algorithm. To this end, a wavelet approach developed for image texture…

Applications · Statistics 2018-08-24 Florian Kapp , Petra Friederichs , Sebastian Brune , Michael Weniger

This paper is devoted to dimensional reductions via the norm resolvent convergence. We derive explicit bounds on the resolvent difference as well as spectral asymptotics. The efficiency of our abstract tool is demonstrated by its…

Mathematical Physics · Physics 2018-11-26 David Krejcirik , Nicolas Raymond , Julien Royer , Petr Siegl

This paper offers a new approach to address the model uncertainty in (potentially) divergent-dimensional single-index models (SIMs). We propose a model-averaging estimator based on cross-validation, which allows the dimension of covariates…

Methodology · Statistics 2022-06-14 Jiahui Zou , Wendun Wang , Xinyu Zhang , Guohua Zou

Supervised dimensionality reduction has emerged as an important theme in the last decade. Despite the plethora of models and formulations, there is a lack of a simple model which aims to project the set of patterns into a space defined by…

Machine Learning · Statistics 2016-10-28 Anthony O. Smith , Anand Rangarajan

We propose a high dimensional mean test framework for shrinking random variables, where the underlying random variables shrink to zero as the sample size increases. By pooling observations across overlapping subsets of dimensions, we…

Methodology · Statistics 2026-02-11 Liujun Chen , Chen Zhou

Variance reduction is a family of powerful mechanisms for stochastic optimization that appears to be helpful in many machine learning tasks. It is based on estimating the exact gradient with some recursive sequences. Previously, many papers…

Optimization and Control · Mathematics 2025-11-07 Aleksandr Shestakov , Valery Parfenov , Aleksandr Beznosikov