English
Related papers

Related papers: Tail inverse regression for dimension reduction wi…

200 papers

Expected shortfall is defined as the average over the tail below (or above) a certain quantile of a probability distribution. Expected shortfall regression provides powerful tools for learning the relationship between a response variable…

Methodology · Statistics 2025-01-03 Shushu Zhang , Xuming He , Kean Ming Tan , Wen-Xin Zhou

This paper investigates an interesting weakly supervised regression setting called regression with interval targets (RIT). Although some of the previous methods on relevant regression settings can be adapted to RIT, they are not…

Machine Learning · Computer Science 2023-06-21 Xin Cheng , Yuzhou Cao , Ximing Li , Bo An , Lei Feng

Dimension reduction techniques, such as Sufficient Dimension Reduction (SDR), are indispensable for analyzing high-dimensional datasets. This paper introduces a novel SDR method named Principal Square Response Forward Regression (PSRFR) for…

Methodology · Statistics 2024-09-05 Zheng Li , Yunhao Wang , Wei Gao , Hon Keung Tony Ng

We address the problem of prediction for extreme observations by proposing an extremal linear prediction method. We construct an inner product space of nonnegative random variables derived from transformed-linear combinations of independent…

Methodology · Statistics 2026-01-21 Jeongjin Lee , Daniel Cooley

Motivated by the prominence of Conditional Value-at-Risk (CVaR) as a measure for tail risk in settings affected by uncertainty, we develop a new formula for approximating CVaR based optimization objectives and their gradients from limited…

Methodology · Statistics 2020-08-25 Anand Deo , Karthyek Murthy

Meta learning is a promising paradigm in the era of large models and task distributional robustness has become an indispensable consideration in real-world scenarios. Recent advances have examined the effectiveness of tail task risk…

Machine Learning · Computer Science 2024-10-31 Yiqin Lv , Qi Wang , Dong Liang , Zheng Xie

Unsupervised Domain Adaptation Regression (DAR) aims to bridge the domain gap between a labeled source dataset and an unlabelled target dataset for regression problems. Recent works mostly focus on learning a deep feature encoder by…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Ismail Nejjar , Qin Wang , Olga Fink

Existing theory for multivariate extreme values focuses upon characterizations of the distributional tails when all components of a random vector, standardized to identical margins, grow at the same rate. In this paper, we consider the…

Statistics Theory · Mathematics 2013-12-20 J. L. Wadsworth , J. A. Tawn

This paper introduces a popular dimension reduction method, sliced inverse regression (SIR), into multivariate statistical process monitoring. Provides an extension of SIR for the single-index model by adopting the idea from partial least…

Applications · Statistics 2012-02-03 Yue Yu , Zhijie Sun

Two major bottlenecks to the solution of large-scale Bayesian inverse problems are the scaling of posterior sampling algorithms to high-dimensional parameter spaces and the computational cost of forward model evaluations. Yet incomplete or…

Computation · Statistics 2016-05-03 Tiangang Cui , Youssef M. Marzouk , Karen E. Willcox

This paper proposes a supervised dimension reduction methodology for tensor data which has two advantages over most image-based prognostic models. First, the model does not require tensor data to be complete which expands its application to…

Machine Learning · Computer Science 2023-06-06 Chengyu Zhou , Xiaolei Fang

Learning representations that capture both intrinsic data geometry and target-relevant structure remains a fundamental challenge, particularly in settings where data reduction must balance compression with predictive fidelity. While…

Machine Learning · Computer Science 2026-05-28 Sai-Aakash Ramesh , Archit Sood , Andrew Corbett , Tim Dodwell

The purpose of sufficient dimension reduction (SDR) is to find the low-dimensional subspace of input features that is sufficient for predicting output values. In this paper, we propose a novel distribution-free SDR method called sufficient…

Machine Learning · Statistics 2011-03-28 Makoto Yamada , Gang Niu , Jun Takagi , Masashi Sugiyama

A novel general framework is proposed in this paper for dimension reduction in regression to fill the gap between linear and fully nonlinear dimension reduction. The main idea is to transform first each of the raw predictors monotonically,…

Methodology · Statistics 2014-01-03 Tao Wang , Xu Guo , Peirong Xu , Lixing Zhu

Data derived from remote sensing or numerical simulations often have a regular gridded structure and are large in volume, making it challenging to find accurate spatial models that can fill in missing grid cells or simulate the process…

Machine Learning · Statistics 2025-05-07 Sweta Rai , Douglas W. Nychka , Soutir Bandyopadhyay

The estimation of loss distributions for dynamic portfolios requires the simulation of scenarios representing realistic joint dynamics of their components. We propose a novel data-driven approach for simulating realistic, high-dimensional…

Risk Management · Quantitative Finance 2025-05-19 Rama Cont , Mihai Cucuringu , Renyuan Xu , Chao Zhang

We propose a novel extremal dependence measure called the partial tail-correlation coefficient (PTCC), in analogy to the partial correlation coefficient in classical multivariate analysis. The construction of our new coefficient is based on…

Methodology · Statistics 2022-11-23 Yan Gong , Peng Zhong , Thomas Opitz , Raphaël Huser

We consider the problem of sufficient dimensionality reduction (SDR), where the high-dimensional observation is transformed to a low-dimensional sub-space in which the information of the observations regarding the label variable is…

Machine Learning · Computer Science 2018-12-20 Ershad Banijamali , Amir-Hossein Karimi , Ali Ghodsi

We reformulate unsupervised dimension reduction problem (UDR) in the language of tempered distributions, i.e. as a problem of approximating an empirical probability density function by another tempered distribution, supported in a…

Statistics Theory · Mathematics 2022-11-08 Rustem Takhanov

We propose a new method for dimension reduction in regression using the first two inverse moments. We develop corresponding weighted chi-squared tests for the dimension of the regression. The proposed method considers linear combinations of…

Methodology · Statistics 2013-08-27 Zhishen Ye , Jie Yang