English
Related papers

Related papers: A Constructive Approach to the Estimation of Dimen…

200 papers

Two methods are proposed for high-dimensional shape-constrained regression and classification. These methods reshape pre-trained prediction rules to satisfy shape constraints like monotonicity and convexity. The first method can be applied…

Machine Learning · Statistics 2018-05-17 Matt Bonakdarpour , Sabyasachi Chatterjee , Rina Foygel Barber , John Lafferty

We introduce a new approach to nonlinear sufficient dimension reduction in cases where both the predictor and the response are distributional data, modeled as members of a metric space. Our key step is to build universal kernels…

Methodology · Statistics 2023-04-26 Qi Zhang , Bing Li , Lingzhou Xue

Sufficient dimension reduction (SDR) is a popular class of regression methods which aim to find a small number of linear combinations of covariates that capture all the information of the responses i.e., a central subspace. The majority of…

Methodology · Statistics 2024-10-15 Linh H. Nghiem , F. K. C. Hui

Compressive spectral imaging (CSI) has emerged as an alternative spectral image acquisition technology, which reduces the number of measurements at the cost of requiring a recovery process. In general, the reconstruction methods are based…

Image and Video Processing · Electrical Eng. & Systems 2021-05-19 Jorge Bacca , Yesid Fonseca , Henry Arguello

Relative location prediction in computed tomography (CT) scan images is a challenging problem. In this paper, a regression model based on one-dimensional convolutional neural networks is proposed to determine the relative location of a CT…

Computer Vision and Pattern Recognition · Computer Science 2017-11-22 Jiajia Guo , Hongwei Du , Bensheng Qiu , Xiao Liang

We propose a direct, regression-based approach to 2D human pose estimation from single images. We formulate the problem as a sequence prediction task, which we solve using a Transformer network. This network directly learns a regression…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Weian Mao , Yongtao Ge , Chunhua Shen , Zhi Tian , Xinlong Wang , Zhibin Wang , Anton van den Hengel

Beginning with a discussion of R. A. Fisher's early written remarks that relate to dimension reduction, this article revisits principal components as a reductive method in regression, develops several model-based extensions and ends with…

Methodology · Statistics 2007-08-30 R. Dennis Cook

Model reduction is essential for real-time simulation of deformable objects. Linear techniques such as PCA provide structured and predictable behavior, but their limited expressiveness restricts accuracy under large or nonlinear…

Graphics · Computer Science 2026-01-28 Shixun Huang , Eitan Grinspun , Yue Chang

Sliced inverse regression is a popular tool for sufficient dimension reduction, which replaces covariates with a minimal set of their linear combinations without loss of information on the conditional distribution of the response given the…

Machine Learning · Statistics 2018-09-18 Kean Ming Tan , Zhaoran Wang , Tong Zhang , Han Liu , R. Dennis Cook

Approximate Bayesian computation (ABC) methods make use of comparisons between simulated and observed summary statistics to overcome the problem of computationally intractable likelihood functions. As the practical implementation of ABC…

Methodology · Statistics 2013-06-12 M. G. B. Blum , M. A. Nunes , D. Prangle , S. A. Sisson

In our work, we propose a novel formulation for supervised dimensionality reduction based on a nonlinear dependency criterion called Statistical Distance Correlation, Szekely et. al. (2007). We propose an objective which is free of…

Machine Learning · Computer Science 2016-01-05 Praneeth Vepakomma , Chetan Tonde , Ahmed Elgammal

The central subspace of a pair of random variables $(y,x) \in \mathbb{R}^{p+1}$ is the minimal subspace $\mathcal{S}$ such that $y \perp \hspace{-2mm} \perp x\mid P_{\mathcal{S}}x$. In this paper, we consider the minimax rate of estimating…

Statistics Theory · Mathematics 2017-01-25 Qian Lin , Xinran Li , Dongming Huang , Jun S. Liu

We provide two novel adaptive-rate compressive sensing (CS) strategies for sparse, time-varying signals using side information. Our first method utilizes extra cross-validation measurements, and the second one exploits extra low-resolution…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Garrett Warnell , Sourabh Bhattacharya , Rama Chellappa , Tamer Basar

Sufficient dimension reduction (SDR) provides a framework for reducing the predictor space dimension in regression problems. We consider SDR in the context of deterministic functions of several variables such as those arising in computer…

Numerical Analysis · Mathematics 2017-10-09 Andrew Glaws , Paul G. Constantine

Application of the minimum distance method to the linear regression model for estimating regression parameters is a difficult and time-consuming process due to the complexity of its distance function, and hence, it is computationally…

Computation · Statistics 2017-02-15 Jiwoong Kim

We propose an extreme dimension reduction method extending the Extreme-PLS approach to the case where the covariate lies in a possibly infinite-dimensional Hilbert space. The ideas are partly borrowed from both Partial Least-Squares and…

Statistics Theory · Mathematics 2026-01-01 Stéphane Girard , Cambyse Pakzad

Low-dimensional embeddings for data from disparate sources play critical roles in multi-modal machine learning, multimedia information retrieval, and bioinformatics. In this paper, we propose a supervised dimensionality reduction method…

Machine Learning · Computer Science 2021-01-15 Yanjun Li , Bihan Wen , Hao Cheng , Yoram Bresler

In traditional multivariate data analysis, dimension reduction and regression have been treated as distinct endeavors. Established techniques such as principal component regression (PCR) and partial least squares (PLS) regression…

Machine Learning · Statistics 2025-12-01 Shiqin Tang , Yining Dong , S. Joe Qin

For crowded scenes, the accuracy of object-based computer vision methods declines when the images are low-resolution and objects have severe occlusions. Taking counting methods for example, almost all the recent state-of-the-art counting…

Computer Vision and Pattern Recognition · Computer Science 2018-06-14 Di Kang , Zheng Ma , Antoni B. Chan

Neural network-based methods for (un)conditional density estimation have recently gained substantial attention, as various neural density estimators have outperformed classical approaches in real-data experiments. Despite these empirical…

Machine Learning · Statistics 2025-10-02 Dehao Dai , Jianqing Fan , Yihong Gu , Debarghya Mukherjee