English
Related papers

Related papers: Linear Contour Learning: A Method for Supervised D…

200 papers

This paper studies the nonparametric modal regression problem systematically from a statistical learning view. Originally motivated by pursuing a theoretical understanding of the maximum correntropy criterion based regression (MCCR), our…

Machine Learning · Statistics 2020-01-20 Yunlong Feng , Jun Fan , Johan A. K. Suykens

Sufficient dimension reduction (SDR) in regression, which reduces the dimension by replacing original predictors with a minimal set of their linear combinations without loss of information, is very helpful when the number of predictors is…

Statistics Theory · Mathematics 2012-11-15 Xin Chen , Changliang Zou , R. Dennis Cook

In this work we develop a novel approach using deep neural networks to reconstruct the conductivity distribution in elliptic problems from one measurement of the solution over the whole domain. The approach is based on a mixed reformulation…

Numerical Analysis · Mathematics 2023-12-20 Bangti Jin , Xiyao Li , Qimeng Quan , Zhi Zhou

Most data sets comprise of measurements on continuous and categorical variables. In regression and classification Statistics literature, modeling high-dimensional mixed predictors has received limited attention. In this paper we study the…

Statistics Theory · Mathematics 2021-10-26 Efstathia Bura , Liliana Forzani , Rodrigo García Arancibia , Pamela Llop , Diego Tomassi

The errors-in-variables (EIV) regression model, being more realistic by accounting for measurement errors in both the dependent and the independent variables, is widely adopted in applied sciences. The traditional EIV model estimators,…

Methodology · Statistics 2015-08-13 Hao Han , Wei Zhu

This paper carries out a large dimensional analysis of a variation of kernel ridge regression that we call \emph{centered kernel ridge regression} (CKRR), also known in the literature as kernel ridge regression with offset. This modified…

Machine Learning · Statistics 2020-04-22 Khalil Elkhalil , Abla Kammoun , Xiangliang Zhang , Mohamed-Slim Alouini , Tareq Al-Naffouri

In this study, we propose shrinkage methods based on {\it generalized ridge regression} (GRR) estimation which is suitable for both multicollinearity and high dimensional problems with small number of samples (large $p$, small $n$). Also,…

Statistics Theory · Mathematics 2020-03-04 Bahadır Yüzbaşı , Mohammad Arashi , S. Ejaz Ahmed

We derive improved regression and classification rates for support vector machines using Gaussian kernels under the assumption that the data has some low-dimensional intrinsic structure that is described by the box-counting dimension. Under…

Statistics Theory · Mathematics 2021-04-08 Thomas Hamm , Ingo Steinwart

Dimension reduction techniques typically seek an embedding of a high-dimensional point cloud into a low-dimensional Euclidean space which optimally preserves the geometry of the input data. Based on expert knowledge, one may instead wish to…

Optimization and Control · Mathematics 2025-02-28 Ranthony A. Clark , Tom Needham , Thomas Weighill

Reduced Rank Regression (RRR) is a widely used method for multi-response regression. However, RRR assumes a linear relationship between features and responses. While linear models are useful and often provide a good approximation, many…

Machine Learning · Statistics 2025-03-11 Leia Greenberg , Haim Avron

We propose a class of dimension reduction methods for right censored survival data using a counting process representation of the failure process. Semiparametric estimating equations are constructed to estimate the dimension reduction…

Methodology · Statistics 2018-06-11 Qiang Sun , Ruoqing Zhu , Tao Wang , Donglin Zeng

Sufficient dimension reduction (SDR) is a popular tool in regression analysis, which replaces the original predictors with a minimal set of their linear combinations. However, the estimated linear combinations generally contain all original…

Computation · Statistics 2020-12-16 Lei Yan , Xin Chen

Dimensionality reduction is a crucial technique in data analysis, as it allows for the efficient visualization and understanding of high-dimensional datasets. The circular coordinate is one of the topological data analysis techniques…

Algebraic Topology · Mathematics 2023-01-31 Taejin Paik , Jaemin Park

Individualized treatment regimes (ITRs) aim to improve clinical outcomes by assigning treatment based on patient-specific characteristics. However, existing methods often struggle with high-dimensional covariates, limiting accuracy,…

Machine Learning · Statistics 2026-01-13 Sungtaek Son , Eardi Lila , Kwun Chuen Gary Chan

Monocular depth prediction plays a crucial role in understanding 3D scene geometry. Although recent methods have achieved impressive progress in terms of evaluation metrics such as the pixel-wise relative error, most methods neglect the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Wei Yin , Yifan Liu , Chunhua Shen

Graph convolution network (GCN) attracts intensive research interest with broad applications. While existing work mainly focused on designing novel GCN architectures for better performance, few of them studied a practical yet challenging…

Machine Learning · Computer Science 2020-10-16 Xiaoming Liu , Qirui Li , Chao Shen , Xi Peng , Yadong Zhou , Xiaohong Guan

Dimensionality is a major concern in analyzing large data sets. Some well known dimension reduction methods are for example principal component analysis (PCA), invariant coordinate selection (ICS), sliced inverse regression (SIR), sliced…

Methodology · Statistics 2024-09-10 Eero Liski , Klaus Nordhausen , Hannu Oja , Anne Ruiz-Gazen

In this paper, we propose a novel lower dimensional representation of a shape sequence. The proposed dimension reduction is invertible and computationally more efficient in comparison to other related works. Theoretically, the differential…

Computer Vision and Pattern Recognition · Computer Science 2011-08-02 Sheng Yi , Hamid Krim , Larry K. Norris

Metric learning seeks perceptual embeddings where visually similar instances are close and dissimilar instances are apart, but learned representations can be sub-optimal when the distribution of intra-class samples is diverse and distinct…

Machine Learning · Computer Science 2021-08-30 Elad Levi , Tete Xiao , Xiaolong Wang , Trevor Darrell

Quantile regression (QR) is becoming increasingly popular due to its relevance in many scientific investigations. However, application of QR can become very challenging when dealing with high-dimensional data, making it necessary to use…

Methodology · Statistics 2019-12-11 Eliana Christou