English
Related papers

Related papers: Dimension Reduction and MARS

200 papers

In functional linear regression, the parameters estimation involves solving a non necessarily well-posed problem and it has points of contact with a range of methodologies, including statistical smoothing, deconvolution and projection on…

Statistics Theory · Mathematics 2018-01-04 Andrea Ghiglietti , Francesca Ieva , Anna Maria Paganoni , Giacomo Aletti

We propose generalized additive partial linear models for complex data which allow one to capture nonlinear patterns of some covariates, in the presence of linear components. The proposed method improves estimation efficiency and increases…

Statistics Theory · Mathematics 2014-05-26 Li Wang , Lan Xue , Annie Qu , Hua Liang

Estimation of the precision matrix (or inverse covariance matrix) is of great importance in statistical data analysis and machine learning. However, as the number of parameters scales quadratically with the dimension $p$, computation…

Computation · Statistics 2022-11-02 Qian LI , Binyan Jiang , Defeng Sun

It is often of interest to estimate regression functions non-parametrically. Penalized regression (PR) is one statistically-effective, well-studied solution to this problem. Unfortunately, in many cases, finding exact solutions to PR…

Methodology · Statistics 2021-12-08 Brayan Ortiz , Noah Simon

We consider model selection and estimation for partial spline models and propose a new regularization method in the context of smoothing splines. The regularization method has a simple yet elegant form, consisting of roughness penalty on…

Methodology · Statistics 2013-11-25 Guang Cheng , Hao Helen Zhang , Zuofeng Shang

The spatial random-effects model is flexible in modeling spatial covariance functions, and is computationally efficient for spatial prediction via fixed rank kriging. However, the success of this model depends on an appropriate set of basis…

Methodology · Statistics 2015-04-23 ShengLi Tzeng , Hsin-Cheng Huang

In some real world applications, such as spectrometry, functional models achieve better predictive performances if they work on the derivatives of order m of their inputs rather than on the original functions. As a consequence, the use of…

Statistics Theory · Mathematics 2011-05-04 Fabrice Rossi , Nathalie Villa-Vialaneix

We propose a multiscale approach to time series autoregression, in which linear regressors for the process in question include features of its own path that live on multiple timescales. We take these multiscale features to be the recent…

Methodology · Statistics 2024-12-17 Rafal Baranowski , Yining Chen , Piotr Fryzlewicz

Nonparametric regression models with locally stationary covariates have received increasing interest in recent years. As a nice relief of "curse of dimensionality" induced by large dimension of covariates, additive regression model is…

Statistics Theory · Mathematics 2016-12-02 Lixia Hu , Tao Huang , Jinhong You

To estimate casual treatment effects, we propose a new matching approach based on the reduced covariates obtained from sufficient dimension reduction. Compared to the original covariates and the propensity score, which are commonly used for…

Methodology · Statistics 2017-02-03 Wei Luo , Yeying Zhu

Missing data is an universal problem in statistics. We develop a unified framework for estimating parameters defined by general estimating equations under a missing-at-random (MAR) mechanism, based on generalized entropy calibration…

Methodology · Statistics 2026-03-31 Mst Moushumi Pervin , Hengfang Wang , Jae Kwang Kim

Recently, Su and Cook proposed a dimension reduction technique called the inner envelope which can be substantially more efficient than the original envelope or existing dimension reduction techniques for multivariate regression. However,…

Methodology · Statistics 2022-05-25 Linquan Ma , Hyunseung Kang , Lan Liu

We propose a nonconvex estimator for joint multivariate regression and precision matrix estimation in the high dimensional regime, under sparsity constraints. A gradient descent algorithm with hard thresholding is developed to solve the…

Machine Learning · Statistics 2016-06-03 Jinghui Chen , Quanquan Gu

Inspired by the complexity of certain real-world datasets, this article introduces a novel flexible linear spline index regression model. The model posits piecewise linear effects of an index on the response, with continuous changes…

Methodology · Statistics 2024-09-04 Lianqiang Qu , Long Lv , Meiling Hao , Liuquan Sun

Sufficient dimension reduction [J. Amer. Statist. Assoc. 86 (1991) 316-342] has long been a prominent issue in multivariate nonparametric regression analysis. To uncover the central dimension reduction space, we propose in this paper an…

Statistics Theory · Mathematics 2014-08-15 Efang Kong , Yingcun Xia

A bottleneck of sufficient dimension reduction (SDR) in the modern era is that, among numerous methods, only the sliced inverse regression (SIR) is generally applicable under the high-dimensional settings. The higher-order inverse…

Methodology · Statistics 2024-07-24 Yin Jin , Wei Luo

A new method of Hansen solubility parameters (HSPs) prediction was developed by combining the multivariate adaptive regression splines (MARSplines) methodology with a simple multivariable regression involving 1D and 2D PaDEL molecular…

Chemical Physics · Physics 2019-01-14 Maciej Przybyłek , Tomasz Jeliński , Piotr Cysewski

Scalability of statistical estimators is of increasing importance in modern applications and dimension reduction is often used to extract relevant information from data. A variety of popular dimension reduction approaches can be framed as…

Machine Learning · Statistics 2013-11-07 Stoyan Georgiev , Sayan Mukherjee

Structured additive distributional regression models offer a versatile framework for estimating complete conditional distributions by relating all parameters of a parametric distribution to covariates. Although these models efficiently…

Methodology · Statistics 2023-11-14 Jana Kleinemeier , Nadja Klein

This study extends the Bayesian nonparametric instrumental variable regression model to determine the structural effects of covariates on the conditional quantile of the response variable. The error distribution is nonparametrically…

Methodology · Statistics 2016-08-30 Genya Kobayashi , Kota Ogasawara