English
Related papers

Related papers: Threshold detection under a semiparametric regress…

200 papers

Asymptotic lower bounds for estimation play a fundamental role in assessing the quality of statistical procedures. In this paper we propose a framework for obtaining semi-parametric efficiency bounds for sparse high-dimensional models,…

Statistics Theory · Mathematics 2017-10-16 Jana Jankova , Sara van de Geer

Classical penalized likelihood regression problems deal with the case that the independent variables data are known exactly. In practice, however, it is common to observe data with incomplete covariate information. We are concerned with a…

Methodology · Statistics 2010-08-04 Xiwen Ma , Bin Dai , Ronald Klein , Barbara E. K. Klein , Kristine E. Lee , Grace Wahba

Here we propose a novel searching scheme for a tuning parameter in high-dimensional penalized regression methods to address variable selection and modeling when sample sizes are limited compared to the data dimensions. Our method is…

Quantitative Methods · Quantitative Biology 2020-02-11 Tao Jiang , Stephanie J. London , Mi Kyeong Lee , Josyf C. Mychaleckyj , Alison A. Motsinger-Reif

The linear regression model cannot be fitted to high-dimensional data, as the high-dimensionality brings about empirical non-identifiability. Penalized regression overcomes this non-identifiability by augmentation of the loss function by a…

Methodology · Statistics 2023-06-29 Wessel N. van Wieringen

In this paper we consider the trace regression model. Assume that we observe a small set of entries or linear combinations of entries of an unknown matrix $A_0$ corrupted by noise. We propose a new rank penalized estimator of $A_0$. For…

Statistics Theory · Mathematics 2011-09-14 Olga Klopp

Consider the {$\ell_{\alpha}$} regularized linear regression, also termed Bridge regression. For $\alpha\in (0,1)$, Bridge regression enjoys several statistical properties of interest such as sparsity and near-unbiasedness of the estimates…

Methodology · Statistics 2023-10-10 Jorge Loría , Anindya Bhadra

This paper tackles the challenge of detecting unreliable behavior in regression algorithms, which may arise from intrinsic variability (e.g., aleatoric uncertainty) or modeling errors (e.g., model uncertainty). First, we formally introduce…

Machine Learning · Computer Science 2024-06-12 Andres Altieri , Marco Romanelli , Georg Pichler , Florence Alberge , Pablo Piantanida

Small area estimation under linear mixed models often assumes that the small area effect is random effect in almost all previous studies. However, in this paper a new approach is proposed explaining small area effect as the unknown function…

Methodology · Statistics 2014-04-16 Rong Zhu , Guohua Zou , Chun Wang , Yi Hu

This paper focuses on a semiparametric regression model in which the response variable is explained by the sum of two components. One of them is parametric (linear), the corresponding explanatory variable is measured with additive error and…

Methodology · Statistics 2024-11-20 Silvia Novo , Germán Aneiros , Philippe Vieu

We consider the application of a popular penalised regression method, Ridge Regression, to data with very high dimensions and many more covariates than observations. Our motivation is the problem of out-of-sample prediction and the setting…

Applications · Statistics 2012-05-04 Erika Cule , Maria De Iorio

We consider a high-dimensional regression model with a possible change-point due to a covariate threshold and develop the Lasso estimator of regression coefficients as well as the threshold parameter. Our Lasso estimator not only selects…

Statistics Theory · Mathematics 2019-08-23 Sokbae Lee , Myung Hwan Seo , Youngki Shin

In the functional linear regression model, many methods have been proposed and studied to estimate the slope function while the functional predictor was observed in the entire domain. However, works on functional linear regression models…

Methodology · Statistics 2021-12-21 Yafei Wang , Tingyu Lai , Bei Jiang , Linglong Kong , Zhongzhan Zhang

This paper considers the problem of inference in a linear regression model with outliers where the number of outliers can grow with sample size but their proportion goes to 0. We apply the square-root lasso estimator penalizing the l1-norm…

Statistics Theory · Mathematics 2019-06-05 Jad Beyhum

We discuss semiparametric regression when only the ranks of responses are observed. The model is $Y_i = F (\mathbf{x}_i'{\boldsymbol\beta}_0 + \varepsilon_i)$, where $Y_i$ is the unobserved response, $F$ is a monotone increasing function,…

Applications · Statistics 2016-02-25 Michael C. Donohue , Anthony C. Gamst , Robert A. Rissman , Ian Abramson

In this paper, we consider a high-dimensional quantile regression model where the sparsity structure may differ between two sub-populations. We develop $\ell_1$-penalized estimators of both regression coefficients and the threshold…

Methodology · Statistics 2018-12-07 Sokbae Lee , Yuan Liao , Myung Hwan Seo , Youngki Shin

We consider the problem of constructing a regression model with a functional predictor and a functional response. We extend the functional linear model to the quadratic model, where the quadratic term also takes the interaction between the…

Methodology · Statistics 2020-06-01 Hidetoshi Matsui

Difficulties may arise when analyzing longitudinal data using mixed-effects models if there are nonparametric functions present in the linear predictor component. This study extends the use of semiparametric mixed-effects modeling in cases…

Methodology · Statistics 2024-02-05 Mozhgan Taavoni , Mohammad Arashi

In modern data science, dynamic tensor data is prevailing in numerous applications. An important task is to characterize the relationship between such dynamic tensor and external covariates. However, the tensor data is often only partially…

Machine Learning · Statistics 2021-05-17 Jie Zhou , Will Wei Sun , Jingfei Zhang , Lexin Li

This paper studies the outlier detection problem from the point of view of penalized regressions. Our regression model adds one mean shift parameter for each of the $n$ data points. We then apply a regularization favoring a sparse vector of…

Methodology · Statistics 2011-10-18 Yiyuan She , Art B. Owen

Linear regression on network-linked observations has been an essential tool in modeling the relationship between response and covariates with additional network structures. Previous methods either lack inference tools or rely on restrictive…

Methodology · Statistics 2022-08-22 Can M. Le , Tianxi Li