English
Related papers

Related papers: Valid F-screening in linear regression

200 papers

In this paper, utilizing recent theoretical results in high dimensional statistical modeling, we propose a model-free yet computationally simple approach to estimate the partially linear model $Y=X\beta+g(Z)+\varepsilon$. Motivated by the…

Methodology · Statistics 2014-01-13 Xia Cui , Ying Lu , Heng Peng

In partially linear single-index models, we obtain the semiparametrically efficient profile least-squares estimators of regression coefficients. We also employ the smoothly clipped absolute deviation penalty (SCAD) approach to…

Statistics Theory · Mathematics 2012-11-16 Hua Liang , Xiang Liu , Runze Li , Chih-Ling Tsai

We study a regression problem where for some part of the data we observe both the label variable ($Y$) and the predictors (${\bf X}$), while for other part of the data only the predictors are given. Such a problem arises, for example, when…

Statistics Theory · Mathematics 2021-04-14 David Azriel , Lawrence D. Brown , Michael Sklar , Richard Berk , Andreas Buja , Linda Zhao

We consider functional linear regression models where functional outcomes are associated with scalar predictors by coefficient functions with shape constraints, such as monotonicity and convexity, that apply to sub-domains of interest. To…

Methodology · Statistics 2025-05-09 Kyunghee Han , Yeonjoo Park , Soo-Young Kim

In this paper, we develop invariance-based procedures for testing and inference in high-dimensional regression models. These procedures, also known as randomization tests, provide several important advantages. First, for the global null…

Methodology · Statistics 2023-12-27 Wenxuan Guo , Panos Toulis

Hypothesis testing procedures are developed to assess linear operator constraints in function-on-scalar regression when incomplete functional responses are observed. The approach enables statistical inferences about the shape and other…

Methodology · Statistics 2022-12-06 Yeonjoo Park , Kyunghee Han , Douglas G. Simpson

This paper develops an approach to inference in a linear regression model when the number of potential explanatory variables is larger than the sample size. The approach treats each regression coefficient in turn as the interest parameter,…

Methodology · Statistics 2022-11-14 Heather S. Battey , Nancy Reid

We present a new and general method of weighted least square univariate regression where the dependent variable is expanded as a series of suitably chosen functions of the independent variables. Each term of the series is obtained by an…

Numerical Analysis · Mathematics 2021-03-26 Nilotpal Kanti Sinha

We introduce equivalence testing procedures for linear regression analyses. Such tests can be very useful for confirming the lack of a meaningful association between a continuous outcome and a continuous or binary predictor. Specifically,…

Methodology · Statistics 2023-05-17 Harlan Campbell

A simple test is proposed for examining the correctness of a given completely specified response function against unspecified general alternatives in the context of univariate regression. The usual diagnostic tools based on residuals plots…

Methodology · Statistics 2010-04-27 Jean-Baptiste Aubin , Samuela Leoni-Aubin

We investigate practical algorithms to find or disprove the existence of small subsets of a dataset which, when removed, reverse the sign of a coefficient in an ordinary least squares regression involving that dataset. We empirically study…

Methodology · Statistics 2023-08-01 Daniel Freund , Samuel B. Hopkins

Two popular variable screening methods under the ultra-high dimensional setting with the desirable sure screening property are the sure independence screening (SIS) and the forward regression (FR). Both are classical variable screening…

Methodology · Statistics 2015-11-05 Ming-Yen Cheng , Sanying Feng , Gaorong Li , Heng Lian

High-dimensional covariates often admit linear factor structure. To effectively screen correlated covariates in high-dimension, we propose a conditional variable screening test based on non-parametric regression using neural networks due to…

Econometrics · Economics 2024-08-21 Jianqing Fan , Weining Wang , Yue Zhao

Determining a lack of association between an outcome variable and a number of different explanatory variables is frequently necessary in order to disregard a proposed model (i.e., to confirm the lack of an association between an outcome and…

Methodology · Statistics 2020-01-16 Harlan Campbell , Daniël Lakens

Estimating linear regression using least squares and reporting robust standard errors is very common in financial economics, and indeed, much of the social sciences and elsewhere. For thick tailed predictors under heteroskedasticity this…

Methodology · Statistics 2020-08-17 Neil Shephard

Functional data analysis tools, such as function-on-function regression models, have received considerable attention in various scientific fields because of their observed high-dimensional and complex data structures. Several statistical…

Methodology · Statistics 2020-09-22 Ufuk Beyaztas , Han Lin Shang

We propose a robust inferential procedure for assessing uncertainties of parameter estimation in high-dimensional linear models, where the dimension $p$ can grow exponentially fast with the sample size $n$. Our method combines the…

Machine Learning · Statistics 2015-03-19 Tianqi Zhao , Mladen Kolar , Han Liu

Regression analysis is a central topic in statistical modeling, aimed at estimating the relationships between a dependent variable, commonly referred to as the response variable, and one or more independent variables, i.e., explanatory…

Machine Learning · Statistics 2025-05-06 Juan M Gorriz , J. Ramirez , F. Segovia , F. J. Martinez-Murcia , C. Jiménez-Mesa , J. Suckling

A partial least squares regression is proposed for estimating the function-on-function regression model where a functional response and multiple functional predictors consist of random curves with quadratic and interaction effects. The…

Methodology · Statistics 2020-12-11 Ufuk Beyaztas , Han Lin Shang

Nonparametric partitioning-based least squares regression is an important tool in empirical work. Common examples include regressions based on splines, wavelets, and piecewise polynomials. This article discusses the main methodological and…

Computation · Statistics 2020-10-29 Matias D. Cattaneo , Max H. Farrell , Yingjie Feng