English
Related papers

Related papers: Local-Polynomial Estimation for Multivariate Regre…

200 papers

Selecting input variables or design points for statistical models has been of great interest in adaptive design and active learning. Motivated by two scientific examples, this paper presents a strategy of selecting the design points for a…

Machine Learning · Statistics 2021-02-12 Chiwoo Park , Peihua Qiu , Jennifer Carpena-Núñez , Rahul Rao , Michael Susner , Benji Maruyama

Existing identification and estimation methods for semiparametric sample selection models rely heavily on exclusion restrictions. However, it is difficult in practice to find a credible excluded variable that has a correlation with…

Econometrics · Economics 2024-12-03 Zhewen Pan , Yifan Zhang

This paper develops a doubly robust extension of local-projections difference-in-differences (LP-DiD) for staggered absorbing treatments. The resulting estimator, DRLPDID, preserves the LP-DiD local-stack ATT target and is consistent when…

Econometrics · Economics 2026-05-01 Daniel de Abreu Pereira Uhr , Guilherme Valle Moura

I propose a locally robust semiparametric framework for estimating causal effects using the popular examiner IV design, in the presence of many examiners and possibly many covariates relative to the sample size. The key ingredient of this…

Econometrics · Economics 2024-05-01 Lonjezo Sithole

For the problem of high-dimensional sparse linear regression, it is known that an $\ell_0$-based estimator can achieve a $1/n$ "fast" rate on the prediction error without any conditions on the design matrix, whereas in absence of…

Statistics Theory · Mathematics 2015-12-01 Yuchen Zhang , Martin J. Wainwright , Michael I. Jordan

Covariance matrix estimation is an important problem in multivariate data analysis, both from theoretical as well as applied points of view. Many simple and popular covariance matrix estimators are known to be severely affected by model…

Methodology · Statistics 2025-11-21 Soumya Chakraborty , Ayanendranath Basu , Abhik Ghosh

We present a greedy method for simultaneously performing local bandwidth selection and variable selection in nonparametric regression. The method starts with a local linear estimator with large bandwidths, and incrementally decreases the…

Statistics Theory · Mathematics 2007-06-13 John Lafferty , Larry Wasserman

Collaborative learning through latent shared feature representations enables heterogeneous clients to train personalized models with improved performance and reduced sample complexity. Despite empirical success and extensive study, the…

Machine Learning · Computer Science 2025-11-25 Xiaochun Niu , Lili Su , Jiaming Xu , Pengkun Yang

Functional data analysis is a fast evolving branch of statistics. Estimation procedures for the popular functional linear model either suffer from lack of robustness or are computationally burdensome. To address these shortcomings, a…

Methodology · Statistics 2021-08-27 Ioannis Kalogridis , Stefan Van Aelst

We study the estimation of distributional treatment effects in randomized experiments with imperfect compliance. When participants do not adhere to their assigned treatments, we leverage treatment assignment as an instrumental variable to…

Methodology · Statistics 2025-10-28 Undral Byambadalai , Tomu Hirata , Tatsushi Oka , Shota Yasui

Local polynomial regression (Fan and Gijbels 1996) is an important class of methods for nonparametric density estimation and regression problems. However, straightforward implementation of local polynomial regression has quadratic time…

Computation · Statistics 2020-09-01 Yining Wang , Yi Wu , Simon S. Du

Background: trials to identify the minimal effective treatment duration are needed in different therapeutic areas, including bacterial infections, TB and Hepatitis--C. However, standard non-inferiority designs have several limitations,…

We mainly study the M-estimation method for the high-dimensional linear regression model, and discuss the properties of M-estimator when the penalty term is the local linear approximation. In fact, M-estimation method is a framework, which…

Probability · Mathematics 2018-10-31 Kai Wang , Yanling Zhu

In this paper, we propose a covariate-adjusted nonlinear regression model. In this model, both the response and predictors can only be observed after being distorted by some multiplicative factors. Because of nonlinearity, existing methods…

Statistics Theory · Mathematics 2009-08-14 Xia Cui , Wensheng Guo , Lu Lin , Lixing Zhu

This paper investigates locally linear regression for locally stationary time series and develops theoretical results for locally linear smoothing and transfer learning. Existing analyses have focused on local constant estimators and given…

Statistics Theory · Mathematics 2025-11-19 Jinwoo Park

Distribution shifts are ubiquitous in real-world machine learning applications, posing a challenge to the generalization of models trained on one data distribution to another. We focus on scenarios where data distributions vary across…

Machine Learning · Statistics 2024-06-05 Steven Wilkins-Reeves , Xu Chen , Qi Ma , Christine Agarwal , Aude Hofleitner

Density estimation and inference methods are widely used in empirical work. When the underlying distribution has compact support, conventional kernel-based density estimators are no longer consistent near or at the boundary because of their…

Computation · Statistics 2021-02-24 Matias D. Cattaneo , Michael Jansson , Xinwei Ma

A method for the detection of changes in the expectation in univariate sequences is provided. Moving sum processes are studied. These rely on the selection of a tuning bandwidth. Here, a framework to overcome bandwidth selection is…

Methodology · Statistics 2023-01-04 Tijana Levajkovic , Michael Messer

We present simple low-level conditions for identification in regression discontinuity designs using a potential outcome framework for the manipulation of the running variable. Using this framework, we replace the existing identification…

Econometrics · Economics 2024-09-18 Takuya Ishihara , Masayuki Sawada

Linear discriminant analysis (LDA) is an important classification tool in statistics and machine learning. This paper investigates the varying coefficient LDA model for dynamic data, with Bayes' discriminant direction being a function of…

Methodology · Statistics 2022-10-11 Yajie Bao , Yuyang Liu