English

Local Polynomial Lp-norm Regression

Machine Learning 2025-04-29 v1 Machine Learning Other Statistics

Abstract

The local least squares estimator for a regression curve cannot provide optimal results when non-Gaussian noise is present. Both theoretical and empirical evidence suggests that residuals often exhibit distributional properties different from those of a normal distribution, making it worthwhile to consider estimation based on other norms. It is suggested that LpL_p-norm estimators be used to minimize the residuals when these exhibit non-normal kurtosis. In this paper, we propose a local polynomial LpL_p-norm regression that replaces weighted least squares estimation with weighted LpL_p-norm estimation for fitting the polynomial locally. We also introduce a new method for estimating the parameter pp from the residuals, enhancing the adaptability of the approach. Through numerical and theoretical investigation, we demonstrate our method's superiority over local least squares in one-dimensional data and show promising outcomes for higher dimensions, specifically in 2D.

Keywords

Cite

@article{arxiv.2504.18695,
  title  = {Local Polynomial Lp-norm Regression},
  author = {Ladan Tazik and James Stafford and John Braun},
  journal= {arXiv preprint arXiv:2504.18695},
  year   = {2025}
}
R2 v1 2026-06-28T23:11:58.554Z