English
Related papers

Related papers: Local Polynomial Lp-norm Regression

200 papers

The class of Lq-regularized least squares (LQLS) are considered for estimating a p-dimensional vector \b{eta} from its n noisy linear observations y = X\b{eta}+w. The performance of these schemes are studied under the high-dimensional…

Statistics Theory · Mathematics 2018-02-20 Haolei Weng , Arian Maleki

To conduct regression analysis for data contaminated with outliers, many approaches have been proposed for simultaneous outlier detection and robust regression, so is the approach proposed in this manuscript. This new approach is called…

Methodology · Statistics 2016-03-25 Xiaoli Gao , Yixin Fang

We propose a class of weighted least squares estimators for the tail index of a distribution function with a regularly varying upper tail. Our approach is based on the method developed by \cite{Holan2010} for the Parzen tail index.…

Statistics Theory · Mathematics 2020-03-02 Amenah AL-Najafi , László Viharos

This paper presents and analyses a new family of linear subdivision schemes to refine noisy data given on triangular meshes. The subdivision rules consist of locally fitting and evaluating a weighted least squares approximating first-degree…

Numerical Analysis · Mathematics 2026-02-03 Costanza Conti , Sergio López-Ureña , Dionisio F. Yáñez

Nonparametric partitioning-based least squares regression is an important tool in empirical work. Common examples include regressions based on splines, wavelets, and piecewise polynomials. This article discusses the main methodological and…

Computation · Statistics 2020-10-29 Matias D. Cattaneo , Max H. Farrell , Yingjie Feng

Least squares estimation, a regression technique based on minimisation of residuals, has been invaluable in bringing the best fit solutions to parameters in science and engineering. However, in dynamic environments such as in Geomatics…

Computational Engineering, Finance, and Science · Computer Science 2018-04-17 C. P. E. Agbachi

Nonlinear regression analysis is a popular and important tool for scientists and engineers. In this article, we introduce theories and methods of nonlinear regression and its statistical inferences using the frequentist and Bayesian…

Methodology · Statistics 2024-02-09 Hsin-Hsiung Huang , Qing He

Iteratively Re-weighted Least Squares (IRLS) were used to simulate the $L_p$-norm approximation of the ballistic trajectory in absolute gravimeters. Two iterations of the IRLS delivered sufficient accuracy of the approximation without a…

Instrumentation and Detectors · Physics 2016-02-17 V. D. Nagornyi , S. Svitlov , A. Araya

The aim of this paper is to propose a least mean squares (LMS) strategy for adaptive estimation of signals defined over graphs. Assuming the graph signal to be band-limited, over a known bandwidth, the method enables reconstruction, with…

Machine Learning · Computer Science 2016-11-17 Paolo Di Lorenzo , Sergio Barbarossa , Paolo Banelli , Stefania Sardellitti

This paper investigates a partially linear spatial autoregressive panel data model that incorporates fixed effects, constant and time-varying regression coefficients, and a time-varying spatial lag coefficient. A two-stage least squares…

Statistics Theory · Mathematics 2024-10-15 Lingling Tian , Chuanhua Wei , Mixia Wu

We investigate the nonlinear regression problem under L2 loss (square loss) functions. Traditional nonlinear regression models often result in non-convex optimization problems with respect to the parameter set. We show that a convex…

Machine Learning · Computer Science 2023-04-03 Kaan Gokcesu , Hakan Gokcesu

In this paper, we construct a parameter estimation framework for robust low-rank tensor regression based on a truncation method and Huber loss, specifically focusing on models with random noise having only finite second-order moments.…

Statistics Theory · Mathematics 2025-12-05 Kangqiang Li , Bingqi Liu , Yang Yang , Li Wang

Ordinary least-squares (OLS) estimators for a linear model are very sensitive to unusual values in the design space or outliers among y values. Even one single atypical value may have a large effect on the parameter estimates. This article…

Methodology · Statistics 2014-04-28 Chun Yu , Weixin Yao , Xue Bai

The generation of curves and surfaces from given data is a well-known problem in Computer-Aided Design that can be approached using subdivision schemes. They are powerful tools that allow obtaining new data from the initial one by means of…

Numerical Analysis · Mathematics 2024-12-03 Sergio López-Ureña , Dionisio F. Yáñez

$L_p$-norm regularization schemes such as $L_0$, $L_1$, and $L_2$-norm regularization and $L_p$-norm-based regularization techniques such as weight decay, LASSO, and elastic net compute a quantity which depends on model weights considered…

Machine Learning · Computer Science 2023-04-24 Hovig Tigran Bayandorian

We consider a linear regression model with a spatially correlated error term on a lattice. When estimating coefficients in the linear regression model, the generalized least squares estimator (GLSE) is used if the covariance structures are…

Methodology · Statistics 2014-10-07 Toshihiro Hirano

We advance both the theory and practice of robust $\ell_p$-quasinorm regression for $p \in (0,1]$ by using novel variants of iteratively reweighted least-squares (IRLS) to solve the underlying non-smooth problem. In the convex case, $p=1$,…

Optimization and Control · Mathematics 2022-10-14 Liangzu Peng , Christian Kümmerle , René Vidal

Shape-constrained convex regression problem deals with fitting a convex function to the observed data, where additional constraints are imposed, such as component-wise monotonicity and uniform Lipschitz continuity. This paper provides a…

Optimization and Control · Mathematics 2020-02-27 Meixia Lin , Defeng Sun , Kim-Chuan Toh

In different fields of applications including, but not limited to, behavioral, environmental, medical sciences and econometrics, the use of panel data regression models has become increasingly popular as a general framework for making…

Methodology · Statistics 2020-05-15 Beste Hamiye Beyaztas , Soutir Bandyopadhyay

Density estimation and inference methods are widely used in empirical work. When the underlying distribution has compact support, conventional kernel-based density estimators are no longer consistent near or at the boundary because of their…

Computation · Statistics 2021-02-24 Matias D. Cattaneo , Michael Jansson , Xinwei Ma