English
Related papers

Related papers: Equivariant adjusted least squares estimator in tw…

200 papers

We propose a procedure to handle the problem of Gaussian regression when the variance is unknown. We mix least-squares estimators from various models according to a procedure inspired by that of Leung and Barron (2007). We show that in some…

Statistics Theory · Mathematics 2007-11-05 Christophe Giraud

Maximum likelihood estimation of large Markov-switching vector autoregressions (MS-VARs) can be challenging or infeasible due to parameter proliferation. To accommodate situations where dimensionality may be of comparable order to or…

Econometrics · Economics 2021-07-28 Kenwin Maung

We study the convergence of specific inexact alternating projections for two non-convex sets in a Euclidean space. The $\sigma$-quasioptimal metric projection ($\sigma \geq 1$) of a point $x$ onto a set $A$ consists of points in $A$ the…

Optimization and Control · Mathematics 2025-09-09 Stanislav Budzinskiy

New local linear estimators are proposed for a wide class of nonparametric regression models. The estimators are uniformly consistent regardless of satisfying traditional conditions of depen\-dence of design elements. The estimators are the…

Statistics Theory · Mathematics 2022-07-05 Yuliana Linke , Igor Borisov , Pavel Ruzankin , Vladimir Kutsenko , Elena Yarovaya , Svetlana Shalnova

Many computer models contain unknown parameters which need to be estimated using physical observations. Kennedy and O'Hagan (2001) shows that the calibration method based on Gaussian process models proposed by Kennedy and O'Hagan (2001) may…

Methodology · Statistics 2015-07-28 Rui Tuo , C. F. Jeff Wu

In this study, we explore the effects of including noise predictors and noise observations when fitting linear regression models. We present empirical and theoretical results that show that double descent occurs in both cases, albeit with…

Statistics Theory · Mathematics 2024-08-16 Insha Ullah , A. H. Welsh

We study the problem of estimability of means in undirected graphical Gaussian models with symmetry restrictions represented by a colored graph. Following on from previous studies, we partition the variables into sets of vertices whose…

Statistics Theory · Mathematics 2012-07-24 Helene Gehrmann , Steffen L. Lauritzen

In many problems, a sensible estimator of a possibly multivariate monotone function may itself fail to be monotone. We study the correction of such an estimator obtained via projection onto the space of functions monotone over a finite grid…

Statistics Theory · Mathematics 2019-09-06 Ted Westling , Mark van der Laan , Marco Carone

In this work, we construct a stable and fairly fast estimator for solving non-parametric multidimensional regression problems. The proposed estimator is based on the use of multivariate Jacobi polynomials that generate a basis for a reduced…

Statistics Theory · Mathematics 2022-08-08 Mohamed Jebalia , Abderrazek Karoui

We study counterfactual regression, which aims to map input features to outcomes under hypothetical scenarios that differ from those observed in the data. This is particularly useful for decision-making when adapting to sudden shifts in…

Methodology · Statistics 2025-04-08 Kwangho Kim

In a general linear model, this paper derives a necessary and sufficient condition under which two general ridge estimators coincide with each other. The condition is given as a structure of the dispersion matrix of the error term. Since…

Statistics Theory · Mathematics 2022-03-29 Koji Tsukuda , Hiroshi Kurata

We consider the problem of recovering linear image $Bx$ of a signal $x$ known to belong to a given convex compact set $X$ from indirect observation $\omega=Ax+\sigma\xi$ of $x$ corrupted by Gaussian noise $\xi$. It is shown that under some…

Statistics Theory · Mathematics 2019-10-22 Anatoli Juditsky , Arkadi Nemirovski

The variance of noise plays an important role in many change-point detection procedures and the associated inferences. Most commonly used variance estimators require strong assumptions on the true mean structure or normality of the error…

Methodology · Statistics 2023-11-17 Ning Hao , Yue Selena Niu , Han Xiao

This paper deals with some nonlinear problems which exponential and biexponential decays are involved in. A proof of the quasiconvexity of the error function in some of these problems of optimization is presented. This proof is restricted…

We address the inference problem concerning regression coefficients in a classical linear regression model using least squares estimates. The analysis is conducted under circumstances where network dependency exists across units in the…

Methodology · Statistics 2024-04-03 Jing Lei , Kehui Chen , Haeun Moon

Non-linear least squares solvers are used across a broad range of offline and real-time model fitting problems. Most improvements of the basic Gauss-Newton algorithm tackle convergence guarantees or leverage the sparsity of the underlying…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Huu Le , Christopher Zach , Edward Rosten , Oliver J. Woodford

In this paper, we compare maximum likelihood (ML), quasi likelihood (QL) and weighted least squares (WLS) estimators for proportional error nonlinear regression models. Literature on thermoluminescence sedimentary dating revealed another…

Statistics Theory · Mathematics 2019-11-25 Richard A. Lockhart , Chandanie W. Navaratna

We discuss local linear smooth backfitting for additive non-parametric models. This procedure is well known for achieving optimal convergence rates under appropriate smoothness conditions. In particular, it allows for the estimation of each…

Statistics Theory · Mathematics 2022-01-27 Munir Hiabu , Enno Mammen , Joseph T. Meyer

In this paper, we consider a modified projected Gauss-Newton method for solving constrained nonlinear least-squares problems. We assume that the functional constraints are smooth and the the other constraints are represented by a simple…

Optimization and Control · Mathematics 2025-04-02 Yassine Nabou , Lucian Toma , Ion Necoara

We construct efficient robust truncated sequential estimators for the pointwise estimation problem in nonparametric autoregression models with smooth coefficients. For Gaussian models we propose an adaptive procedure based on the…

Statistics Theory · Mathematics 2013-04-18 Ouerdia Arkoun , Serguei Pergamenchtchikov