English
Related papers

Related papers: Least squares estimation for the subcritical Hesto…

200 papers

In this paper, we construct an estimator of an errors-in-variables linear regression model. The regression model leads to a constrained total least squares problems with row and column constraints. Although this problem can be numerically…

Numerical Analysis · Mathematics 2026-02-11 Kensuke Aishima

To enhance the robustness of the classic least sum of squares (LS) of the residuals estimator, Zuo (2022) introduced the least sum of squares of trimmed (LST) residuals estimator. The LST enjoys many desired properties and serves well as a…

Statistics Theory · Mathematics 2022-04-05 Yijun Zuo

We present a sample- and time-efficient differentially private algorithm for ordinary least squares, with error that depends linearly on the dimension and is independent of the condition number of $X^\top X$, where $X$ is the design matrix.…

Machine Learning · Computer Science 2024-04-25 Gavin Brown , Jonathan Hayase , Samuel Hopkins , Weihao Kong , Xiyang Liu , Sewoong Oh , Juan C. Perdomo , Adam Smith

This paper deals with the consistency of the least squares estimator of a convex regression function when the predictor is multidimensional. We characterize and discuss the computation of such an estimator via the solution of certain…

Statistics Theory · Mathematics 2015-03-13 Emilio Seijo , Bodhisattva Sen

We consider least squares estimation in a general nonparametric regression model. The rate of convergence of the least squares estimator (LSE) for the unknown regression function is well studied when the errors are sub-Gaussian. We find…

Statistics Theory · Mathematics 2021-04-12 Arun K. Kuchibhotla , Rohit K. Patra

Statistical inference for a linear stochastic hyperbolic equation with two unknown parameters is studied. Based on observation of coordinates of the solution or their linear combination, minimum contrast estimators are introduced. Strong…

Probability · Mathematics 2018-06-21 Josef Janák

We study the asymptotic behaviour of least squares estimators in regression models for long-range dependent random fields observed on spheres. The least squares estimator can be given as a weighted functional of long-range dependent random…

Statistics Theory · Mathematics 2019-05-23 Vo Anh , Andriy Olenko , Volodymyr Vaskovych

We study the parameter estimation problem of Vasicek Model driven by sub-fractional Brownian processes from discrete observations, and let {S_t^H,t>=0} denote a sub-fractional Brownian motion whose Hurst parameter 1/2<H<1 . The studies are…

Statistics Theory · Mathematics 2020-07-06 Cuiyun Zhang , Jingjun Guo , Aiqin Ma , Bo Peng

This paper deals with subspace estimation in the small sample size regime, where the number of samples is comparable in magnitude with the observation dimension. The traditional estimators, mostly based on the sample correlation matrix, are…

Methodology · Statistics 2015-06-19 Pascal Vallet , Xavier Mestre , Philippe Loubaton

The article introduces spatial long-range dependent models based on the fractional difference operators associated with the Gegenbauer polynomials. The results on consistency and asymptotic normality of a class of minimum contrast…

Statistics Theory · Mathematics 2015-01-21 R. M. Espejo , N. N. Leonenko , A. Olenko , M. D. Ruiz-Medina

We establish asymptotic properties of $M$-estimators, defined in terms of a contrast function and observations from a continuous-time locally stationary process. Using the stationary approximation of the sequence, $\theta$-weak dependence,…

Statistics Theory · Mathematics 2021-05-11 Bennet Ströh

We study a least squares estimator for an unknown parameter in the drift coefficient of a path- distribution dependent stochastic differential equation involving a small dispersion parameter epsilon greater than zero. The estimator, based…

Probability · Mathematics 2018-02-06 Panpan Ren , Jiang-Lun Wu

Under distribution uncertainty, on the basis of discrete data we investigate the consistency of the least squares estimator (LSE) of the parameter for the stochastic differential equation (SDE) where the noise are characterized by…

Statistics Theory · Mathematics 2019-04-30 Chen Fei , Weiyin Fei

In this article, we present the least squares estimator for the drift parameter in a linear regression model driven by the increment of a fractional Brownian motion sampled at random times. For two different random times, Jittered and…

Statistics Theory · Mathematics 2019-02-25 Héctor Araya , Natalia Bahamonde , Lisandro Fermín , Tania Roa , Soledad Torres

We prove conditional asymptotic normality of a class of quadratic U-statistics that are dominated by their degenerate second order part and have kernels that change with the number of observations. These statistics arise in the construction…

Methodology · Statistics 2015-12-09 James Robins , Lingling Li , Eric Tchetgen Tchetgen , Aad van der Vaart

We consider an on-line least squares regression problem with optimal solution $\theta^*$ and Hessian matrix H, and study a time-average stochastic gradient descent estimator of $\theta^*$. For $k\ge2$, we provide an unbiased estimator of…

Machine Learning · Statistics 2025-11-18 Nabil Kahalé

We consider a multivariate functional measurement error model $AX\approx B$. The errors in $[A,B]$ are uncorrelated, row-wise independent, and have equal (unknown) variances. We study the total least squares estimator of $X$, which, in the…

Probability · Mathematics 2016-07-14 Alexander Kukush , Yaroslav Tsaregorodtsev

M-type smoothing splines are a broad class of spline estimators that include the popular least-squares smoothing spline but also spline estimators that are less susceptible to outlying observations and model-misspecification. However,…

Statistics Theory · Mathematics 2025-03-06 Ioannis Kalogridis

We consider the estimation of parametric fractional time series models in which not only is the memory parameter unknown, but one may not know whether it lies in the stationary/invertible region or the nonstationary or noninvertible…

Statistics Theory · Mathematics 2012-03-14 Javier Hualde , Peter M. Robinson

Measuring the stability of conclusions derived from Ordinary Least Squares linear regression is critically important, but most metrics either only measure local stability (i.e. against infinitesimal changes in the data), or are only…

Machine Learning · Statistics 2022-06-07 Ankur Moitra , Dhruv Rohatgi