English
Related papers

Related papers: Least squares estimation for the subcritical Hesto…

200 papers

We consider the estimation of a bounded regression function with nonparametric heteroscedastic noise and random design. We study the true and empirical excess risks of the least-squares estimator on finite-dimensional vector spaces. We give…

Statistics Theory · Mathematics 2015-06-29 Adrien Saumard

The paper studies asymptotic properties of estimators of multidimensional stochastic differential equations driven by Brownian motions from high-frequency discrete data. Consistency and central limit properties of a class of estimators of…

Statistics Theory · Mathematics 2024-11-07 Arnab Ganguly

We study the asymptotic behavior of the least squares estimators of the unknown parameters of bifurcating autoregressive processes. Under very weak assumptions on the driven noise of the process, namely conditional pair-wise independence…

Probability · Mathematics 2009-06-29 Bernard Bercu , Benoite de Saporta , Anne Gegout-Petit

In linear models, the generalized least squares (GLS) estimator is applicable when the structure of the error dependence is known. When it is unknown, such structure must be approximated and estimated in a manner that may lead to…

Statistics Theory · Mathematics 2019-02-12 Hien D Nguyen

It is well known that in the presence of heteroscedasticity ordinary least squares estimator is not efficient. I propose a generalized automatic least squares estimator (GALS) that makes partial correction of heteroscedasticity based on a…

Econometrics · Economics 2023-04-18 Bulat Gafarov

We consider the problem of jointly estimating the number as well as the parameters of two-dimensional sinusoidal signals, observed in the presence of an additive colored noise field. We begin by elaborating on the least squares estimation…

Methodology · Statistics 2008-01-21 Mark Kliger , Joseph M. Francos

We study the short-time asymptotical behavior of stochastic flows on \mathbb{R} in the \sup-norm. The results are stated in terms of a Gaussian process associated with the covariation of the flow. In case the Gaussian process has a…

Probability · Mathematics 2010-10-27 Alexander Shamov

We consider the least-squares regression problem and provide a detailed asymptotic analysis of the performance of averaged constant-step-size stochastic gradient descent (a.k.a. least-mean-squares). In the strongly-convex case, we provide…

Machine Learning · Computer Science 2014-12-02 Alexandre Défossez , Francis Bach

We consider the model selection consistency or sparsistency of a broad set of $\ell_1$-regularized $M$-estimators for linear and non-linear statistical models in a unified fashion. For this purpose, we propose the local structured…

Statistics Theory · Mathematics 2014-10-29 Yen-Huan Li , Jonathan Scarlett , Pradeep Ravikumar , Volkan Cevher

We settle an open problem of several years standing by showing that the least-squares mean for positive definite matrices is monotone for the usual (Loewner) order. Indeed we show this is a special case of its appropriate generalization to…

Metric Geometry · Mathematics 2010-07-28 Jimmie Lawson , Yongdo Lim

We consider the problem of recursively and causally reconstructing time sequences of sparse signals (with unknown and time-varying sparsity patterns) from a limited number of noisy linear measurements. The sparsity pattern is assumed to…

Information Theory · Computer Science 2010-07-28 Namrata Vaswani

The least squares method allows fitting parameters of a mathematical model from experimental data. This article proposes a general approach of this method. After introducing the method and giving a formal definition, the transitivity of the…

Optimization and Control · Mathematics 2015-02-27 Benjamin Lenoir

We consider stochastic differential equations (SDEs) driven by small L\'evy noise with some unknown parameters, and propose a new type of least squares estimators based on discrete samples from the SDEs. To approximate the increments of a…

Statistics Theory · Mathematics 2022-07-11 Mitsuki Kobayashi , Yasutaka Shimizu

We propose a discontinuous least squares finite element method for solving the Helmholtz equation. The method is based on the L2 norm least squares functional with the weak imposition of the continuity across the interior faces as well as…

Numerical Analysis · Mathematics 2021-05-06 Ruo Li , Qicheng Liu , Fanyi Yang

We consider the problem of parameter estimation for a system of ordinary differential equations from noisy observations on a solution of the system. In case the system is nonlinear, as it typically is in practical applications, an analytic…

Statistics Theory · Mathematics 2012-07-27 Shota Gugushvili , Chris A. J. Klaassen

This paper studies least-square regression penalized with partly smooth convex regularizers. This class of functions is very large and versatile allowing to promote solutions conforming to some notion of low-complexity. Indeed, they force…

Optimization and Control · Mathematics 2014-07-01 Samuel Vaiter , Gabriel Peyré , Jalal M. Fadili

This paper studies permutation tests for regression parameters in a time series setting, where the time series is assumed stationary but may exhibit an arbitrary (but weak) dependence structure. In such a setting, it is perhaps surprising…

Statistics Theory · Mathematics 2024-04-11 Joseph P. Romano , Marius A. Tirlea

We consider the estimation problem for jointly stable random variables. Under two specific dependency models: a linear transformation of two independent stable variables and a sub-Gaussian symmetric $\alpha$-stable (S$\alpha$S) vector, we…

Information Theory · Computer Science 2026-01-15 Rayan Chouity , Charbel Hannoun , Jihad Fahs , Ibrahim Abou-Faycal

In this paper, we investigate the parameter estimation problem for reflected OU processes. Both the estimates based on continuously observed processes and discretely observed processes are considered. The explicit formulas for the…

Methodology · Statistics 2022-05-03 Han Yuecai , Zhang Dingwen

We characterize the performance of the widely-used least-squares estimator in astrometry in terms of a comparison with the Cramer-Rao lower variance bound. In this inference context the performance of the least-squares estimator does not…

Instrumentation and Methods for Astrophysics · Physics 2015-11-18 Rodrigo A. Lobos , Jorge F. Silva , Rene A. Mendez , Marcos Orchard