English
Related papers

Related papers: Conditional least squares estimation in nonstation…

200 papers

In this paper, we consider the usual linear regression model in the case where the error process is assumed strictly stationary. We use a result from Hannan, who proved a Central Limit Theorem for the usual least squares estimator under…

Statistics Theory · Mathematics 2019-06-18 Emmanuel Caron , Sophie Dede

In this paper, we consider the statistical inference of the drift parameter $\theta$ of non-ergodic Ornstein-Uhlenbeck~(O-U) process driven by a general Gaussian process $(G_t)_{t\ge 0}$. When $H \in (0, \frac 12) \cup (\frac 12,1) $ the…

Statistics Theory · Mathematics 2022-07-28 Yanping Lu

We introduce a new measure of robustness for statistical estimators, which we call \emph{empirical sensitivity}. An estimator $\hat \theta$ has bounded empirical sensitivity if, with high probability over a dataset $X = (X_1, \dots, X_n)…

Statistics Theory · Mathematics 2026-05-22 Valentio Iverson , Gautam Kamath , Argyris Mouzakis , Adam Smith

We study a regression problem where for some part of the data we observe both the label variable ($Y$) and the predictors (${\bf X}$), while for other part of the data only the predictors are given. Such a problem arises, for example, when…

Statistics Theory · Mathematics 2021-04-14 David Azriel , Lawrence D. Brown , Michael Sklar , Richard Berk , Andreas Buja , Linda Zhao

We obtain the large $n$ asymptotics of the partition function $Z_n$ of the six-vertex model with domain wall boundary conditions in the antiferroelectric phase region, with the weights $a=\sinh(\ga-t), b=\sinh(\ga+t), c=\sinh(2\ga),…

Mathematical Physics · Physics 2009-12-16 Pavel Bleher , Karl Liechty

We consider the problem of heteroscedastic linear regression, where, given $n$ samples $(\mathbf{x}_i, y_i)$ from $y_i = \langle \mathbf{w}^{*}, \mathbf{x}_i \rangle + \epsilon_i \cdot \langle \mathbf{f}^{*}, \mathbf{x}_i \rangle$ with…

Machine Learning · Statistics 2023-07-04 Dheeraj Baby , Aniket Das , Dheeraj Nagaraj , Praneeth Netrapalli

Compressed sensing is a signal processing technique in which data is acquired directly in a compressed form. There are two modeling approaches that can be considered: the worst-case (Hamming) approach and a statistical mechanism, in which…

Information Theory · Computer Science 2016-01-20 Wasim Huleihel , Neri Merhav

We consider a finite impulse response system with centered independent sub-Gaussian design covariates and noise components that are not necessarily identically distributed. We derive non-asymptotic near-optimal estimation and prediction…

Statistics Theory · Mathematics 2019-12-02 Boualem Djehiche , Othmane Mazhar , Cristian R. Rojas

We study the parameter estimation problem of Vasicek Model driven by sub-fractional Brownian processes from discrete observations, and let {S_t^H,t>=0} denote a sub-fractional Brownian motion whose Hurst parameter 1/2<H<1 . The studies are…

Statistics Theory · Mathematics 2020-07-06 Cuiyun Zhang , Jingjun Guo , Aiqin Ma , Bo Peng

We investigate a semiparametric regression model where one gets noisy non linear non invertible functions of the observations. We focus on the application to bearings-only tracking. We first investigate the least squares estimator and prove…

Statistics Theory · Mathematics 2008-12-17 Elisabeth Gassiat , Benoit Landelle

Functional linear regression has recently attracted considerable interest. Many works focus on asymptotic inference. In this paper we consider in a non asymptotic framework a simple estimation procedure based on functional Principal…

Statistics Theory · Mathematics 2013-01-16 Elodie Brunel , André Mas , Angelina Roche

Let $X_1,\dots, X_n$ be i.i.d. random variables sampled from a normal distribution $N(\mu,\Sigma)$ in ${\mathbb R}^d$ with unknown parameter $\theta=(\mu,\Sigma)\in \Theta:={\mathbb R}^d\times {\mathcal C}_+^d,$ where ${\mathcal C}_+^d$ is…

Statistics Theory · Mathematics 2019-12-20 Vladimir Koltchinskii , Mayya Zhilova

We will consider the following stochastic differential equation (SDE): \begin{equation} X_t=X_0+\int_0^tb(X_s,\theta_0)ds+\sigma B_t,~~~t\in(0,T], \end{equation} where $\{B_t\}_{t\ge 0}$ is a fractional Brownian motion with Hurst index…

Statistics Theory · Mathematics 2021-12-24 Yasutaka Shimizu , Shohei Nakajima

We consider high-dimensional sparse regression problems in which we observe $y = X \beta + z$, where $X$ is an $n \times p$ design matrix and $z$ is an $n$-dimensional vector of independent Gaussian errors, each with variance $\sigma^2$.…

Statistics Theory · Mathematics 2015-09-25 Weijie Su , Emmanuel Candes

Parameter estimation in a class of heteroscedastic time series models is investigated. The existence of conditional least-squares and conditional likelihood estimators is proved. Their consistency and their asymptotic normality are…

Statistics Theory · Mathematics 2008-02-08 Joseph Ngatchou-Wandji

This paper deals with the problem of global parameter estimation of AD(1, n) where n is a positive integer which is a subclass of affine diffusions introduced by Duffie, Filipovic, and Schachermayer. In general affine models are applied to…

Statistics Theory · Mathematics 2024-06-13 Mohamed Ben Alaya , Houssem Dahbi , Hamdi Fathallah

We consider a multivariate functional measurement error model $AX\approx B$. The errors in $[A,B]$ are uncorrelated, row-wise independent, and have equal (unknown) variances. We study the total least squares estimator of $X$, which, in the…

Probability · Mathematics 2016-07-14 Alexander Kukush , Yaroslav Tsaregorodtsev

We study finite-sum non-convex optimization $\min_{x\in\mathbb{R}^d} F(x) \;=\; \frac{1}{n}\sum_{i=1}^n f_i(x)$ and analyze a variance-reduced cubic Newton method based on EMA-smoothed SARAH estimators for both gradient and Hessian…

Optimization and Control · Mathematics 2026-04-28 Dmitry Pasechnyuk-Vilensky , Dmitry Kamzolov , Martin Takáč

We study the asymptotic properties of parameter estimation and predictive inference under the exchangeable Gibbs partition, characterized by a discount parameter $\alpha\in(0,1)$ and a triangular array $v_{n,k}$ satisfying a backward…

Statistics Theory · Mathematics 2026-04-07 Takuya Koriyama

We consider the problem of nonparametric regression under shape constraints. The main examples include isotonic regression (with respect to any partial order), unimodal/convex regression, additive shape-restricted regression, and…

Statistics Theory · Mathematics 2018-07-03 Adityanand Guntuboyina , Bodhisattva Sen