English
Related papers

Related papers: Conditional least squares estimation in nonstation…

200 papers

The statistical analysis for equations driven by fractional Gaussian process (fGp) is relatively recent. The development of stochastic calculus with respect to the fGp allowed to study such models. In the present paper we consider the drift…

Probability · Mathematics 2016-09-28 Mohamed El Machkouri , Khalifa Es-Sebaiy , Youssef Ouknine

We study the asymptotic properties of the SCAD-penalized least squares estimator in sparse, high-dimensional, linear regression models when the number of covariates may increase with the sample size. We are particularly interested in the…

Statistics Theory · Mathematics 2007-09-12 Jian Huang , Huiliang Xie

We develop a Levenberg-Marquardt method for minimizing the sum of a smooth nonlinear least-squar es term $f(x) = \tfrac{1}{2} \|F(x)\|_2^2$ and a nonsmooth term $h$. Both $f$ and $h$ may be nonconvex. Steps are computed by minimizing the…

Optimization and Control · Mathematics 2023-01-09 Aleksandr Y. Aravkin , Robert Baraldi , Dominique Orban

The least trimmed squares (LTS) estimator is a renowned robust alternative to the classic least squares estimator and is popular in location, regression, machine learning, and AI literature. Many studies exist on LTS, including its…

Machine Learning · Statistics 2025-01-10 Yijun Zuo

Supervised learning by extreme learning machines resp. neural networks with random weights is studied under a non-stationary spatial-temporal sampling design which especially addresses settings where an autonomous object moving in a…

Machine Learning · Statistics 2021-09-02 Ansgar Steland

We study the problem of parameter estimation for reflected stochastic processes driven by a standard Brownian motion. The estimator is obtained using nonlinear least squares method based on discretely observed processes. Under some certain…

Statistics Theory · Mathematics 2022-05-03 Han Yuecai , Zhang Dingwen

Instrumental variable (IV) analysis is widely used in fields such as economics and epidemiology to address unobserved confounding and measurement error when estimating the causal effects of intermediate covariates on outcomes. However,…

Methodology · Statistics 2025-09-16 Zian Zhuang , Hua Zhou , Jin Zhou , Gang Li

Let $X^{(n)}$ be an observation sampled from a distribution $P_{\theta}^{(n)}$ with an unknown parameter $\theta,$ $\theta$ being a vector in a Banach space $E$ (most often, a high-dimensional space of dimension $d$). We study the problem…

Statistics Theory · Mathematics 2022-04-19 Vladimir Koltchinskii

We consider a sparse linear regression model Y=X\beta^{*}+W where X has a Gaussian entries, W is the noise vector with mean zero Gaussian entries, and \beta^{*} is a binary vector with support size (sparsity) k. Using a novel conditional…

Machine Learning · Statistics 2019-09-26 David Gamarnik , Ilias Zadik

We consider the estimation of parametric fractional time series models in which not only is the memory parameter unknown, but one may not know whether it lies in the stationary/invertible region or the nonstationary or noninvertible…

Statistics Theory · Mathematics 2012-03-14 Javier Hualde , Peter M. Robinson

Regularly varying stochastic processes model extreme dependence between process values at different locations and/or time points. For such processes we propose a two-step parameter estimation of the extremogram, when some part of the domain…

Statistics Theory · Mathematics 2018-08-28 Sven Buhl , Claudia Klüppelberg

Suppose that $\mathbf{y}=\lvert A\mathbf{x_0}\rvert+\eta$ where $\mathbf{x_0} \in \mathbb{R}^d$ is the target signal and $\eta\in \mathbb{R}^m$ is a noise vector. The aim of phase retrieval is to estimate $\mathbf{x_0}$ from $\mathbf{y}$. A…

Information Theory · Computer Science 2019-04-23 Meng Huang , Zhiqiang Xu

In this paper, utilizing recent theoretical results in high dimensional statistical modeling, we propose a model-free yet computationally simple approach to estimate the partially linear model $Y=X\beta+g(Z)+\varepsilon$. Motivated by the…

Methodology · Statistics 2014-01-13 Xia Cui , Ying Lu , Heng Peng

Given a large number of covariates $Z$, we consider the estimation of a high-dimensional parameter $\theta$ in an individualized linear threshold $\theta^T Z$ for a continuous variable $X$, which minimizes the disagreement between…

Statistics Theory · Mathematics 2019-05-28 Huijie Feng , Yang Ning , Jiwei Zhao

We consider the problem of least squares parameter estimation from single-trajectory data for discrete-time, unstable, closed-loop nonlinear stochastic systems, with linearly parameterised uncertainty. Assuming a region of the state space…

Systems and Control · Electrical Eng. & Systems 2024-12-06 Seth Siriya , Jingge Zhu , Dragan Nešić , Ye Pu

We study a least squares estimator $\hat {\theta}_T$ for the Ornstein-Uhlenbeck process, $dX_t=\theta X_t dt+\sigma dB^H_t$, driven by fractional Brownian motion $B^H$ with Hurst parameter $H\ge \frac12$. We prove the strong consistence of…

Probability · Mathematics 2009-02-02 Yaozhong Hu , David Nualart

We consider the problem of estimating an unknown $\theta\in {\mathbb{R}}^n$ from noisy observations under the constraint that $\theta$ belongs to certain convex polyhedral cones in ${\mathbb{R}}^n$. Under this setting, we prove bounds for…

Statistics Theory · Mathematics 2015-07-31 Sabyasachi Chatterjee , Adityanand Guntuboyina , Bodhisattva Sen

In this paper, we investigate stochastic heat equation with sublinear diffusion coefficients. By assuming certain concavity of the diffusion coefficient, we establish non-trivial moment upper bounds and almost sure spatial asymptotic…

Probability · Mathematics 2023-06-13 Le Chen , Panqiu Xia

We consider the problem of frequency estimation of the periodic signal multiplied by a stationary Gaussian process (Ornstein-Uhlenbeck) and observed in the presence of the white Gaussian noise. We show the consistency and asymptotic…

Statistics Theory · Mathematics 2017-10-10 O. V. Chernoyarov , Yu. A. Kutoyants

In this work we establish under certain hypotheses the $N \to +\infty$ asymptotic expansion of integrals of the form $$\mathcal{Z}_{N,\Gamma}[V] \, = \, \int_{\Gamma^N} \prod_{ a < b}^{N}(z_a - z_b)^\beta \, \prod_{k=1}^{N} \mathrm{e}^{ - N…

Mathematical Physics · Physics 2024-11-22 Alice Guionnet , Karol Kozlowski , Alex Little