English
Related papers

Related papers: Moderate deviations principle for empirical covari…

200 papers

We consider a time-varying first-order autoregressive model with irregular innovations, where we assume that the coefficient function is H\"{o}lder continuous. To estimate this function, we use a quasi-maximum likelihood based approach. A…

Statistics Theory · Mathematics 2023-02-28 Hanna Gruber , Moritz Jirak

This paper studies inference for quadratic forms of linear regression coefficients with clustered data and many covariates. Our framework covers three important special cases: instrumental variables regression with many instruments and…

Econometrics · Economics 2026-02-18 Michal Kolesár , Pengjin Min , Wenjie Wang , Yichong Zhang

We consider a multidimensional diffusion X with drift coefficient b({\alpha},X(t)) and diffusion coefficient {\epsilon}{\sigma}({\beta},X(t)). The diffusion is discretely observed at times t_k=k{\Delta} for k=1..n on a fixed interval [0,T].…

Statistics Theory · Mathematics 2013-05-17 Romain Guy , Catherine Laredo , Elisabeta Vergu

In this paper, we propose the Minimum Regularized Covariance Trace (MRCT) estimator, a novel method for robust covariance estimation and functional outlier detection. The MRCT estimator employs a subset-based approach that prioritizes…

Methodology · Statistics 2024-04-11 Jeremy Oguamalam , Una Radojičić , Peter Filzmoser

For normal canonical models with $X \sim N_p(\theta, \sigma^{2} I_{p}), \;\; S^{2} \sim \sigma^{2}\chi^{2}_{k}, \;{independent}$, we consider the problem of estimating $\theta$ under scale invariant squared error loss $\frac{\|d-\theta…

Statistics Theory · Mathematics 2012-04-30 Othmane Kortbi , Éric Marchand

Traditionally regression analysis answers questions about the relationships among variables based on the assumption that the observation values of variables are precise numbers. It has long been dominated by least squares techniques, mostly…

Statistics Theory · Mathematics 2018-12-06 Zhe Liu

We establish a moderate deviation principle for processes with independent increments under certain growth conditions for the characteristics of the process. Using this moderate deviation principle, we give a new proof for Strassen's…

Probability · Mathematics 2016-05-20 Franziska Kühn , René L. Schilling

In this article, we study a robust estimation method for a general class of integer-valued time series models. The conditional distribution of the process belongs to a broad class of distribution and unlike classical autoregressive…

Statistics Theory · Mathematics 2023-02-01 Mamadou Lamine Diop , William Kengne

The delta method is a popular and elementary tool for deriving limiting distributions of transformed statistics, while applications of asymptotic distributions do not allow one to obtain desirable accuracy of approximation for tail…

Statistics Theory · Mathematics 2011-05-19 Fuqing Gao , Xingqiu Zhao

This paper presents a computationally feasible method to compute rigorous bounds on the interval-generalisation of regression analysis to account for epistemic uncertainty in the output variables. The new iterative method uses machine…

Data Analysis, Statistics and Probability · Physics 2023-02-22 Krasymyr Tretiak , Georg Schollmeyer , Scott Ferson

We consider the problem of estimating the common mean of independently sampled data, where samples are drawn in a possibly non-identical manner from symmetric, unimodal distributions with a common mean. This generalizes the setting of…

Statistics Theory · Mathematics 2019-07-09 Ankit Pensia , Varun Jog , Po-Ling Loh

We present a simple proof for bounding the smallest eigenvalue of the empirical covariance in a causal Gaussian process. Along the way, we establish a one-sided tail inequality for Gaussian quadratic forms using a causal decomposition. Our…

Systems and Control · Electrical Eng. & Systems 2023-10-31 Ingvar Ziemann

We are interested in stochastic processes satisfying a nonlinear recurrence relation of the form $$X_{n + k} = \Phi_0 (X_n, ..., X_{n + k - 1}) + \Theta_n$$ where $\Theta$ is a noise term. We establish the existence of an invariant measure…

Dynamical Systems · Mathematics 2025-12-11 Lisette Jager , Killian Verdure

This paper considers nonparametric estimation and inference in first-order autoregressive (AR(1)) models with deterministically time-varying parameters. A key feature of the proposed approach is to allow for time-varying stationarity in…

Econometrics · Economics 2024-11-04 Donald W. K. Andrews , Ming Li

This article introduces a new nonparametric method for estimating a univariate regression function of bounded variation. The method exploits the Jordan decomposition which states that a function of bounded variation can be decomposed as the…

Statistics Theory · Mathematics 2016-08-11 Arnaud Guyader , Nick Hengartner , Nicolas Jégou , Eric Matzner-Løber

This paper considers a first-order autoregressive panel data model with individual-specific effects and heterogeneous autoregressive coefficients defined on the interval (-1,1], thus allowing for some of the individual processes to have…

Econometrics · Economics 2024-06-26 M. Hashem Pesaran , Liying Yang

Let a sequence of iid. random variables $\xi_1,...,\xi_n$ be given on a measurable space $(X,\cal X)$ with distribution $\mu$ together with a function $f(x_1,...,x_k)$ on the product space $(X^k,{\cal X}^k)$. Let $\mu_n$ denote the…

Probability · Mathematics 2007-05-23 Peter Major

Valid causal inference in observational studies often requires controlling for confounders. However, in practice measurements of confounders may be noisy, and can lead to biased estimates of causal effects. We show that we can reduce the…

Machine Learning · Statistics 2018-06-05 Nathan Kallus , Xiaojie Mao , Madeleine Udell

Given i.i.d. observations of a random vector $X \in \mathbb{R}^p$, we study the problem of estimating both its covariance matrix $\Sigma^*$, and its inverse covariance or concentration matrix {$\Theta^* = (\Sigma^*)^{-1}$.} We estimate…

Machine Learning · Statistics 2008-11-24 Pradeep Ravikumar , Martin J. Wainwright , Garvesh Raskutti , Bin Yu

In a regression model with multiple response variables and multiple explanatory variables, if the difference of the mean vectors of the response variables for different values of explanatory variables is always in the direction of the first…

Statistics Theory · Mathematics 2026-02-17 Koji Tsukuda , Shun Matsuura