English
Related papers

Related papers: Uniform Inference in Linear Error-in-Variables Mod…

200 papers

In this work, we consider a multivariate regression model with one-sided errors. We assume for the regression function to lie in a general H\"{o}lder class and estimate it via a nonparametric local polynomial approach that consists of…

Statistics Theory · Mathematics 2021-02-11 Leonie Selk , Charles Tillier , Orlando Marigliano

We develop new econometric methods for estimation and inference in high-dimensional panel data models with interactive fixed effects. Our approach can be regarded as a non-trivial extension of the very popular common correlated effects…

Econometrics · Economics 2025-08-11 Maximilian Ruecker , Michael Vogt , Oliver Linton , Christopher Walsh

Reinforcement learning algorithms typically rely on the assumption that the environment dynamics and value function can be expressed in terms of a Markovian state representation. However, when state information is only partially observable,…

We study causal effect estimation from a mixture of observational and interventional data in a confounded linear regression model with multivariate treatments. We show that the statistical efficiency in terms of expected squared error can…

This work considers a computationally and statistically efficient parameter estimation method for a wide class of latent variable models---including Gaussian mixture models, hidden Markov models, and latent Dirichlet allocation---which…

Machine Learning · Computer Science 2014-11-17 Anima Anandkumar , Rong Ge , Daniel Hsu , Sham M. Kakade , Matus Telgarsky

Advances in information technology have led to extremely large datasets that are often kept in different storage centers. Existing statistical methods must be adapted to overcome the resulting computational obstacles while retaining…

Methodology · Statistics 2021-11-12 Qiong Zhang , Jiahua Chen

Linear regression is a frequently used tool in statistics, however, its validity and interpretability relies on strong model assumptions. While robust estimates of the coefficients' covariance extend the validity of hypothesis tests and…

Methodology · Statistics 2015-04-23 Werner Brannath , Martin Scharpenberg

The paper considers two-phase random design linear regression models. The errors and the regressors are stationary long-range dependent Gaussian. The regression parameters, the scale parameters and the change-point are estimated using a…

Statistics Theory · Mathematics 2009-06-10 Gabriela Ciuperca

We present an alternating least squares type numerical optimization scheme to estimate conditionally-independent mixture models in $\mathbb{R}^n$, without parameterizing the distributions. Following the method of moments, we tackle an…

Numerical Analysis · Mathematics 2023-08-09 Yifan Zhang , Joe Kileel

We revisit a model for time-varying linear regression that assumes the unknown parameters evolve according to a linear dynamical system. Counterintuitively, we show that when the underlying dynamics are stable the parameters of this model…

Statistics Theory · Mathematics 2022-01-03 Ali Jadbabaie , Horia Mania , Devavrat Shah , Suvrit Sra

For the last two decades, high-dimensional data and methods have proliferated throughout the literature. Yet, the classical technique of linear regression has not lost its usefulness in applications. In fact, many high-dimensional…

Statistics Theory · Mathematics 2021-05-18 Arun Kumar Kuchibhotla , Lawrence D. Brown , Andreas Buja , Edward I. George , Linda Zhao

Fitting generative models to sequential data typically involves two recursive computations through time, one forward and one backward. The latter could be a computation of the loss gradient (as in backpropagation through time), or an…

Machine Learning · Computer Science 2023-10-23 Azwar Abdulsalam , Joseph G. Makin

In this paper, we propose a triple (or double-debiased) Lasso estimator for inference on a low-dimensional parameter in high-dimensional linear regression models. The estimator is based on a moment function that satisfies not only first-…

Econometrics · Economics 2026-03-23 Denis Chetverikov , Jesper R. -V. Sørensen , Aleh Tsyvinski

Divide-and-conquer methods use large-sample approximations to provide frequentist guarantees when each block of data is both small enough to facilitate efficient computation and large enough to support approximately valid inferences. When…

Methodology · Statistics 2025-04-01 Emily C. Hector , Leonardo Cella , Ryan Martin

The linear regression models are widely used statistical techniques in numerous practical applications. The standard regression model requires several assumptions about the regres- sors and the error term. The regression parameters are…

Methodology · Statistics 2016-10-23 P. Vellaisamy

Classical a posteriori error analysis for differential equations quantifies the error in a Quantity of Interest (QoI) which is represented as a bounded linear functional of the solution. In this work we consider a posteriori error estimates…

Numerical Analysis · Mathematics 2020-07-07 Jehanzeb H. Chaudhry , Donald Estep , Zachary Stevens , Simon J. Tavener

Quantiles and expected shortfalls are commonly used risk measures in financial risk management. The two measurements are correlated while have distinguished features. In this project, our primary goal is to develop stable and practical…

Methodology · Statistics 2022-08-24 Xiang Peng , Huixia Judy Wang

We develop an estimator for the high-dimensional covariance matrix of a locally stationary process with a smoothly varying trend and use this statistic to derive consistent predictors in non-stationary time series. In contrast to the…

Methodology · Statistics 2020-01-08 Holger Dette , Weichi Wu

Missing values arise in most real-world data sets due to the aggregation of multiple sources and intrinsically missing information (sensor failure, unanswered questions in surveys...). In fact, the very nature of missing values usually…

Machine Learning · Statistics 2022-02-04 Alexis Ayme , Claire Boyer , Aymeric Dieuleveut , Erwan Scornet

A common optimization tool used in deep reinforcement learning is momentum, which consists in accumulating and discounting past gradients, reapplying them at each iteration. We argue that, unlike in supervised learning, momentum in Temporal…

Machine Learning · Computer Science 2021-06-09 Emmanuel Bengio , Joelle Pineau , Doina Precup