English
Related papers

Related papers: Delta Theorem in the Age of High Dimensions

200 papers

This study considers various semiparametric difference-in-differences models under different assumptions on the relation between the treatment group identifier, time and covariates for cross-sectional and panel data. The variance lower…

Econometrics · Economics 2020-08-17 Michael Zimmert

We study the distribution functions of several classical error terms in analytic number theory, focusing on the remainder term in the Dirichlet divisor problem $\Delta(x)$. We first bound the discrepancy between the distribution function of…

Number Theory · Mathematics 2024-10-07 Youness Lamzouri

Multi-layer feedforward networks have been used to approximate a wide range of nonlinear functions. An important and fundamental problem is to understand the learnability of a network model through its statistical risk, or the expected…

Machine Learning · Computer Science 2022-06-28 Gen Li , Jie Ding

A fast method of an arbitrary high order for approximating volume potentials is proposed, which is effective also in high dimensional cases. Basis functions introduced in the theory of approximate approximations are used. Results of…

Numerical Analysis · Mathematics 2009-11-04 Flavia Lanzara , Vladimir Maz'ya , Gunther Schmidt

In this expository note we describe a surprising phenomenon in overparameterized linear regression, where the dimension exceeds the number of samples: there is a regime where the test risk of the estimator found by gradient descent…

Machine Learning · Statistics 2019-12-17 Preetum Nakkiran

Latent variable models have accumulated a considerable amount of interest from the industry and academia for their versatility in a wide range of applications. A large amount of effort has been made to develop systems that is able to extend…

Machine Learning · Computer Science 2015-11-19 Aaron Q. Li , Amr Ahmed , Mu Li , Vanja Josifovski

We introduce estimation and test procedures through divergence optimization for discrete or continuous parametric models. This approach is based on a new dual representation for divergences. We treat point estimation and tests for simple…

Statistics Theory · Mathematics 2008-12-02 Michel Broniatowski , Amor Keziou

The paper establishes the central limit theorems and proposes how to perform valid inference in factor models. We consider a setting where many counties/regions/assets are observed for many time periods, and when estimation of a global…

Econometrics · Economics 2023-06-22 Stanislav Anatolyev , Anna Mikusheva

In this paper, a novel approach to the problem of estimating the heavy-tail exponent alpha>0 of a distribution is proposed. It is based on the fact that block-maxima of size m of the independent and identically distributed data scale at a…

Statistics Theory · Mathematics 2007-06-13 Stilian A. Stoev , George Michailidis , Murad S. Taqqu

In a general class of one dimensional random differential equation the convergence of the distribution function of the solution to stationary state distribution is studied. In particular it is proved the boundedness respectively the…

Probability · Mathematics 2010-07-07 Gyorgy Steinbrecher , Xavier Garbet , Boris Weyssow

The super-parametric density estimators and its related algorism were suggested by Y. -S. Tsai et al [7]. The number of parameters is unlimited in the super- parametric estimators and it is a general theory in sense of unifying or…

Computation · Statistics 2008-11-07 Yeong-Shyeong Tsai , Ying-Lin Hsu , Mung-Chung Shung

We prove limit theorems of an entirely new type for certain long memory regularly varying stationary infinitely divisible random processes. These theorems involve multiple phase transitions governed by how long the memory is. Apart from one…

Probability · Mathematics 2018-05-23 Gennady Samorodnitsky , Yizao Wang

We give an asymptotic development of the maximum likelihood estimator (MLE), or any other estimator defined implicitly, in a way which involves the limiting behavior of the score and its higher-order derivatives. This development, which is…

Statistics Theory · Mathematics 2024-04-10 Antoine Lejay , Sara Mazzonetto

In psychological and educational computer-based multidimensional tests, latent speed, a rate of the amount of labor performed on the items with respect to time, may also be multidimensional. To capture the multidimensionality of latent…

Methodology · Statistics 2018-07-17 Peida Zhan , Hong Jiao , Wen-Chung Wang , Kaiwen Man

In this paper new tests for the independence of two high-dimensional vectors are investigated. We consider the case where the dimension of the vectors increases with the sample size and propose multivariate analysis of variance-type…

Statistics Theory · Mathematics 2023-04-19 Taras Bodnar , Holger Dette , Nestor Parolya

Recent research has focused on $\ell_1$ penalized least squares (Lasso) estimators for high-dimensional linear regressions in which the number of covariates $p$ is considerably larger than the sample size $n$. However, few studies have…

Statistics Theory · Mathematics 2022-05-05 Yuefeng Han , Ruey S. Tsay

We study linear subset regression in the context of the high-dimensional overall model $y = \vartheta+\theta' z + \epsilon$ with univariate response $y$ and a $d$-vector of random regressors $z$, independent of $\epsilon$. Here,…

Statistics Theory · Mathematics 2019-02-13 Hannes Leeb , Lukas Steinberger

This paper considers the maximum likelihood estimation of factor models of high dimension, where the number of variables (N) is comparable with or even greater than the number of observations (T). An inferential theory is developed. We…

Statistics Theory · Mathematics 2012-05-31 Jushan Bai , Kunpeng Li

Meta learning uses information from base learners (e.g. classifiers or estimators) as well as information about the learning problem to improve upon the performance of a single base learner. For example, the Bayes error rate of a given…

Machine Learning · Computer Science 2016-03-11 Kevin R. Moon , Veronique Delouille , Alfred O. Hero

An important challenge in statistical analysis concerns the control of the finite sample bias of estimators. For example, the maximum likelihood estimator has a bias that can result in a significant inferential loss. This problem is…

Statistics Theory · Mathematics 2019-11-04 Stéphane Guerrier , Mucyo Karemera , Samuel Orso , Maria-Pia Victoria-Feser