English
Related papers

Related papers: Local asymptotics of cross-validation in least-squ…

200 papers

The noncentral Wishart distribution has become more mainstream in statistics as the prevalence of applications involving sample covariances with underlying multivariate Gaussian populations as dramatically increased since the advent of…

Statistics Theory · Mathematics 2022-05-25 Frédéric Ouimet

We consider a multivariate functional measurement error model $AX\approx B$. The errors in $[A,B]$ are uncorrelated, row-wise independent, and have equal (unknown) variances. We study the total least squares estimator of $X$, which, in the…

Probability · Mathematics 2016-07-14 Alexander Kukush , Yaroslav Tsaregorodtsev

The Maximum Likelihood (ML) and Cross Validation (CV) methods for estimating covariance hyper-parameters are compared, in the context of Kriging with a misspecified covariance structure. A two-step approach is used. First, the case of the…

Statistics Theory · Mathematics 2013-06-03 François Bachoc

We study local asymptotic normality of M-estimates of convex minimization in an infinite dimensional parameter space. The objective function of M-estimates is not necessary differentiable and is possibly subject to convex constraints. In…

Statistics Theory · Mathematics 2017-04-11 Kosaku Takanashi

Near-Gaussian probability densities are common in many important physical applications. Here we develop an asymptotic expansion methodology for computing entropic functionals for such densities. The expansion proposed is a close relative of…

Statistics Theory · Mathematics 2016-06-29 Gordon V. Chavez , Richard Kleeman

The main purpose of this paper is to investigate the strong approximation of the integrated empirical process. More precisely, we obtain the exact rate of the approximations by a sequence of weighted Brownian bridges and a weighted Kiefer…

Statistics Theory · Mathematics 2017-11-21 Sergio Alvarez-Andrade , Salim Bouzebda , Aimé Lachal

We consider the problem of model selection type aggregation in the context of density estimation. We first show that empirical risk minimization is sub-optimal for this problem and it shares this property with the exponential weights…

Statistics Theory · Mathematics 2016-09-29 Pierre C. Bellec

We consider the least-squares regression problem and provide a detailed asymptotic analysis of the performance of averaged constant-step-size stochastic gradient descent (a.k.a. least-mean-squares). In the strongly-convex case, we provide…

Machine Learning · Computer Science 2014-12-02 Alexandre Défossez , Francis Bach

We derive the precise asymptotic distributional behavior of Gaussian variational approximate estimators of the parameters in a single-predictor Poisson mixed model. These results are the deepest yet obtained concerning the statistical…

Statistics Theory · Mathematics 2012-02-24 Peter Hall , Tung Pham , M. P. Wand , S. S. J. Wang

In the present paper we consider the varying coefficient model which represents a useful tool for exploring dynamic patterns in many applications. Existing methods typically provide asymptotic evaluation of precision of estimation…

Statistics Theory · Mathematics 2013-02-07 Olga Klopp , Marianna Pensky

Impropriety testing for complex-valued vector has been considered lately due to potential applications ranging from digital communications to complex media imaging. This paper provides new results for such tests in the asymptotic regime,…

Signal Processing · Electrical Eng. & Systems 2020-01-07 Florent Chatelain , Nicolas Le Bihan , Jonathan H. Manton

We study the estimation problem for linear time-invariant (LTI) state-space models with Gaussian excitation of an unknown covariance. We provide non asymptotic lower bounds for the expected estimation error and the mean square estimation…

Statistics Theory · Mathematics 2021-09-20 Boualem Djehiche , Othmane Mazhar

Mutation validation (MV) is a recently proposed approach for model selection, garnering significant interest due to its unique characteristics and potential benefits compared to the widely used cross-validation (CV) method. In this study,…

Machine Learning · Computer Science 2024-07-25 Jinyang Yu , Sami Hamdan , Leonard Sasse , Abigail Morrison , Kaustubh R. Patil

Gaussian variational inference and the Laplace approximation are popular alternatives to Markov chain Monte Carlo that formulate Bayesian posterior inference as an optimization problem, enabling the use of simple and scalable stochastic…

Computation · Statistics 2023-07-07 Zuheng Xu , Trevor Campbell

This paper considers the problem of variable selection allowing for parameter instability. It distinguishes between signal and pseudo-signal variables that are correlated with the target variable, and noise variables that are not, and…

Econometrics · Economics 2024-07-17 Alexander Chudik , M. Hashem Pesaran , Mahrad Sharifvaghefi

Via a simulation study we compare the finite sample performance of the deconvolution kernel density estimator in the supersmooth deconvolution problem to its asymptotic behaviour predicted by two asymptotic normality theorems. Our results…

Methodology · Statistics 2008-01-18 Bert van Es , Shota Gugushvili

Structural estimation is an important methodology in empirical economics, and a large class of structural models are estimated through the generalized method of moments (GMM). Traditionally, selection of structural models has been performed…

Econometrics · Economics 2018-07-19 Junpei Komiyama , Hajime Shimao

We develop the asymptotic expansion theory for vector-valued sequences (F N) N $\ge$1 of random variables in terms of the convergence of the Stein-Malliavin matrix associated to the sequence F N. Our approach combines the classical Fourier…

Probability · Mathematics 2017-12-11 Ciprian Tudor , Nakahiro Yoshida

We study the asymptotic behavior of the maximum likelihood estimator corresponding to the observation of a trajectory of a Skew Brownian motion, through a uniform time discretization. We characterize the speed of convergence and the…

Probability · Mathematics 2015-03-17 Antoine Lejay , Ernesto Mordecki , Soledad Torres

This paper focuses on a class of variational inequalities (VIs), where the map defining the VI is given by the component-wise conditional value-at-risk (CVaR) of a random function. We focus on solving the VI using sample average…

Optimization and Control · Mathematics 2022-08-25 Ashish Cherukuri
‹ Prev 1 4 5 6 7 8 10 Next ›