English
Related papers

Related papers: Asymptotic linear expansion of regularized M-estim…

200 papers

In this paper we propose a family of robust estimates for isotonic regression: isotonic M-estimators. We show that their asymptotic distribution is, up to an scalar factor, the same as that of Brunk's classical isotonic estimator. We also…

Methodology · Statistics 2011-05-26 Enrique E. Álvarez , Víctor J. Yohai

During the last years, asymptotic (or sequential) constraint qualifications, which postulate upper semicontinuity of certain set-valued mappings and provide a natural companion of asymptotic stationarity conditions, have been shown to be…

Optimization and Control · Mathematics 2023-02-10 Matúš Benko , Patrick Mehlitz

Suppose that $n$ statistical units are observed, each following the model $Y(x_j)=m(x_j)+ \epsilon(x_j),\, j=1,...,N,$ where $m$ is a regression function, $0 \leq x_1 <...<x_N \leq 1$ are observation times spaced according to a sampling…

Statistics Theory · Mathematics 2011-07-21 Karim Benhenni , David Degras

Additive models play an essential role in studying non-linear relationships. Despite many recent advances in estimation, there is a lack of methods and theories for inference in high-dimensional additive models, including confidence…

Statistics Theory · Mathematics 2022-02-18 Zijian Guo , Wei Yuan , Cun-Hui Zhang

Ever since the proof of asymptotic normality of maximum likelihood estimator by Cramer (1946), it has been understood that a basic technique of the Taylor series expansion suffices for asymptotics of $M$-estimators with…

Statistics Theory · Mathematics 2018-09-17 Arun Kumar Kuchibhotla

Latent variable models are a fundamental modeling tool in machine learning applications, but they present significant computational and analytical challenges. The popular EM algorithm and its variants, is a much used algorithmic tool; yet…

Machine Learning · Computer Science 2015-12-08 Xinyang Yi , Constantine Caramanis

When a parameter of interest is defined to be a nondifferentiable transform of a regular parameter, the parameter does not have an influence function, rendering the existing theory of semiparametric efficient estimation inapplicable.…

Statistics Theory · Mathematics 2022-01-06 Kyungchul Song

We extend a recently established asymptotic normality theorem for generalized linear mixed models to include the dispersion parameter. The new results show that the maximum likelihood estimators of all model parameters have asymptotically…

Statistics Theory · Mathematics 2022-08-11 Aishwarya Bhaskaran , Matt P. Wand

Asymptotic expansions with explicit upper bounds for remainders are given for stationary distributions of nonlinearly perturbed semi-Markov processes with finite phase spaces. The corresponding algorithms are based on a special technique of…

Probability · Mathematics 2016-03-16 Dmitrii Silvestrov , Sergei Silvestrov

Generalised linear models for multi-class classification problems are one of the fundamental building blocks of modern machine learning tasks. In this manuscript, we characterise the learning of a mixture of $K$ Gaussians with generic means…

New algorithms for computing of asymptotic expansions for stationary distributions of nonlinearly perturbed semi-Markov processes are presented. The algorithms are based on special techniques of sequential phase space reduction, which can…

Probability · Mathematics 2017-03-08 Dmitrii Silvestrov , Sergei Silvestrov

The paper considers the problem of distributed adaptive linear parameter estimation in multi-agent inference networks. Local sensing model information is only partially available at the agents and inter-agent communication is assumed to be…

Optimization and Control · Mathematics 2012-08-07 Soummya Kar , Jose' M. F. Moura , H. Vincent Poor

We study behavior of the restricted maximum likelihood (REML) estimator under a misspecified linear mixed model (LMM) that has received much attention in recent gnome-wide association studies. The asymptotic analysis establishes consistency…

Statistics Theory · Mathematics 2014-04-10 Jiming Jiang , Cong Li , Debashis Paul , Can Yang , Hongyu Zhao

We consider the problem of constructing nonparametric undirected graphical models for high-dimensional functional data. Most existing statistical methods in this context assume either a Gaussian distribution on the vertices or linear…

Statistics Theory · Mathematics 2021-03-22 Eftychia Solea , Holger Dette

Non-standard distributional approximations have received considerable attention in recent years. They often provide more accurate approximations in small samples, and theoretical improvements in some cases. This paper shows that the…

Statistics Theory · Mathematics 2017-12-12 Matias D. Cattaneo , Michael Jansson , Whitney K. Newey

Reformulated uniform asymptotic expansions are derived for ordinary differential equations having a large parameter and a simple turning point. These involve Airy functions, but not their derivatives, unlike traditional asymptotic…

Classical Analysis and ODEs · Mathematics 2024-05-15 T. M. Dunster

When multiple models are considered in regression problems, the model averaging method can be used to weigh and integrate the models. In the present study, we examined how the goodness-of-prediction of the estimator depends on the…

Statistics Theory · Mathematics 2023-08-21 Ryo Ando , Fumiyasu Komaki

The non-parametric estimation of covariance lies at the heart of functional data analysis, whether for curve or surface-valued data. The case of a two-dimensional domain poses both statistical and computational challenges, which are…

Statistics Theory · Mathematics 2022-01-19 Tomas Masak , Soham Sarkar , Victor M. Panaretos

We derive asymptotic expansions of the Kummer functions $M(a,b,z)$ and $U(a,b+1,z)$ for large positive values of $a$ and $b$, with $z$ fixed. For both functions we consider $b/a\le 1$ and $b/a\ge 1$, with special attention for the case…

Classical Analysis and ODEs · Mathematics 2021-02-24 Nico M. Temme

In this paper, the maximum spacing method is considered for multivariate observations. Nearest neighbour balls are used as a multidimensional analogue to univariate spacings. A class of information-type measures is used to generalize the…

Statistics Theory · Mathematics 2019-04-19 Kristi Kuljus , Bo Ranneby