English
Related papers

Related papers: Continuity and differentiability of regression M f…

200 papers

We develop inference procedures robust to general forms of weak dependence. The procedures utilize test statistics constructed by resampling in a manner that does not depend on the unknown correlation structure of the data. We prove that…

Econometrics · Economics 2021-08-26 Michael P. Leung

A reduced-rank mixed effects model is developed for robust modeling of sparsely observed paired functional data. In this model, the curves for each functional variable are summarized using a few functional principal components, and the…

Methodology · Statistics 2023-08-08 Huiya Zhou , Xiaomeng Yan , Lan Zhou

Asymptotic theory for M-estimation problems usually focuses on the asymptotic convergence of the sample descriptor, defined as the minimizer of the sample loss function. Here, we explore a related question and formulate asymptotic theory…

Statistics Theory · Mathematics 2024-11-15 Benjamin Eltzner

The semivarying coefficient models are widely used in the application of finance, economics, medical science and many other areas. The functional coefficients are commonly estimated by local smoothing methods, e.g. local linear estimator.…

Methodology · Statistics 2020-01-01 Heng Peng , Chuanlong Xie , Jingxin Zhao

There are several ways to establish the asymptotic normality of $L$-statistics, which depend on the choice of the weights-generating function and the cumulative distribution selection of the underlying model. In this study, we focus on…

Statistics Theory · Mathematics 2024-07-23 Chudamani Poudyal

Maximum Likelihood Estimators (MLE) has many good properties. For example, the asymptotic variance of MLE solution attains equality of the asymptotic Cram{\'e}r-Rao lower bound (efficiency bound), which is the minimum possible variance for…

Machine Learning · Statistics 2019-11-05 Song Liu , Takafumi Kanamori , Wittawat Jitkrittum , Yu Chen

Parametric high-dimensional regression analysis requires the usage of regularization terms to get interpretable models. The respective estimators can be regarded as regularized M-functionals which are naturally highly nonlinear. We study…

Statistics Theory · Mathematics 2019-09-04 Tino Werner

We study the distributional properties of the linear discriminant function under the assumption of normality by comparing two groups with the same covariance matrix but different mean vectors. A stochastic representation for the…

Statistics Theory · Mathematics 2017-05-09 Taras Bodnar , Stepan Mazur , Edward Ngailo , Nestor Parolya

In this paper we propose a family of robust estimates for isotonic regression: isotonic M-estimators. We show that their asymptotic distribution is, up to an scalar factor, the same as that of Brunk's classical isotonic estimator. We also…

Methodology · Statistics 2011-05-26 Enrique E. Álvarez , Víctor J. Yohai

Estimation of mean and covariance functions is fundamental for functional data analysis. While this topic has been studied extensively in the literature, a key assumption is that there are enough data in the domain of interest to estimate…

Methodology · Statistics 2020-09-01 Zhenhua Lin , Jane-Ling Wang , Qixian Zhong

Generalized linear mixed models are powerful tools for analyzing clustered data, where the unknown parameters are classically (and most commonly) estimated by the maximum likelihood and restricted maximum likelihood procedures. However,…

Statistics Theory · Mathematics 2023-03-23 Andrea M. Bratsberg , Magne Thoresen , Abhik Ghosh

The problem of f-divergence estimation is important in the fields of machine learning, information theory, and statistics. While several nonparametric divergence estimators exist, relatively few have known convergence properties. In…

Information Theory · Computer Science 2015-03-16 Kevin R. Moon , Alfred O. Hero

Robust M-estimation uses loss functions, such as least absolute deviation (LAD), quantile loss and Huber's loss, to construct its objective function, in order to for example eschew the impact of outliers, whereas the difficulty in analysing…

Econometrics · Economics 2023-01-18 Chaohua Dong , Jiti Gao , Yundong Tu , Bin Peng

Functional linear regression is a widely used approach to model functional responses with respect to functional inputs. However, classical functional linear regression models can be severely affected by outliers. We therefore introduce a…

Methodology · Statistics 2019-09-02 Harjit Hullait , David S. Leslie , Nicos G. Pavlidis , Steve King

We consider the problem of estimating smooth integrated functionals of a monotone nonincreasing density $f$ on $[0,\infty)$ using the nonparametric maximum likelihood based plug-in estimator. We find the exact asymptotic distribution of…

Statistics Theory · Mathematics 2019-04-16 Rajarshi Mukherjee , Bodhisattva Sen

In this paper, we study estimation of certain integral functionals of one or two densities with samples from stationary m-dependent sequences. We consider two types of U-statistic estimators for these functionals that are functions of the…

Statistics Theory · Mathematics 2013-09-20 David Källberg , Oleg Seleznjev

Under a partially linear models we study a family of robust estimates for the regression parameter and the regression function when some of the predictor variables take values on a Riemannian manifold. We obtain the consistency and the…

Statistics Theory · Mathematics 2011-05-26 Guillermo Henry , Daniela Rodriguez

This paper considers extensions of minimum-disparity estimators to the problem of estimating parameters in a regression model that is conditionally specified; that is where a parametric model describes the distribution of a response $y$…

Statistics Theory · Mathematics 2016-02-10 Giles Hooker

Density regression models allow a comprehensive understanding of data by modeling the complete conditional probability distribution. While flexible estimation approaches such as normalizing flows (NF) work particularly well in multiple…

Machine Learning · Statistics 2025-06-13 Marcel Arpogaus , Thomas Kneib , Thomas Nagler , David Rügamer

Entropy-type integral functionals of densities are widely used in mathematical statistics, information theory, and computer science. Examples include measures of closeness between distributions (e.g., density power divergence) and…

Statistics Theory · Mathematics 2013-03-08 David Källberg , Oleg Seleznjev