English
Related papers

Related papers: Estimation in Discrete Parameter Models

200 papers

A recent article on generalised linear mixed model asymptotics, Jiang et al. (2022), derived the rates of convergence for the asymptotic variances of maximum likelihood estimators. If $m$ denotes the number of groups and $n$ is the average…

Statistics Theory · Mathematics 2023-04-03 Luca Maestrini , Aishwarya Bhaskaran , Matt P. Wand

In this paper we study the asymptotic theory for spectral analysis of stationary random fields, including linear and nonlinear fields. Asymptotic properties of Fourier coefficients and periodograms, including limiting distributions of…

Statistics Theory · Mathematics 2021-10-28 Wai Leong Ng , Chun Yip Yau

We study asymptotic properties of $M$-estimates of regression parameters in linear models in which errors are dependent. Weak and strong Bahadur representations of the $M$-estimates are derived and a central limit theorem is established.…

Statistics Theory · Mathematics 2009-09-29 Wei Biao Wu

Multidimensional item response theory is a statistical test theory used to estimate the latent skills of learners and the difficulty levels of problems based on test results. Both compensatory and non-compensatory models have been proposed…

Methodology · Statistics 2025-07-22 Hiroshi Tamano , Hideitsu Hino , Daichi Mochihashi

Two dynamical indicators, the local dimension and the extremal index, used to quantify persistence in phase space have been developed and applied to different data across various disciplines. These are computed using the asymptotic limit of…

Dynamical Systems · Mathematics 2024-11-26 Ignacio del Amo , George Datseris , Mark Holland

We propose and analyze estimators for statistical functionals of one or more distributions under nonparametric assumptions. Our estimators are based on the theory of influence functions, which appear in the semiparametric statistics…

We investigate differentially private estimators for individual parameters within larger parametric models. While generic private estimators exist, the estimators we provide repose on new local notions of estimand stability, and these…

Machine Learning · Computer Science 2025-03-24 Hilal Asi , John C. Duchi , Kunal Talwar

Equilibrium statistical physics is considered from the point of view of statistical estimation theory. This involves the notions of statistical model, of estimators, and of exponential family. A useful property of the latter is the…

Statistical Mechanics · Physics 2016-08-31 Jan Naudts

Predictions and forecasts of machine learning models should take the form of probability distributions, aiming to increase the quantity of information communicated to end users. Although applications of probabilistic prediction and…

Machine Learning · Statistics 2024-03-19 Hristos Tyralis , Georgia Papacharalampous

This is a review of asymptotic and non-asymptotic behaviour of Bayesian methods under model specification. In particular we focus on consistency, i.e. convergence of the posterior distribution to the point mass at the best parametric…

Statistics Theory · Mathematics 2023-11-21 Natalia Bochkina

In practice, data often contain discrete variables. But most of the popular nonparametric estimation methods have been developed in a purely continuous framework. A common trick among practitioners is to make discrete variables continuous…

Methodology · Statistics 2018-01-08 Thomas Nagler

We study asymptotic behavior of one-step weighted $M$-estimators based on samples from arrays of not necessarily identically distributed random variables and representing explicit approximations to the corresponding consistent weighted…

Statistics Theory · Mathematics 2015-07-07 Yu. Yu. Linke

The ideas of aleatoric and epistemic uncertainty are widely used to reason about the probabilistic predictions of machine-learning models. We identify incoherence in existing discussions of these ideas and suggest this stems from the…

Machine Learning · Computer Science 2025-08-19 Freddie Bickford Smith , Jannik Kossen , Eleanor Trollope , Mark van der Wilk , Adam Foster , Tom Rainforth

This paper proposes new parametric model adequacy tests for possibly nonlinear and nonstationary time series models with noncontinuous data distribution, which is often the case in applied work. In particular, we consider the correct…

Statistics Theory · Mathematics 2021-08-10 Igor Kheifets , Carlos Velasco

Inferring information from a set of acquired data is the main objective of any signal processing (SP) method. In particular, the common problem of estimating the value of a vector of parameters from a set of noisy measurements is at the…

Signal Processing · Electrical Eng. & Systems 2017-09-26 S. Fortunati , F. Gini , M. S. Greco , C. D. Richmond

We introduce the problem of estimation of the parameters of a dynamically selected population in an infinite sequence of random variables and provide its application in the statistical inference based on record values from a non-stationary…

Statistics Theory · Mathematics 2015-06-01 Morteza Amini , Nader Nematollahi

Evaluation of treatment effects and more general estimands is typically achieved via parametric modelling, which is unsatisfactory since model misspecification is likely. Data-adaptive model building (e.g. statistical/machine learning) is…

Statistics Theory · Mathematics 2022-01-14 Oliver Hines , Oliver Dukes , Karla Diaz-Ordaz , Stijn Vansteelandt

There exist some testing procedures based on the maximum mean discrepancy (MMD) to address the challenge of model specification. However, they ignore the presence of estimated parameters in the case of composite null hypotheses. In this…

Methodology · Statistics 2024-12-10 Florian Brück , Jean-David Fermanian , Aleksey Min

We consider an estimation problem of expected functionals of a general random element that values in a metric space. If the functional forms an explicit function of some unknown parameters, we can estimate it by plugging-in a suitable…

Statistics Theory · Mathematics 2020-09-02 Yasutaka Shimizu

In this paper we study the asymptotic behaviour of empirical processes when parameters are estimated, assuming that the underlying sequence of random variables is long-range dependent. We show completely different phenomena compared to…

Statistics Theory · Mathematics 2007-06-13 Rafal Kulik