English
Related papers

Related papers: Efficient GMM and Weighting Matrix under Misspecif…

200 papers

Downsampling or under-sampling is a technique that is utilized in the context of large and highly imbalanced classification models. We study optimal downsampling for imbalanced classification using generalized linear models (GLMs). We…

Machine Learning · Statistics 2025-05-20 Yan Chen , Jose Blanchet , Krzysztof Dembczynski , Laura Fee Nern , Aaron Flores

We propose a unified framework for establishing existence of nonparametric M-estimators, computing the corresponding estimates, and proving their strong consistency when the class of functions is exceptionally rich. In particular, the…

Statistics Theory · Mathematics 2019-09-11 Johannes O. Royset , Roger J-B Wets

Survey instruments and assessments are frequently used in many domains of social science. When the constructs that these assessments try to measure become multifaceted, multidimensional item response theory (MIRT) provides a unified…

Methodology · Statistics 2025-01-08 Chenchen Ma , Jing Ouyang , Chun Wang , Gongjun Xu

We provide a unified approach to a method of estimation of the regression parameter in balanced linear models with a structured covariance matrix that combines a high breakdown point and bounded influence with high asymptotic efficiency at…

Statistics Theory · Mathematics 2023-03-22 Hendrik Paul Lopuhaä

Joint misclassification of exposure and outcome variables can lead to considerable bias in epidemiological studies of causal exposure-outcome effects. In this paper, we present a new maximum likelihood based estimator for the marginal…

Methodology · Statistics 2019-01-16 Bas B. L. Penning de Vries , Maarten van Smeden , Rolf H. H. Groenwold

We study estimation and inference using data collected by reinforcement learning (RL) algorithms. These algorithms adaptively experiment by interacting with individual units over multiple stages, updating their strategies based on past…

Machine Learning · Statistics 2025-10-06 Vasilis Syrgkanis , Ruohan Zhan

We consider estimation under model misspecification where there is a model mismatch between the underlying system, which generates the data, and the model used during estimation. We propose a model misspecification framework which enables a…

Signal Processing · Electrical Eng. & Systems 2023-02-22 Martin Hellkvist , Ayça Özçelikkale , Anders Ahlén

Combining information from multiple samples is often needed in biomedical and economic studies, but the differences between these samples must be appropriately taken into account in the analysis of the combined data. We study estimation for…

Methodology · Statistics 2018-08-14 Heng Shu , Zhiqiang Tan

The relevance condition of Integrated Conditional Moment (ICM) estimators is significantly weaker than the conventional IV's in at least two respects: (1) consistent estimation without excluded instruments is possible, provided endogenous…

Econometrics · Economics 2022-11-14 Emmanuel Selorm Tsyawo

Fitting parametric models by optimizing frequency domain objective functions is an attractive approach of parameter estimation in time series analysis. Whittle estimators are a prominent example in this context. Under weak conditions and…

Statistics Theory · Mathematics 2021-07-26 Jens-Peter Kreiss , Efstathios Paparoditis

There are several ways to establish the asymptotic normality of $L$-statistics, which depend on the choice of the weights-generating function and the cumulative distribution selection of the underlying model. In this study, we focus on…

Statistics Theory · Mathematics 2024-07-23 Chudamani Poudyal

Gaussian mixture models (GMMs) are fundamental tools in statistical and data sciences. We study the moments of multivariate Gaussians and GMMs. The $d$-th moment of an $n$-dimensional random variable is a symmetric $d$-way tensor of size…

Machine Learning · Statistics 2022-03-23 João M. Pereira , Joe Kileel , Tamara G. Kolda

The bootstrap is a popular method of constructing confidence intervals due to its ease of use and broad applicability. Theoretical properties of bootstrap procedures have been established in a variety of settings. However, there is limited…

Statistics Theory · Mathematics 2024-04-19 Zhou Tang , Ted Westling

We present a procedure to diagnose model misspecification in situations where inference is performed using approximate Bayesian computation. We demonstrate theoretically, and empirically that this procedure can consistently detect the…

Methodology · Statistics 2022-10-25 Andrés Ramírez-Hassan , David T. Frazier

In distributed, or privacy-preserving learning, we are often given a set of probabilistic models estimated from different local repositories, and asked to combine them into a single model that gives efficient statistical estimation. A…

Machine Learning · Statistics 2017-03-01 Jun Han , Qiang Liu

The Misspecification-Resistant Information Criterion (MRIC) proposed in [H.-L. Hsu, C.-K. Ing, H. Tong: On model selection from a finite family of possibly misspecified time series models. The Annals of Statistics. 47 (2), 1061--1087…

Statistics Theory · Mathematics 2022-02-21 Gery Andrés Díaz Rubio , Simone Giannerini , Greta Goracci

In this letter, we propose a Gaussian mixture model (GMM)-based channel estimator which is learned on imperfect training data, i.e., the training data are solely comprised of noisy and sparsely allocated pilot observations. In a practical…

Signal Processing · Electrical Eng. & Systems 2023-02-14 Benedikt Fesl , Nurettin Turan , Michael Joham , Wolfgang Utschick

We study semiparametric efficiency bounds and efficient estimation of parameters defined through general moment restrictions with missing data. Identification relies on auxiliary data containing information about the distribution of the…

Statistics Theory · Mathematics 2008-04-04 Xiaohong Chen , Han Hong , Alessandro Tarozzi

Amortized Bayesian model comparison (BMC) enables fast probabilistic ranking of models via simulation-based training of neural surrogates. However, the accuracy of neural surrogates deteriorates when simulation models are misspecified; the…

Machine Learning · Statistics 2026-05-13 Šimon Kucharský , Aayush Mishra , Daniel Habermann , Stefan T. Radev , Paul-Christian Bürkner

Importance weighting is a standard tool for correcting distribution shift, but its statistical behavior under target shift -- where the label distribution changes between training and testing while the conditional distribution of inputs…

Machine Learning · Statistics 2026-03-04 Davit Gogolashvili