English
Related papers

Related papers: Random Effects Misspecification and its Consequenc…

200 papers

We study generalized Bayesian inference under misspecification, i.e. when the model is 'wrong but useful'. Generalized Bayes equips the likelihood with a learning rate $\eta$. We show that for generalized linear models (GLMs),…

Statistics Theory · Mathematics 2021-06-01 Rianne de Heide , Alisa Kirichenko , Nishant Mehta , Peter Grünwald

The gaussian spread regression model for the calibration of site specific ensemble temperature forecasts depends on the apparently restrictive assumption that the uncertainty around temperature forecasts is normally distributed. We…

Atmospheric and Oceanic Physics · Physics 2007-05-23 Stephen Jewson

Estimation of crossed random effects models commonly requires computational costs that grow faster than linearly in the sample size $N$, often as fast as $\Omega(N^{3/2})$, making them unsuitable for large data sets. For non-Gaussian…

Methodology · Statistics 2025-05-01 Ruggero Bellio , Swarnadip Ghosh , Art B. Owen , Cristiano Varin

At the heart of machine learning lies the question of generalizability of learned rules over previously unseen data. While over-parameterized models based on neural networks are now ubiquitous in machine learning applications, our…

Machine Learning · Computer Science 2020-05-04 Melikasadat Emami , Mojtaba Sahraee-Ardakan , Parthe Pandit , Sundeep Rangan , Alyson K. Fletcher

Conformal prediction is a statistically rigorous method for quantifying uncertainty in models by having them output sets of predictions, with larger sets indicating more uncertainty. However, prediction sets are not inherently actionable;…

Machine Learning · Computer Science 2025-02-17 Jesse C. Cresswell , Bhargava Kumar , Yi Sui , Mouloud Belbahri

We study learning algorithms when there is a mismatch between the distributions of the training and test datasets of a learning algorithm. The effect of this mismatch on the generalization error and model misspecification are quantified.…

Information Theory · Computer Science 2022-08-11 Saeed Masiha , Amin Gohari , Mohammad Hossein Yassaee , Mohammad Reza Aref

In the present paper we investigate the predictive risk of possibly misspecified quantile regression functions. The in-sample risk is well-known to be an overly optimistic estimate of the predictive risk and we provide two relatively simple…

Statistics Theory · Mathematics 2018-11-05 Alexander Giessing , Xuming He

The assumption of normality in data has been considered in the field of statistical analysis for a long time. However, in many practical situations, this assumption is clearly unrealistic. It has recently been suggested that the use of…

Computation · Statistics 2016-11-25 Reinaldo B. Arellano-Valle , Javier E. Contreras-Reyes

Estimates of uncertainty or variance in experimental means are central to physics. This is especially the case for `world averages' of fundamental physical parameters in particle physics, which aggregate results from a number of experiments…

High Energy Physics - Experiment · Physics 2023-10-13 Fintan Costello , Paul Watts

Meta-analysis aims to combine effect measures from several studies. For continuous outcomes, the most popular effect measures use simple or standardized differences in sample means. However, a number of applications focus on the absolute…

Methodology · Statistics 2023-10-03 Elena Kulinskaya , David C. Hoaglin

The estimation of the potential impact fraction (including the population attributable fraction) with continuous exposure data frequently relies on strong distributional assumptions. However, these assumptions are often violated if the…

Decisions based partly or solely on predictions from probabilistic models may be sensitive to model misspecification. Statisticians are taught from an early stage that "all models are wrong", but little formal guidance exists on how to…

Methodology · Statistics 2015-03-09 James Watson , Chris Holmes

Estimating uncertainty of machine learning models is essential to assess the quality of the predictions that these models provide. However, there are several factors that influence the quality of uncertainty estimates, one of which is the…

Machine Learning · Computer Science 2022-11-03 Yuko Kato , David M. J. Tax , Marco Loog

Exposure mappings are widely used to model potential outcomes in the presence of interference, where each unit's outcome may depend not only on its own treatment, but also on the treatment of other units as well. However, in practice these…

Methodology · Statistics 2018-07-02 David Choi

This article reviews recent advances in fixed effect estimation of panel data models for long panels, where the number of time periods is relatively large. We focus on semiparametric models with unobserved individual and time effects, where…

Econometrics · Economics 2018-03-29 Iván Fernández-Val , Martin Weidner

I study identification, estimation and inference for spillover effects in experiments where units' outcomes may depend on the treatment assignments of other units within a group. I show that the commonly-used reduced-form linear-in-means…

Econometrics · Economics 2022-01-21 Gonzalo Vazquez-Bare

In recent years, there has been a significant growth in research focusing on minimum $\ell_2$ norm (ridgeless) interpolation least squares estimators. However, the majority of these analyses have been limited to an unrealistic regression…

Statistics Theory · Mathematics 2024-06-14 Sungyoon Lee , Sokbae Lee

Difficulties may arise when analyzing longitudinal data using mixed-effects models if there are nonparametric functions present in the linear predictor component. This study extends the use of semiparametric mixed-effects modeling in cases…

Methodology · Statistics 2024-02-05 Mozhgan Taavoni , Mohammad Arashi

Although treatment effects can be estimated from observed outcome distributions obtained from proper randomization in clinical trials, covariate adjustment is recommended to increase precision. For important treatment effects, such as odds…

Methodology · Statistics 2025-07-03 Susanne Dandl , Torsten Hothorn

The Rashomon Effect describes the following phenomenon: for a given dataset there may exist many models with equally good performance but with different solution strategies. The Rashomon Effect has implications for Explainable Machine…

Machine Learning · Computer Science 2023-06-30 Sebastian Müller , Vanessa Toborek , Katharina Beckh , Matthias Jakobs , Christian Bauckhage , Pascal Welke