English
Related papers

Related papers: Non-Bayesian Post-Model-Selection Estimation as Es…

200 papers

Machine learning (ML) models are typically optimized for their accuracy on a given dataset. However, this predictive criterion rarely captures all desirable properties of a model, in particular how well it matches a domain expert's…

Machine Learning · Computer Science 2022-07-07 Damien Teney , Maxime Peyrard , Ehsan Abbasnejad

The use of high-dimensional regression techniques from machine learning has significantly improved the quantitative accuracy of interatomic potentials. Atomic simulations can now plausibly target quantitative predictions in a variety of…

Materials Science · Physics 2025-03-04 Danny Perez , Aparna P. A. Subramanyam , Ivan Maliyov , Thomas D. Swinburne

We consider the problem of uncertainty estimation in the context of (non-Bayesian) deep neural classification. In this context, all known methods are based on extracting uncertainty signals from a trained network optimized to solve the…

Machine Learning · Computer Science 2019-04-25 Yonatan Geifman , Guy Uziel , Ran El-Yaniv

Simulation-based Bayesian inference (SBI) methods are widely used for parameter estimation in complex models where evaluating the likelihood is challenging but generating simulations is relatively straightforward. However, these methods…

One-bit quantization has garnered significant attention in recent years for various signal processing and communication applications. Estimating model parameters from one bit quantized data can be challenging, particularly when the…

Signal Processing · Electrical Eng. & Systems 2025-04-01 Nadav E. Rosenthal , Joseph Tabrikian

Model misspecification is a long-standing enigma of the Bayesian inference framework as posteriors tend to get overly concentrated on ill-informed parameter values towards the large sample limit. Tempering of the likelihood has been…

Methodology · Statistics 2019-12-13 Owen Thomas , Jukka Corander

Quantitative MRI (qMRI) involves parameter estimation governed by an explicit signal model. However, these models are often confounded and difficult to validate in vivo. A model is misspecified when the assumed signal model differs from the…

Image and Video Processing · Electrical Eng. & Systems 2026-02-12 Jiachen Wang , Jon Tamir , Adam Bush

Multidimensional item response theory is a statistical test theory used to estimate the latent skills of learners and the difficulty levels of problems based on test results. Both compensatory and non-compensatory models have been proposed…

Methodology · Statistics 2025-07-22 Hiroshi Tamano , Hideitsu Hino , Daichi Mochihashi

In the usual Bayesian setting, a full probabilistic model is required to link the data and parameters, and the form of this model and the inference and prediction mechanisms are specified via de Finetti's representation. In general, such a…

Methodology · Statistics 2026-01-21 Yu Luo , David A. Stephens , Daniel J. Graham , Emma J. McCoy

We discuss the role of misspecification and censoring on Bayesian model selection in the contexts of right-censored survival and concave log-likelihood regression. Misspecification includes wrongly assuming the censoring mechanism to be…

Methodology · Statistics 2021-11-15 David Rossell , Francisco Javier Rubio

In the causal inference literature an estimator belonging to a class of semi-parametric estimators is called robust if it has desirable properties under the assumption that at least one of the working models is correctly specified. In this…

Statistics Theory · Mathematics 2018-06-26 Ingeborg Waernbaum , Laura Pazzagli

We provide a comprehensive set of new results on the impact of mis-specifying the short run dynamics in fractionally integrated processes. We show that four alternative parametric estimators - frequency domain maximum likelihood, Whittle,…

Statistics Theory · Mathematics 2018-10-23 Gael M. Martin , Kanchana Nadarajah , D. S. Poskitt

Nonparametric modeling approaches show very promising results in the area of system identification and control. A naturally provided model confidence is highly relevant for system-theoretical considerations to provide guarantees for…

Machine Learning · Computer Science 2018-11-19 Thomas Beckers , Jonas Umlauft , Sandra Hirche

Modern imaging techniques heavily rely on Bayesian statistical models to address difficult image reconstruction and restoration tasks. This paper addresses the objective evaluation of such models in settings where ground truth is…

Image and Video Processing · Electrical Eng. & Systems 2026-05-29 Tom Sprunck , Marcelo Pereyra , Tobias Liaudat

Standard Bayesian inference is known to be sensitive to model misspecification, leading to unreliable uncertainty quantification and poor predictive performance. However, finding generally applicable and computationally feasible methods for…

Methodology · Statistics 2020-07-31 Jonathan H. Huggins , Jeffrey W. Miller

Most machine learning techniques are based upon statistical learning theory, often simplified for the sake of computing speed. This paper is focused on the uncertainty aspect of mathematical modeling in machine learning. Regression analysis…

Machine Learning · Computer Science 2022-06-07 Valentin Arkov

We consider the estimation problem in high-dimensional semi-supervised learning. Our goal is to investigate when and how the unlabeled data can be exploited to improve the estimation of the regression parameters of linear model in light of…

Methodology · Statistics 2023-03-21 Siyi Deng , Yang Ning , Jiwei Zhao , Heping Zhang

Misclassification of binary responses, if ignored, may severely bias the maximum likelihood estimators (MLE) of regression parameters. For such data, a binary regression model incorporating misclassification probabilities is extensively…

Statistics Theory · Mathematics 2020-09-28 Arindam Chatterjee , Tathagata Bandyopadhyay , Sumanta Adhya

We study a linear statistical model where outcomes depend on regressors with fixed population coefficients and observation-specific latent coefficients, along with measurement errors. A decision-maker estimates population coefficients and…

Theoretical Economics · Economics 2026-04-15 Junnan He , Lin Hu , Matthew Kovach , Anqi Li

Specifying reward functions for robots that operate in environments without a natural reward signal can be challenging, and incorrectly specified rewards can incentivise degenerate or dangerous behavior. A promising alternative to manually…

Artificial Intelligence · Computer Science 2021-01-20 Rachel Freedman , Rohin Shah , Anca Dragan