English
Related papers

Related papers: Robust Inference Policies

200 papers

Preserving the robustness of the procedure has, at the present time, become almost a default requirement for statistical data analysis. Since efficiency at the model and robustness under misspecification of the model are often in conflict,…

Statistics Theory · Mathematics 2019-10-29 Saptarshi Roy , Kaustav Chakraborty , Somnath Bhadra , Ayanendranath Basu

Prediction becomes more challenging with missing covariates. What method is chosen to handle missingness can greatly affect how models perform. In many real-world problems, the best prediction performance is achieved by models that can…

Generalized Linear Models are routinely used in data analysis. The classical procedures for estimation are based on Maximum Likelihood and it is well known that the presence of outliers can have a large impact on this estimator. Robust…

Computation · Statistics 2017-10-02 Marina Valdora , Claudio Agostinelli , Victor J. Yohai

The recent availability of huge, many-dimensional data sets, like those arising from genome-wide association studies (GWAS), provides many opportunities for strengthening causal inference. One popular approach is to utilize these…

Machine Learning · Statistics 2020-12-21 Ioan Gabriel Bucur , Tom Claassen , Tom Heskes

This paper introduces a set of algorithms for Monte-Carlo Bayesian reinforcement learning. Firstly, Monte-Carlo estimation of upper bounds on the Bayes-optimal value function is employed to construct an optimistic policy. Secondly,…

Machine Learning · Computer Science 2016-11-18 Christos Dimitrakakis

We explore the notion of uncertainty in the context of modern abstractive summarization models, using the tools of Bayesian Deep Learning. Our approach approximates Bayesian inference by first extending state-of-the-art summarization models…

Computation and Language · Computer Science 2022-05-04 Alexios Gidiotis , Grigorios Tsoumakas

We introduce a methodology for robust Bayesian estimation with robust divergence (e.g., density power divergence or {\gamma}-divergence), indexed by a single tuning parameter. It is well known that the posterior density induced by robust…

Methodology · Statistics 2022-07-04 Shouto Yonekura , Shonosuke Sugasawa

The Bayesian approach to data analysis provides a powerful way to handle uncertainty in all observations, model parameters, and model structure using probability theory. Probabilistic programming languages make it easier to specify and fit…

A vital stage in the mathematical modelling of real-world systems is to calibrate a model's parameters to observed data. Likelihood-free parameter inference methods, such as Approximate Bayesian Computation, build Monte Carlo samples of the…

Computation · Statistics 2021-12-23 Thomas P Prescott , Ruth E Baker

The prevalence of one-shot devices is quite prolific in engineering and medical domains. Unlike typical one-shot devices, nondestructive one-shot devices (NOSD) may survive multiple tests and offer additional data for reliability…

Methodology · Statistics 2025-02-11 Shanya Baghel , Shuvashree Mondal

Increasingly complex applications involve large datasets in combination with non-linear and high dimensional mathematical models. In this context, statistical inference is a challenging issue that calls for pragmatic approaches that take…

Data Analysis, Statistics and Probability · Physics 2013-01-31 Andreas Raue , Clemens Kreutz , Fabian Joachim Theis , Jens Timmer

Multi-fidelity methods are prominently used when cheaply-obtained, but possibly biased and noisy, observations must be effectively combined with limited or expensive true data in order to construct reliable models. This arises in both…

Machine Learning · Statistics 2019-03-19 Kurt Cutajar , Mark Pullin , Andreas Damianou , Neil Lawrence , Javier González

Bayesian methods, distributionally robust optimization methods, and regularization methods are three pillars of trustworthy machine learning combating distributional uncertainty, e.g., the uncertainty of an empirical distribution compared…

Machine Learning · Computer Science 2024-03-26 Shixiong Wang , Haowei Wang

A stream of algorithmic advances has steadily increased the popularity of the Bayesian approach as an inference paradigm, both from the theoretical and applied perspective. Even with apparent successes in numerous application fields, a…

Methodology · Statistics 2020-07-10 Owen Thomas , Henri Pesonen , Jukka Corander

Although Bayesian inference is an immensely popular paradigm among a large segment of scientists including statisticians, most applications consider objective priors and need critical investigations (Efron, 2013, Science). While it has…

Statistics Theory · Mathematics 2020-09-11 Abhik Ghosh , Tuhin Majumder , Ayanendranath Basu

Recent advances in uncertainty quantification increasingly emphasise the distinction between aleatory and epistemic uncertainty in machine learning, motivating the need for more unified frameworks. However, despite much progress in…

Machine Learning · Computer Science 2026-05-26 Yu Chen , Scott Ferson

Bayesian inference is a popular approach to calibrating uncertainties, but it can underpredict such uncertainties when model misspecification is present, impacting its reliability to inform decision making. Recently, the statistics and…

Computational Engineering, Finance, and Science · Computer Science 2026-01-09 Rebekah White , Rileigh Bandy , Teresa Portone

Bayesian inference under a set of priors, called robust Bayesian analysis, allows for estimation of parameters within a model and quantification of epistemic uncertainty in quantities of interest by bounded (or imprecise) probability.…

Computation · Statistics 2022-07-15 Ivette Raices Cruz , Johan Lindström , Matthias C. M. Troffaes , Ullrika Sahlin

Although linear regression models are fundamental tools in statistical science, the estimation results can be sensitive to outliers. While several robust methods have been proposed in frequentist frameworks, statistical inference is not…

Methodology · Statistics 2020-07-15 Shintaro Hashimoto , Shonosuke Sugasawa

In predictive modeling with simulation or machine learning, it is critical to accurately assess the quality of estimated values through output analysis. In recent decades output analysis has become enriched with methods that quantify the…

Methodology · Statistics 2023-10-27 Kimia Vahdat , Sara Shashaani