English
Related papers

Related papers: Measuring Bayesian Robustness Using R\'enyi Diverg…

200 papers

This paper develops Bayesian sample size formulae for experiments comparing two groups. We assume the experimental data will be analysed in the Bayesian framework, where pre-experimental information from multiple sources can be represented…

Methodology · Statistics 2022-03-09 Haiyan Zheng , Thomas Jaki , James M. S. Wason

Replication of scientific studies is important for assessing the credibility of their results. However, there is no consensus on how to quantify the extent to which a replication study replicates an original result. We propose a novel…

Methodology · Statistics 2026-05-19 Roberto Macrì-Demartino , Leonardo Egidi , Leonhard Held , Samuel Pawel

We propose an extension of the classical R\'enyi divergences to quantum states through an optimization over probability distributions induced by restricted sets of measurements. In particular, we define the notion of locally-measured…

Quantum Physics · Physics 2025-10-10 Tobias Rippchen , Sreejith Sreekumar , Mario Berta

We develop a general class of Bayesian repulsive Gaussian mixture models that encourage well-separated clusters, aiming at reducing potentially redundant components produced by independent priors for locations (such as the Dirichlet…

Methodology · Statistics 2017-10-24 Fangzheng Xie , Yanxun Xu

Diffusion models have emerged as powerful learned priors for Bayesian inverse problems (BIPs). Diffusion-based solvers rely on a presumed likelihood for the observations in BIPs to guide the generation process. Likelihood misspecification…

Machine Learning · Computer Science 2026-05-12 Yiming Yang , Xiaoyuan Cheng , Yi He , Kaiyu Li , Wenxuan Yuan , Zhuo Sun

When using complex Bayesian models to combine information, the checking for consistency of the information being combined is good statistical practice. Here a new method is developed for detecting prior-data conflicts in Bayesian models…

Methodology · Statistics 2016-11-29 David J. Nott , Xueou Wang , Michael Evans , Berthold-Georg Englert

External data borrowing in clinical trial designs has increased in recent years. This is accomplished in the Bayesian framework by specifying informative prior distributions. To mitigate the impact of potential inconsistency (bias) between…

In the Bayesian literature, a line of research called resolution of conflict is about the characterization of robustness against outliers of statistical models. The robustness characterization of a model is achieved by establishing the…

Statistics Theory · Mathematics 2025-12-10 Philippe Gagnon

The R\'enyi information measures are characterized in terms of their Shannon counterparts, and properties of the former are recovered from first principle via the associated properties of the latter. Motivated by this characterization, a…

Information Theory · Computer Science 2016-03-14 Ofer Shayevitz

The quality of a Bayes factor crucially depends on the number of regressors, the sample size and the prior on the regression parameters, and hence it has to be established in a case-by-case basis. In this paper we analyze the consistency of…

Statistics Theory · Mathematics 2025-05-20 Elías Moreno , J. J. Serrano-Pérez , F. Torres-Ruiz

For nonlinear supervised learning models, assessing the importance of predictor variables or their interactions is not straightforward because it can vary in the domain of the variables. Importance can be assessed locally with sensitivity…

Methodology · Statistics 2021-12-14 Topi Paananen , Michael Riis Andersen , Aki Vehtari

Any classifier can be "smoothed out" under Gaussian noise to build a new classifier that is provably robust to $\ell_2$-adversarial perturbations, viz., by averaging its predictions over the noise via randomized smoothing. Under the…

Machine Learning · Computer Science 2022-12-21 Jongheon Jeong , Seojin Kim , Jinwoo Shin

We express the joint R\'enyi entropy of progressively censored order statistics in terms of an incomplete integral of the hazard function, and provide a simple estimate of the joint R\'enyi entropy of progressively Type-II censored data.…

Methodology · Statistics 2013-03-25 Akram Kohansal , Saeid Rezakhah

The most popular hypothesis testing procedure, the likelihood ratio test, is known to be highly non-robust in many real situations. Basu et al. (2013a) provided an alternative robust procedure of hypothesis testing based on the density…

Statistics Theory · Mathematics 2016-07-04 Abhik Ghosh , Ayanendranath Basu , Leandro Pardo

Adversarial robustness is a critical property in a variety of modern machine learning applications. While it has been the subject of several recent theoretical studies, many important questions related to adversarial robustness are still…

Machine Learning · Computer Science 2023-08-30 Pranjal Awasthi , Natalie S. Frank , Mehryar Mohri

We study diffusion control problems under parameter uncertainty. Controllers based on plug-in estimation can be brittle due to potential distribution shifts. Bayesian control with a prior on the parameters offers a formulation with beliefs…

Optimization and Control · Mathematics 2026-02-03 Jose Blanchet , Jiayi Cheng , Yuewei Ling , Hao Liu , Yang Liu

In safety-critical deep learning applications, robustness measures the ability of neural models that handle imperceptible perturbations in input data, which may lead to potential safety hazards. Existing pre-deployment robustness assessment…

Machine Learning · Computer Science 2025-08-27 Wenchuan Mu , Kwan Hui Lim

We introduce a probabilistic robustness measure for Bayesian Neural Networks (BNNs), defined as the probability that, given a test point, there exists a point within a bounded set such that the BNN prediction differs between the two. Such a…

Machine Learning · Computer Science 2019-03-06 Luca Cardelli , Marta Kwiatkowska , Luca Laurenti , Nicola Paoletti , Andrea Patane , Matthew Wicker

In Bayesian analysis, the posterior follows from the data and a choice of a prior and a likelihood. One hopes that the posterior is robust to reasonable variation in the choice of prior and likelihood, since this choice is made by the…

Methodology · Statistics 2015-12-09 Ryan Giordano , Tamara Broderick , Michael Jordan

We propose a general solution to the problem of robust Bayesian inference in complex settings where outliers may be present. In practice, the automation of robust Bayesian analyses is important in the many applications involving large and…

Methodology · Statistics 2022-04-15 Jeremie Houssineau , David J. Nott