English
Related papers

Related papers: Measuring Bayesian Robustness Using R\'enyi Diverg…

200 papers

We investigate the problem of learning Bayesian networks in a robust model where an $\epsilon$-fraction of the samples are adversarially corrupted. In this work, we study the fully observable discrete case where the structure of the network…

Data Structures and Algorithms · Computer Science 2018-10-30 Yu Cheng , Ilias Diakonikolas , Daniel Kane , Alistair Stewart

Although Bayesian inference is an immensely popular paradigm among a large segment of scientists including statisticians, most applications consider objective priors and need critical investigations (Efron, 2013, Science). While it has…

Statistics Theory · Mathematics 2020-09-11 Abhik Ghosh , Tuhin Majumder , Ayanendranath Basu

The robustness to the prior of Bayesian inference procedures based on a measure of statistical evidence are considered. These inferences are shown to have optimal properties with respect to robustness. Furthermore, a connection between…

Statistics Theory · Mathematics 2015-04-28 Luai Al-Labadi , Michael Evans

A method for implicit variable selection in mixture of experts frameworks is proposed. We introduce a prior structure where information is taken from a set of independent covariates. Robust class membership predictors are identified using a…

Econometrics · Economics 2019-01-15 Gregor Zens

We study convexity properties of R\'{e}nyi entropy as function of $\alpha>0$ on finite alphabets. We also describe robustness of the R\'{e}nyi entropy on finite alphabets, and it turns out that the rate of respective convergence depends on…

Probability · Mathematics 2021-03-09 Filipp Buryak , Yuliya Mishura

One possibility of defining a quantum R\'enyi $\alpha$-divergence of two quantum states is to optimize the classical R\'enyi $\alpha$-divergence of their post-measurement probability distributions over all possible measurements (measured…

Quantum Physics · Physics 2023-01-18 Milán Mosonyi , Fumio Hiai

In the realm of supervised learning, Bayesian learning has shown robust predictive capabilities under input and parameter perturbations. Inspired by these findings, we demonstrate the robustness properties of Bayesian learning in the…

Machine Learning · Computer Science 2022-05-17 Nardos Ayele Ashenafi , Wankun Sirichotiyakul , Aykut C. Satici

We propose a robust Bayesian formulation of random feature (RF) regression that accounts explicitly for prior and likelihood misspecification via Huber-style contamination sets. Starting from the classical equivalence between…

Machine Learning · Computer Science 2026-02-24 Michele Caprio , Katerina Papagiannouli , Siu Lun Chau , Sayan Mukherjee

The class of dual $\phi$-divergence estimators (introduced in Broniatowski and Keziou (2009) is explored with respect to robustness through the influence function approach. For scale and location models, this class is investigated in terms…

Statistics Theory · Mathematics 2009-12-15 Aida Toma , Michel Broniatowski

We study the problem of certifying the robustness of Bayesian neural networks (BNNs) to adversarial input perturbations. Given a compact set of input points $T \subseteq \mathbb{R}^m$ and a set of output points $S \subseteq \mathbb{R}^n$,…

Machine Learning · Computer Science 2023-06-26 Matthew Wicker , Andrea Patane , Luca Laurenti , Marta Kwiatkowska

This paper develops a quantitative framework to assess the robustness of Bayes-optimal decisions in finite decision problems under model uncertainty. We introduce two complementary stability notions for acts: the robustness radius,…

Methodology · Statistics 2026-05-12 Christoph Jansen , Georg Schollmeyer

This paper studies the influence of perturbations of conjugate priors in Bayesian inference. A perturbed prior is defined inside a larger family, local mixture models, and the effect on posterior inference is studied. The perturbation, in…

Methodology · Statistics 2015-09-01 Vahed Maroufy , Paul Marriott

Although linear regression models are fundamental tools in statistical science, the estimation results can be sensitive to outliers. While several robust methods have been proposed in frequentist frameworks, statistical inference is not…

Methodology · Statistics 2020-07-15 Shintaro Hashimoto , Shonosuke Sugasawa

This paper is concerned with Bayesian inferential methods for data from controlled branching processes that account for model robustness through the use of disparities. Under regularity conditions, we establish that estimators built on…

Methodology · Statistics 2018-02-19 M. González , C. Minuesa , I. del Puerto , A. N. Vidyashankar

The random variable simulation problem consists in using a $k$-dimensional i.i.d. random vector $X^{k}$ with distribution $P_{X}^{k}$ to simulate an $n$-dimensional i.i.d. random vector $Y^{n}$ so that its distribution is approximately…

Information Theory · Computer Science 2018-12-24 Lei Yu , Vincent Y. F. Tan

Bayesian hierarchical models are increasing popular in economics. When using hierarchical models, it is useful not only to calculate posterior expectations, but also to measure the robustness of these expectations to reasonable alternative…

Machine Learning · Statistics 2016-06-24 Ryan Giordano , Tamara Broderick , Rachael Meager , Jonathan Huggins , Michael Jordan

The robustness of classifiers has become a question of paramount importance in the past few years. Indeed, it has been shown that state-of-the-art deep learning architectures can easily be fooled with imperceptible changes to their inputs.…

Computer Vision and Pattern Recognition · Computer Science 2020-06-12 Théo Giraudon , Vincent Gripon , Matthias Löwe , Franck Vermet

In this paper we criticize the robustness measure traditionally employed to assess the performance of machine learning models deployed in adversarial settings. To mitigate the limitations of robustness, we introduce a new measure called…

Machine Learning · Computer Science 2021-12-07 Stefano Calzavara , Lorenzo Cazzaro , Claudio Lucchese , Federico Marcuzzi , Salvatore Orlando

We propose a novel approach to Bayesian analysis that is provably robust to outliers in the data and often has computational advantages over standard methods. Our technique is based on splitting the data into non-overlapping subgroups,…

Statistics Theory · Mathematics 2016-06-03 Stanislav Minsker , Sanvesh Srivastava , Lizhen Lin , David B. Dunson

Robust Mixture Prior (RMP) is a popular Bayesian dynamic borrowing method, which combines an informative historical distribution with a less informative component (referred as robustification component) in a mixture prior to enhance the…

Methodology · Statistics 2026-03-18 Marco Ratta , Gaelle Saint-Hilary , Mauro Gasparini , Pavel Mozgunov