English
Related papers

Related papers: Measuring Bayesian Robustness Using R\'enyi Diverg…

200 papers

We consider the well-posedness of Bayesian inverse problems when the prior measure has exponential tails. In particular, we consider the class of convex (log-concave) probability measures which include the Gaussian and Besov measures as…

Probability · Mathematics 2017-02-27 Bamdad Hosseini , Nilima Nigam

It is becoming increasingly important to understand the vulnerability of machine learning models to adversarial attacks. One of the fundamental problems in adversarial machine learning is to quantify how much training data is needed in the…

Machine Learning · Computer Science 2023-08-24 Pascale Gourdeau

The prevalence of one-shot devices is quite prolific in engineering and medical domains. Unlike typical one-shot devices, nondestructive one-shot devices (NOSD) may survive multiple tests and offer additional data for reliability…

Methodology · Statistics 2025-02-11 Shanya Baghel , Shuvashree Mondal

In this paper the Bayesian analysis is applied to assign a probability density to the value of a quantity having a definite sign. This analysis is logically consistent with the results, positive or negative, of repeated measurements.…

Methodology · Statistics 2009-11-13 D Calonico , F Levi , L Lorini , G Mana

While additional training data improves the robustness of deep neural networks against adversarial examples, it presents the challenge of curating a large number of specific real-world samples. We circumvent this challenge by using…

Machine Learning · Computer Science 2022-03-04 Vikash Sehwag , Saeed Mahloujifar , Tinashe Handina , Sihui Dai , Chong Xiang , Mung Chiang , Prateek Mittal

When using Bayesian inference to support conservative software reliability assessments, it is useful to consider a collection of Bayesian inference problems, with the aim of determining the worst-case value (from this collection) for a…

Applications · Statistics 2025-11-11 Kizito Salako , Rabiu Tsoho Muhammad

Local sensitivity diagnostics for Bayesian models are described that are analogues of frequentist measures of leverage and influence. The diagnostics are simple to calculate using MCMC. A comparison between leverage and influence allows a…

Methodology · Statistics 2025-03-27 Martyn Plummer

A robust estimation framework for binary regression models is studied, aiming to extend traditional approaches like logistic regression models. While previous studies largely focused on logistic models, we explore a broader class of models…

Methodology · Statistics 2025-02-24 Kenichi Hayashi , Shinto Eguchi

Bayesian shrinkage methods have generated a lot of recent interest as tools for high-dimensional regression and model selection. These methods naturally facilitate tractable uncertainty quantification and incorporation of prior information.…

Methodology · Statistics 2017-04-21 Bala Rajaratnam , Doug Sparks , Kshitij Khare , Liyuan Zhang

We describe different Bayesian ensemble refinement methods, examine their interrelation, and discuss their practical application. With ensemble refinement, the properties of dynamic and partially disordered (bio)molecular structures can be…

Data Analysis, Statistics and Probability · Physics 2016-01-20 Gerhard Hummer , Jürgen Köfinger

We study robust estimators of the mean of a probability measure $P$, called robust empirical mean estimators. This elementary construction is then used to revisit a problem of aggregation and a problem of estimator selection, extending…

Statistics Theory · Mathematics 2021-07-05 M. Lerasle , R. I. Oliveira

The measurement of the efficiency of an event selection is always an important part of the analysis of experimental data. The statistical techniques which are needed to determine the efficiency and its uncertainty are reviewed. Frequentist…

Data Analysis, Statistics and Probability · Physics 2012-08-28 Diego Casadei

We develop the \textit{a posteriori} error analysis of three mixed finite element formulations for rotation-based equations in elasticity, poroelasticity, and interfacial elasticity-poroelasticity. The discretisations use $H^1$-conforming…

Numerical Analysis · Mathematics 2021-06-18 VerÓnica Anaya , Arbaz Khan , David Mora , Ricardo Ruiz-Baier

R\'enyi divergences play a pivotal role in information theory, statistics, and machine learning. While several estimators of these divergences have been proposed in the literature with their consistency properties established and minimax…

Information Theory · Computer Science 2025-09-12 Sreejith Sreekumar , Kengo Kato

Learning unbiased models on imbalanced datasets is a significant challenge. Rare classes tend to get a concentrated representation in the classification space which hampers the generalization of learned boundaries to new test examples. In…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Salman Khan , Munawar Hayat , Waqas Zamir , Jianbing Shen , Ling Shao

Conditions for Bayesian posterior robustness have been examined in recent literature. However, many of the proofs seem to be long and complicated. In this paper, we first summarize some basic lemmas that have been applied implicitly or…

Statistics Theory · Mathematics 2023-11-06 Yasuyuki Hamura

We study stability properties of the expected utility function in Bayesian optimal experimental design. We provide a framework for this problem in a non-parametric setting and prove a convergence rate of the expected utility with respect to…

Statistics Theory · Mathematics 2023-11-07 Duc-Lam Duong , Tapio Helin , Jose Rodrigo Rojo-Garcia

While it has long been empirically observed that adversarial robustness may be at odds with standard accuracy and may have further disparate impacts on different classes, it remains an open question to what extent such observations hold and…

Machine Learning · Computer Science 2023-05-30 Yuzheng Hu , Fan Wu , Hongyang Zhang , Han Zhao

Both the Bayes factor and the relative belief ratio satisfy the principle of evidence and so can be seen to be valid measures of statistical evidence. Certainly Bayes factors are regularly employed. The question then is: which of these…

Statistics Theory · Mathematics 2024-02-28 Luai Al-Labadi , Ayman Alzaatreh , Michael Evans

The $\gamma$-divergence is well-known for having strong robustness against heavy contamination. By virtue of this property, many applications via the $\gamma$-divergence have been proposed. There are two types of \gd\ for regression…

Statistics Theory · Mathematics 2026-05-15 Takayuki Kawashima , Hironori Fujisawa