English
Related papers

Related papers: Robustifying Empirical Bayes

200 papers

This paper addresses the issues of conservativeness and computational complexity of probabilistic robustness analysis. We solve both issues by defining a new sampling strategy and robustness measure. The new measure is shown to be much less…

Applications · Statistics 2008-05-12 Xinjia Chen , Kemin Zhou , Jorge L. Aravena

Explanation methods shed light on the decision process of black-box classifiers such as deep neural networks. But their usefulness can be compromised because they are susceptible to manipulations. With this work, we aim to enhance the…

Machine Learning · Computer Science 2020-12-21 Ann-Kathrin Dombrowski , Christopher J. Anders , Klaus-Robert Müller , Pan Kessel

Sparse modeling for signal processing and machine learning has been at the focus of scientific research for over two decades. Among others, supervised sparsity-aware learning comprises two major paths paved by: a) discriminative methods and…

Machine Learning · Statistics 2022-11-23 Lei Cheng , Feng Yin , Sergios Theodoridis , Sotirios Chatzis , Tsung-Hui Chang

This paper considers approximate smoothing for discretely observed non-linear stochastic differential equations. The problem is tackled by developing methods for linearising stochastic differential equations with respect to an arbitrary…

Methodology · Statistics 2019-01-21 Filip Tronarp , Simo Särkkä

We propose two novel approaches to the recovery of an (approximately) sparse signal from noisy linear measurements in the case that the signal is a priori known to be non-negative and obey given linear equality constraints, such as simplex…

Information Theory · Computer Science 2015-06-17 Jeremy Vila , Philip Schniter

In the Bayes paradigm and for a given loss function, we propose the construction of a new type of posterior distributions, that extends the classical Bayes one, for estimating the law of an $n$-sample. The loss functions we have in mind are…

Statistics Theory · Mathematics 2024-01-05 Yannick Baraud

We harness the power of Bayesian emulation techniques, designed to aid the analysis of complex computer models, to examine the structure of complex Bayesian analyses themselves. These techniques facilitate robust Bayesian analyses and/or…

Methodology · Statistics 2017-03-06 Ian Vernon , John Paul Gosling

In this study the common least-squares minimization approach is compared to the Bayesian updating procedure. In the content of material parameter identification the posterior parameter density function is obtained from its prior and the…

Data Analysis, Statistics and Probability · Physics 2024-08-12 Thomas Most

Currently available quantum computers suffer from constraints including hardware noise and a limited number of qubits. As such, variational quantum algorithms that utilise a classical optimiser in order to train a parameterised quantum…

Quantum Physics · Physics 2023-04-18 Samuel Duffield , Marcello Benedetti , Matthias Rosenkranz

We investigate the discrimination of two candidates of an unknown parameter in quantum systems with continuous weak measurement, inspired by the application of hypothesis testing in distinguish-ing two Hamiltonians [Kiilerich and M{\o}lmer,…

Quantum Physics · Physics 2019-07-24 Beili Gong , Wei Cui

The ordinary Bayes estimator based on the posterior density suffers from the potential problems of non-robustness under data contamination or outliers. In this paper, we consider the general set-up of independent but non-homogeneous (INH)…

Statistics Theory · Mathematics 2019-11-28 Tuhin Majumder , Ayanendranath Basu , Abhik Ghosh

Bayesian networks offer great potential for use in automating large scale diagnostic reasoning tasks. Gibbs sampling is the main technique used to perform diagnostic reasoning in large richly interconnected Bayesian networks. Unfortunately…

Artificial Intelligence · Computer Science 2013-02-21 Mark Hulme

Empirical Bayes (EB) is a popular framework for large-scale inference that aims to find data-driven estimators to compete with the Bayesian oracle that knows the true prior. Two principled approaches to EB estimation have emerged over the…

Statistics Theory · Mathematics 2024-11-21 Yandi Shen , Yihong Wu

The literature has proposed various robust alternatives to empirical risk minimisation to address failure modes such as distribution shift, label noise and finite-sample degeneracies. Examples include distributionally robust optimization,…

Machine Learning · Computer Science 2026-05-28 Jonas Hanselle , Valentin Margraf , Clemens Damke , Eyke Hüllermeier

Once upon a time, predictions for the accuracy of inference on gravitational-wave signals relied on computationally inexpensive but often inaccurate techniques. Recently, the approach has shifted to actual inference on noisy signals with…

Instrumentation and Methods for Astrophysics · Physics 2015-12-09 Carl-Johan Haster , Ilya Mandel , Will M. Farr

We study the rate of Bayesian consistency for hierarchical priors consisting of prior weights on a model index set and a prior on a density model for each choice of model index. Ghosal, Lember and Van der Vaart [2] have obtained general…

Statistics Theory · Mathematics 2008-09-23 Yang Xing

The fairness of a deep neural network is strongly affected by dataset bias and spurious correlations, both of which are usually present in modern feature-rich and complex visual datasets. Due to the difficulty and variability of the task,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Rebecca S Stone , Nishant Ravikumar , Andrew J Bulpitt , David C Hogg

Recently, impressive denoising results have been achieved by Bayesian approaches which assume Gaussian models for the image patches. This improvement in performance can be attributed to the use of per-patch models. Unfortunately such an…

Computer Vision and Pattern Recognition · Computer Science 2017-12-08 Cecilia Aguerrebere , Andrés Almansa , Julie Delon , Yann Gousseau , Pablo Musé

Time series forecasting is a challenging task due to the existence of complex and dynamic temporal dependencies. This can lead to incorrect predictions by even the best forecasting models. Using more training data is one way to improve the…

Machine Learning · Computer Science 2023-12-25 Sepideh Koohfar , Laura Dietz

Loss-based updating, including generalized Bayes, Gibbs, and quasi-posteriors, replaces likelihoods by a user-chosen loss and produces a posterior-like distribution via exponential tilt. We give a decision-theoretic characterization that…

Methodology · Statistics 2026-02-03 Kenichiro McAlinn , Kōsaku Takanashi