English
Related papers

Related papers: Bayesian Active Learning in the Presence of Nuisan…

200 papers

Uncertainty-aware machine learners, such as Bayesian neural networks, output a quantification of uncertainty instead of a point prediction. We provide uncertainty-aware learners with a principled framework to characterize, and identify ways…

Machine Learning · Computer Science 2026-04-01 Sabina J. Sloman , Michele Caprio , Samuel Kaski

Learning data representations that capture task-related features, but are invariant to nuisance variations remains a key challenge in machine learning. We introduce an automated Bayesian inference framework, called AutoBayes, that explores…

Machine Learning · Computer Science 2020-12-01 Andac Demir , Toshiaki Koike-Akino , Ye Wang , Deniz Erdogmus

Active learning is a framework for supervised learning to improve the predictive performance by adaptively annotating a small number of samples. To realize efficient active learning, both an acquisition function that determines the next…

Machine Learning · Statistics 2021-04-12 Hideaki Ishibashi , Hideitsu Hino

For many nonlinear Bayesian state estimation problems, the posterior recursion is not analytically tractable, leading to algorithms that are influenced by numerical approximation errors. These algorithms depend on parameters that affect the…

Systems and Control · Electrical Eng. & Systems 2026-05-14 Ondrej Straka , Felipe Giraldo-Grueso , Renato Zanetti

The traditional statistical inference is static, in the sense that the estimate of the quantity of interest does not affect the future evolution of the quantity. In some sequential estimation problems however, the future values of the…

Machine Learning · Computer Science 2023-01-03 Aolin Xu , Peng Guan

Bias in classifiers is a severe issue of modern deep learning methods, especially for their application in safety- and security-critical areas. Often, the bias of a classifier is a direct consequence of a bias in the training dataset,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Christian Reimers , Paul Bodesheim , Jakob Runge , Joachim Denzler

We address the common problem of calculating intervals in the presence of systematic uncertainties. We aim to investigate several approaches, but here describe just a Bayesian technique for setting upper limits. The particular example we…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Joel Heinrich , Craig Blocker , John Conway , Luc Demortier , Louis Lyons , Giovanni Punzi , Pekka K. Sinervo

One of the main challenges of deep learning tools is their inability to capture model uncertainty. While Bayesian deep learning can be used to tackle the problem, Bayesian neural networks often require more time and computational power to…

Machine Learning · Computer Science 2020-10-20 Jiaming Zeng , Adam Lesnikowski , Jose M. Alvarez

Neural networks have achieved remarkable performance across various problem domains, but their widespread applicability is hindered by inherent limitations such as overconfidence in predictions, lack of interpretability, and vulnerability…

Machine Learning · Statistics 2023-09-29 Julyan Arbel , Konstantinos Pitas , Mariia Vladimirova , Vincent Fortuin

What happens to the optimal interpretation of noisy data when there exists more than one equally plausible interpretation of the data? In a Bayesian model-learning framework the answer depends on the prior expectations of the dynamics of…

Other Quantitative Biology · Quantitative Biology 2007-05-23 Gurinder Singh Atwal , William Bialek

The transferability of adversarial examples allows for the attack on unknown deep neural networks (DNNs), posing a serious threat to many applications and attracting great attention. In this paper, we improve the transferability of…

Machine Learning · Computer Science 2025-10-16 Qizhang Li , Yiwen Guo , Xiaochen Yang , Wangmeng Zuo , Hao Chen

In recent times, neural networks have become a powerful tool for the analysis of complex and abstract data models. However, their introduction intrinsically increases our uncertainty about which features of the analysis are model-related…

Machine Learning · Statistics 2020-11-09 Tom Charnock , Laurence Perreault-Levasseur , François Lanusse

This paper provides an introduction to Double/Debiased Machine Learning (DML). DML is a general approach to performing inference about a target parameter in the presence of nuisance functions: objects that are needed to identify the target…

Distance metric learning is an important component for many tasks, such as statistical classification and content-based image retrieval. Existing approaches for learning distance metrics from pairwise constraints typically suffer from two…

Machine Learning · Computer Science 2012-06-26 Liu Yang , Rong Jin , Rahul Sukthankar

In supervised learning, acquiring labeled training data for a predictive model can be very costly, but acquiring a large amount of unlabeled data is often quite easy. Active learning is a method of obtaining predictive models with high…

Machine Learning · Computer Science 2020-12-17 Hideitsu Hino

The classic Bayesian persuasion model assumes a Bayesian and best-responding receiver. We study a relaxation of the Bayesian persuasion model where the receiver can approximately best respond to the sender's signaling scheme. We show that,…

Computer Science and Game Theory · Computer Science 2024-02-23 Yiling Chen , Tao Lin

In a statistical analysis in Particle Physics, nuisance parameters can be introduced to take into account various types of systematic uncertainties. The best estimate of such a parameter is often modeled as a Gaussian distributed variable…

Data Analysis, Statistics and Probability · Physics 2019-02-25 Glen Cowan

Active learning methods for neural networks are usually based on greedy criteria which ultimately give a single new design point for the evaluation. Such an approach requires either some heuristics to sample a batch of design points at one…

Machine Learning · Computer Science 2020-01-28 Evgenii Tsymbalov , Sergei Makarychev , Alexander Shapeev , Maxim Panov

Adding domain knowledge to a learning system is known to improve results. In multi-parameter Bayesian frameworks, such knowledge is incorporated as a prior. On the other hand, various model parameters can have different learning rates in…

Machine Learning · Computer Science 2022-06-22 Sareh Nabi , Houssam Nassif , Joseph Hong , Hamed Mamani , Guido Imbens

Bayesian active learning relies on the precise quantification of predictive uncertainty to explore unknown function landscapes. While Gaussian process surrogates are the standard for such tasks, an underappreciated fact is that their…

Machine Learning · Computer Science 2026-02-03 Sanna Jarl , Maria Bånkestad , Jonathan J. S. Scragg , Jens Sjölund