中文
相关论文

相关论文: If there is no underfitting, there is no Cold Post…

200 篇论文

In certain applications involving the solution of a Bayesian inverse problem, it may not be possible or desirable to evaluate the full posterior, e.g. due to the high computational cost of doing so. This problem motivates the use of…

统计理论 · 数学 2024-02-27 Han Cheng Lie , T. J. Sullivan , Aretha Teckentrup

Despite the impressive generalization capabilities of deep neural networks, they have been repeatedly shown to be overconfident when they are wrong. Fixing this issue is known as model calibration, and has consequently received much…

机器学习 · 计算机科学 2024-02-15 Muthu Chidambaram , Rong Ge

Conformal prediction (CP) is a wrapper around traditional machine learning models, giving coverage guarantees under the sole assumption of exchangeability; in classification problems, for a chosen significance level $\varepsilon$, CP…

机器学习 · 计算机科学 2023-02-23 Javier Abad , Umang Bhatt , Adrian Weller , Giovanni Cherubin

The inverse temperature parameter of the Potts model governs the strength of spatial cohesion and therefore has a major influence over the resulting model fit. A difficulty arises from the dependence of an intractable normalising constant…

统计计算 · 统计学 2018-08-20 Matthew T. Moores , Geoff K. Nicholls , Anthony N. Pettitt , Kerrie Mengersen

This work considers Bayesian inference under misspecification for complex statistical models comprised of simpler submodels, referred to as modules, that are coupled together. Such ``multi-modular" models often arise when combining…

统计理论 · 数学 2023-08-02 David T. Frazier , David J. Nott

Bayesian experimental design involves the optimal allocation of resources in an experiment, with the aim of optimising cost and performance. For implicit models, where the likelihood is intractable but sampling from the model is possible,…

机器学习 · 统计学 2019-02-26 Steven Kleinegesse , Michael Gutmann

Machine learning algorithms in socially sensitive domains (e.g., credit decisions) often focus on equalizing predictive outcomes. However, satisfying these metrics does not guarantee that models use the same reasoning for different groups.…

机器学习 · 计算机科学 2026-05-14 Gideon Popoola , John Sheppard

Convolutional neural networks (CNNs) work well on large datasets. But labelled data is hard to collect, and in some applications larger amounts of data are not available. The problem then is how to use CNNs with small data -- as CNNs…

机器学习 · 统计学 2016-01-19 Yarin Gal , Zoubin Ghahramani

As one of the most promising methods in self-supervised learning, contrastive learning has achieved a series of breakthroughs across numerous fields. A predominant approach to implementing contrastive learning is applying InfoNCE loss: By…

机器学习 · 计算机科学 2025-01-30 Bum Jun Kim , Sang Woo Kim

Thermal preferences vary from person to person and may change over time. The main objective of this paper is to sequentially pose intelligent queries to occupants in order to optimally learn the indoor air temperature values which maximize…

机器学习 · 计算机科学 2019-04-02 Nimish Awalgaonkar , Ilias Bilionis , Xiaoqi Liu , Panagiota Karava , Athanasios Tzempelikos

Under model misspecification, it is known that Bayesian posteriors often do not properly quantify uncertainty about true or pseudo-true parameters. Even more fundamentally, misspecification leads to a lack of reproducibility in the sense…

统计方法学 · 统计学 2023-11-06 Jonathan H. Huggins , Jeffrey W. Miller

Counterfactual Explanations (CEs) help address the question: How can the factors that influence the prediction of a predictive model be changed to achieve a more favorable outcome from a user's perspective? Thus, they bear the potential to…

机器学习 · 计算机科学 2023-11-27 Xuan Zhao , Klaus Broelemann , Gjergji Kasneci

Sequential neural posterior estimation (SNPE) techniques have been recently proposed for dealing with simulation-based models with intractable likelihoods. Unlike approximate Bayesian computation, SNPE techniques learn the posterior from…

机器学习 · 统计学 2025-01-17 Yifei Xiong , Xiliang Yang , Sanguo Zhang , Zhijian He

In applications of Bayesian procedures, once a class of priors has been chosen, it may be tempting to fix the prior's hyperparameters from the data, in an empirical Bayes (EB) fashion, usually by their maximum marginal likelihood estimates…

统计理论 · 数学 2026-04-14 Stefano Rizzelli , Judith Rousseau , Sonia Petrone

In this paper, we study the learning rate of generalized Bayes estimators in a general setting where the hypothesis class can be uncountable and have an irregular shape, the loss function can have heavy tails, and the optimal hypothesis may…

统计理论 · 数学 2021-11-22 Lam Si Tung Ho , Binh T. Nguyen , Vu Dinh , Duy Nguyen

Due to their uncertainty quantification, Bayesian solutions to inverse problems are the framework of choice in applications that are risk averse. These benefits come at the cost of computations that are in general, intractable. New advances…

机器学习 · 计算机科学 2024-05-10 Rafael Orozco , Ali Siahkoohi , Mathias Louboutin , Felix J. Herrmann

The posterior over Bayesian neural network (BNN) parameters is extremely high-dimensional and non-convex. For computational reasons, researchers approximate this posterior using inexpensive mini-batch methods such as mean-field variational…

机器学习 · 计算机科学 2021-04-30 Pavel Izmailov , Sharad Vikram , Matthew D. Hoffman , Andrew Gordon Wilson

Standard Bayesian inference is known to be sensitive to model misspecification, leading to unreliable uncertainty quantification and poor predictive performance. However, finding generally applicable and computationally feasible methods for…

统计方法学 · 统计学 2020-07-31 Jonathan H. Huggins , Jeffrey W. Miller

In the context of the expected-posterior prior (EPP) approach to Bayesian variable selection in linear models, we combine ideas from power-prior and unit-information-prior methodologies to simultaneously produce a minimally-informative…

统计计算 · 统计学 2015-04-27 Dimitris Fouskakis , Ioannis Ntzoufras , David Draper

Understanding the confidence with which a machine learning model classifies an input datum is an important, and perhaps under-investigated, concept. In this paper, we propose a new calibration metric, the Entropic Calibration Difference…

机器学习 · 计算机科学 2025-02-21 Daniel James Sumler , Lee Devlin , Simon Maskell , Richard O. Lane