English
Related papers

Related papers: Source Invariance and Probabilistic Transfer: A Te…

200 papers

Uncertainty is a key feature of any machine learning model and is particularly important in neural networks, which tend to be overconfident. This overconfidence is worrying under distribution shifts, where the model performance silently…

Machine Learning · Computer Science 2024-03-18 Arthur Thuy , Dries F. Benoit

Parameter identification problems are formulated in a probabilistic language, where the randomness reflects the uncertainty about the knowledge of the true values. This setting allows conceptually easily to incorporate new information, e.g.…

Numerical Analysis · Computer Science 2013-03-19 Bojana V. Rosić , Anna Kučerová , Jan Sýkora , Oliver Pajonk , Alexander Litvinenko , Hermann G. Matthies

We introduce a method to measure uncertainty in large language models. For tasks like question answering, it is essential to know when we can trust the natural language outputs of foundation models. We show that measuring uncertainty in…

Computation and Language · Computer Science 2023-04-18 Lorenz Kuhn , Yarin Gal , Sebastian Farquhar

Estimating uncertainty of machine learning models is essential to assess the quality of the predictions that these models provide. However, there are several factors that influence the quality of uncertainty estimates, one of which is the…

Machine Learning · Computer Science 2022-11-03 Yuko Kato , David M. J. Tax , Marco Loog

Researchers in explainable artificial intelligence have developed numerous methods for helping users understand the predictions of complex supervised learning models. By contrast, explaining the $\textit{uncertainty}$ of model outputs has…

Machine Learning · Statistics 2023-11-01 David S. Watson , Joshua O'Hara , Niek Tax , Richard Mudd , Ido Guy

Due to lack of scientific understanding, some mechanisms may be missing in mathematical modeling of complex phenomena in science and engineering. These mathematical models thus contain some uncertainties such as uncertain parameters. One…

Probability · Mathematics 2012-04-05 Jinqiao Duan , Ting Gao , Guowei He

The ideas of aleatoric and epistemic uncertainty are widely used to reason about the probabilistic predictions of machine-learning models. We identify incoherence in existing discussions of these ideas and suggest this stems from the…

Machine Learning · Computer Science 2025-08-19 Freddie Bickford Smith , Jannik Kossen , Eleanor Trollope , Mark van der Wilk , Adam Foster , Tom Rainforth

Probabilistic graphical models are a powerful concept for modeling high-dimensional distributions. Besides modeling distributions, probabilistic graphical models also provide an elegant framework for performing statistical inference;…

Artificial Intelligence · Computer Science 2022-09-13 Christian Knoll

Learning representations that capture the underlying data generating process is a key problem for data efficient and robust use of neural networks. One key property for robustness which the learned representation should capture and which…

Machine Learning · Computer Science 2022-06-24 Mathieu Chevalley , Charlotte Bunne , Andreas Krause , Stefan Bauer

Estimating phylogenetic trees is an important problem in evolutionary biology, environmental policy and medicine. Although trees are estimated, their uncertainties are discarded by mathematicians working in tree space. Here we explicitly…

Methodology · Statistics 2017-10-16 Amy D. Willis , Rayna C. Bell

Uncertainty enters into human reasoning and inference in at least two ways. It is reasonable to suppose that there will be roles for these distinct uses of uncertainty also in automated reasoning.

Artificial Intelligence · Computer Science 2013-04-10 Henry E. Kyburg

The relationship between three probability distributions and their maximizable entropy forms is discussed without postulating entropy property. For this purpose, the entropy I is defined as a measure of uncertainty of the probability…

Statistical Mechanics · Physics 2020-10-28 Qiuping A. Wang

In recent years, there has been an increased need for the use of active systems - systems required to act automatically based on events, or changes in the environment. Such systems span many areas, from active databases to applications that…

Artificial Intelligence · Computer Science 2012-07-09 Segev Wasserkrug , Avigdor Gal , Opher Etzion

_Uncertainty expressions_ such as "probably" or "highly unlikely" are pervasive in human language. While prior work has established that there is population-level agreement in terms of how humans quantitatively interpret these expressions,…

Computation and Language · Computer Science 2024-11-08 Catarina G Belem , Markelle Kelly , Mark Steyvers , Sameer Singh , Padhraic Smyth

Animals perform near-optimal probabilistic inference in a wide range of psychophysical tasks. Probabilistic inference requires trial-to-trial representation of the uncertainties associated with task variables and subsequent use of this…

Neurons and Cognition · Quantitative Biology 2017-04-25 A. Emin Orhan , Wei Ji Ma

Recently, it has been emphasized that the possibility theory framework allows us to distinguish between i) what is possible because it is not ruled out by the available knowledge, and ii) what is possible for sure. This distinction may be…

Artificial Intelligence · Computer Science 2013-01-07 Salem Benferhat , Didier Dubois , Souhila Kaci , Henri Prade

Explainability and uncertainty quantification are key to trustable artificial intelligence. However, the reasoning behind uncertainty estimates is generally left unexplained. Identifying the drivers of uncertainty complements explanations…

Machine Learning · Computer Science 2025-05-13 Pascal Iversen , Simon Witzke , Katharina Baum , Bernhard Y. Renard

This paper addresses two main challenges facing systems neuroscience today: understanding the nature and function of a) cortical feedback between sensory areas and b) correlated variability. Starting from the old idea of perception as…

Neurons and Cognition · Quantitative Biology 2015-11-20 Ralf M. Haefner , Pietro Berkes , József Fiser

This paper exploits extended Bayesian networks for uncertainty reasoning on Petri nets, where firing of transitions is probabilistic. In particular, Bayesian networks are used as symbolic representations of probability distributions,…

Artificial Intelligence · Computer Science 2020-10-01 Rebecca Bernemann , Benjamin Cabrera , Reiko Heckel , Barbara König

Uncertainty representation and quantification are paramount in machine learning and constitute an important prerequisite for safety-critical applications. In this paper, we propose novel measures for the quantification of aleatoric and…

Machine Learning · Computer Science 2024-04-22 Paul Hofman , Yusuf Sale , Eyke Hüllermeier