English
Related papers

Related papers: Limits of Learning about a Categorical Latent Vari…

200 papers

It is well known that complete prior ignorance is not compatible with learning, at least in a coherent theory of (epistemic) uncertainty. What is less widely known, is that there is a state similar to full ignorance, that Walley calls…

Probability · Mathematics 2008-06-26 Alberto Piatti , Marco Zaffalon , Fabio Trojani , Marcus Hutter

In a standard Bayesian approach to the alpha-factor model for common-cause failure, a precise Dirichlet prior distribution models epistemic uncertainty in the alpha-factors. This Dirichlet prior is then updated with observed data to obtain…

Methodology · Statistics 2018-08-10 Matthias C. M. Troffaes , Gero Walter , Dana Kelly

Uncertainty quantification has received increasing attention in machine learning in the recent past. In particular, a distinction between aleatoric and epistemic uncertainty has been found useful in this regard. The latter refers to the…

Machine Learning · Computer Science 2022-10-14 Viktor Bengs , Eyke Hüllermeier , Willem Waegeman

Proper learning refers to the setting in which learners must emit predictors in the underlying hypothesis class $H$, and often leads to learners with simple algorithmic forms (e.g. empirical risk minimization (ERM), structural risk…

Machine Learning · Computer Science 2025-12-10 Julian Asilis , Siddartha Devic , Shaddin Dughmi , Vatsal Sharan , Shang-Hua Teng

The ideas of aleatoric and epistemic uncertainty are widely used to reason about the probabilistic predictions of machine-learning models. We identify incoherence in existing discussions of these ideas and suggest this stems from the…

Machine Learning · Computer Science 2025-08-19 Freddie Bickford Smith , Jannik Kossen , Eleanor Trollope , Mark van der Wilk , Adam Foster , Tom Rainforth

Uncertainty quantification is at the core of the reliability and robustness of machine learning. In this paper, we provide a theoretical framework to dissect the uncertainty, especially the \textit{epistemic} component, in deep learning…

Machine Learning · Computer Science 2023-06-21 Ziyi Huang , Henry Lam , Haofeng Zhang

In this paper we formulate the problem of inference under incomplete information in very general terms. This includes modelling the process responsible for the incompleteness, which we call the incompleteness process. We allow the process…

Artificial Intelligence · Computer Science 2014-01-16 Marco Zaffalon , Enrique Miranda

This paper develops a theory of learning under ambiguity induced by the decision maker's beliefs about the collection of data correlated with the true state of the world. Within our framework, two classical results on Bayesian learning…

Theoretical Economics · Economics 2026-02-10 Cheaheon Lim

Theoretically as well as experimentally it is investigated how people represent their knowledge in order to make decisions or to share their knowledge with others. Experiment 1 probes into the ways how people 6ather information about the…

Artificial Intelligence · Computer Science 2013-04-15 Alf C. Zimmer

Decision Focused Learning has emerged as a critical paradigm for integrating machine learning with downstream optimisation. Despite its promise, existing methodologies predominantly rely on probabilistic models and focus narrowly on task…

Machine Learning · Computer Science 2025-03-21 Keivan Shariatmadar , Neil Yorke-Smith , Ahmad Osman , Fabio Cuzzolin , Hans Hallez , David Moens

When ignorance due to the lack of knowledge, modeled as epistemic uncertainty using Dempster-Shafer structures on closed intervals, is present in the model parameters, a new uncertainty propagation method is necessary to propagate both…

Methodology · Statistics 2011-07-11 Gabriel Terejanu , Puneet Singla , Tarunraj Singh , Peter D. Scott

In context-specific applications such as robotics, telecommunications, and healthcare, artificial intelligence systems often face the challenge of limited training data. This scarcity introduces epistemic uncertainty, i.e., reducible…

Information Theory · Computer Science 2026-03-17 Osvaldo Simeone , Yaniv Romano

Despite AI's impressive achievements, including recent advances in generative and large language models, there remains a significant gap in the ability of AI systems to handle uncertainty and generalize beyond their training data. AI models…

Artificial Intelligence · Computer Science 2025-06-30 Shireen Kudukkil Manchingal , Andrew Bradley , Julian F. P. Kooij , Keivan Shariatmadar , Neil Yorke-Smith , Fabio Cuzzolin

We consider a weakly supervised learning scenario where the supervision signal is generated by a transition function $\sigma$ of labels associated with multiple input instances. We formulate this problem as \emph{multi-instance Partial…

Machine Learning · Computer Science 2024-07-16 Kaifu Wang , Efthymia Tsamoura , Dan Roth

Data-driven learning is generalized to consider history-dependent multi-fidelity data, while quantifying epistemic uncertainty and disentangling it from data noise (aleatoric uncertainty). This generalization is hierarchical and adapts to…

Machine Learning · Computer Science 2025-07-21 Jiaxiang Yi , Bernardo P. Ferreira , Miguel A. Bessa

In real-world scenarios, typical visual recognition systems could fail under two major causes, i.e., the misclassification between known classes and the excusable misbehavior on unknown-class images. To tackle these deficiencies, flexible…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Lei Fan , Bo Liu , Haoxiang Li , Ying Wu , Gang Hua

Prediction, where observed data is used to quantify uncertainty about a future observation, is a fundamental problem in statistics. Prediction sets with coverage probability guarantees are a common solution, but these do not provide…

Statistics Theory · Mathematics 2022-11-22 Leonardo Cella , Ryan Martin

Epistemic uncertainty arises in lack of complete knowledge about the state of a system. There are multiple mathematical frameworks for measuring such uncertainty quantitatively, often referred to as imprecise probability theories. Inspired…

Category Theory · Mathematics 2026-03-05 Torgeir Aambø

Characterizing aleatoric and epistemic uncertainty on the predicted rewards can help in building reliable reinforcement learning (RL) systems. Aleatoric uncertainty results from the irreducible environment stochasticity leading to…

Machine Learning · Computer Science 2022-06-06 Bertrand Charpentier , Ransalu Senanayake , Mykel Kochenderfer , Stephan Günnemann

Quantifying the uncertainty of supervised learning models plays an important role in making more reliable predictions. Epistemic uncertainty, which usually is due to insufficient knowledge about the model, can be reduced by collecting more…

Machine Learning · Computer Science 2022-01-27 Xinlei Zhou , Han Liu , Farhad Pourpanah , Tieyong Zeng , Xizhao Wang
‹ Prev 1 2 3 10 Next ›