中文
相关论文

相关论文: Aleatoric and Epistemic Uncertainty with Random Fo…

200 篇论文

Random forests are a learning algorithm proposed by Breiman [Mach. Learn. 45 (2001) 5--32] that combines several randomized decision trees and aggregates their predictions by averaging. Despite its wide usage and outstanding practical…

统计理论 · 数学 2015-08-11 Erwan Scornet , Gérard Biau , Jean-Philippe Vert

Uncertainty quantification is at the core of the reliability and robustness of machine learning. In this paper, we provide a theoretical framework to dissect the uncertainty, especially the \textit{epistemic} component, in deep learning…

机器学习 · 计算机科学 2023-06-21 Ziyi Huang , Henry Lam , Haofeng Zhang

Trustworthy ML systems should not only return accurate predictions, but also a reliable representation of their uncertainty. Bayesian methods are commonly used to quantify both aleatoric and epistemic uncertainty, but alternative…

人工智能 · 计算机科学 2024-09-11 Mira Jürgens , Nis Meinert , Viktor Bengs , Eyke Hüllermeier , Willem Waegeman

Identifying and disentangling sources of predictive uncertainty is essential for trustworthy supervised learning. We argue that widely used second-order methods that disentangle aleatoric and epistemic uncertainty are fundamentally…

机器学习 · 计算机科学 2026-02-09 Sebastián Jiménez , Mira Jürgens , Willem Waegeman

Tree-based ensemble methods, as Random Forests and Gradient Boosted Trees, have been successfully used for regression in many applications and research studies. Furthermore, these methods have been extended in order to deal with uncertainty…

机器学习 · 计算机科学 2018-11-20 Myriam Tami , Marianne Clausel , Emilie Devijver , Adrien Dulac , Eric Gaussier , Stefan Janaqi , Meriam Chebre

Uncertainty quantification (UQ) is a critical aspect of artificial intelligence (AI) systems, particularly in high-risk domains such as healthcare, autonomous systems, and financial technology, where decision-making processes must account…

Exploration is a significant challenge in practical reinforcement learning (RL), and uncertainty-aware exploration that incorporates the quantification of epistemic and aleatory uncertainty has been recognized as an effective exploration…

机器学习 · 计算机科学 2024-01-08 Parvin Malekzadeh , Ming Hou , Konstantinos N. Plataniotis

Neural networks are ubiquitous in many tasks, but trusting their predictions is an open issue. Uncertainty quantification is required for many applications, and disentangled aleatoric and epistemic uncertainties are best. In this paper, we…

机器学习 · 计算机科学 2022-04-21 Matias Valdenegro-Toro , Daniel Saromo

The ability to acknowledge the inevitable uncertainty in their knowledge and reasoning is a prerequisite for AI systems to be truly truthful and reliable. In this paper, we present a taxonomy of uncertainty specific to vision-language AI…

人工智能 · 计算机科学 2024-07-03 Khyathi Raghavi Chandu , Linjie Li , Anas Awadalla , Ximing Lu , Jae Sung Park , Jack Hessel , Lijuan Wang , Yejin Choi

Artificial intelligence commonly refers to the science and engineering of artificial systems that can carry out tasks generally associated with requiring aspects of human intelligence, such as playing games, translating languages, and…

人工智能 · 计算机科学 2025-02-11 Andreas Krause , Jonas Hübotter

Decision Trees and Random Forests are among the most widely used machine learning models, and often achieve state-of-the-art performance in tabular, domain-agnostic datasets. Nonetheless, being primarily discriminative models they lack…

机器学习 · 统计学 2020-07-14 Alvaro H. C. Correia , Robert Peharz , Cassio de Campos

When collaborating with an AI system, we need to assess when to trust its recommendations. If we mistakenly trust it in regions where it is likely to err, catastrophic failures may occur, hence the need for Bayesian approaches for…

人工智能 · 计算机科学 2021-02-23 Federico Cerutti , Lance M. Kaplan , Angelika Kimmig , Murat Sensoy

Despite AI's impressive achievements, including recent advances in generative and large language models, there remains a significant gap in the ability of AI systems to handle uncertainty and generalize beyond their training data. AI models…

Combining machine learning with econometric analysis is becoming increasingly prevalent in both research and practice. A common empirical strategy involves the application of predictive modeling techniques to 'mine' variables of interest…

计量经济学 · 经济学 2020-12-22 Mochen Yang , Edward McFowland , Gordon Burtch , Gediminas Adomavicius

A random forest is a popular tool for estimating probabilities in machine learning classification tasks. However, the means by which this is accomplished is unprincipled: one simply counts the fraction of trees in a forest that vote for a…

机器学习 · 统计学 2018-12-17 Matthew A. Olson , Abraham J. Wyner

Real-world data contains aleatoric uncertainty - irreducible noise arising from imperfect measurements or from incomplete knowledge about the data generation process. Mean-variance estimation networks can learn this type of uncertainty but…

机器学习 · 计算机科学 2026-05-29 Jiaxiang Yi , Miguel A. Bessa

Neural networks are powerful tools in various applications, and quantifying their uncertainty is crucial for reliable decision-making. In the deep learning field, the uncertainties are usually categorized into aleatoric (data) and epistemic…

机器学习 · 计算机科学 2023-12-21 Wang Zhang , Ziwen Ma , Subhro Das , Tsui-Wei Weng , Alexandre Megretski , Luca Daniel , Lam M. Nguyen

Giving autonomous agents the ability to forecast their own outcomes and uncertainty will allow them to communicate their competencies and be used more safely. We accomplish this by using a learned world model of the agent system to forecast…

机器学习 · 计算机科学 2023-02-20 Aastha Acharya , Rebecca Russell , Nisar R. Ahmed

Representing and quantifying uncertainty in physical parameterisations is a central challenge in weather and climate modelling, and approaches are often developed separately for different timescales. Here, we introduce a unified framework…

大气与海洋物理 · 物理学 2025-12-01 Laura A. Mansfield , Hannah M. Christensen

Learning, whether natural or artificial, is a process of selection. It starts with a set of candidate options and selects the more successful ones. In the case of machine learning the selection is done based on empirical estimates of…

机器学习 · 计算机科学 2026-01-30 Yevgeny Seldin