中文
相关论文

相关论文: Universal Value-Function Uncertainties

200 篇论文

Reinforcement learning (RL) can be used to create a decision-making agent for autonomous driving. However, previous approaches provide only black-box solutions, which do not offer information on how confident the agent is about its…

机器人学 · 计算机科学 2023-04-18 Carl-Johan Hoel , Krister Wolff , Leo Laine

Neural networks (NNs) can achieved high performance in various fields such as computer vision, and natural language processing. However, deploying NNs in resource-constrained safety-critical systems has challenges due to uncertainty in the…

机器学习 · 计算机科学 2024-01-17 Soyed Tuhin Ahmed

Classical problems in computational physics such as data-driven forecasting and signal reconstruction from sparse sensors have recently seen an explosion in deep neural network (DNN) based algorithmic approaches. However, most DNN models do…

机器学习 · 计算机科学 2023-02-21 Romit Maulik , Romain Egele , Krishnan Raghavan , Prasanna Balaprakash

We consider the problem of detecting out-of-distribution (OOD) samples in deep reinforcement learning. In a value based reinforcement learning setting, we propose to use uncertainty estimation techniques directly on the agent's value…

机器学习 · 计算机科学 2019-01-09 Andreas Sedlmeier , Thomas Gabor , Thomy Phan , Lenz Belzner , Claudia Linnhoff-Popien

Modelling uncertainty in Machine Learning models is essential for achieving safe and reliable predictions. Most research on uncertainty focuses on output uncertainty (predictions), but minimal attention is paid to uncertainty at inputs. We…

机器学习 · 计算机科学 2024-06-28 Matias Valdenegro-Toro , Ivo Pascal de Jong , Marco Zullich

Representation learning has significantly driven the field to develop pretrained models that can act as a valuable starting point when transferring to new datasets. With the rising demand for reliable machine learning and uncertainty…

机器学习 · 计算机科学 2023-10-20 Michael Kirchhof , Bálint Mucsányi , Seong Joon Oh , Enkelejda Kasneci

Despite the recent improvements in overall accuracy, deep learning systems still exhibit low levels of robustness. Detecting possible failures is critical for a successful clinical integration of these systems, where each data point…

图像与视频处理 · 电气工程与系统科学 2019-10-14 Alain Jungo , Mauricio Reyes

Uncertainty estimation aims to evaluate the confidence of a trained deep neural network. However, existing uncertainty estimation approaches rely on low-dimensional distributional assumptions and thus suffer from the high dimensionality of…

机器学习 · 计算机科学 2023-10-26 Tsai Hor Chan , Kin Wai Lau , Jiajun Shen , Guosheng Yin , Lequan Yu

Model-based reinforcement learning (RL) offers a compelling approach to offline RL by enabling value learning on imagined on-policy trajectories. However, it often suffers from compounding errors due to repeated model inference on…

机器学习 · 计算机科学 2026-05-18 Hojun Chung , Junseo Lee , Songhwai Oh

Uncertainty is a key feature of any machine learning model and is particularly important in neural networks, which tend to be overconfident. This overconfidence is worrying under distribution shifts, where the model performance silently…

机器学习 · 计算机科学 2024-03-18 Arthur Thuy , Dries F. Benoit

Current person image retrieval methods have achieved great improvements in accuracy metrics. However, they rarely describe the reliability of the prediction. In this paper, we propose an Uncertainty-Aware Learning (UAL) method to remedy…

计算机视觉与模式识别 · 计算机科学 2022-10-25 Zhaopeng Dou , Zhongdao Wang , Weihua Chen , Yali Li , Shengjin Wang

Uncertainty quantification (UQ) is an important component of molecular property prediction, particularly for drug discovery applications where model predictions direct experimental design and where unanticipated imprecision wastes valuable…

机器学习 · 计算机科学 2020-05-21 Lior Hirschfeld , Kyle Swanson , Kevin Yang , Regina Barzilay , Connor W. Coley

Countless research works of deep neural networks (DNNs) in the task of credit card fraud detection have focused on improving the accuracy of point predictions and mitigating unwanted biases by building different network architectures or…

Uncertainty estimation in deep learning has become a leading research field in medical image analysis due to the need for safe utilisation of AI algorithms in clinical practice. Most approaches for uncertainty estimation require sampling…

图像与视频处理 · 电气工程与系统科学 2022-04-12 Kaisar Kushibar , Víctor Manuel Campello , Lidia Garrucho Moras , Akis Linardos , Petia Radeva , Karim Lekadir

Deep neural networks (DNNs) are powerful learning models yet their results are not always reliable. This is due to the fact that modern DNNs are usually uncalibrated and we cannot characterize their epistemic uncertainty. In this work, we…

计算机视觉与模式识别 · 计算机科学 2020-06-03 Gianni Franchi , Andrei Bursuc , Emanuel Aldea , Severine Dubuisson , Isabelle Bloch

Deep Neural Networks (DNNs) have demonstrated remarkable performance across various domains, including computer vision and natural language processing. However, they often struggle to accurately quantify the uncertainty of their…

机器学习 · 计算机科学 2025-11-14 Adrien Lafage , Olivier Laurent , Firas Gabetni , Gianni Franchi

We consider the problem of uncertainty estimation in the context of (non-Bayesian) deep neural classification. In this context, all known methods are based on extracting uncertainty signals from a trained network optimized to solve the…

机器学习 · 计算机科学 2019-04-25 Yonatan Geifman , Guy Uziel , Ran El-Yaniv

Most theoretically motivated work in the offline reinforcement learning setting requires precise uncertainty estimates. This requirement restricts the algorithms derived in that work to the tabular and linear settings where such estimates…

机器学习 · 计算机科学 2022-06-03 David Brandfonbrener , Remi Tachet des Combes , Romain Laroche

Image classification with neural networks (NNs) is widely used in industrial processes, situations where the model likely encounters unknown objects during deployment, i.e., out-of-distribution (OOD) data. Worryingly, NNs tend to make…

机器学习 · 计算机科学 2025-01-14 Arthur Thuy , Dries F. Benoit

Dealing with uncertainty is essential for efficient reinforcement learning. There is a growing literature on uncertainty estimation for deep learning from fixed datasets, but many of the most popular approaches are poorly-suited to…

机器学习 · 统计学 2018-11-16 Ian Osband , John Aslanides , Albin Cassirer