English
Related papers

Related papers: Risk-aware Classification via Uncertainty Quantifi…

200 papers

Existing safety evaluation methods for large language models (LLMs) suffer from inherent limitations, including evaluator bias and detection failures arising from model homogeneity, which collectively undermine the robustness of risk…

Artificial Intelligence · Computer Science 2025-10-24 Xiuyuan Chen , Jian Zhao , Yuchen Yuan , Tianle Zhang , Huilin Zhou , Zheng Zhu , Ping Hu , Linghe Kong , Chi Zhang , Weiran Huang , Xuelong Li

Neural networks (NNs) lack measures of "reliability" estimation that would enable reasoning over their predictions. Despite the vital importance, especially in areas of human well-being and health, state-of-the-art uncertainty estimation…

Machine Learning · Computer Science 2021-02-12 Lorena Qendro , Jagmohan Chauhan , Alberto Gil C. P. Ramos , Cecilia Mascolo

In this paper, we leverage predictive uncertainty of deep neural networks to answer challenging questions material scientists usually encounter in machine learning based materials applications workflows. First, we show that by leveraging…

Materials Science · Physics 2021-04-26 Jize Zhang , Bhavya Kailkhura , T. Yong-Jin Han

Over recent years, there has been a rapid development of deep learning (DL) in both industry and academia fields. However, finding the optimal hyperparameters of a DL model often needs high computational cost and human expertise. To…

Neural and Evolutionary Computing · Computer Science 2022-08-24 Nan Li , Lianbo Ma , Guo Yu , Bing Xue , Mengjie Zhang , Yaochu Jin

In this work, we introduce a novel Deep Learning-based method to perceive the environment of a vehicle based on radar scans while accounting for uncertainties in its predictions. The environment of the host vehicle is segmented into equally…

Machine Learning · Computer Science 2023-06-06 Marco Braun , Moritz Luszek , Jan Siegemund , Kevin Kollek , Anton Kummert

Deploying machine learning models in safety-related do-mains (e.g. autonomous driving, medical diagnosis) demands for approaches that are explainable, robust against adversarial attacks and aware of the model uncertainty. Recent deep…

Computer Vision and Pattern Recognition · Computer Science 2020-12-14 Jan Kronenberger , Anselm Haselhoff

Reliable Large Language Models (LLMs) should abstain when confidence is insufficient. However, prior studies often treat refusal as a generic "I don't know'', failing to distinguish input-level ambiguity (data uncertainty) from capability…

Computation and Language · Computer Science 2026-04-21 Jingyi Ren , Ante Wang , Yunghwei Lai , Xiaolong Wang , Linlu Gong , Weitao Li , Weizhi Ma , Yang Liu

Uncertainty Quantification (UQ) presents a pivotal challenge in the field of Artificial Intelligence (AI), profoundly impacting decision-making, risk assessment and model reliability. In this paper, we introduce Credal and Interval Deep…

Machine Learning · Computer Science 2025-12-08 Michele Caprio , Shireen K. Manchingal , Fabio Cuzzolin

Accurate reconstruction of environmental scalar fields from sparse onboard observations is essential for autonomous vehicles engaged in aquatic monitoring. Beyond point estimates, principled uncertainty quantification is critical for active…

Accurate uncertainty quantification remains a key challenge for standard LLMs, prompting the adoption of Bayesian and ensemble-based methods. However, such methods typically necessitate computationally expensive sampling, involving multiple…

Machine Learning · Computer Science 2025-07-25 Lakshmana Sri Harsha Nemani , P. K. Srijith , Tomasz Kuśmierczyk

Deep Learning sets the state-of-the-art in many challenging tasks showing outstanding performance in a broad range of applications. Despite its success, it still lacks robustness hindering its adoption in medical applications. Modeling…

Computer Vision and Pattern Recognition · Computer Science 2019-09-19 Agnieszka Tomczack , Nassir Navab , Shadi Albarqouni

Reliably predicting potential failure risks of machine learning (ML) systems when deployed with production data is a crucial aspect of trustworthy AI. This paper introduces Risk Advisor, a novel post-hoc meta-learner for estimating failure…

Machine Learning · Computer Science 2021-09-10 Preethi Lahoti , Krishna P. Gummadi , Gerhard Weikum

Deep neural networks has been increasingly applied in fault diagnostics, where it uses historical data to capture systems behavior, bypassing the need for high-fidelity physical models. However, despite their competence in prediction tasks,…

Machine Learning · Computer Science 2025-09-24 Arman Mohammadi , Mattias Krysander , Daniel Jung , Erik Frisk

The current expansion of theory and research on artificial intelligence in management and organization studies has revitalized the theory and research on decision-making in organizations. In particular, recent advances in deep learning (DL)…

Machine Learning · Computer Science 2020-11-06 Yash Raj Shrestha , Vaibhav Krishna , Georg von Krogh

A significant limitation of one-class classification anomaly detection methods is their reliance on the assumption that unlabeled training data only contains normal instances. To overcome this impractical assumption, we propose two novel…

Machine Learning · Computer Science 2023-09-04 Le Thi Khanh Hien , Sukanya Patra , Souhaib Ben Taieb

We propose a risk-aware framework for multi-robot, multi-demand assignment and planning in unknown environments. Our motivation is disaster response and search-and-rescue scenarios where ground vehicles must reach demand locations as soon…

Robotics · Computer Science 2020-09-04 Vishnu D. Sharma , Maymoonah Toubeh , Lifeng Zhou , Pratap Tokekar

Machine-learning-based entity resolution has been widely studied. However, some entity pairs may be mislabeled by machine learning models and existing studies do not study the risk analysis problem -- predicting and interpreting which…

Databases · Computer Science 2019-12-09 Zhaoqiang Chen , Qun Chen , Boyi Hou , Tianyi Duan , Zhanhuai Li , Guoliang Li

Existing semi-supervised medical segmentation co-learning frameworks have realized that model performance can be diminished by the biases in model recognition caused by low-quality pseudo-labels. Due to the averaging nature of their…

Image and Video Processing · Electrical Eng. & Systems 2025-05-20 Yuanpeng He , Yali Bi , Lijian Li , Chi-Man Pun , Wenpin Jiao , Zhi Jin

Recent advancements in autonomous vehicles (AVs) use Large Language Models (LLMs) to perform well in normal driving scenarios. However, ensuring safety in dynamic, high-risk environments and managing safety-critical long-tail events remain…

Artificial Intelligence · Computer Science 2024-12-20 Zhiyuan Zhou , Heye Huang , Boqi Li , Shiyue Zhao , Yao Mu , Jianqiang Wang

While the state-of-the-art performance on entity resolution (ER) has been achieved by deep learning, its effectiveness depends on large quantities of accurately labeled training data. To alleviate the data labeling burden, Active Learning…

Machine Learning · Computer Science 2020-12-25 Youcef Nafa , Qun Chen , Zhaoqiang Chen , Xingyu Lu , Haiyang He , Tianyi Duan , Zhanhuai Li