English
Related papers

Related papers: Calibrating Healthcare AI: Towards Reliable and In…

200 papers

Recently, artificial intelligence and machine learning in general have demonstrated remarkable performances in many tasks, from image processing to natural language processing, especially with the advent of deep learning. Along with…

Machine Learning · Computer Science 2020-10-23 Erico Tjoa , Cuntai Guan

We study calibration in question answering, estimating whether model correctly predicts answer for each question. Unlike prior work which mainly rely on the model's confidence score, our calibrator incorporates information about the input…

Computation and Language · Computer Science 2021-06-04 Shujian Zhang , Chengyue Gong , Eunsol Choi

When predictive models are used to support complex and important decisions, the ability to explain a model's reasoning can increase trust, expose hidden biases, and reduce vulnerability to adversarial attacks. However, attempts at…

Machine Learning · Computer Science 2019-07-11 Dimitris Bertsimas , Arthur Delarue , Patrick Jaillet , Sebastien Martin

Machine learning applications often require calibrated predictions, e.g. a 90\% credible interval should contain the true outcome 90\% of the times. However, typical definitions of calibration only require this to hold on average, and offer…

Machine Learning · Statistics 2020-09-10 Shengjia Zhao , Tengyu Ma , Stefano Ermon

The field of machine learning has seen tremendous progress in recent years, with deep learning models delivering exceptional performance across a range of tasks. However, these models often come at the cost of interpretability, as they…

Machine Learning · Computer Science 2024-01-08 Shun Liu

Deep learning has emerged as a compelling solution to many NLP tasks with remarkable performances. However, due to their opacity, such models are hard to interpret and trust. Recent work on explaining deep models has introduced approaches…

Computation and Language · Computer Science 2019-05-21 Reza Ghaeini , Xiaoli Z. Fern , Hamed Shahbazi , Prasad Tadepalli

This paper explores the intricate relationship between interpretability and robustness in deep learning models. Despite their remarkable performance across various tasks, deep learning models often exhibit critical vulnerabilities,…

Machine Learning · Computer Science 2024-12-30 Navid Nayyem , Abdullah Rakin , Longwei Wang

We present an interpretable companion model for any pre-trained black-box classifiers. The idea is that for any input, a user can decide to either receive a prediction from the black-box model, with high accuracy but no explanations, or…

Machine Learning · Statistics 2020-02-12 Danqing Pan , Tong Wang , Satoshi Hara

We discuss our insights into interpretable artificial-intelligence (AI) models, and how they are essential in the context of developing ethical AI systems, as well as data-driven solutions compliant with the Sustainable Development Goals…

Machine Learning · Computer Science 2021-08-25 Ricardo Vinuesa , Beril Sirmacek

Equity is widely held to be fundamental to the ethics of healthcare. In the context of clinical decision-making, it rests on the comparative fidelity of the intelligence -- evidence-based or intuitive -- guiding the management of each…

Although deep reinforcement learning has become a promising machine learning approach for sequential decision-making problems, it is still not mature enough for high-stake domains such as autonomous driving or medical applications. In such…

Machine Learning · Computer Science 2022-02-25 Claire Glanois , Paul Weng , Matthieu Zimmer , Dong Li , Tianpei Yang , Jianye Hao , Wulong Liu

Decision analysis deals with modeling and enhancing decision processes. A principal challenge in improving behavior is in obtaining a transparent description of existing behavior in the first place. In this paper, we develop an expressive,…

Machine Learning · Statistics 2023-10-31 Daniel Jarrett , Alihan Hüyük , Mihaela van der Schaar

In an increasing number of applications designers have access to multiple computer models which typically have different levels of fidelity and cost. Traditionally, designers calibrate these models one at a time against some high-fidelity…

Machine Learning · Computer Science 2025-06-02 Jonathan Tammer Eweis-Labolle , Tyler Johnson , Xiangyu Sun , Ramin Bostanabad

Artificial Intelligence models are becoming increasingly more powerful and accurate, supporting or even replacing humans' decision making. But with increased power and accuracy also comes higher complexity, making it hard for users to…

Artificial Intelligence · Computer Science 2019-07-10 Vivian S. Silva , André Freitas , Siegfried Handschuh

Explainability is a longstanding challenge in deep learning, especially in high-stakes domains like healthcare. Common explainability methods highlight image regions that drive an AI model's decision. Humans, however, heavily rely on…

Artificial Intelligence · Computer Science 2023-11-21 Shobhit Agarwal , Yevgeniy R. Semenov , William Lotter

Mislabeled data is a pervasive issue that undermines the performance of machine learning systems in real-world applications. An effective approach to mitigate this problem is to detect mislabeled instances and subject them to special…

Machine Learning · Computer Science 2025-11-05 Ilies Chibane , Thomas George , Pierre Nodet , Vincent Lemaire

Artificial Intelligence (AI) models have demonstrated expert-level performance in melanoma detection, yet their clinical adoption is hindered by performance disparities across demographic subgroups such as gender, race, and age. Previous…

Machine Learning · Computer Science 2025-11-12 Brandon Dominique , Prudence Lam , Nicholas Kurtansky , Jochen Weber , Kivanc Kose , Veronica Rotemberg , Jennifer Dy

Healthcare requires AI that is predictive, reliable, and data-efficient. However, recent generative models lack physical foundation and temporal reasoning required for clinical decision support. As scaling language models show diminishing…

Machine Learning · Computer Science 2025-11-21 Mohammad Areeb Qazi , Maryam Nadeem , Mohammad Yaqub

High-stakes applications require AI-generated models to be interpretable. Current algorithms for the synthesis of potentially interpretable models rely on objectives or regularization terms that represent interpretability only coarsely…

Machine Learning · Computer Science 2021-04-28 Marco Virgolin , Andrea De Lorenzo , Francesca Randone , Eric Medvet , Mattias Wahde

AI is poised to revolutionize telecommunication networks by boosting efficiency, automation, and decision-making. However, the black-box nature of most AI models introduces substantial risk, possibly deterring adoption by network operators.…

Information Theory · Computer Science 2025-04-29 Osvaldo Simeone , Sangwoo Park , Matteo Zecchin