English
Related papers

Related papers: Estimation of Concept Explanations Should be Uncer…

200 papers

Transparency, user trust, and human comprehension are popular ethical motivations for interpretable machine learning. In support of these goals, researchers evaluate model explanation performance using humans and real world applications.…

Artificial Intelligence · Computer Science 2019-10-31 Bernease Herman

We take inspiration from the study of human explanation to inform the design and evaluation of interpretability methods in machine learning. First, we survey the literature on human explanation in philosophy, cognitive science, and the…

Artificial Intelligence · Computer Science 2021-09-21 David Alvarez-Melis , Harmanpreet Kaur , Hal Daumé , Hanna Wallach , Jennifer Wortman Vaughan

Software project development process is requiring accurate software cost and schedule estimation for achieve goal or success. A lot it referred to as the "Intricate brainteaser" because of its conscience attribute which is impact by…

Software Engineering · Computer Science 2015-03-12 Kardile Vilas Vasantrao

Supporting model interpretability for complex phenomena where annotators can legitimately disagree, such as emotion recognition, is a challenging machine learning task. In this work, we show that explicitly quantifying the uncertainty in…

Machine Learning · Computer Science 2019-10-08 Asma Ghandeharioun , Brian Eoff , Brendan Jou , Rosalind W. Picard

For applications of machine learning in critical decisions, explainability is a primary concern, and often a regulatory requirement. Local linear methods for generating explanations, such as LIME and SHAP, have been criticized for being…

Machine Learning · Computer Science 2026-03-25 Joseph L. Breeden

Artificial Intelligence (AI), and in particular, the explainability thereof, has gained phenomenal attention over the last few years. Whilst we usually do not question the decision-making process of these systems in situations where only…

Artificial Intelligence · Computer Science 2021-01-29 Iena Petronella Derks , Alta de Waal

Evaluating off-policy decisions using batch data poses significant challenges due to limited sample sizes leading to high variance. To improve Off-Policy Evaluation (OPE), we must identify and address the sources of this variance. Recent…

Machine Learning · Statistics 2024-12-02 Ritam Majumdar , Jack Teversham , Sonali Parbhoo

Techniques for understanding the functioning of complex machine learning models are becoming increasingly popular, not only to improve the validation process, but also to extract new insights about the data via exploratory analysis. Though…

Machine Learning · Statistics 2018-11-02 Jayaraman J. Thiagarajan , Irene Kim , Rushil Anirudh , Peer-Timo Bremer

Survival models are used in various fields, such as the development of cancer treatment protocols. Although many statistical and machine learning models have been proposed to achieve accurate survival predictions, little attention has been…

Machine Learning · Computer Science 2020-03-26 Hrushikesh Loya , Pranav Poduval , Deepak Anand , Neeraj Kumar , Amit Sethi

Explainable AI has become a common term in the literature, scrutinized by computer scientists and statisticians and highlighted by psychological or philosophical researchers. One major effort many researchers tackle is constructing general…

Artificial Intelligence · Computer Science 2025-09-12 Carina Newen , Daniel Bodemer , Sonja Glantz , Emmanuel Müller , Magdalena Wischnewski , Lenka Schnaubert

Artificial neural networks will always make a prediction, even when completely uncertain and regardless of the consequences. This obliviousness of uncertainty is a major obstacle towards their adoption in practice. Techniques exist,…

Machine Learning · Computer Science 2021-05-13 Hans Weytjens , Jochen De Weerdt

As large language models (LLMs) continue to evolve, understanding and quantifying the uncertainty in their predictions is critical for enhancing application credibility. However, the existing literature relevant to LLM uncertainty…

Computation and Language · Computer Science 2024-10-22 Hsiu-Yuan Huang , Yutong Yang , Zhaoxi Zhang , Sanwoo Lee , Yunfang Wu

We consider the problem of assigning a meaningful degree of belief to uncertainty estimates of perturbative series. We analyse the assumptions which are implicit in the conventional estimates made using renormalisation scale variations. We…

High Energy Physics - Phenomenology · Physics 2011-09-26 Matteo Cacciari , Nicolas Houdeau

Predictions of uncertainty-aware models are diverse, ranging from single point estimates (often averaged over prediction samples) to predictive distributions, to set-valued or credal-set representations. We propose a novel unified…

Machine Learning · Computer Science 2025-02-18 Shireen Kudukkil Manchingal , Muhammad Mubashar , Kaizheng Wang , Fabio Cuzzolin

The ubiquity of machine learning based predictive models in modern society naturally leads people to ask how trustworthy those models are? In predictive modeling, it is quite common to induce a trade-off between accuracy and…

Machine Learning · Computer Science 2019-04-05 John Mitros , Brian Mac Namee

Interpreting the inner function of neural networks is crucial for the trustworthy development and deployment of these black-box models. Prior interpretability methods focus on correlation-based measures to attribute model decisions to…

Machine Learning · Computer Science 2023-06-21 Ola Ahmad , Nicolas Bereux , Loïc Baret , Vahid Hashemi , Freddy Lecue

Neural networks make accurate predictions but often fail to provide reliable uncertainty estimates, especially under covariate distribution shifts between training and testing. To address this problem, we propose a Bayesian framework for…

Machine Learning · Statistics 2025-12-22 Yuli Slavutsky , David M. Blei

While explainability is a desirable characteristic of increasingly complex black-box models, modern explanation methods have been shown to be inconsistent and contradictory. The semantics of explanations is not always fully understood - to…

Artificial Intelligence · Computer Science 2024-08-09 Omer Reingold , Judy Hanwen Shen , Aditi Talati

To interpret uncertainty estimates from differentiable probabilistic models, recent work has proposed generating Counterfactual Latent Uncertainty Explanations (CLUEs). However, for a single input, such approaches could output a variety of…

Machine Learning · Computer Science 2021-12-06 Dan Ley , Umang Bhatt , Adrian Weller

Concept Bottleneck Models (CBMs) provide inherent interpretability by first mapping input samples to high-level semantic concepts, followed by a combination of these concepts for the final classification. However, the annotation of…

Machine Learning · Computer Science 2026-03-02 Yangyi Li , Mengdi Huai