English
Related papers

Related papers: Estimation of Concept Explanations Should be Uncer…

200 papers

To build intelligent machine learning systems, there are two broad approaches. One approach is to build inherently interpretable models, as endeavored by the growing field of causal representation learning. The other approach is to build…

Machine Learning · Computer Science 2024-12-10 Goutham Rajendran , Simon Buchholz , Bryon Aragam , Bernhard Schölkopf , Pradeep Ravikumar

Statistical models typically capture uncertainties in our knowledge of the corresponding real-world processes, however, it is less common for this uncertainty specification to capture uncertainty surrounding the values of the inputs to the…

Methodology · Statistics 2023-05-10 Samuel E. Jackson , David C. Woods

Interpretability, trustworthiness, and usability are key considerations in high-stake security applications, especially when utilizing deep learning models. While these models are known for their high accuracy, they behave as black boxes in…

Causal concept effect estimation is gaining increasing interest in the field of interpretable machine learning. This general approach explains the behaviors of machine learning models by estimating the causal effect of human-understandable…

Machine Learning · Computer Science 2024-11-15 Jifan Gao , Guanhua Chen

Understanding the uncertainty of a neural network's (NN) predictions is essential for many purposes. The Bayesian framework provides a principled approach to this, however applying it to NNs is challenging due to large numbers of parameters…

Machine Learning · Statistics 2020-02-27 Tim Pearce , Felix Leibfried , Alexandra Brintrup , Mohamed Zaki , Andy Neely

Various AI models are increasingly being considered as part of clinical decision-support tools. However, the trustworthiness of such models is rarely considered. Clinicians are more likely to use a model if they can understand and trust its…

Artificial Intelligence · Computer Science 2020-03-09 Evangelia Kyrimi , Somayyeh Mossadegh , Nigel Tai , William Marsh

The focus of recent research has shifted from merely improving the metrics based performance of Deep Neural Networks (DNNs) to DNNs which are more interpretable to humans. The field of eXplainable Artificial Intelligence (XAI) has observed…

Artificial Intelligence · Computer Science 2024-03-26 Avani Gupta , P J Narayanan

Neural network models are widely used in a variety of domains, often as black-box solutions, since they are not directly interpretable for humans. The field of explainable artificial intelligence aims at developing explanation methods to…

Machine Learning · Computer Science 2023-07-25 Patrik Hammersborg , Inga Strümke

Deep Learning is a consolidated, state-of-the-art Machine Learning tool to fit a function when provided with large data sets of examples. However, in regression tasks, the straightforward application of Deep Learning models provides a point…

Machine Learning · Computer Science 2018-07-25 Axel Brando , Jose A. Rodríguez-Serrano , Mauricio Ciprian , Roberto Maestre , Jordi Vitrià

It is a mystery which input features contribute to a neural network's output. Various explanation (feature attribution) methods are proposed in the literature to shed light on the problem. One peculiar observation is that these explanations…

Machine Learning · Computer Science 2022-03-07 Ashkan Khakzar , Pedram Khorsandi , Rozhin Nobahari , Nassir Navab

Due to their intuitive appeal, Bayesian methods of modeling and uncertainty quantification have become popular in modern machine and deep learning. When providing a prior distribution over the parameter space, it is straightforward to…

Machine Learning · Statistics 2025-06-05 Ivan Melev , Goeran Kauermann

The last decade has seen huge progress in the development of advanced machine learning models; however, those models are powerless unless human users can interpret them. Here we show how the mind's construction of concepts and meaning can…

Machine Learning · Statistics 2016-07-04 Nick Condry

We explore recently introduced definition modeling technique that provided the tool for evaluation of different distributed vector representations of words through modeling dictionary definitions of words. In this work, we study the problem…

Computation and Language · Computer Science 2018-06-27 Artyom Gadetsky , Ilya Yakubovskiy , Dmitry Vetrov

Transformer-based language models have set new benchmarks across a wide range of NLP tasks, yet reliably estimating the uncertainty of their predictions remains a significant challenge. Existing uncertainty estimation (UE) techniques often…

Machine Learning · Computer Science 2024-09-18 Elizaveta Kostenok , Daniil Cherniavskii , Alexey Zaytsev

Neural predictive models have achieved remarkable performance improvements in various natural language processing tasks. However, most neural predictive models suffer from the lack of explainability of predictions, limiting their practical…

Computation and Language · Computer Science 2021-06-01 Dongfang Li , Jingcong Tao , Qingcai Chen , Baotian Hu

Although large language models (LLMs) are highly interactive and extendable, current approaches to ensure reliability in deployments remain mostly limited to rejecting outputs with high uncertainty in order to avoid misinformation. This…

Machine Learning · Computer Science 2025-06-10 T. Duy Nguyen-Hien , Desi R. Ivanova , Yee Whye Teh , Wee Sun Lee

Deep learning models have exhibited superior performance in predictive tasks with the explosively increasing Electronic Health Records (EHR). However, due to the lack of transparency, behaviors of deep learning models are difficult to…

Machine Learning · Computer Science 2019-07-16 Riyi Qiu , Yugang Jia , Mirsad Hadzikadic , Michael Dulin , Xi Niu , Xin Wang

Bayesian inference is often utilized for uncertainty quantification tasks. A recent analysis by Xu and Raginsky 2022 rigorously decomposed the predictive uncertainty in Bayesian inference into two uncertainties, called aleatoric and…

Machine Learning · Statistics 2023-07-25 Futoshi Futami , Tomoharu Iwata

Algorithmic transparency entails exposing system properties to various stakeholders for purposes that include understanding, improving, and contesting predictions. Until now, most research into algorithmic transparency has predominantly…

Many interpretable AI approaches have been proposed to provide plausible explanations for a model's decision-making. However, configuring an explainable model that effectively communicates among computational modules has received less…

Machine Learning · Computer Science 2023-11-09 Jinyung Hong , Keun Hee Park , Theodore P. Pavlic