English
Related papers

Related papers: Bridging the Gap Between Explainable AI and Uncert…

200 papers

Artificial intelligence (AI) provides considerable opportunities to assist human work. However, one crucial challenge of human-AI collaboration is that many AI algorithms operate in a black-box manner where the way how the AI makes…

Human-Computer Interaction · Computer Science 2024-06-13 Julian Senoner , Simon Schallmoser , Bernhard Kratzwald , Stefan Feuerriegel , Torbjørn Netland

Interpretability is the study of explaining models in understandable terms to humans. At present, interpretability is divided into two paradigms: the intrinsic paradigm, which believes that only models designed to be explained can be…

Machine Learning · Computer Science 2024-11-14 Andreas Madsen , Himabindu Lakkaraju , Siva Reddy , Sarath Chandar

AI systems' ability to explain their reasoning is critical to their utility and trustworthiness. Deep neural networks have enabled significant progress on many challenging problems such as visual question answering (VQA). However, most of…

Computation and Language · Computer Science 2019-06-05 Jialin Wu , Raymond J. Mooney

Explainability is one of the key ethical concepts in the design of AI systems. However, attempts to operationalize this concept thus far have tended to focus on approaches such as new software for model interpretability or guidelines with…

Computers and Society · Computer Science 2020-10-06 Ben Zevenbergen , Allison Woodruff , Patrick Gage Kelley

Interpretable machine learning tackles the important problem that humans cannot understand the behaviors of complex machine learning models and how these models arrive at a particular decision. Although many approaches have been proposed, a…

Machine Learning · Computer Science 2019-05-21 Mengnan Du , Ninghao Liu , Xia Hu

The field of explainable AI (XAI) has quickly become a thriving and prolific community. However, a silent, recurrent and acknowledged issue in this area is the lack of consensus regarding its terminology. In particular, each new…

Artificial Intelligence · Computer Science 2021-11-03 Sebastian Palacio , Adriano Lucieri , Mohsin Munir , Jörn Hees , Sheraz Ahmed , Andreas Dengel

As researchers strive to narrow the gap between machine intelligence and human through the development of artificial intelligence technologies, it is imperative that we recognize the critical importance of trustworthiness in open-world,…

Machine Learning · Statistics 2023-10-19 Shide Du , Zihan Fang , Shiyang Lan , Yanchao Tan , Manuel Günther , Shiping Wang , Wenzhong Guo

Algorithmic transparency entails exposing system properties to various stakeholders for purposes that include understanding, improving, and contesting predictions. Until now, most research into algorithmic transparency has predominantly…

Explainability has been a challenge in AI for as long as AI has existed. With the recently increased use of AI in society, it has become more important than ever that AI systems would be able to explain the reasoning behind their results…

Artificial Intelligence · Computer Science 2020-09-30 Kary Främling

Understanding the decisions made and actions taken by increasingly complex AI system remains a key challenge. This has led to an expanding field of research in explainable artificial intelligence (XAI), highlighting the potential of…

Uncertainty quantification (UQ) plays a pivotal role in reduction of uncertainties during both optimization and decision making processes. It can be applied to solve a variety of real-world applications in science and engineering. Bayesian…

Efforts to promote fairness, accountability, and transparency are assumed to be critical in fostering Trust in AI (TAI), but extant literature is frustratingly vague regarding this 'trust'. The lack of exposition on trust itself suggests…

Computers and Society · Computer Science 2022-08-02 Bran Knowles , John T. Richards , Frens Kroeger

Benchmarking the capabilities of AI systems, including Large Language Models (LLMs) and Vision Models, typically ignores the impact of uncertainty in the underlying ground truth answers from experts. This ambiguity is not just limited to…

In the past few decades, artificial intelligence (AI) technology has experienced swift developments, changing everyone's daily life and profoundly altering the course of human society. The intention of developing AI is to benefit humans, by…

Artificial Intelligence · Computer Science 2021-08-20 Haochen Liu , Yiqi Wang , Wenqi Fan , Xiaorui Liu , Yaxin Li , Shaili Jain , Yunhao Liu , Anil K. Jain , Jiliang Tang

Machine learning models in safety-critical settings like healthcare are often blackboxes: they contain a large number of parameters which are not transparent to users. Post-hoc explainability methods where a simple, human-interpretable…

Machine Learning · Computer Science 2022-06-03 Aparna Balagopalan , Haoran Zhang , Kimia Hamidieh , Thomas Hartvigsen , Frank Rudzicz , Marzyeh Ghassemi

The full acceptance of Deep Learning (DL) models in the clinical field is rather low with respect to the quantity of high-performing solutions reported in the literature. Particularly, end users are reluctant to rely on the rough…

Image and Video Processing · Electrical Eng. & Systems 2022-10-11 Benjamin Lambert , Florence Forbes , Alan Tucholka , Senan Doyle , Harmonie Dehaene , Michel Dojat

Artificial intelligence (AI) is becoming increasingly more popular and can be found in workplaces and homes around the world. The decisions made by such "black box" systems are often opaque; that is, so complex as to be functionally…

Artificial Intelligence · Computer Science 2022-05-27 Rob Geada , Tommaso Teofili , Rui Vieira , Rebecca Whitworth , Daniele Zonca

Explainability and its emerging counterpart contestability have become important normative and design principles for trustworthy AI as they enable users and subjects to understand and challenge AI decisions. However, realizing these…

Computers and Society · Computer Science 2025-08-15 Timothée Schmude , Mireia Yurrita , Kars Alfrink , Thomas Le Goff , Sebastian Tschiatschek , Tiphaine Viard

Patients increasingly rely on online reviews when choosing healthcare providers, yet the sheer volume of these reviews can hinder effective decision-making. This paper summarises a mixed-methods study aimed at evaluating a proposed…

Computers and Society · Computer Science 2026-03-03 Eman Alamoudi , Ellis Solaiman

As a field of AI, Machine Reasoning (MR) uses largely symbolic means to formalize and emulate abstract reasoning. Studies in early MR have notably started inquiries into Explainable AI (XAI) -- arguably one of the biggest concerns today for…