English
Related papers

Related papers: In Search of Verifiability: Explanations Rarely En…

200 papers

In many practical applications of AI, an AI model is used as a decision aid for human users. The AI provides advice that a human (sometimes) incorporates into their decision-making process. The AI advice is often presented with some measure…

Artificial Intelligence · Computer Science 2022-10-31 Kailas Vodrahalli , Tobias Gerstenberg , James Zou

While natural-language explanations from large language models (LLMs) are widely adopted to improve transparency and trust, their impact on objective human-AI team performance remains poorly understood. We identify a Persuasion Paradox:…

Human-Computer Interaction · Computer Science 2026-04-07 Ruth Cohen , Lu Feng , Ayala Bloch , Sarit Kraus

The use of Artificial Intelligence (AI), or more generally data-driven algorithms, has become ubiquitous in today's society. Yet, in many cases and especially when stakes are high, humans still make final decisions. The critical question,…

Artificial Intelligence · Computer Science 2024-10-15 Eli Ben-Michael , D. James Greiner , Melody Huang , Kosuke Imai , Zhichao Jiang , Sooahn Shin

Recent years have seen a boom in interest in machine learning systems that can provide a human-understandable rationale for their predictions or decisions. However, exactly what kinds of explanation are truly human-interpretable remains…

Artificial Intelligence · Computer Science 2018-02-05 Menaka Narayanan , Emily Chen , Jeffrey He , Been Kim , Sam Gershman , Finale Doshi-Velez

A central challenge in AI-assisted decision making is achieving warranted, well-calibrated trust. Both overtrust (accepting incorrect AI recommendations) and undertrust (rejecting correct advice) should be prevented. Prior studies differ in…

Human-Computer Interaction · Computer Science 2026-03-06 Laura Spillner , Rachel Ringe , Robert Porzel , Rainer Malaka

Computational argumentation offers formal frameworks for transparent, verifiable reasoning but has traditionally been limited by its reliance on domain-specific information and extensive feature engineering. In contrast, LLMs excel at…

Artificial Intelligence · Computer Science 2026-03-18 Stylianos Loukas Vasileiou , Antonio Rago , Francesca Toni , William Yeoh

To achieve the promoted benefits of an AI symptom checker, laypeople must trust and subsequently follow its instructions. In AI, explanations are seen as a tool to communicate the rationale behind black-box decisions to encourage trust and…

Human-Computer Interaction · Computer Science 2022-03-01 Claire Woodcock , Brent Mittelstadt , Dan Busbridge , Grant Blank

Explainability has been a goal for Artificial Intelligence (AI) systems since their conception, with the need for explainability growing as more complex AI models are increasingly used in critical, high-stakes settings such as healthcare.…

Artificial Intelligence · Computer Science 2020-10-06 Shruthi Chari , Oshani Seneviratne , Daniel M. Gruen , Morgan A. Foreman , Amar K. Das , Deborah L. McGuinness

We are witnessing the emergence of an AI economy and society where AI technologies are increasingly impacting health care, business, transportation and many aspects of everyday life. Many successes have been reported where AI systems even…

Machine Learning · Computer Science 2022-12-27 D. Petkovic

A core assumption of explainable AI systems is that explanations change what users know, thereby enabling them to act within their complex socio-technical environments. Despite the centrality of action, explanations are often organized and…

Human-Computer Interaction · Computer Science 2023-05-11 Gennie Mansi , Mark Riedl

Artificial Intelligence (AI) has become an integral part of domains such as security, finance, healthcare, medicine, and criminal justice. Explaining the decisions of AI systems in human terms is a key challenge--due to the high complexity…

Artificial Intelligence · Computer Science 2019-11-25 Sheikh Rabiul Islam , William Eberle , Sheikh K. Ghafoor

AI and ML models have already found many applications in critical domains, such as healthcare and criminal justice. However, fully automating such high-stakes applications can raise ethical or fairness concerns. Instead, in such cases,…

Artificial Intelligence · Computer Science 2023-04-28 Ioannis Papantonis , Vaishak Belle

Just as people improve decision-making by consulting diverse human advisors, they can now also consult with multiple AI systems. Prior work on group decision-making shows that advice aggregation creates pressure to conform, leading to…

Human-Computer Interaction · Computer Science 2026-03-24 Yuta Tsuchiya , Yukino Baba

Understanding when and why to apply any given eXplainable Artificial Intelligence (XAI) technique is not a straightforward task. There is no single approach that is best suited for a given context. This paper aims to address the challenge…

Artificial Intelligence · Computer Science 2023-12-14 Leila Methnani , Virginia Dignum , Andreas Theodorou

Why do explainable AI (XAI) explanations in radiology, despite their promise of transparency, still fail to gain human trust? Current XAI approaches provide justification for predictions, however, these do not meet practitioners' needs.…

Human-Computer Interaction · Computer Science 2023-04-10 Robert Kaufman , David Kirsh

Reliable inference requires that artificial intelligence (AI) models provide trustworthy uncertainty estimates, not merely accurate predictions. Recent advances in Bayesian learning have made significant progress toward this goal, and…

Machine Learning · Computer Science 2026-05-12 Jiayi Huang

AI assistance in decision-making has become popular, yet people's inappropriate reliance on AI often leads to unsatisfactory human-AI collaboration performance. In this paper, through three pre-registered, randomized human subject…

Human-Computer Interaction · Computer Science 2024-01-17 Zhuoran Lu , Dakuo Wang , Ming Yin

Transparency is a major requirement of modern AI based decision making systems deployed in real world. A popular approach for achieving transparency is by means of explanations. A wide variety of different explanations have been proposed…

Artificial Intelligence · Computer Science 2022-05-19 André Artelt , Stelios Vrachimis , Demetrios Eliades , Marios Polycarpou , Barbara Hammer

In human-AI decision making, designing AI that complements human expertise has been a natural strategy to enhance human-AI collaboration, yet it often comes at the cost of decreased AI performance in areas of human strengths. This can…

Artificial Intelligence · Computer Science 2026-02-24 Hasan Amin , Ming Yin , Rajiv Khanna

With the recent advances in the field of artificial intelligence, an increasing number of decision-making tasks are delegated to software systems. A key requirement for the success and adoption of such systems is that users must trust…

Artificial Intelligence · Computer Science 2020-06-17 Ingrid Nunes , Dietmar Jannach