English
Related papers

Related papers: Manipulation Risks in Explainable AI: The Implicat…

200 papers

As AI systems are increasingly deployed to support decision-making in critical domains, explainability has become a means to enhance the understandability of these outputs and enable users to make more informed and conscious choices.…

Artificial Intelligence · Computer Science 2025-08-15 Maria J. P. Peixoto , Akriti Pandey , Ahsan Zaman , Peter R. Lewis

Explainable Artificial Intelligence (XAI) has experienced a significant growth over the last few years. This is due to the widespread application of machine learning, particularly deep learning, that has led to the development of highly…

Artificial Intelligence · Computer Science 2020-10-13 Giulia Vilone , Luca Longo

As robots and digital assistants are deployed in the real world, these agents must be able to communicate their decision-making criteria to build trust, improve human-robot teaming, and enable collaboration. While the field of explainable…

Human-Computer Interaction · Computer Science 2025-04-22 Andrew Silva , Pradyumna Tambwekar , Mariah Schrum , Matthew Gombolay

In this paper, we study the problem of AI explanation of misinformation, where the goal is to identify explanation designs that help improve users' misinformation detection abilities and their overall user experiences. Our work is motivated…

Human-Computer Interaction · Computer Science 2025-09-05 Yeaeun Gong , Yifan Liu , Lanyu Shang , Na Wei , Dong Wang

The European Union (EU) through the High-Level Expert Group on Artificial Intelligence (AI-HLEG) and the General Data Protection Regulation (GDPR) has recently posed an interesting challenge to the eXplainable AI (XAI) community, by…

Computers and Society · Computer Science 2022-01-20 Francesco Sovrano , Fabio Vitali , Monica Palmirani

Explainability has been a challenge in AI for as long as AI has existed. With the recently increased use of AI in society, it has become more important than ever that AI systems would be able to explain the reasoning behind their results…

Artificial Intelligence · Computer Science 2020-09-30 Kary Främling

In coming years or decades, artificial general intelligence (AGI) may surpass human capabilities across many critical domains. We argue that, without substantial effort to prevent it, AGIs could learn to pursue goals that are in conflict…

Artificial Intelligence · Computer Science 2025-05-06 Richard Ngo , Lawrence Chan , Sören Mindermann

Machine Learning algorithms are technological key enablers for artificial intelligence (AI). Due to the inherent complexity, these learning algorithms represent black boxes and are difficult to comprehend, therefore influencing compliance…

Computers and Society · Computer Science 2020-02-21 NIklas Kuhl , Jodie Lobana , Christian Meske

A core challenge in the development of increasingly capable AI systems is to make them safe and reliable by ensuring their behaviour is consistent with human values. This challenge, known as the alignment problem, does not merely apply to…

Machine Learning · Computer Science 2023-11-07 Raphaël Millière

Since Artificial Intelligence (AI) software uses techniques like deep lookahead search and stochastic optimization of huge neural networks to fit mammoth datasets, it often results in complex behavior that is difficult for people to…

Artificial Intelligence · Computer Science 2018-10-16 Daniel S. Weld , Gagan Bansal

Explainable AI (XAI) can greatly enhance user trust and satisfaction in AI-assisted decision-making processes. Recent findings suggest that a single explainer may not meet the diverse needs of multiple users in an AI system; indeed, even…

While a vast collection of explainable AI (XAI) algorithms have been developed in recent years, they are often criticized for significant gaps with how humans produce and consume explanations. As a result, current XAI techniques are often…

Artificial Intelligence · Computer Science 2023-08-08 Vivian Lai , Yiming Zhang , Chacha Chen , Q. Vera Liao , Chenhao Tan

The field of artificial intelligence (AI) is rapidly influencing health and healthcare, but bias and poor performance persists for populations who face widespread structural oppression. Previous work has clearly outlined the need for more…

In human-AI interactions, explanation is widely seen as necessary for enabling trust in AI systems. We argue that trust, however, may be a pre-requisite because explanation is sometimes impossible. We derive this result from a formalization…

Artificial Intelligence · Computer Science 2025-03-03 Nghi Truong , Phanish Puranam , Ilia Testlin

With the availability of large databases and recent improvements in deep learning methodology, the performance of AI systems is reaching or even exceeding the human level on an increasing number of complex tasks. Impressive examples of this…

Artificial Intelligence · Computer Science 2017-08-29 Wojciech Samek , Thomas Wiegand , Klaus-Robert Müller

Despite the practical success of Artificial Intelligence (AI), current neural AI algorithms face two significant issues. First, the decisions made by neural architectures are often prone to bias and brittleness. Second, when a chain of…

Artificial Intelligence · Computer Science 2024-10-21 Sushmita Paul , Jinqiang Yu , Jip J. Dekker , Alexey Ignatiev , Peter J. Stuckey

Providing well-calibrated AI confidence can help promote users' appropriate trust in and reliance on AI, which are essential for AI-assisted decision-making. However, calibrating AI confidence -- providing confidence score that accurately…

Artificial Intelligence · Computer Science 2025-09-30 Jingshu Li , Yitian Yang , Renwen Zhang , Q. Vera Liao , Tianqi Song , Zhengtao Xu , Yi-chieh Lee

Recent work in explanation generation for decision making agents has looked at how unexplained behavior of autonomous systems can be understood in terms of differences in the model of the system and the human's understanding of the same,…

Artificial Intelligence · Computer Science 2018-02-06 Tathagata Chakraborti , Sarath Sreedharan , Sachin Grover , Subbarao Kambhampati

The growing adoption of artificial intelligence in healthcare has raised concerns about the transparency and trustworthiness of AI-driven medical diagnosis systems. Many existing models operate as black boxes, limiting clinicians' ability…

Human-Computer Interaction · Computer Science 2026-04-21 Altynbek Seitenov , Ainur Nurzhanova , Azhar Bekbussinova , Yerassyl Bolatkan

Agentic AI represents a major shift in how autonomous systems reason, plan, and execute multi-step tasks through the coordination of Large Language Models (LLMs), Vision Language Models (VLMs), tools, and external services. While these…