English
Related papers

Related papers: Deceptive AI Explanations: Creation and Detection

200 papers

Since Artificial Intelligence (AI) software uses techniques like deep lookahead search and stochastic optimization of huge neural networks to fit mammoth datasets, it often results in complex behavior that is difficult for people to…

Artificial Intelligence · Computer Science 2018-10-16 Daniel S. Weld , Gagan Bansal

Transparency, user trust, and human comprehension are popular ethical motivations for interpretable machine learning. In support of these goals, researchers evaluate model explanation performance using humans and real world applications.…

Artificial Intelligence · Computer Science 2019-10-31 Bernease Herman

Recent research on large language models (LLMs) has demonstrated their ability to understand and employ deceptive behavior, even without explicit prompting. However, such behavior has only been observed in rare, specialized cases and has…

Computation and Language · Computer Science 2025-06-24 Laurène Vaugrante , Francesca Carlon , Maluna Menke , Thilo Hagendorff

Recent advances in AI models have increased the integration of AI-based decision aids into the human decision making process. To fully unlock the potential of AI-assisted decision making, researchers have computationally modeled how humans…

Human-Computer Interaction · Computer Science 2024-11-19 Zhuoyan Li , Ming Yin

As large language models (LLMs) achieve advanced persuasive capabilities, concerns about their potential risks have grown. The EU AI Act prohibits AI systems that use manipulative or deceptive techniques to undermine informed…

Computers and Society · Computer Science 2025-05-20 Haein Kong

Recent work on interpretability in machine learning and AI has focused on the building of simplified models that approximate the true criteria used to make decisions. These models are a useful pedagogical device for teaching trained…

Artificial Intelligence · Computer Science 2018-11-06 Brent Mittelstadt , Chris Russell , Sandra Wachter

People's decision-making abilities often fail to improve or may even erode when they rely on AI for decision-support, even when the AI provides informative explanations. We argue this is partly because people intuitively seek contrastive…

Human-Computer Interaction · Computer Science 2025-03-20 Zana Buçinca , Siddharth Swaroop , Amanda E. Paluch , Finale Doshi-Velez , Krzysztof Z. Gajos

Humans are the final decision makers in critical tasks that involve ethical and legal concerns, ranging from recidivism prediction, to medical diagnosis, to fighting against fake news. Although machine learning models can sometimes achieve…

Artificial Intelligence · Computer Science 2019-01-10 Vivian Lai , Chenhao Tan

Displaying confidence scores in human-AI interaction has been shown to help build trust between humans and AI systems. However, most existing research uses only the confidence score as a form of communication. As confidence scores are just…

Artificial Intelligence · Computer Science 2023-03-13 Thao Le , Tim Miller , Ronal Singh , Liz Sonenberg

In this paper, we show that counterfactual explanations of confidence scores help users better understand and better trust an AI model's prediction in human-subject studies. Showing confidence scores in human-agent interaction systems can…

Machine Learning · Computer Science 2022-06-08 Thao Le , Tim Miller , Ronal Singh , Liz Sonenberg

Prior work has identified a resilient phenomenon that threatens the performance of human-AI decision-making teams: overreliance, when people agree with an AI, even when it is incorrect. Surprisingly, overreliance does not reduce when the AI…

Human-Computer Interaction · Computer Science 2023-01-30 Helena Vasconcelos , Matthew Jörke , Madeleine Grunde-McLaughlin , Tobias Gerstenberg , Michael Bernstein , Ranjay Krishna

There is broad agreement that Artificial Intelligence (AI) systems, particularly those using Machine Learning (ML), should be able to "explain" their behavior. Unfortunately, there is little agreement as to what constitutes an…

Human-Computer Interaction · Computer Science 2022-07-04 Leilani H. Gilpin , Andrew R. Paley , Mohammed A. Alam , Sarah Spurlock , Kristian J. Hammond

The current literature on AI-advised decision making -- involving explainable AI systems advising human decision makers -- presents a series of inconclusive and confounding results. To synthesize these findings, we propose a simple theory…

Artificial Intelligence · Computer Science 2024-02-05 Raymond Fok , Daniel S. Weld

This study explores the integration of contextual explanations into AI-powered loan decision systems to enhance trust and usability. While traditional AI systems rely heavily on algorithmic transparency and technical accuracy, they often…

Human-Computer Interaction · Computer Science 2025-10-07 Allen Daniel Sunny

In many contexts, lying -- the use of verbal falsehoods to deceive -- is harmful. While lying has traditionally been a human affair, AI systems that make sophisticated verbal statements are becoming increasingly prevalent. This raises the…

Computers and Society · Computer Science 2021-10-14 Owain Evans , Owen Cotton-Barratt , Lukas Finnveden , Adam Bales , Avital Balwit , Peter Wills , Luca Righetti , William Saunders

Explaining deep learning models is essential for clinical integration of medical image analysis systems. A good explanation highlights if a model depends on spurious features that undermines generalization and harms a subset of patients or,…

Image and Video Processing · Electrical Eng. & Systems 2025-08-18 Yoni Schirris , Eric Marcus , Jonas Teuwen , Hugo Horlings , Efstratios Gavves

The rapid adoption of large language models has introduced a new class of AI-generated fake news that coexists with traditional human-written misinformation, raising important questions about how these two forms of deceptive content differ…

Computation and Language · Computer Science 2026-04-14 Samuel Jaeger , Calvin Ibeneye , Aya Vera-Jimenez , Dhrubajyoti Ghosh

Explainable Artificial Intelligence (XAI) aims to create transparency in modern AI models by offering explanations of the models to human users. There are many ways in which researchers have attempted to evaluate the quality of these XAI…

Human-Computer Interaction · Computer Science 2025-11-07 Joe Shymanski , Jacob Brue , Sandip Sen

As intelligence increases, so does its shadow. AI deception, in which systems induce false beliefs to secure self-beneficial outcomes, has evolved from a speculative concern to an empirically demonstrated risk across language models, AI…

In today's society, where Artificial Intelligence (AI) has gained a vital role, concerns regarding user's trust have garnered significant attention. The use of AI systems in high-risk domains have often led users to either under-trust it,…

Human-Computer Interaction · Computer Science 2025-04-16 Siddharth Mehrotra , Ujwal Gadiraju , Eva Bittner , Folkert van Delden , Catholijn M. Jonker , Myrthe L. Tielman