English
Related papers

Related papers: Diagnosing AI Explanation Methods with Folk Concep…

200 papers

Smart home systems are gaining popularity as homeowners strive to enhance their living and working environments while minimizing energy consumption. However, the adoption of artificial intelligence (AI)-enabled decision-making models in…

Human-Computer Interaction · Computer Science 2024-07-30 Md Shajalal , Alexander Boden , Gunnar Stevens , Delong Du , Dean-Robin Kern

There are many examples of human decision making which cannot be modeled by classical probabilistic and logic models, on which the current AI systems are based. Hence the need for a modeling framework which can enable intelligent systems to…

Artificial Intelligence · Computer Science 2018-08-15 Sagar Uprety , Dawei Song

Explainable AI (XAI) is widely viewed as a sine qua non for ever-expanding AI research. A better understanding of the needs of XAI users, as well as human-centered evaluations of explainable models are both a necessity and a challenge. In…

Artificial Intelligence · Computer Science 2024-10-17 Yao Rong , Tobias Leemann , Thai-trang Nguyen , Lisa Fiedler , Peizhu Qian , Vaibhav Unhelkar , Tina Seidel , Gjergji Kasneci , Enkelejda Kasneci

In the context of explainable artificial intelligence (XAI), limited research has identified role-specific explanation needs. This study investigates the explanation needs of data scientists, who are responsible for training, testing,…

Human-Computer Interaction · Computer Science 2025-02-25 Helmut Degen , Ziran Min , Parinitha Nagaraja

This paper proposes a research direction to advance AI which draws inspiration from cognitive theories of human decision making. The premise is that if we gain insights about the causes of some human capabilities that are still lacking in…

Current Explainable AI (ExAI) methods, especially in the NLP field, are conducted on various datasets by employing different metrics to evaluate several aspects. The lack of a common evaluation framework is hindering the progress tracking…

Computation and Language · Computer Science 2022-10-14 Julia El Zini , Mohamad Mansour , Basel Mousi , Mariette Awad

There is a clear desire to model and comprehend human behavior. Trends in research covering this topic show a clear assumption that many view human reasoning as the presupposed standard in artificial reasoning. As such, topics such as game…

Artificial Intelligence · Computer Science 2022-05-16 Andrew Fuchs , Andrea Passarella , Marco Conti

Recent advances in artificial intelligence (AI) have underscored the need for explainable AI (XAI) to support human understanding of AI systems. Consideration of human factors that impact explanation efficacy, such as mental workload and…

Artificial Intelligence · Computer Science 2023-10-13 Lindsay Sanneman , Mycal Tucker , Julie Shah

Although modern machine learning and deep learning methods allow for complex and in-depth data analytics, the predictive models generated by these methods are often highly complex, and lack transparency. Explainable AI (XAI) methods are…

Machine Learning · Computer Science 2021-06-17 Mythreyi Velmurugan , Chun Ouyang , Catarina Moreira , Renuka Sindhgatta

The rise of AI methods to make predictions and decisions has led to a pressing need for more explainable artificial intelligence (XAI) methods. One common approach for XAI is to produce a post-hoc explanation, explaining why a black box ML…

Artificial Intelligence · Computer Science 2022-12-01 Jinqiang Yu , Alexey Ignatiev , Peter J. Stuckey , Nina Narodytska , Joao Marques-Silva

Effective AI governance requires structured approaches for stakeholders to access and verify AI system behavior. With the rise of large language models, Natural Language Explanations (NLEs) are now key to articulating model behavior, which…

Computation and Language · Computer Science 2025-07-16 Isar Nejadgholi , Mona Omidyeganeh , Marc-Antoine Drouin , Jonathan Boisvert

The focus of recent research has shifted from merely improving the metrics based performance of Deep Neural Networks (DNNs) to DNNs which are more interpretable to humans. The field of eXplainable Artificial Intelligence (XAI) has observed…

Artificial Intelligence · Computer Science 2024-03-26 Avani Gupta , P J Narayanan

Feature attribution methods have become a staple method to disentangle the complex behavior of black box models. Despite their success, some scholars have argued that such methods suffer from a serious flaw: they do not allow a reliable…

Explainable AI (XAI) research has traditionally focused on rational users, aiming to improve understanding and reduce cognitive biases. However, emotional factors play a critical role in how explanations are perceived and processed. Prior…

Human-Computer Interaction · Computer Science 2025-05-22 Christian Schütze , Birte Richter , Britta Wrede

Evaluating the quality of explanations in Explainable Artificial Intelligence (XAI) is to this day a challenging problem, with ongoing debate in the research community. While some advocate for establishing standardized offline metrics,…

Human-Computer Interaction · Computer Science 2024-09-27 Teodor Chiaburu , Frank Haußer , Felix Bießmann

For AI systems to garner widespread public acceptance, we must develop methods capable of explaining the decisions of black-box models such as neural networks. In this work, we identify two issues of current explanatory methods. First, we…

Computation and Language · Computer Science 2019-12-06 Oana-Maria Camburu , Eleonora Giunchiglia , Jakob Foerster , Thomas Lukasiewicz , Phil Blunsom

This late-breaking work presents a large-scale analysis of explainable AI (XAI) literature to evaluate claims of human explainability. We collaborated with a professional librarian to identify 18,254 papers containing keywords related to…

Human-Computer Interaction · Computer Science 2025-03-24 Ashley Suh , Isabelle Hurley , Nora Smith , Ho Chit Siu

In many AI applications today, the predominance of black-box machine learning models, due to their typically higher accuracy, amplifies the need for Explainable AI (XAI). Existing XAI approaches, such as the widely used SHAP values or…

Artificial Intelligence · Computer Science 2026-05-28 David Martens , James Hinns , Camille Dams , Mark Vergouwen , Theodoros Evgeniou

Explanation methods and their evaluation have become a significant issue in explainable artificial intelligence (XAI) due to the recent surge of opaque AI models in decision support systems (DSS). Since the most accurate AI models are…

Artificial Intelligence · Computer Science 2023-08-30 Helena Löfström , Karl Hammar , Ulf Johansson

The intersection of Artificial Intelligence (AI) and neuroscience in Explainable AI (XAI) is pivotal for enhancing transparency and interpretability in complex decision-making processes. This paper explores the evolution of XAI…

Artificial Intelligence · Computer Science 2024-02-13 Yongchen Zhou , Richard Jiang