English
Related papers

Related papers: The five Is: Key principles for interpretable and …

200 papers

Transformer language models are state of the art in a multitude of NLP tasks. Despite these successes, their opaqueness remains problematic. Recent methods aiming to provide interpretability and explainability to black-box models primarily…

Computation and Language · Computer Science 2022-03-14 Felix Friedrich , Patrick Schramowski , Christopher Tauchmann , Kristian Kersting

The capabilities of artificial intelligence systems have been advancing to a great extent, but these systems still struggle with failure modes, vulnerabilities, and biases. In this paper, we study the current state of the field, and present…

Cryptography and Security · Computer Science 2025-06-12 Xingli Fang , Jianwei Li , Varun Mulchandani , Jung-Eun Kim

There are concerns about the reliability and safety of artificial intelligence (AI) based on sub-symbolic neural networks because its decisions cannot be explained explicitly. This is the black box problem of modern AI. At the same time,…

Artificial Intelligence · Computer Science 2024-05-21 V. L. Kalmykov , L. V. Kalmykov

Artificial intelligence has become a part of the provision of governmental services, from making decisions about benefits to issuing fines for parking violations. However, AI systems rarely live up to the promise of neutral optimisation,…

Artificial Intelligence · Computer Science 2025-10-10 Dave Murray-Rust , Kars Alfrink , Cristina Zaga

The rapid development of Artificial Intelligence (AI) requires developers and designers of AI systems to focus on the collaboration between humans and machines. AI explanations of system behavior and reasoning are vital for effective…

Human-Computer Interaction · Computer Science 2022-10-11 Ruben S. Verhagen , Siddharth Mehrotra , Mark A. Neerincx , Catholijn M. Jonker , Myrthe L. Tielman

There is general consensus that it is important for artificial intelligence (AI) and machine learning systems to be explainable and/or interpretable. However, there is no general consensus over what is meant by 'explainable' and…

Artificial Intelligence · Computer Science 2018-10-02 Alun Preece , Dan Harborne , Dave Braines , Richard Tomsett , Supriyo Chakraborty

The implementation of Artificial Intelligence (AI) systems in the manufacturing domain enables higher production efficiency, outstanding performance, and safer operations, leveraging powerful tools such as deep learning and reinforcement…

Artificial Intelligence · Computer Science 2021-07-07 Georgios Sofianidis , Jože M. Rožanec , Dunja Mladenić , Dimosthenis Kyriazis

As artificial intelligence rapidly transforms society, developers and policymakers struggle to anticipate which applications will face public moral resistance. We propose that these judgments are not idiosyncratic but systematic and…

Computers and Society · Computer Science 2025-10-08 Kimmo Eriksson , Simon Karlsson , Irina Vartanova , Pontus Strimling

The aim of this article is to understand the problem of "black box" algorithms, an issue inherent to the nascent field of Explainable Artificial Intelligence (XAI). While it is relatively easy to understand something someone explained to…

Computers and Society · Computer Science 2026-05-14 Remy Demichelis

In machine learning algorithm design, there exists a trade-off between the interpretability and performance of the algorithm. In general, algorithms which are simpler and easier for humans to comprehend tend to show worse performance than…

Machine Learning · Computer Science 2024-07-15 Eric M. Vernon , Naoki Masuyama , Yusuke Nojima

Speech AI Technologies are largely trained on publicly available datasets or by the massive web-crawling of speech. In both cases, data acquisition focuses on minimizing collection effort, without necessarily taking the data subjects'…

Computers and Society · Computer Science 2023-05-04 Orestis Papakyriakopoulos , Alice Xiang

Machine learning (ML) models, demonstrably powerful, suffer from a lack of interpretability. The absence of transparency, often referred to as the black box nature of ML models, undermines trust and urges the need for efforts to enhance…

Machine Learning · Computer Science 2024-06-25 Fatima Ezzeddine

General-purpose conversational AI chatbots and AI companions increasingly provide young adolescents with emotionally supportive conversations, raising questions about how conversational style shapes anthropomorphism and emotional reliance.…

Human-Computer Interaction · Computer Science 2025-12-19 Pilyoung Kim , Yun Xie , Sujin Yang

In the early stages of scientific research, researchers rely on core scholarly judgments to identify relevant literature, assess credible evidence, and determine which directions merit pursuit. As AI tools become increasingly integrated…

Computers and Society · Computer Science 2026-04-28 Sanjana Gautam , Houjiang Liu , Yujin Choi , Matthew Lease

Artificial intelligence (AI) generally and machine learning (ML) specifically demonstrate impressive practical success in many different application domains, e.g. in autonomous driving, speech recognition, or recommender systems. Deep…

Artificial Intelligence · Computer Science 2018-01-02 Andreas Holzinger , Chris Biemann , Constantinos S. Pattichis , Douglas B. Kell

Explainability techniques for data-driven predictive models based on artificial intelligence and machine learning algorithms allow us to better understand the operation of such systems and help to hold them accountable. New transparency…

Machine Learning · Computer Science 2022-09-09 Kacper Sokol , Alexander Hepburn , Raul Santos-Rodriguez , Peter Flach

Although several post-hoc methods for explainable AI have been developed, most are static and neglect the user perspective, limiting their effectiveness for the target audience. In response, we developed the interactive explainable…

Artificial Intelligence · Computer Science 2025-06-27 Pauline Speckmann , Mario Nadj , Christian Janiesch

Empathy is a vital factor that contributes to mutual understanding, and joint problem-solving. In recent years, a growing number of studies have recognized the benefits of empathy and started to incorporate empathy in conversational…

Computation and Language · Computer Science 2023-10-13 Aravind Sesagiri Raamkumar , Yinping Yang

Advances in AI technologies have resulted in superior levels of AI-based model performance. However, this has also led to a greater degree of model complexity, resulting in 'black box' models. In response to the AI black box problem, the…

Human-Computer Interaction · Computer Science 2022-10-25 Julie Gerlings , Millie Søndergaard Jensen , Arisa Shollo

We introduce the fundamental ideas and challenges of Predictable AI, a nascent research area that explores the ways in which we can anticipate key validity indicators (e.g., performance, safety) of present and future AI ecosystems. We argue…