English
Related papers

Related papers: The five Is: Key principles for interpretable and …

200 papers

In this paper, we propose "Confident AI" as a means to designing Artificial Intelligence (AI) and Machine Learning (ML) systems with both algorithm and user confidence in model predictions and reported results. The 4 basic tenets of…

Artificial Intelligence · Computer Science 2022-02-15 Jim Davis

This paper investigates the prospect of developing human-interpretable, explainable artificial intelligence (AI) systems based on active inference and the free energy principle. We first provide a brief overview of active inference, and in…

Recent advancements in machine learning have spurred growing interests in automated interpreting quality assessment. Nevertheless, existing research suffers from insufficient examination of language use quality, unsatisfactory modeling…

Computation and Language · Computer Science 2025-08-15 Zhaokun Jiang , Ziyin Zhang

Black box neural networks are an indispensable part of modern robots. Nevertheless, deploying such high-stakes systems in real-world scenarios poses significant challenges when the stakeholders, such as engineers and legislative bodies,…

Robotics · Computer Science 2025-10-10 Som Sagar , Aditya Taparia , Harsh Mankodiya , Pranav Bidare , Yifan Zhou , Ransalu Senanayake

As language-based AI systems become more anthropomorphic, the question of whether they can have subjective experience is increasingly pressing. I focus here on the tractability of research questions in the space of AI consciousness. I argue…

Computers and Society · Computer Science 2026-05-11 Iulia-Maria Comsa

This paper is preoccupied with the following question: given a (possibly opaque) learning system, how can we understand whether its behaviour adheres to governance constraints? The answer can be quite simple: we just need to "ask" the…

Artificial Intelligence · Computer Science 2021-02-10 Andrea Aler Tubella , Andreas Theodorou , Juan Carlos Nieves

The financial industry faces a significant challenge modeling and risk portfolios: balancing the predictability of advanced machine learning models, neural network models, and explainability required by regulatory entities (such as Office…

Machine Learning · Computer Science 2025-11-10 Rongbin Ye , Jiaqi Chen

Causal machine learning tools are beginning to see use in real-world policy evaluation tasks to flexibly estimate treatment effects. One issue with these methods is that the machine learning models used are generally black boxes, i.e.,…

Machine Learning · Computer Science 2024-04-01 Patrick Rehill , Nicholas Biddle

As practitioners increasingly deploy machine learning models in critical domains such as health care, finance, and policy, it becomes vital to ensure that domain experts function effectively alongside these models. Explainability is one way…

Machine Learning · Computer Science 2022-02-07 Himabindu Lakkaraju , Dylan Slack , Yuxin Chen , Chenhao Tan , Sameer Singh

Artificial Intelligence (AI) has continued to achieve tremendous success in recent times. However, the decision logic of these frameworks is often not transparent, making it difficult for stakeholders to understand, interpret or explain…

Machine Learning · Computer Science 2025-01-20 Fuseini Mumuni , Alhassan Mumuni

This paper addresses the critical challenge of building consumer trust in AI-powered customer engagement by emphasising the necessity for transparency and accountability. Despite the potential of AI to revolutionise business operations and…

Computers and Society · Computer Science 2024-10-04 Tara DeZao

This paper presents a conceptual and operational framework for developing and operating safe and trustworthy AI agents based on a Three-Pillar Model grounded in transparency, accountability, and trustworthiness. Building on prior work in…

Computers and Society · Computer Science 2026-01-13 Edward C. Cheng , Jeshua Cheng , Alice Siu

Given the sheer volume of surgical procedures and the significant rate of postoperative fatalities, assessing and managing surgical complications has become a critical public health concern. Existing artificial intelligence (AI) tools for…

Recent advances in AI reasoning models provide unprecedented transparency into their decision-making processes, transforming them from traditional black-box systems into models that articulate step-by-step chains of thought rather than…

Software Engineering · Computer Science 2025-03-04 Christoph Treude , Raula Gaikovina Kula

Recent applications of autonomous agents and robots, such as self-driving cars, scenario-based trainers, exploration robots, and service robots have brought attention to crucial trust-related challenges associated with the current…

Robotics · Computer Science 2022-09-26 Fatai Sado , Chu Kiong Loo , Wei Shiung Liew , Matthias Kerzel , Stefan Wermter

We characterize three notions of explainable AI that cut across research fields: opaque systems that offer no insight into its algo- rithmic mechanisms; interpretable systems where users can mathemat- ically analyze its algorithmic…

Artificial Intelligence · Computer Science 2017-10-03 Derek Doran , Sarah Schulz , Tarek R. Besold

Explainable Artificial Intelligence (XAI) has re-emerged in response to the development of modern AI and ML systems. These systems are complex and sometimes biased, but they nevertheless make decisions that impact our lives. XAI systems are…

Artificial Intelligence · Computer Science 2021-02-10 Shane T. Mueller , Elizabeth S. Veinott , Robert R. Hoffman , Gary Klein , Lamia Alam , Tauseef Mamun , William J. Clancey

This paper introduces a conversational interface system that enables participatory design of differentially private AI systems in public sector applications. Addressing the challenge of balancing mathematical privacy guarantees with…

Information Theory · Computer Science 2025-05-28 Wenjun Yang , Eyhab Al-Masri

Large Language Models (LLMs) have played a pivotal role in advancing Artificial Intelligence (AI). However, despite their achievements, LLMs often struggle to explain their decision-making processes, making them a 'black box' and presenting…

Computation and Language · Computer Science 2025-06-30 Avash Palikhe , Zhenyu Yu , Zichong Wang , Wenbin Zhang

Recent research suggests that it may be possible to build conscious AI systems now or in the near future. Conscious AI systems would arguably deserve moral consideration, and it may be the case that large numbers of conscious systems could…

Artificial Intelligence · Computer Science 2025-01-14 Patrick Butlin , Theodoros Lappas