English
Related papers

Related papers: Explainability in Human-Agent Systems

200 papers

Interpretable machine learning tackles the important problem that humans cannot understand the behaviors of complex machine learning models and how these models arrive at a particular decision. Although many approaches have been proposed, a…

Machine Learning · Computer Science 2019-05-21 Mengnan Du , Ninghao Liu , Xia Hu

Transparency is an essential requirement of machine learning based decision making systems that are deployed in real world. Often, transparency of a given system is achieved by providing explanations of the behavior and predictions of the…

Machine Learning · Computer Science 2021-05-18 André Artelt , Barbara Hammer

Explainability has been a challenge in AI for as long as AI has existed. With the recently increased use of AI in society, it has become more important than ever that AI systems would be able to explain the reasoning behind their results…

Artificial Intelligence · Computer Science 2020-09-30 Kary Främling

Artificial intelligence-augmented technology represents a considerable opportunity for improving healthcare delivery. Significant progress has been made to demonstrate the value of complex models to enhance clinicians` efficiency in…

Human-Computer Interaction · Computer Science 2025-04-08 Mohammad Golam Kibria , Lauren Kucirka , Javed Mostafa

Explanation in machine learning and related fields such as artificial intelligence aims at making machine learning models and their decisions understandable to humans. Existing work suggests that personalizing explanations might help to…

Machine Learning · Computer Science 2019-04-29 Johanes Schneider , Joshua Handali

As large language models (LLMs) are increasingly deployed in sensitive domains such as healthcare, law, and education, the demand for transparent, interpretable, and accountable AI systems becomes more urgent. Explainable AI (XAI) acts as a…

Computers and Society · Computer Science 2025-05-28 Francisco Herrera

The understanding of context and context-awareness is very important for the areas of handheld and ubiquitous computing. Unfortunately, at present, there has not been a satisfactory definition of these two concepts that would lead to a more…

Human-Computer Interaction · Computer Science 2008-01-08 George Tsibidis , Theodoros N. Arvanitis , Chris Baber

Artificial intelligence now outperforms humans in several scientific and engineering tasks, yet its internal representations often remain opaque. In this Perspective, we argue that explainable artificial intelligence (XAI), combined with…

Artificial Intelligence · Computer Science 2026-02-17 Ricardo Vinuesa , Steven L. Brunton , Gianmarco Mengaldo

Explainability is highly-desired in Machine Learning (ML) systems supporting high-stakes policy decisions in areas such as health, criminal justice, education, and employment. While the field of explainable ML has expanded in recent years,…

Machine Learning · Computer Science 2023-02-21 Kasun Amarasinghe , Kit Rodolfa , Hemank Lamba , Rayid Ghani

Software analytics has been the subject of considerable recent attention but is yet to receive significant industry traction. One of the key reasons is that software practitioners are reluctant to trust predictions produced by the analytics…

Software Engineering · Computer Science 2018-02-05 Hoa Khanh Dam , Truyen Tran , Aditya Ghose

Accountability is widely understood as a goal for well governed computer systems, and is a sought-after value in many governance contexts. But how can it be achieved? Recent work on standards for governable artificial intelligence systems…

Computers and Society · Computer Science 2021-08-23 Joshua A. Kroll

Recent works have recognized the need for human-centered perspectives when designing and evaluating human-AI interactions and explainable AI methods. Yet, current approaches fall short at intercepting and managing unexpected user behavior…

Human-Computer Interaction · Computer Science 2022-05-04 Michaela Benk , Raphael Weibel , Andrea Ferrario

With the recent proliferation of artificial intelligence systems, there has been a surge in the demand for explainability of these systems. Explanations help to reduce system opacity, support transparency, and increase stakeholder trust. In…

Software Engineering · Computer Science 2024-09-12 Umm-e-Habiba , Justus Bogner , Stefan Wagner

Explainability is motivated by the lack of transparency of black-box Machine Learning approaches, which do not foster trust and acceptance of Machine Learning algorithms. This also happens in the Predictive Process Monitoring field, where…

Artificial Intelligence · Computer Science 2025-07-25 Williams Rizzi , Marco Comuzzi , Chiara Di Francescomarino , Chiara Ghidini , Suhwan Lee , Fabrizio Maria Maggi , Alexander Nolte

Safety critical systems strongly require the quality aspects of artificial intelligence including explainability. In this paper, we analyzed a trained network to extract features which mainly contribute the inference. Based on the analysis,…

Computer Vision and Pattern Recognition · Computer Science 2017-12-11 Hiroshi Kuwajima , Masayuki Tanaka

Autonomous systems in remote locations have a high degree of autonomy and there is a need to explain what they are doing and why in order to increase transparency and maintain trust. Here, we describe a natural language chat interface that…

Computation and Language · Computer Science 2018-03-07 Francisco J. Chiyah Garcia , David A. Robb , Xingkun Liu , Atanas Laskov , Pedro Patron , Helen Hastie

As artificial intelligence becomes increasingly pervasive and powerful, the ability to audit AI-based systems is growing in importance. However, explainability for artificial intelligence systems is not a one-size-fits-all solution;…

Human-Computer Interaction · Computer Science 2025-10-13 Nicola Rossberg , Bennett Kleinberg , Barry O'Sullivan , Luca Longo , Andrea Visentin

Decision-making algorithms are being used in important decisions, such as who should be enrolled in health care programs and be hired. Even though these systems are currently deployed in high-stakes scenarios, many of them cannot explain…

Computers and Society · Computer Science 2022-05-12 Gabriel Lima , Nina Grgić-Hlača , Jin Keun Jeong , Meeyoung Cha

Ante-hoc interpretability has become the holy grail of explainable artificial intelligence for high-stakes domains such as healthcare; however, this notion is elusive, lacks a widely-accepted definition and depends on the operational…

Machine Learning · Computer Science 2023-07-11 Kacper Sokol , Julia E. Vogt

Interactive Artificial Intelligence (AI) agents are becoming increasingly prevalent in society. However, application of such systems without understanding them can be problematic. Black-box AI systems can lead to liability and…

Computers and Society · Computer Science 2023-01-16 Pradyumna Tambwekar , Matthew Gombolay