English
Related papers

Related papers: XAI for Coding Agent Failures: Transforming Raw Ex…

200 papers

Agentic systems augment large language models with external tools and iterative decision making, enabling complex tasks such as deep research, function calling, and coding. However, their long and intricate execution traces make failure…

Learned classifiers deployed in agentic pipelines face a fundamental reliability problem: predictions are probabilistic inferences, not verified conclusions, and acting on them without grounding in observable evidence leads to compounding…

Software Engineering · Computer Science 2026-04-14 Jugal Gajjar

Over the last decade, explainable AI has primarily focused on interpreting individual model predictions, producing post-hoc explanations that relate inputs to outputs under a fixed decision structure. Recent advances in large language…

Artificial Intelligence · Computer Science 2026-03-09 Sindhuja Chaduvula , Jessee Ho , Kina Kim , Aravind Narayanan , Mahshid Alinoori , Muskan Garg , Dhanesh Ramachandram , Shaina Raza

Explainable AI (XAI) has emerged as a powerful tool for improving the performance of AI models, going beyond providing model transparency and interpretability. The scarcity of labeled data remains a fundamental challenge in developing…

Computation and Language · Computer Science 2025-06-05 Melkamu Abay Mersha , Mesay Gemeda Yigezu , Atnafu Lambebo Tonja , Hassan Shakil , Samer Iskander , Olga Kolesnikova , Jugal Kalita

Explainable Artificial Intelligence (XAI) strategies play a crucial part in increasing the understanding and trustworthiness of neural networks. Nonetheless, these techniques could potentially generate misleading explanations. Blinding…

Machine Learning · Computer Science 2024-03-26 Md Abdul Kadir , GowthamKrishna Addluri , Daniel Sonntag

Indecipherable black boxes are common in machine learning (ML), but applications increasingly require explainable artificial intelligence (XAI). The core of XAI is to establish transparent and interpretable data-driven algorithms. This work…

Optimization and Control · Mathematics 2023-06-13 Howard Heaton , Samy Wu Fung

This paper introduces an approach to increasing the explainability of artificial intelligence (AI) systems by embedding Large Language Models (LLMs) within standardized analytical processes. While traditional explainable AI (XAI) methods…

Artificial Intelligence · Computer Science 2025-11-11 Marc Jansen , Marcel Pehlke

The advances in artificial intelligence enabled by deep learning architectures are undeniable. In several cases, deep neural network driven models have surpassed human level performance in benchmark autonomy tasks. The underlying policies…

Artificial Intelligence · Computer Science 2021-06-11 Jeff Druce , James Niehaus , Vanessa Moody , David Jensen , Michael L. Littman

A longstanding challenge surrounding deep learning algorithms is unpacking and understanding how they make their decisions. Explainable Artificial Intelligence (XAI) offers methods to provide explanations of internal functions of algorithms…

Artificial Intelligence · Computer Science 2022-08-16 Amin Nayebi , Sindhu Tipirneni , Brandon Foreman , Chandan K. Reddy , Vignesh Subbian

Explainable AI (XAI) aims to support appropriate human-AI reliance by increasing the interpretability of complex model decisions. Despite the proliferation of proposed methods, there is mixed evidence surrounding the effects of different…

Human-Computer Interaction · Computer Science 2024-10-29 Emma Casolin , Flora D. Salim , Ben Newell

Nowadays, deep neural networks are widely used in mission critical systems such as healthcare, self-driving vehicles, and military which have direct impact on human lives. However, the black-box nature of deep neural networks challenges its…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Arun Das , Paul Rad

Communication networks are becoming increasingly complex towards 6G. Manual management is no longer an option for network operators. Network automation has been widely discussed in the networking community, and it is a sensible means to…

Networking and Internet Architecture · Computer Science 2022-05-12 Yulei Wu , Guozhi Lin , Jingguo Ge

Explainable AI (XAI) systems have been proposed to help people understand how AI systems produce outputs and behaviors. Explainable Reinforcement Learning (XRL) has an added complexity due to the temporal nature of sequential…

Artificial Intelligence · Computer Science 2025-08-19 Madhuri Singh , Amal Alabdulkarim , Gennie Mansi , Mark O. Riedl

Utilizing potent representations of the large vision-language models (VLMs) to accomplish various downstream tasks has attracted increasing attention. Within this research field, soft prompt learning has become a representative approach for…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Yequan Bie , Luyang Luo , Zhixuan Chen , Hao Chen

Artificial intelligence is reshaping science and industry, yet many users still regard its models as opaque "black boxes". Conventional explainable artificial-intelligence methods clarify individual predictions but overlook the upstream…

Machine Learning · Computer Science 2025-08-18 George Paterakis , Andrea Castellani , George Papoutsoglou , Tobias Rodemann , Ioannis Tsamardinos

Explainable AI (XAI) is a rapidly growing domain with a myriad of proposed methods as well as metrics aiming to evaluate their efficacy. However, current studies are often of limited scope, examining only a handful of XAI methods and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Lukas Klein , Carsten T. Lüth , Udo Schlegel , Till J. Bungert , Mennatallah El-Assady , Paul F. Jäger

Concerns have arisen regarding the unregulated utilization of artificial intelligence (AI) outputs, potentially leading to various societal issues. While humans routinely validate information, manually inspecting the vast volumes of…

Software Engineering · Computer Science 2025-01-07 Shota Aoki , Takahiro Katagiri , Satoshi Ohshima , Masatoshi Kawai , Toru Nagai , Tetsuya Hoshino

Research into explainable artificial intelligence (XAI) for data analysis tasks suffer from a large number of contradictions and lack of concrete design recommendations stemming from gaps in understanding the tasks that require AI…

Artificial Intelligence · Computer Science 2025-07-15 Hamzah Ziadeh , Hendrik Knoche

AI agents often fail in ways that are difficult to localize because executions are probabilistic, long-horizon, multi-agent, and mediated by noisy tool outputs. We address this gap by manually annotating failed agent runs and release a…

Artificial Intelligence · Computer Science 2026-02-03 Shraddha Barke , Arnav Goyal , Alind Khare , Avaljot Singh , Suman Nath , Chetan Bansal

This position paper highlights a growing trend in Explainable AI (XAI) research where Large Language Models (LLMs) are used to translate outputs from explainability techniques, like feature-attribution weights, into a natural language…

Human-Computer Interaction · Computer Science 2025-04-18 Ashley Suh , Kenneth Alperin , Harry Li , Steven R Gomez