English
Related papers

Related papers: eXplainable AI for data driven control: an inverse…

200 papers

Recent AI algorithms are black box models whose decisions are difficult to interpret. eXplainable AI (XAI) is a class of methods that seek to address lack of AI interpretability and trust by explaining to customers their AI decisions. The…

Artificial Intelligence · Computer Science 2024-04-02 Behnam Mohammadi , Nikhil Malik , Tim Derdenger , Kannan Srinivasan

Explainability plays a crucial role in providing a more comprehensive understanding of deep learning models' behaviour. This allows for thorough validation of the model's performance, ensuring that its decisions are based on relevant visual…

Machine Learning · Computer Science 2023-06-16 E. Zhixuan Zeng , Hayden Gunraj , Sheldon Fernandez , Alexander Wong

Post-hoc explainability methods are a subset of Machine Learning (ML) that aim to provide a reason for why a model behaves in a certain way. In this paper, we show a new black-box model-agnostic adversarial attack for post-hoc explainable…

Machine Learning · Computer Science 2025-11-14 Leonardo Pesce , Jiawen Wei , Gianmarco Mengaldo

We propose and implement an interpretable machine learning classification model for Explainable AI (XAI) based on expressive Boolean formulas. Potential applications include credit scoring and diagnosis of medical conditions. The Boolean…

This paper introduces a novel model-free and a partially model-free algorithm for inverse optimal control (IOC), also known as inverse reinforcement learning (IRL), aimed at estimating the cost function of continuous-time nonlinear…

Systems and Control · Electrical Eng. & Systems 2025-03-20 Hamed Jabbari Asl , Eiji Uchibe

Explainable AI (XAI) is an active research area to interpret a neural network's decision by ensuring transparency and trust in the task-specified learned models. Recently, perturbation-based model analysis has shown better interpretation,…

Computer Vision and Pattern Recognition · Computer Science 2021-02-17 Mahesh Sudhakar , Sam Sattarzadeh , Konstantinos N. Plataniotis , Jongseong Jang , Yeonjeong Jeong , Hyunwoo Kim

The explainability of black-box machine learning algorithms, commonly known as Explainable Artificial Intelligence (XAI), has become crucial for financial and other regulated industrial applications due to regulatory requirements and the…

Machine Learning · Computer Science 2024-08-14 Gregory Yampolsky , Dhruv Desai , Mingshu Li , Stefano Pasquali , Dhagash Mehta

Artificial Intelligence (AI) is rapidly expanding and integrating more into daily life to automate tasks, guide decision making, and enhance efficiency. However, complex AI models, which make decisions without providing clear explanations…

Software Engineering · Computer Science 2025-09-03 Lakshit Arora , Sanjay Surendranath Girija , Shashank Kapoor , Aman Raj , Dipen Pradhan , Ankit Shetgaonkar

A longstanding challenge surrounding deep learning algorithms is unpacking and understanding how they make their decisions. Explainable Artificial Intelligence (XAI) offers methods to provide explanations of internal functions of algorithms…

Artificial Intelligence · Computer Science 2022-08-16 Amin Nayebi , Sindhu Tipirneni , Brandon Foreman , Chandan K. Reddy , Vignesh Subbian

Cost functions have the potential to provide compact and understandable generalizations of motion. The goal of Inverse Optimal Control (IOC) is to analyze an observed behavior which is assumed to be optimal with respect to an unknown cost…

Robotics · Computer Science 2021-04-27 John R. Rebula , Stefan Schaal , James Finley , Ludovic Righetti

Explanation is key to people having confidence in high-stakes AI systems. However, machine-learning-based systems -- which account for almost all current AI -- can't explain because they are usually black boxes. The explainable AI (XAI)…

Artificial Intelligence · Computer Science 2024-09-30 Sergei Nirenburg , Marjorie McShane , Kenneth W. Goodman , Sanjay Oruganti

Both humans and machine learning models learn from experience, particularly in safety- and reliability-critical domains. While psychology seeks to understand human cognition, the field of Explainable AI (XAI) develops methods to interpret…

Human-Computer Interaction · Computer Science 2025-11-25 Roussel Rahman , Aashwin Ananda Mishra , Wan-Lin Hu

Explainable AI (XAI) is an increasingly important area of machine learning research, which aims to make black-box models transparent and interpretable. In this paper, we propose a novel approach to XAI that uses the so-called counterfactual…

Artificial Intelligence · Computer Science 2023-08-02 Bastian Pfeifer , Mateusz Krzyzinski , Hubert Baniecki , Anna Saranti , Andreas Holzinger , Przemyslaw Biecek

XAI refers to the techniques and methods for building AI applications which assist end users to interpret output and predictions of AI models. Black box AI applications in high-stakes decision-making situations, such as medical domain have…

The adoption of intelligent systems creates opportunities as well as challenges for medical work. On the positive side, intelligent systems have the potential to compute complex data from patients and generate automated diagnosis…

Human-Computer Interaction · Computer Science 2019-02-19 Yao Xie , Ge Gao , Xiang 'Anthony' Chen

Explainability has been a challenge in AI for as long as AI has existed. With the recently increased use of AI in society, it has become more important than ever that AI systems would be able to explain the reasoning behind their results…

Artificial Intelligence · Computer Science 2020-09-30 Kary Främling

Although modern machine learning and deep learning methods allow for complex and in-depth data analytics, the predictive models generated by these methods are often highly complex, and lack transparency. Explainable AI (XAI) methods are…

Machine Learning · Computer Science 2021-06-17 Mythreyi Velmurugan , Chun Ouyang , Catarina Moreira , Renuka Sindhgatta

Cybersecurity vendors consistently apply AI (Artificial Intelligence) to their solutions and many cybersecurity domains can benefit from AI technology. However, black-box AI techniques present some difficulties in comprehension and adoption…

Cryptography and Security · Computer Science 2023-03-03 Carlos Mendes , Tatiane Nogueira Rios

Explainable Artificial Intelligence (XAI) methods are intended to help human users better understand the decision making of an AI agent. However, many modern XAI approaches are unintuitive to end users, particularly those without prior AI…

Machine Learning · Computer Science 2022-09-09 Faraz Khadivpour , Arghasree Banerjee , Matthew Guzdial

Explainable AI (XAI) techniques are necessary to help clinicians make sense of AI predictions and integrate predictions into their decision-making workflow. In this work, we conduct a survey study to understand clinician preference among…

Computation and Language · Computer Science 2025-08-28 Jun Hou , Lucy Lu Wang