English
Related papers

Related papers: Counterfactual State Explanations for Reinforcemen…

200 papers

We study reinforcement learning (RL) for text-based games, which are interactive simulations in the context of natural language. While different methods have been developed to represent the environment information and language actions,…

Machine Learning · Computer Science 2020-12-29 Yunqiu Xu , Meng Fang , Ling Chen , Yali Du , Joey Tianyi Zhou , Chengqi Zhang

Deep reinforcement learning (RL) algorithms are powerful tools for solving visuomotor decision tasks. However, the trained models are often difficult to interpret, because they are represented as end-to-end deep neural networks. In this…

Machine Learning · Computer Science 2021-11-04 Sihang Guo , Ruohan Zhang , Bo Liu , Yifeng Zhu , Mary Hayhoe , Dana Ballard , Peter Stone

Reinforcement learning (RL) is an area of research that has blossomed tremendously in recent years and has shown remarkable potential for artificial intelligence based opponents in computer games. This success is primarily due to the vast…

Artificial Intelligence · Computer Science 2018-08-16 Per-Arne Andersen , Morten Goodwin , Ole-Christoffer Granmo

Deep reinforcement learning has been shown to be a powerful framework for learning policies from complex high-dimensional sensory inputs to actions in complex tasks, such as the Atari domain. In this paper, we explore output representation…

Machine Learning · Computer Science 2016-06-16 Ishan P. Durugkar , Clemens Rosenbaum , Stefan Dernbach , Sridhar Mahadevan

To collaborate well with robots, we must be able to understand their decision making. Humans naturally infer other agents' beliefs and desires by reasoning about their observable behavior in a way that resembles inverse reinforcement…

Robotics · Computer Science 2022-08-05 Michael S. Lee , Henny Admoni , Reid Simmons

Despite the impressive feats demonstrated by Reinforcement Learning (RL), these algorithms have seen little adoption in high-risk, real-world applications due to current difficulties in explaining RL agent actions and building user trust.…

Machine Learning · Computer Science 2023-12-08 Timothy K. Mathes , Jessica Inman , Andrés Colón , Simon Khan

Due to the limited availability of medical data, deep learning approaches for medical image analysis tend to generalise poorly to unseen data. Augmenting data during training with random transformations has been shown to help and became a…

Image and Video Processing · Electrical Eng. & Systems 2022-10-04 Tian Xia , Pedro Sanchez , Chen Qin , Sotirios A. Tsaftaris

Generative Adversarial Networks (GAN) have emerged as a formidable AI tool to generate realistic outputs based on training datasets. However, the challenge of exerting control over the generation process of GANs remains a significant…

This study presents a novel framework for counterfactual user behavior forecasting that combines structural causal models with transformer-based generative artificial intelligence. To model fictitious situations, the method creates causal…

Machine Learning · Computer Science 2025-11-12 Dharmateja Priyadarshi Uddandarao , Ravi Kiran Vadlamani

Human actions are based on the mental perception of the environment. Even when all the aspects of an environment are not visible, humans have an internal mental model that can generalize the partially visible scenes to fully constructed and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Usama Younus , Vinoj Jayasundara , Shivam Mishra , Suleyman Aslan

One of the prominent methods for explaining the decision of a machine-learning classifier is by a counterfactual example. Most current algorithms for generating such examples in the textual domain are based on generative language models.…

Machine Learning · Computer Science 2023-12-19 Daniel Gilo , Shaul Markovitch

Counterfactual explanations elucidate algorithmic decisions by pointing to scenarios that would have led to an alternative, desired outcome. Giving insight into the model's behavior, they hint users towards possible actions and give grounds…

Machine Learning · Statistics 2024-04-05 Susanne Dandl , Kristin Blesch , Timo Freiesleben , Gunnar König , Jan Kapar , Bernd Bischl , Marvin Wright

Reinforcement Learning (RL) is an area of machine learning figuring out how agents take actions in an unknown environment to maximize its rewards. Unlike classical Markov Decision Process (MDP) in which agent has full knowledge of its…

Artificial Intelligence · Computer Science 2023-03-07 Yangxin Zhong , Jiajie He , Lingjie Kong

Our main contribution in this work is an empirical finding that random General Value Functions (GVFs), i.e., deep action-conditional predictions -- random both in what feature of observations they predict as well as in the sequence of…

Machine Learning · Computer Science 2021-11-09 Zeyu Zheng , Vivek Veeriah , Risto Vuorio , Richard Lewis , Satinder Singh

Deep reinforcement learning (RL) policies are known to be vulnerable to adversarial perturbations to their observations, similar to adversarial examples for classifiers. However, an attacker is not usually able to directly modify another…

Machine Learning · Computer Science 2021-01-19 Adam Gleave , Michael Dennis , Cody Wild , Neel Kant , Sergey Levine , Stuart Russell

Counterfactual explanations for machine learning models are used to find minimal interventions to the feature values such that the model changes the prediction to a different output or a target output. A valid counterfactual explanation…

Machine Learning · Computer Science 2023-03-23 Shravan Kumar Sajja , Sumanta Mukherjee , Satyam Dwivedi

Counterfactual explanations promote explainability in machine learning models by answering the question "how should an input instance be perturbed to obtain a desired predicted label?". The comparison of this instance before and after…

Machine Learning · Computer Science 2022-11-09 Jing Ma , Ruocheng Guo , Saumitra Mishra , Aidong Zhang , Jundong Li

We propose a novel approach to mitigate biases in computer vision models by utilizing counterfactual generation and fine-tuning. While counterfactuals have been used to analyze and address biases in DNN models, the counterfactuals…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Pushkar Shukla , Dhruv Srikanth , Lee Cohen , Matthew Turk

Explainable Artificial Intelligence (XAI) is a set of techniques that allows the understanding of both technical and non-technical aspects of Artificial Intelligence (AI) systems. XAI is crucial to help satisfying the increasingly important…

Artificial Intelligence · Computer Science 2021-11-09 Riccardo Crupi , Alessandro Castelnovo , Daniele Regoli , Beatriz San Miguel Gonzalez

Counterfactual explanations are increasingly used as an Explainable Artificial Intelligence (XAI) technique to provide stakeholders of complex machine learning algorithms with explanations for data-driven decisions. The popularity of…

Artificial Intelligence · Computer Science 2023-04-26 Dieter Brughmans , Lissa Melis , David Martens
‹ Prev 1 4 5 6 7 8 10 Next ›