English
Related papers

Related papers: Counterfactual State Explanations for Reinforcemen…

200 papers

Intelligent agents such as robots are increasingly deployed in real-world, safety-critical settings. It is vital that these agents are able to explain the reasoning behind their decisions to human counterparts, however, their behavior is…

Machine Learning · Computer Science 2023-09-20 Xijia Zhang , Yue Guo , Simon Stepputtis , Katia Sycara , Joseph Campbell

Action advising endeavors to leverage supplementary guidance from expert teachers to alleviate the issue of sampling inefficiency in Deep Reinforcement Learning (DRL). Previous agent-specific action advising methods are hindered by…

Artificial Intelligence · Computer Science 2023-11-29 Yaoquan Wei , Shunyu Liu , Jie Song , Tongya Zheng , Kaixuan Chen , Yong Wang , Mingli Song

A key challenge in model-based reinforcement learning (RL) is to synthesize computationally efficient and accurate environment models. We show that carefully designed generative models that learn and operate on compact state…

Reinforcement learning (RL) has shown great success in solving many challenging tasks via use of deep neural networks. Although using deep learning for RL brings immense representational power, it also causes a well-known…

Machine Learning · Computer Science 2022-04-18 Sahir , Ercüment İlhan , Srijita Das , Matthew E. Taylor

Adversarial examples are firstly investigated in the area of computer vision: by adding some carefully designed ''noise'' to the original input image, the perturbed image that cannot be distinguished from the original one by human, can fool…

Machine Learning · Computer Science 2020-06-02 Pengyue Wang , Yan Li , Shashi Shekhar , William F. Northrop

Deep Reinforcement Learning (DRL) is a frequently employed technique to solve scheduling problems. Although DRL agents ace at delivering viable results in short computing times, their reasoning remains opaque. We conduct a case study where…

Artificial Intelligence · Computer Science 2024-09-02 Daniel Fischer , Hannah M. Hüsener , Felix Grumbach , Lukas Vollenkemper , Arthur Müller , Pascal Reusch

In the last decade, deep learning has achieved great success in machine learning tasks where the input data is represented with different levels of abstractions. Driven by the recent research in reinforcement learning using deep neural…

Machine Learning · Computer Science 2022-05-18 Dejan Markovikj

Deep reinforcement learning achieves superhuman performance in a range of video game environments, but requires that a designer manually specify a reward function. It is often easier to provide demonstrations of a target behavior than to…

Machine Learning · Computer Science 2018-10-26 Aaron Tucker , Adam Gleave , Stuart Russell

End-to-end reinforcement learning agents learn a state representation and a policy at the same time. Recurrent neural networks (RNNs) have been trained successfully as reinforcement learning agents in settings like dialogue that require…

Machine Learning · Computer Science 2019-06-25 Layla El Asri , Adam Trischler

Artificial intelligence (AI) is increasingly being considered to assist human decision-making in high-stake domains (e.g. health). However, researchers have discussed an issue that humans can over-rely on wrong suggestions of the AI model…

Human-Computer Interaction · Computer Science 2023-08-09 Min Hun Lee , Chong Jun Chew

Counterfactual explanations are an increasingly popular form of post hoc explanation due to their (i) applicability across problem domains, (ii) proposed legal compliance (e.g., with GDPR), and (iii) reliance on the contrastive nature of…

Artificial Intelligence · Computer Science 2023-03-17 Greta Warren , Mark T. Keane , Christophe Gueret , Eoin Delaney

Model-free reinforcement learning (RL) can be used to learn effective policies for complex tasks, such as Atari games, even from image observations. However, this typically requires very large amounts of interaction -- substantially more,…

Counterfactual reasoning requires predicting how alternative events, contrary to what actually happened, might have resulted in different outcomes. Despite being considered a necessary component of AI-complete systems, few resources have…

Computation and Language · Computer Science 2019-09-13 Lianhui Qin , Antoine Bosselut , Ari Holtzman , Chandra Bhagavatula , Elizabeth Clark , Yejin Choi

In a recent study, Reinforcement Learning (RL) used in combination with many-objective search, has been shown to outperform alternative techniques (random search and many-objective search) for online testing of Deep Neural Network-enabled…

Software Engineering · Computer Science 2024-03-21 Luca Giamattei , Matteo Biagiola , Roberto Pietrantuono , Stefano Russo , Paolo Tonella

Reinforcement learning techniques successfully generate convincing agent behaviors, but it is still difficult to tailor the behavior to align with a user's specific preferences. What is missing is a communication method for the system to…

Human-Computer Interaction · Computer Science 2021-05-28 Christian Arzate Cruz , Takeo Igarashi

Deep reinforcement learning has learned to play many games well, but failed on others. To better characterize the modes and reasons of failure of deep reinforcement learners, we test the widely used Asynchronous Actor-Critic (A2C) algorithm…

Machine Learning · Computer Science 2019-08-14 Philip Bontrager , Ahmed Khalifa , Damien Anderson , Matthew Stephenson , Christoph Salge , Julian Togelius

Although many machine learning methods, especially from the field of deep learning, have been instrumental in addressing challenges within robotic applications, we cannot take full advantage of such methods before these can provide…

Robotics · Computer Science 2022-12-09 Vilde B. Gjærum , Inga Strümke , Anastasios M. Lekkas , Tim Miller

Counterfactual instances are a powerful tool to obtain valuable insights into automated decision processes, describing the necessary minimal changes in the input space to alter the prediction towards a desired target. Most previous…

Machine Learning · Computer Science 2021-06-07 Robert-Florian Samoilescu , Arnaud Van Looveren , Janis Klaise

In this paper we introduce and evaluate a distal explanation model for model-free reinforcement learning agents that can generate explanations for `why' and `why not' questions. Our starting point is the observation that causal models can…

Artificial Intelligence · Computer Science 2020-09-15 Prashan Madumal , Tim Miller , Liz Sonenberg , Frank Vetere

As machine learning (ML) models become more widely deployed in high-stakes applications, counterfactual explanations have emerged as key tools for providing actionable model explanations in practice. Despite the growing popularity of…

Machine Learning · Computer Science 2022-12-16 Martin Pawelczyk , Chirag Agarwal , Shalmali Joshi , Sohini Upadhyay , Himabindu Lakkaraju