English
Related papers

Related papers: Causal Explanation for Reinforcement Learning: Qua…

200 papers

Work on "learning with rationales" shows that humans providing explanations to a machine learning system can improve the system's predictive accuracy. However, this work has not been connected to work in "explainable AI" which concerns…

Computation and Language · Computer Science 2019-06-03 Julia Strout , Ye Zhang , Raymond J. Mooney

While Reinforcement Learning (RL) achieves tremendous success in sequential decision-making problems of many domains, it still faces key challenges of data inefficiency and the lack of interpretability. Interestingly, many researchers have…

Artificial Intelligence · Computer Science 2023-06-02 Yan Zeng , Ruichu Cai , Fuchun Sun , Libo Huang , Zhifeng Hao

Much of our experiments are designed to uncover the cause(s) and effect(s) behind a data generating mechanism (i.e., phenomenon) we happen to be interested in. Uncovering such relationships allows us to identify the true working of a…

Machine Learning · Computer Science 2023-07-11 M. Z. Naser

Reinforcement learning (RL) agents optimize only the features specified in a reward function and are indifferent to anything left out inadvertently. This means that we must not only specify what to do, but also the much larger space of what…

Machine Learning · Computer Science 2019-04-22 Rohin Shah , Dmitrii Krasheninnikov , Jordan Alexander , Pieter Abbeel , Anca Dragan

It has long been hypothesised that causal reasoning plays a fundamental role in robust and general intelligence. However, it is not known if agents must learn causal models in order to generalise to new domains, or if other inductive biases…

Artificial Intelligence · Computer Science 2024-07-22 Jonathan Richens , Tom Everitt

Inspired by a novel action-theoretic formalization of actual cause, Khan and Lesp\'erance (2021) recently proposed a first account of causal knowledge that supports epistemic effects, models causal knowledge dynamics, and allows sensing…

Artificial Intelligence · Computer Science 2022-05-17 Shakil M. Khan

A key to causal inference with observational data is achieving balance in predictive features associated with each treatment type. Recent literature has explored representation learning to achieve this goal. In this work, we discuss the…

Machine Learning · Statistics 2021-02-25 Serge Assaad , Shuxi Zeng , Chenyang Tao , Shounak Datta , Nikhil Mehta , Ricardo Henao , Fan Li , Lawrence Carin

The ability to robustly identify causal relationships is essential for autonomous decision-making and adaptation to novel scenarios. However, accurately inferring causal structure requires integrating both world knowledge and abstract…

Machine Learning · Computer Science 2025-06-17 Khurram Yamin , Shantanu Gupta , Gaurav R. Ghosal , Zachary C. Lipton , Bryan Wilder

In Reinforcement Learning-based Recommender Systems (RLRS), the complexity and dynamism of user interactions often result in high-dimensional and noisy state spaces, making it challenging to discern which aspects of the state are truly…

Artificial Intelligence · Computer Science 2024-07-19 Siyu Wang , Xiaocong Chen , Lina Yao

In this work, we argue for the importance of causal reasoning in creating fair algorithms for decision making. We give a review of existing approaches to fairness, describe work in causality necessary for the understanding of causal…

Artificial Intelligence · Computer Science 2018-05-16 Joshua R. Loftus , Chris Russell , Matt J. Kusner , Ricardo Silva

Feature importance estimates that inform users about the degree to which given inputs influence the output of a predictive model are crucial for understanding, validating, and interpreting machine-learning models. However, providing fast…

Machine Learning · Computer Science 2019-10-29 Patrick Schwab , Walter Karlen

A suitable state representation is a fundamental part of the learning process in Reinforcement Learning. In various tasks, the state can either be described by natural language or be natural language itself. This survey outlines the…

Computation and Language · Computer Science 2020-07-21 Brielen Madureira , David Schlangen

When learning a task as a team, some agents in Multi-Agent Reinforcement Learning (MARL) may fail to understand their true impact in the performance of the team. Such agents end up learning sub-optimal policies, demonstrating undesired lazy…

Artificial Intelligence · Computer Science 2023-03-28 Rafael Pina , Varuna De Silva , Corentin Artaud

When users can benefit from certain predictive outcomes, they may be prone to act to achieve those outcome, e.g., by strategically modifying their features. The goal in strategic classification is therefore to train predictive models that…

Machine Learning · Computer Science 2023-06-12 Guy Horowitz , Nir Rosenfeld

Selective rationalization has become a common mechanism to ensure that predictive models reveal how they use any available features. The selection may be soft or hard, and identifies a subset of input features relevant for prediction. The…

Computation and Language · Computer Science 2019-12-17 Mo Yu , Shiyu Chang , Yang Zhang , Tommi S. Jaakkola

Deep reinforcement learning (DRL) requires the collection of interventional data, which is sometimes expensive and even unethical in the real world, such as in the autonomous driving and the medical field. Offline reinforcement learning…

Machine Learning · Computer Science 2023-06-12 Wenxuan Zhu , Chao Yu , Qiang Zhang

In the rapidly growing literature on explanation algorithms, it often remains unclear what precisely these algorithms are for and how they should be used. In this position paper, we argue for a novel and pragmatic perspective: Explainable…

Machine Learning · Computer Science 2025-06-17 Sebastian Bordt , Eric Raidl , Ulrike von Luxburg

During a research project in which we developed a machine learning (ML) driven visualization system for non-ML experts, we reflected on interpretability research in ML, computer-supported collaborative work and human-computer interaction.…

Human-Computer Interaction · Computer Science 2022-01-19 Jesse Josua Benjamin , Christoph Kinkeldey , Claudia Müller-Birn , Tim Korjakow , Eva-Maria Herbst

Explainability is needed to establish confidence in machine learning results. Some explainable methods take a post hoc approach to explain the weights of machine learning models, others highlight areas of the input contributing to…

Machine Learning · Computer Science 2024-07-15 Paul Whitten , Francis Wolff , Chris Papachristou

Automated decision making is used routinely throughout our everyday life. Recommender systems decide which jobs, movies, or other user profiles might be interesting to us. Spell checkers help us to make good use of language. Fraud detection…

Machine Learning · Computer Science 2020-07-15 Alexander Jung , Pedro H. J. Nardelli
‹ Prev 1 4 5 6 7 8 10 Next ›