English
Related papers

Related papers: Explaining Reinforcement Learning: A Counterfactua…

200 papers

The use of algorithm-agnostic approaches is an emerging area of research for explaining the contribution of individual features towards the predicted outcome. Whilst there is a focus on explaining the prediction itself, a little has been…

Machine Learning · Computer Science 2022-11-07 Guilherme Dean Pelegrina , Sajid Siraj

Session-based Recommendation (SR) systems have recently achieved considerable success, yet their complex, "black box" nature often obscures why certain recommendations are made. Existing explanation methods struggle to pinpoint truly…

Social and Information Networks · Computer Science 2025-12-02 Han Zhou , Hui Fang , Zhu Sun , Wentao Hu

Contrastive self-supervised learning (CSL) has managed to match or surpass the performance of supervised learning in image and video classification. However, it is still largely unknown if the nature of the representations induced by the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Rohit Gupta , Naveed Akhtar , Ajmal Mian , Mubarak Shah

Reinforcement Learning (RL) is a learning paradigm in which the agent learns from its environment through trial and error. Deep reinforcement learning (DRL) algorithms represent the agent's policies using neural networks, making their…

Artificial Intelligence · Computer Science 2024-09-10 Jasmina Gajcin , Jovan Jeromela , Ivana Dusparic

In this work, we examine Asymmetric Shapley Values (ASV), a variant of the popular SHAP additive local explanation method. ASV proposes a way to improve model explanations incorporating known causal relations between variables, and is also…

Machine Learning · Computer Science 2023-10-17 Domokos M. Kelen , Mihály Petreczky , Péter Kersch , András A. Benczúr

In the current era of artificial intelligence, federated learning has emerged as a novel approach to addressing data privacy concerns inherent in centralized learning paradigms. This decentralized learning model not only mitigates the risk…

Machine Learning · Computer Science 2024-10-22 Ketin Yin , Zonghao Guo , ZhengHan Qin

Reinforcement learning (RL) presents a promising framework to learn policies through environment interaction, but often requires an infeasible amount of interaction data to solve complex tasks from sparse rewards. One direction includes…

Machine Learning · Computer Science 2024-05-07 Stone Tao , Arth Shukla , Tse-kai Chan , Hao Su

Offline reinforcement learning faces a significant challenge of value over-estimation due to the distributional drift between the dataset and the current learned policy, leading to learning failure in practice. The common approach is to…

Machine Learning · Computer Science 2023-12-05 Liting Chen , Jie Yan , Zhengdao Shao , Lu Wang , Qingwei Lin , Saravan Rajmohan , Thomas Moscibroda , Dongmei Zhang

While Deep Reinforcement Learning (DRL) has emerged as a promising solution for intricate control tasks, the lack of explainability of the learned policies impedes its uptake in safety-critical applications, such as automated driving…

Machine Learning · Computer Science 2024-04-30 Amir Samadi , Konstantinos Koufos , Kurt Debattista , Mehrdad Dianati

Reinforcement Learning (RL) has demonstrated substantial potential across diverse fields, yet understanding its decision-making process, especially in real-world scenarios where rationality and safety are paramount, is an ongoing challenge.…

Artificial Intelligence · Computer Science 2024-02-21 Yu Xiong , Zhipeng Hu , Ye Huang , Runze Wu , Kai Guan , Xingchen Fang , Ji Jiang , Tianze Zhou , Yujing Hu , Haoyu Liu , Tangjie Lyu , Changjie Fan

With the widespread use of sophisticated machine learning models in sensitive applications, understanding their decision-making has become an essential task. Models trained on tabular data have witnessed significant progress in explanations…

Machine Learning · Computer Science 2022-06-16 Aditya Lahiri , Kamran Alipour , Ehsan Adeli , Babak Salimi

Contrastive learning (CL) benefits the training of sequential recommendation models with informative self-supervision signals. Existing solutions apply general sequential data augmentation strategies to generate positive pairs and encourage…

Information Retrieval · Computer Science 2024-03-19 Peilin Zhou , Jingqi Gao , Yueqi Xie , Qichen Ye , Yining Hua , Jae Boum Kim , Shoujin Wang , Sunghun Kim

Attention-based sequential recommendation methods have shown promise in accurately capturing users' evolving interests from their past interactions. Recent research has also explored the integration of reinforcement learning (RL) into these…

Machine Learning · Computer Science 2024-04-19 Melissa Mozifian , Tristan Sylvain , Dave Evans , Lili Meng

Contrastive representation learning seeks to acquire useful representations by estimating the shared information between multiple views of data. Here, the choice of data augmentation is sensitive to the quality of learned representations:…

Machine Learning · Statistics 2023-01-18 Kyungmin Lee , Jinwoo Shin

Counterfactual explanation is a form of interpretable machine learning that generates perturbations on a sample to achieve the desired outcome. The generated samples can act as instructions to guide end users on how to observe the desired…

Machine Learning · Computer Science 2023-03-28 Tri Dung Duong , Qian Li , Guandong Xu

Explaining AI systems is fundamental both to the development of high performing models and to the trust placed in them by their users. The Shapley framework for explainability has strength in its general applicability combined with its…

Machine Learning · Statistics 2021-12-21 Christopher Frye , Colin Rowat , Ilya Feige

Learning rewards from human behaviour or feedback is a promising approach to aligning AI systems with human values but fails to consistently extract correct reward functions. Interpretability tools could enable users to understand and…

Artificial Intelligence · Computer Science 2024-10-16 Jan Wehner , Frans Oliehoek , Luciano Cavalcante Siebert

Contrastive self-supervised learning (SSL) learns an embedding space that maps similar data pairs closer and dissimilar data pairs farther apart. Despite its success, one issue has been overlooked: the fairness aspect of representations…

Designing fair compensation mechanisms for demand response (DR) is challenging. This paper models the problem in a game theoretic setting and designs a payment distribution mechanism based on the Shapley Value. As exact computation of the…

Computer Science and Game Theory · Computer Science 2014-03-27 Gearóid O'Brien , Abbas El Gamal , Ram Rajagopal

Global explanations of a reinforcement learning (RL) agent's expected behavior can make it safer to deploy. However, such explanations are often difficult to understand because of the complicated nature of many RL policies. Effective human…

Machine Learning · Computer Science 2022-11-16 Sanjana Narayanan , Isaac Lage , Finale Doshi-Velez