English
Related papers

Related papers: Causal Reinforcement Learning: A Survey

200 papers

Recommender Systems (RS) have significantly advanced online content filtering and personalized decision-making. However, emerging vulnerabilities in RS have catalyzed a paradigm shift towards Trustworthy RS (TRS). Despite substantial…

Information Retrieval · Computer Science 2025-02-19 Jin Li , Shoujin Wang , Qi Zhang , Longbing Cao , Fang Chen , Xiuzhen Zhang , Dietmar Jannach , Charu C. Aggarwal

Causal questions inquire about causal relationships between different events or phenomena. They are important for a variety of use cases, including virtual assistants and search engines. However, many current approaches to causal question…

Artificial Intelligence · Computer Science 2024-03-26 Lukas Blübaum , Stefan Heindorf

Causal discovery studies the problem of mining causal relationships between variables from data, which is of primary interest in science. During the past decades, significant amount of progresses have been made toward this fundamental data…

Artificial Intelligence · Computer Science 2016-11-28 Kui Yu , Jiuyong Li , Lin Liu

Reinforcement learning is about learning agent models that make the best sequential decisions in unknown environments. In an unknown environment, the agent needs to explore the environment while exploiting the collected information, which…

Machine Learning · Computer Science 2021-02-12 Hong Qian , Yang Yu

Recently, recommender system (RS) based on causal inference has gained much attention in the industrial community, as well as the states of the art performance in many prediction and debiasing tasks. Nevertheless, a unified causal analysis…

Information Retrieval · Computer Science 2022-05-19 Peng Wu , Haoxuan Li , Yuhao Deng , Wenjie Hu , Quanyu Dai , Zhenhua Dong , Jie Sun , Rui Zhang , Xiao-Hua Zhou

Visual representation learning is ubiquitous in various real-world applications, including visual comprehension, video understanding, multi-modal analysis, human-computer interaction, and urban computing. Due to the emergence of huge…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Yang Liu , Yushen Wei , Hong Yan , Guanbin Li , Liang Lin

The two fields of machine learning and graphical causality arose and developed separately. However, there is now cross-pollination and increasing interest in both fields to benefit from the advances of the other. In the present paper, we…

Autonomous operations of robots in unknown environments are challenging due to the lack of knowledge of the dynamics of the interactions, such as the objects' movability. This work introduces a novel Causal Reinforcement Learning approach…

The convenient access to copious multi-faceted data has encouraged machine learning researchers to reconsider correlation-based learning and embrace the opportunity of causality-based learning, i.e., causal machine learning (causal…

Machine Learning · Computer Science 2022-02-08 Lu Cheng , Ruocheng Guo , Raha Moraffah , Paras Sheth , K. Selcuk Candan , Huan Liu

One of the biggest hurdles robotics faces is the facet of sophisticated and hard-to-engineer behaviors. Reinforcement learning offers a set of tools, and a framework to address this problem. In parallel, the misgivings of robotics offer a…

Robotics · Computer Science 2022-10-17 Akash Nagaraj , Mukund Sood , Bhagya M Patil

Causal reasoning is increasingly used in Reinforcement Learning (RL) to improve the learning process in several dimensions: efficacy of learned policies, efficiency of convergence, generalisation capabilities, safety and interpretability of…

Machine Learning · Computer Science 2025-03-25 Giovanni Briglia , Stefano Mariani , Franco Zambonelli

The diversity of tasks and dynamic nature of reinforcement learning (RL) require RL agents to be able to learn sequentially and continuously, a learning paradigm known as continuous reinforcement learning. This survey reviews how continual…

Machine Learning · Computer Science 2025-06-30 Amara Zuffer , Michael Burke , Mehrtash Harandi

Generating explanations for reinforcement learning (RL) is challenging as actions may produce long-term effects on the future. In this paper, we develop a novel framework for explainable RL by learning a causal world model without prior…

Machine Learning · Computer Science 2024-01-19 Zhongwei Yu , Jingqing Ruan , Dengpeng Xing

To make effective decisions, it is important to have a thorough understanding of the causal relationships among actions, environments, and outcomes. This review aims to surface three crucial aspects of decision-making through a causal lens:…

Machine Learning · Statistics 2026-04-22 Lin Ge , Hengrui Cai , Runzhe Wan , Yang Xu , Rui Song

Reinforcement learning (RL) is a popular paradigm for addressing sequential decision tasks in which the agent has only limited environmental feedback. Despite many advances over the past three decades, learning in many domains still…

Machine Learning · Computer Science 2020-09-21 Sanmit Narvekar , Bei Peng , Matteo Leonetti , Jivko Sinapov , Matthew E. Taylor , Peter Stone

Causal reasoning is the main learning and explanation tool used by humans. AI systems should possess causal reasoning capabilities to be deployed in the real world with trust and reliability. Introducing the ideas of causality to machine…

Machine Learning · Computer Science 2021-06-11 Abbavaram Gowtham Reddy

To discover new drugs is to seek and to prove causality. As an emerging approach leveraging human knowledge and creativity, data, and machine intelligence, causal inference holds the promise of reducing cognitive bias and improving decision…

Quantitative Methods · Quantitative Biology 2025-04-09 Tom Michoel , Jitao David Zhang

Deep reinforcement learning has made significant strides in various robotic tasks. However, employing deep reinforcement learning methods to tackle multi-stage tasks still a challenge. Reinforcement learning algorithms often encounter…

Robotics · Computer Science 2025-03-06 Jiechao Deng , Ning Tan

Inducing causal relationships from observations is a classic problem in machine learning. Most work in causality starts from the premise that the causal variables themselves are observed. However, for AI agents such as robots trying to make…

The desire to make applications and machines more intelligent and the aspiration to enable their operation without human interaction have been driving innovations in neural networks, deep learning, and other machine learning techniques.…

Machine Learning · Computer Science 2022-09-30 Fadi AlMahamid , Katarina Grolinger