English
Related papers

Related papers: Causal Reinforcement Learning: A Survey

200 papers

Current Reinforcement Learning (RL) methods often suffer from sample-inefficiency, resulting from blind exploration strategies that neglect causal relationships among states, actions, and rewards. Although recent causal approaches aim to…

Artificial Intelligence · Computer Science 2025-02-17 Hongye Cao , Fan Feng , Tianpei Yang , Jing Huo , Yang Gao

Machine Learning explainability techniques have been proposed as a means of `explaining' or interrogating a model in order to understand why a particular decision or prediction has been made. Such an ability is especially important at a…

Machine Learning · Statistics 2022-02-28 Matthew J. Vowels

Fairness-aware learning studies the development of algorithms that avoid discriminatory decision outcomes despite biased training data. While most studies have concentrated on immediate bias in static contexts, this paper highlights the…

Machine Learning · Computer Science 2025-06-16 Jacob Lear , Lu Zhang

Feature selection is a crucial preprocessing step in data analytics and machine learning. Classical feature selection algorithms select features based on the correlations between predictive features and the class variable and do not attempt…

Machine Learning · Computer Science 2019-11-19 Kui Yu , Xianjie Guo , Lin Liu , Jiuyong Li , Hao Wang , Zhaolong Ling , Xindong Wu

While witnessing the exceptional success of machine learning (ML) technologies in many applications, users are starting to notice a critical shortcoming of ML: correlation is a poor substitute for causation. The conventional way to discover…

Machine Learning · Computer Science 2024-09-26 Ahmet Kapkiç , Pratanu Mandal , Shu Wan , Paras Sheth , Abhinav Gorantla , Yoonhyuk Choi , Huan Liu , K. Selçuk Candan

Despite recent progress in reinforcement learning (RL), RL algorithms for exploration still remain an active area of research. Existing methods often focus on state-based metrics, which do not consider the underlying causal structures of…

Reinforcement learning is a machine learning approach based on behavioral psychology. It is focused on learning agents that can acquire knowledge and learn to carry out new tasks by interacting with the environment. However, a problem…

Artificial Intelligence · Computer Science 2022-12-15 Hugo Muñoz , Ernesto Portugal , Angel Ayala , Bruno Fernandes , Francisco Cruz

Since the advent of autonomous driving technology, it has experienced remarkable progress over the last decade. However, most existing research still struggles to address the challenges posed by environments where multiple vehicles have to…

Multiagent Systems · Computer Science 2025-08-01 Jing Wang , Yan Jin , Fei Ding , Chongfeng Wei

This paper serves as a starting point for machine learning researchers, engineers and students who are interested in but not yet familiar with causal inference. We start by laying out an important set of assumptions that are collectively…

Machine Learning · Computer Science 2024-08-28 Daniel Jiwoong Im , Kyunghyun Cho

Machine Learning (ML) has become an integral aspect of many real-world applications. As a result, the need for responsible machine learning has emerged, focusing on aligning ML models to ethical and social values, while enhancing their…

Machine Learning · Computer Science 2024-02-06 Raha Moraffah , Paras Sheth , Saketh Vishnubhatla , Huan Liu

This survey (re)introduces reinforcement learning methods to economists. The curse of dimensionality limits how far exact dynamic programming can be effectively applied, forcing us to rely on suitably "small" problems or our ability to…

General Economics · Economics 2026-03-25 Pranjal Rawat

Reinforcement learning (RL) is a general framework for adaptive control, which has proven to be efficient in many domains, e.g., board games, video games or autonomous vehicles. In such problems, an agent faces a sequential decision-making…

Machine Learning · Computer Science 2020-06-16 Olivier Buffet , Olivier Pietquin , Paul Weng

Causal inference is a study of causal relationships between events and the statistical study of inferring these relationships through interventions and other statistical techniques. Causal reasoning is any line of work toward determining…

Software Engineering · Computer Science 2023-04-03 Patrick Chadbourne , Nasir Eisty

Causal inference plays an important role in explanatory analysis and decision making across various fields like statistics, marketing, health care, and education. Its main task is to estimate treatment effects and make intervention…

Methodology · Statistics 2024-07-22 Yingrong Wang , Haoxuan Li , Minqin Zhu , Anpeng Wu , Ruoxuan Xiong , Fei Wu , Kun Kuang

Reinforcement learning systems will to a greater and greater extent make decisions that significantly impact the well-being of humans, and it is therefore essential that these systems make decisions that conform to our expectations of…

Machine Learning · Computer Science 2022-05-18 Tue Herlau

Causal discovery from time series data encompasses many existing solutions, including those based on deep learning techniques. However, these methods typically do not endorse one of the most prevalent paradigms in deep learning: End-to-end…

Machine Learning · Computer Science 2024-02-15 Gideon Stein , Maha Shadaydeh , Joachim Denzler

In this paper, we confront the problem of applying reinforcement learning to agents that perceive the environment through many sensors and that can perform parallel actions using many actuators as is the case in complex autonomous robots.…

Artificial Intelligence · Computer Science 2011-07-04 E. Celaya , J. M. Porta

Attention-based sequential recommendation methods have shown promise in accurately capturing users' evolving interests from their past interactions. Recent research has also explored the integration of reinforcement learning (RL) into these…

Machine Learning · Computer Science 2024-04-19 Melissa Mozifian , Tristan Sylvain , Dave Evans , Lili Meng

Reinforcement learning (RL) has proven its worth in a series of artificial domains, and is beginning to show some successes in real-world scenarios. However, much of the research advances in RL are hard to leverage in real-world systems due…

Machine Learning · Computer Science 2021-03-05 Gabriel Dulac-Arnold , Nir Levine , Daniel J. Mankowitz , Jerry Li , Cosmin Paduraru , Sven Gowal , Todd Hester

In recent years, there has been increasing interest in causal reasoning for designing fair decision-making systems due to its compatibility with legal frameworks, interpretability for human stakeholders, and robustness to spurious…

Machine Learning · Computer Science 2022-10-27 Aida Rahmattalabi , Alice Xiang