English
Related papers

Related papers: Causal Representation Learning for Generalisable R…

200 papers

Deep reinforcement learning (DRL) requires the collection of interventional data, which is sometimes expensive and even unethical in the real world, such as in the autonomous driving and the medical field. Offline reinforcement learning…

Machine Learning · Computer Science 2023-06-12 Wenxuan Zhu , Chao Yu , Qiang Zhang

Deep reinforcement learning (DRL) has achieved remarkable progress in online path planning tasks for multi-UAV systems. However, existing DRL-based methods often suffer from performance degradation when tackling unseen scenarios, since the…

Robotics · Computer Science 2024-07-16 Jiafan Zhuang , Zihao Xia , Gaofei Han , Boxi Wang , Wenji Li , Dongliang Wang , Zhifeng Hao , Ruichu Cai , Zhun Fan

Disentangled representation has been widely explored in many fields due to its maximal compactness, interpretability and versatility. Recommendation system also needs disentanglement to make representation more explainable and general for…

Social and Information Networks · Computer Science 2020-10-27 Weiguang Chen , Wenjun Jiang , Xueqi Li , Kenli Li , Albert Zomaya , Guojun Wang

Integrating causal inference (CI) with reinforcement learning (RL) has emerged as a powerful paradigm to address critical limitations in classical RL, including low explainability, lack of robustness and generalization failures. Traditional…

Artificial Intelligence · Computer Science 2025-12-23 Cristiano da Costa Cunha , Wei Liu , Tim French , Ajmal Mian

Reinforcement Learning (RL) faces significant challenges in adaptive healthcare interventions, such as dementia care, where data is scarce, decisions require interpretability, and underlying patient-state dynamic are complex and causal in…

Robotics · Computer Science 2025-12-02 Wenzheng Zhao , Ran Zhang , Ruth Palan Lopez , Shu-Fen Wung , Fengpei Yuan

As a pivotal component to attaining generalizable solutions in human intelligence, reasoning provides great potential for reinforcement learning (RL) agents' generalization towards varied goals by summarizing part-to-whole arguments and…

Machine Learning · Computer Science 2023-05-18 Wenhao Ding , Haohong Lin , Bo Li , Ding Zhao

This paper proposes an efficient approach to learning disentangled representations with causal mechanisms based on the difference of conditional probabilities in original and new distributions. We approximate the difference with models'…

Machine Learning · Computer Science 2024-01-03 Yuanpeng Li , Joel Hestness , Mohamed Elhoseiny , Liang Zhao , Kenneth Church

Despite notable successes of Reinforcement Learning (RL), the prevalent use of an online learning paradigm prevents its widespread adoption, especially in hazardous or costly scenarios. Offline RL has emerged as an alternative solution,…

Machine Learning · Computer Science 2024-05-08 Minjae Cho , Jonathan P. How , Chuangchuang Sun

This paper focuses on causal representation learning (CRL) under a general nonparametric latent causal model and a general transformation model that maps the latent data to the observational data. It establishes identifiability and…

Machine Learning · Computer Science 2024-02-15 Burak Varıcı , Emre Acartürk , Karthikeyan Shanmugam , Ali Tajer

Building robust and real-time classifiers with diverse datasets are one of the most significant challenges to deep learning researchers. It is because there is a considerable gap between a model built with training (seen) data and real…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Mayanka Chandrashekar , Yugyung Lee

Disentangled representation learning (DRL) aims to break down observed data into core intrinsic factors for a profound understanding of the data. In real-world scenarios, manually defining and labeling these factors are non-trivial, making…

Machine Learning · Computer Science 2024-11-01 Youngjun Jun , Jiwoo Park , Kyobin Choo , Tae Eun Choi , Seong Jae Hwang

Causal Representation Learning (CRL) aims at identifying high-level causal factors and their relationships from high-dimensional observations, e.g., images. While most CRL works focus on learning causal representations in a single…

Machine Learning · Computer Science 2024-03-18 Davide Talon , Phillip Lippe , Stuart James , Alessio Del Bue , Sara Magliacane

Causal representation learning (CRL) and traditional representation learning have largely developed along different trajectories. Traditional representation learning has been driven mainly by applications and empirical objectives, whereas…

Machine Learning · Computer Science 2026-05-21 Yan Li , Yuewen Sun , Shaoan Xie , Gongxu Luo , Yunlong Deng , Kun Zhang , Guangyi Chen

Recommender systems usually rely on observed user interaction data to build personalized recommendation models, assuming that the observed data reflect user interest. However, user interacting with an item may also due to conformity, the…

Information Retrieval · Computer Science 2023-02-09 Weiqi Zhao , Dian Tang , Xin Chen , Dawei Lv , Daoli Ou , Biao Li , Peng Jiang , Kun Gai

In offline reinforcement learning-based recommender systems (RLRS), learning effective state representations is crucial for capturing user preferences that directly impact long-term rewards. However, raw state representations often contain…

Information Retrieval · Computer Science 2025-02-05 Siyu Wang , Xiaocong Chen , Lina Yao

Offline reinforcement learning (RL) optimizes the policy on a previously collected dataset without any interactions with the environment, yet usually suffers from the distributional shift problem. To mitigate this issue, a typical solution…

Machine Learning · Computer Science 2023-09-06 Qisen Yang , Shenzhi Wang , Qihang Zhang , Gao Huang , Shiji Song

Sequential recommender systems have achieved state-of-the-art recommendation performance by modeling the sequential dynamics of user activities. However, in most recommendation scenarios, the popular items comprise the major part of the…

Information Retrieval · Computer Science 2023-08-08 Yi Ren , Xu Zhao , Hongyan Tang , Shuai Li

Causal representation learning (CRL) seeks to uncover meaningful latent variables and their corresponding causal structure from high-dimensional observational data. Although its significance, CRL identifiability remains a crucial property,…

Machine Learning · Computer Science 2026-05-20 Manal Benhamza , Marianne Clausel , Myriam Tami

The goal of an offline reinforcement learning (RL) algorithm is to learn optimal polices using historical (offline) data, without access to the environment for online exploration. One of the main challenges in offline RL is the distribution…

Machine Learning · Computer Science 2023-10-31 Kishan Panaganti , Zaiyan Xu , Dileep Kalathil , Mohammad Ghavamzadeh

Context-based offline meta-reinforcement learning (OMRL) methods have achieved appealing success by leveraging pre-collected offline datasets to develop task representations that guide policy learning. However, current context-based OMRL…

Machine Learning · Computer Science 2025-02-04 Zhengzhe Zhang , Wenjia Meng , Haoliang Sun , Gang Pan