English
Related papers

Related papers: Causal Curiosity: RL Agents Discovering Self-super…

200 papers

It has been postulated that a good representation is one that disentangles the underlying explanatory factors of variation. However, it remains an open question what kind of training framework could potentially achieve that. Whereas most…

While human infants robustly discover their own causal efficacy, standard reinforcement learning agents remain brittle, as their reliance on correlation-based rewards fails in noisy, ecologically valid scenarios. To address this, we…

Artificial Intelligence · Computer Science 2025-07-22 Xia Xu , Jochen Triesch

Imitation learning, which learns agent policy by mimicking expert demonstration, has shown promising results in many applications such as medical treatment regimes and self-driving vehicles. However, it remains a difficult task to interpret…

Machine Learning · Computer Science 2024-01-31 Tianxiang Zhao , Wenchao Yu , Suhang Wang , Lu Wang , Xiang Zhang , Yuncong Chen , Yanchi Liu , Wei Cheng , Haifeng Chen

It has been postulated that a good representation is one that disentangles the underlying explanatory factors of variation. However, it remains an open question what kind of training framework could potentially achieve that. Whereas most…

Curiosity for machine agents has been a focus of lively research activity. The study of human and animal curiosity, particularly specific curiosity, has unearthed several properties that would offer important benefits for machine learners,…

Artificial Intelligence · Computer Science 2022-12-02 Nadia M. Ady , Roshan Shariff , Johannes Günther , Patrick M. Pilarski

Reinforcement Learning enables to train an agent via interaction with the environment. However, in the majority of real-world scenarios, the extrinsic feedback is sparse or not sufficient, thus intrinsic reward formulations are needed to…

Machine Learning · Computer Science 2022-06-07 Patrik Reizinger , Márton Szemenyei

We propose a curiosity reward based on information theory principles and consistent with the animal instinct to maintain certain critical parameters within a bounded range. Our experimental validation shows the added value of the additional…

Artificial Intelligence · Computer Science 2018-02-08 Ildefons Magrans de Abril , Ryota Kanai

Many open problems in machine learning are intrinsically related to causality, however, the use of causal analysis in machine learning is still in its early stage. Within a general reinforcement learning setting, we consider the problem of…

Machine Learning · Computer Science 2022-05-18 Tue Herlau , Rasmus Larsen

Self-supervised representation learning has achieved remarkable success in recent years. By subverting the need for supervised labels, such approaches are able to utilize the numerous unlabeled images that exist on the Internet and in…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Yilun Du , Chuang Gan , Phillip Isola

Causal dynamics learning has recently emerged as a promising approach to enhancing robustness in reinforcement learning (RL). Typically, the goal is to build a dynamics model that makes predictions based on the causal relationships among…

Machine Learning · Computer Science 2024-06-06 Inwoo Hwang , Yunhyeok Kwak , Suhyung Choi , Byoung-Tak Zhang , Sanghack Lee

Reinforcement learning algorithms rely on carefully engineering environment rewards that are extrinsic to the agent. However, annotating each environment with hand-designed, dense rewards is not scalable, motivating the need for developing…

Machine Learning · Computer Science 2018-08-14 Yuri Burda , Harri Edwards , Deepak Pathak , Amos Storkey , Trevor Darrell , Alexei A. Efros

This paper introduces a novel combination of scheduling control on a flexible robot manufacturing cell with curiosity based reinforcement learning. Reinforcement learning has proved to be highly successful in solving tasks like robotics and…

Robotics · Computer Science 2020-11-18 Mohammed Sharafath Abdul Hameed , Md Muzahid Khan , Andreas Schwung

In Model-Based Reinforcement Learning (MBRL), incorporating causal structures into dynamics models provides agents with a structured understanding of the environments, enabling efficient decision. Empowerment as an intrinsic motivation…

Artificial Intelligence · Computer Science 2025-02-17 Hongye Cao , Fan Feng , Meng Fang , Shaokang Dong , Tianpei Yang , Jing Huo , Yang Gao

When robots learn reward functions using high capacity models that take raw state directly as input, they need to both learn a representation for what matters in the task -- the task ``features" -- as well as how to combine these features…

Robotics · Computer Science 2023-03-20 Andreea Bobu , Yi Liu , Rohin Shah , Daniel S. Brown , Anca D. Dragan

Despite the recent progress in deep learning and reinforcement learning, transfer and generalization of skills learned on specific tasks is very limited compared to human (or animal) intelligence. The lifelong, incremental building of…

Artificial Intelligence · Computer Science 2022-08-10 Louis Annabi

Causality has the potential to truly transform the way we solve a large number of real-world problems. Yet, so far, its potential largely remains to be unlocked as causality often requires crucial assumptions which cannot be tested in…

Machine Learning · Computer Science 2024-02-15 Jeroen Berrevoets , Krzysztof Kacprzyk , Zhaozhi Qian , Mihaela van der Schaar

The ability to perform causal and counterfactual reasoning are central properties of human intelligence. Decision-making systems that can perform these types of reasoning have the potential to be more generalizable and interpretable.…

Artificial Intelligence · Computer Science 2021-06-28 Daniel McDuff , Yale Song , Jiyoung Lee , Vibhav Vineet , Sai Vemprala , Nicholas Gyde , Hadi Salman , Shuang Ma , Kwanghoon Sohn , Ashish Kapoor

In this work, we propose a novel algorithmic framework for data sharing and coordinated exploration for the purpose of learning more data-efficient and better performing policies under a concurrent reinforcement learning (CRL) setting. In…

Machine Learning · Statistics 2024-02-01 Tim Tse , Isaac Chan , Zhitang Chen

We hypothesize that curiosity is a mechanism found by evolution that encourages meaningful exploration early in an agent's life in order to expose it to experiences that enable it to obtain high rewards over the course of its lifetime. We…

Machine Learning · Computer Science 2020-03-12 Ferran Alet , Martin F. Schneider , Tomas Lozano-Perez , Leslie Pack Kaelbling

Inferring the abstract relational and causal structure of the world is a major challenge for reinforcement-learning (RL) agents. For humans, language--particularly in the form of explanations--plays a considerable role in overcoming this…