English
Related papers

Related papers: Multi-scale Predictive Representations for Goal-co…

200 papers

Reinforcement learning (RL) excels in various applications but struggles in dynamic environments where the underlying Markov decision process evolves. Continual reinforcement learning (CRL) enables RL agents to continually learn and adapt…

Machine Learning · Computer Science 2025-12-23 Xue Yang , Michael Schukat , Junlin Lu , Patrick Mannion , Karl Mason , Enda Howley

Deep reinforcement learning (RL) has been endowed with high expectations in tackling challenging manipulation tasks in an autonomous and self-directed fashion. Despite the significant strides made in the development of reinforcement…

Robotics · Computer Science 2023-04-27 Zhenshan Bing , Aleksandr Mavrichev , Sicong Shen , Xiangtong Yao , Kejia Chen , Kai Huang , Alois Knoll

Deep reinforcement learning (DRL) has seen remarkable success in the control of single robots. However, applying DRL to robot swarms presents significant challenges. A critical challenge is non-stationarity, which occurs when two or more…

Robotics · Computer Science 2023-08-29 Joshua Bloom , Pranjal Paliwal , Apratim Mukherjee , Carlo Pinciroli

Pre-training Reinforcement Learning agents in a task-agnostic manner has shown promising results. However, previous works still struggle in learning and discovering meaningful skills in high-dimensional state-spaces, such as pixel-spaces.…

Artificial Intelligence · Computer Science 2021-07-20 Juan José Nieto , Roger Creus , Xavier Giro-i-Nieto

Causal representation learning (CRL) offers the promise of uncovering the underlying causal model by which observed data was generated, but the practical applicability of existing methods remains limited by the strong assumptions required…

Machine Learning · Computer Science 2026-01-30 Yuhang Liu , Zhen Zhang , Dong Gong , Erdun Gao , Biwei Huang , Mingming Gong , Anton van den Hengel , Kun Zhang , Javen Qinfeng Shi

In imitation learning, it is common to learn a behavior policy to match an unknown target policy via max-likelihood training on a collected set of target demonstrations. In this work, we consider using offline experience datasets -…

Machine Learning · Computer Science 2021-10-11 Ofir Nachum , Mengjiao Yang

How to learn an effective reinforcement learning-based model for control tasks from high-level visual observations is a practical and challenging problem. A key to solving this problem is to learn low-dimensional state representations from…

Machine Learning · Computer Science 2022-12-27 Jianda Chen , Sinno Jialin Pan

Model-based reinforcement learning (RL) has proven to be a data efficient approach for learning control tasks but is difficult to utilize in domains with complex observations such as images. In this paper, we present a method for learning…

Machine Learning · Computer Science 2019-06-25 Marvin Zhang , Sharad Vikram , Laura Smith , Pieter Abbeel , Matthew J. Johnson , Sergey Levine

In offline model-based reinforcement learning (offline MBRL), we learn a dynamic model from historically collected data, and subsequently utilize the learned model and fixed datasets for policy learning, without further interacting with the…

Machine Learning · Computer Science 2022-10-13 Shentao Yang , Shujian Zhang , Yihao Feng , Mingyuan Zhou

Reinforcement learning (RL) algorithms have been around for decades and employed to solve various sequential decision-making problems. These algorithms however have faced great challenges when dealing with high-dimensional environments. The…

Machine Learning · Computer Science 2020-04-01 Thanh Thi Nguyen , Ngoc Duy Nguyen , Saeid Nahavandi

Mean field games (MFGs) have emerged as a powerful framework for modeling interactions in large-scale multi-agent systems. Despite recent advancements in reinforcement learning (RL) for MFGs, existing methods are typically limited to finite…

Machine Learning · Computer Science 2025-10-28 Lorenzo Magnino , Kai Shao , Zida Wu , Jiacheng Shen , Mathieu Laurière

Offline Reinforcement learning (RL) has shown potent in many safe-critical tasks in robotics where exploration is risky and expensive. However, it still struggles to acquire skills in temporally extended tasks. In this paper, we study the…

Robotics · Computer Science 2022-05-25 Jinning Li , Chen Tang , Masayoshi Tomizuka , Wei Zhan

Reinforcement learning (RL) algorithms have proven transformative in a range of domains. To tackle real-world domains, these systems often use neural networks to learn policies directly from pixels or other high-dimensional sensory input.…

Machine Learning · Computer Science 2025-10-02 Nishil Patel , Sebastian Lee , Stefano Sarao Mannelli , Sebastian Goldt , Andrew Saxe

In this paper we study online Reinforcement Learning (RL) in partially observable dynamical systems. We focus on the Predictive State Representations (PSRs) model, which is an expressive model that captures other well-known models such as…

Machine Learning · Computer Science 2022-08-16 Wenhao Zhan , Masatoshi Uehara , Wen Sun , Jason D. Lee

This work presents a distributed algorithm for resolving cooperative multi-vehicle conflicts in highly constrained spaces. By formulating the conflict resolution problem as a Multi-Agent Reinforcement Learning (RL) problem, we can train a…

Robotics · Computer Science 2023-02-06 Xu Shen , Francesco Borrelli

Reinforcement learning (RL) is one of the active fields in machine learning, demonstrating remarkable potential in tackling real-world challenges. Despite its promising prospects, this methodology has encountered with issues and challenges,…

Machine Learning · Computer Science 2024-11-21 Alireza Rashidi Laleh , Majid Nili Ahmadabadi

Unsupervised pretraining has driven empirical advances in goal-conditioned reinforcement learning (GCRL), but its theoretical foundations remain poorly understood. In particular, an influential class of methods, mutual information skill…

Machine Learning · Computer Science 2026-05-08 Alireza Modirshanechi , Benjamin Eysenbach , Peter Dayan , Eric Schulz

General-purpose robotic manipulation, including reach and grasp, is essential for deployment into households and workspaces involving diverse and evolving tasks. Recent advances propose using large pre-trained models, such as Large Language…

Robotics · Computer Science 2025-07-16 Huiyi Wang , Fahim Shahriar , Alireza Azimi , Gautham Vasan , Rupam Mahmood , Colin Bellinger

Meta reinforcement learning (Meta-RL) is an approach wherein the experience gained from solving a variety of tasks is distilled into a meta-policy. The meta-policy, when adapted over only a small (or just a single) number of steps, is able…

Machine Learning · Computer Science 2022-09-28 Desik Rengarajan , Sapana Chaudhary , Jaewon Kim , Dileep Kalathil , Srinivas Shakkottai

Representation learning is increasingly employed to generate representations that are predictive across multiple downstream tasks. The development of representation learning algorithms that provide strong fairness guarantees is thus…

Machine Learning · Computer Science 2023-10-25 Yuhong Luo , Austin Hoag , Philip S. Thomas