English
Related papers

Related papers: Control-Aware Representations for Model-based Rein…

200 papers

Despite recent progress in reinforcement learning (RL) from raw pixel data, sample inefficiency continues to present a substantial obstacle. Prior works have attempted to address this challenge by creating self-supervised auxiliary tasks,…

Machine Learning · Computer Science 2024-05-27 Ruijie Zheng , Xiyao Wang , Yanchao Sun , Shuang Ma , Jieyu Zhao , Huazhe Xu , Hal Daumé , Furong Huang

Balancing exploration and exploitation is crucial in reinforcement learning (RL). In this paper, we study model-based posterior sampling for reinforcement learning (PSRL) in continuous state-action spaces theoretically and empirically.…

Machine Learning · Computer Science 2021-11-18 Ying Fan , Yifei Ming

In machine learning, meta-learning methods aim for fast adaptability to unknown tasks using prior knowledge. Model-based meta-reinforcement learning combines reinforcement learning via world models with Meta Reinforcement Learning (MRL) for…

Robotics · Computer Science 2022-10-10 Karam Daaboul , Joel Ikels , Marius Zöllner

A Learning Model Predictive Controller (LMPC) for linear system in presented. The proposed controller is an extension of the LMPC [1] and it aims to decrease the computational burden. The control scheme is reference-free and is able to…

Optimization and Control · Mathematics 2019-10-31 Ugo Rosolia , Francesco Borrelli

Empowerment has the potential to help agents learn large skillsets, but is not yet a scalable solution for training general-purpose agents. Recent empowerment methods learn diverse skillsets by maximizing the mutual information between…

Artificial Intelligence · Computer Science 2024-10-16 Andrew Levy , Alessandro Allievi , George Konidaris

Reinforcement learning (RL) faces substantial challenges when applied to real-life problems, primarily stemming from the scarcity of available data due to limited interactions with the environment. This limitation is exacerbated by the fact…

Neural and Evolutionary Computing · Computer Science 2024-04-10 Cristiano Capone , Paolo Muratore

Precise robotic manipulation skills are desirable in many industrial settings, reinforcement learning (RL) methods hold the promise of acquiring these skills autonomously. In this paper, we explicitly consider incorporating operational…

Lane change in dense traffic typically requires the recognition of an appropriate opportunity for maneuvers, which remains a challenging problem in self-driving. In this work, we propose a chance-aware lane-change strategy with high-level…

Robotics · Computer Science 2024-02-19 Yubin Wang , Yulin Li , Zengqi Peng , Hakim Ghazzai , Jun Ma

Learning a latent dynamics model provides a task-agnostic representation of an agent's understanding of its environment. Leveraging this knowledge for model-based reinforcement learning (RL) holds the potential to improve sample efficiency…

Machine Learning · Computer Science 2025-02-10 Malte Mosbach , Jan Niklas Ewertz , Angel Villar-Corrales , Sven Behnke

Reinforcement learning (RL) exhibits impressive performance when managing complicated control tasks for robots. However, its wide application to physical robots is limited by the absence of strong safety guarantees. To overcome this…

Robotics · Computer Science 2023-05-18 Desong Du , Shaohang Han , Naiming Qi , Haitham Bou Ammar , Jun Wang , Wei Pan

Causal representation learning (CRL) models aim to transform high-dimensional data into a latent space, enabling interventions to generate counterfactual samples or modify existing data based on the causal relationships among latent…

Machine Learning · Computer Science 2026-03-19 Alireza Sadeghi , Wael AbdAlmageed

Quantum control is concerned with the realisation of desired dynamics in quantum systems, serving as a linchpin for advancing quantum technologies and fundamental research. Analytic approaches and standard optimisation algorithms do not…

Quantum Physics · Physics 2025-05-29 Jan Ole Ernst , Aniket Chatterjee , Tim Franzmeyer , Axel Kuhn

We present a versatile latent representation that enables physically simulated character to efficiently utilize motion priors. To build a powerful motion embedding that is shared across multiple tasks, the physics controller should employ…

Graphics · Computer Science 2025-03-18 Jinseok Bae , Jungdam Won , Donggeun Lim , Inwoo Hwang , Young Min Kim

The process of learning a manipulation task depends strongly on the action space used for exploration: posed in the incorrect action space, solving a task with reinforcement learning can be drastically inefficient. Additionally, similar…

Model-free Reinforcement Learning (RL) works well when experience can be collected cheaply and model-based RL is effective when system dynamics can be modeled accurately. However, both assumptions can be violated in real world problems such…

Machine Learning · Computer Science 2020-05-07 Mohak Bhardwaj , Ankur Handa , Dieter Fox , Byron Boots

We introduce Embed to Control (E2C), a method for model learning and control of non-linear dynamical systems from raw pixel images. E2C consists of a deep generative model, belonging to the family of variational autoencoders, that learns to…

Machine Learning · Computer Science 2015-11-23 Manuel Watter , Jost Tobias Springenberg , Joschka Boedecker , Martin Riedmiller

Within a robotic context, we merge the techniques of passivity-based control (PBC) and reinforcement learning (RL) with the goal of eliminating some of their reciprocal weaknesses, as well as inducing novel promising features in the…

Robotics · Computer Science 2024-01-17 Riccardo Zanella , Gianluca Palli , Stefano Stramigioli , Federico Califano

In curriculum reinforcement learning (CRL), an agent incrementally accumulates knowledge over a sequence of tasks (i.e., a curriculum), and the learning process is aimed at using the accumulated knowledge to finally solve a challenging…

Machine Learning · Computer Science 2026-05-25 Yongyan Wen , Siyuan Li , Mingjian Fu , Yiqin Yang , Xun Wang , Peng Liu

Recent work has shown that reinforcement learning (RL) is a promising approach to control dynamical systems described by partial differential equations (PDE). This paper shows how to use RL to tackle more general PDE control problems that…

Machine Learning · Computer Science 2018-06-20 Yangchen Pan , Amir-massoud Farahmand , Martha White , Saleh Nabi , Piyush Grover , Daniel Nikovski

While reinforcement learning (RL) has the potential to enable robots to autonomously acquire a wide range of skills, in practice, RL usually requires manual, per-task engineering of reward functions, especially in real world settings where…

Robotics · Computer Science 2019-02-15 Tianhe Yu , Gleb Shevchuk , Dorsa Sadigh , Chelsea Finn