English
Related papers

Related papers: Pretraining in Actor-Critic Reinforcement Learning…

200 papers

The pre-training of visual representations has enhanced the efficiency of robot learning. Due to the lack of large-scale in-domain robotic datasets, prior works utilize in-the-wild human videos to pre-train robotic visual representation.…

Robotics · Computer Science 2024-10-31 Guangqi Jiang , Yifei Sun , Tao Huang , Huanyu Li , Yongyuan Liang , Huazhe Xu

Skill-based reinforcement learning (RL) has emerged as a promising strategy to leverage prior knowledge for accelerated robot learning. Skills are typically extracted from expert demonstrations and are embedded into a latent space from…

Robotics · Computer Science 2022-11-07 Krishan Rana , Ming Xu , Brendan Tidd , Michael Milford , Niko Sünderhauf

This paper presents a model-based reinforcement learning (RL) framework for optimal closed-loop control of nonlinear robotic systems. The proposed approach learns linear lifted dynamics through Koopman operator theory and integrates the…

Robotics · Computer Science 2026-04-23 Wenjian Hao , Yuxuan Fang , Zehui Lu , Shaoshuai Mou

We present a method for efficient learning of control policies for multiple related robotic motor skills. Our approach consists of two stages, joint training and specialization training. During the joint training stage, a neural network…

Robotics · Computer Science 2018-03-06 Wenhao Yu , C. Karen Liu , Greg Turk

Reinforcement Learning (RL) has been successful in various domains like robotics, game playing, and simulation. While RL agents have shown impressive capabilities in their specific tasks, they insufficiently adapt to new tasks. In…

Machine Learning · Computer Science 2023-10-30 Thomas Schmied , Markus Hofmarcher , Fabian Paischer , Razvan Pascanu , Sepp Hochreiter

Reinforcement learning (RL) agents in human-computer interactions applications require repeated user interactions before they can perform well. To address this "cold start" problem, we propose a novel approach of using cognitive models to…

Artificial Intelligence · Computer Science 2021-03-11 Chao Zhang , Shihan Wang , Henk Aarts , Mehdi Dastani

Modeling generalized robot control policies poses ongoing challenges for language-guided robot manipulation tasks. Existing methods often struggle to efficiently utilize cross-dataset resources or rely on resource-intensive vision-language…

Robotics · Computer Science 2024-11-05 Wenhui Tan , Bei Liu , Junbo Zhang , Ruihua Song , Jianlong Fu

Offline reinforcement learning (RL) enables learning control policies by utilizing only prior experience, without any online interaction. This can allow robots to acquire generalizable skills from large and diverse datasets, without any…

Machine Learning · Computer Science 2021-09-24 Aviral Kumar , Anikait Singh , Stephen Tian , Chelsea Finn , Sergey Levine

In many robotic applications, some aspects of the system dynamics can be modeled accurately while others are difficult to obtain or model. We present a novel reinforcement learning (RL) method for continuous state and action spaces that…

Artificial Intelligence · Computer Science 2017-06-06 Tomoki Nishi , Prashant Doshi , Michael R. James , Danil Prokhorov

Robots are good at performing repetitive tasks in modern manufacturing industries. However, robot motions are mostly planned and preprogrammed with a notable lack of adaptivity to task changes. Even for slightly changed tasks, the whole…

Systems and Control · Electrical Eng. & Systems 2022-07-04 Tian Yu , Qing Chang

In recent years, increasing attention has been directed to leveraging pre-trained vision models for motor control. While existing works mainly emphasize the importance of this pre-training phase, the arguably equally important role played…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Yingdong Hu , Renhao Wang , Li Erran Li , Yang Gao

Reinforcement Learning (RL) has shown great potential for autonomous decision-making in the cybersecurity domain, enabling agents to learn through direct environment interaction. However, RL agents in Autonomous Cyber Operations (ACO)…

Cryptography and Security · Computer Science 2026-02-17 Konur Tholl , François Rivest , Mariam El Mezouar , Adrian Taylor , Ranwa Al Mallah

Learning-based approaches, particularly reinforcement learning (RL), have become widely used for developing control policies for autonomous agents, such as locomotion policies for legged robots. RL training typically maximizes a predefined…

Robotics · Computer Science 2025-04-23 Dylan Khor , Bowen Weng

We present a behaviour-based reinforcement learning approach, inspired by Brook's subsumption architecture, in which simple fully connected networks are trained as reactive behaviours. Our working assumption is that a pick and place robotic…

Robotics · Computer Science 2020-06-01 Ameya Pore , Gerardo Aragon-Camarasa

We present a general, two-stage reinforcement learning approach to create robust policies that can be deployed on real robots without any additional training using a single demonstration generated by trajectory optimization. The…

Robotics · Computer Science 2022-01-25 Miroslav Bogdanovic , Majid Khadiv , Ludovic Righetti

Most reinforcement learning (RL) methods focus on learning optimal policies over low-level action spaces. While these methods can perform well in their training environments, they lack the flexibility to transfer to new tasks. Instead, RL…

Robotics · Computer Science 2024-09-20 Jesse Zhang , Minho Heo , Zuxin Liu , Erdem Biyik , Joseph J Lim , Yao Liu , Rasool Fakoor

Learning is the basis of both biological and artificial systems when it comes to mimicking intelligent behaviors. From the classical PPO (Proximal Policy Optimization), there is a series of deep reinforcement learning algorithms which are…

Robotics · Computer Science 2025-12-16 Wanru Gong , Xinyi Zheng , Yuan Hui , Zhongjun Li , Weiqiang Wang , Xiaoqing Zhu

Generalization in Reinforcement Learning (RL) aims to learn an agent during training that generalizes to the target environment. This paper studies RL generalization from a theoretical aspect: how much can we expect pre-training over…

Machine Learning · Computer Science 2023-06-30 Haotian Ye , Xiaoyu Chen , Liwei Wang , Simon S. Du

Proximal Policy Optimization (PPO) has become the de facto standard for training legged robots, thanks to its robustness and scalability in massively parallel simulation environments like IsaacLab. However, its on-policy nature makes it…

Robotics · Computer Science 2026-05-26 Gianluca Sabatini , Chenhao Li , Marco Hutter

We investigate the usage of Large Language Model (LLM) in collecting high-quality data to warm-start Reinforcement Learning (RL) algorithms for learning in some classical Markov Decision Process (MDP) environments. In this work, we focus on…

Machine Learning · Computer Science 2025-05-19 Thang Duong , Minglai Yang , Chicheng Zhang