English
Related papers

Related papers: Dual Action Policy for Robust Sim-to-Real Reinforc…

200 papers

The U.S. Defense Advanced Research Projects Agency (DARPA) Subterranean Challenge requires teams of robots to traverse difficult and diverse underground environments. Traversing small gaps is one of the challenging scenarios that robots…

Robotics · Computer Science 2021-11-03 Brendan Tidd , Akansel Cosgun , Jurgen Leitner , Nicolas Hudson

We propose Dual Approximation Policy Optimization (DAPO), a framework that incorporates general function approximation into policy mirror descent methods. In contrast to the popular approach of using the $L_2$-norm to measure function…

Machine Learning · Computer Science 2024-10-03 Zhihan Xiong , Maryam Fazel , Lin Xiao

Multi-agent reinforcement learning (MARL) for cyber-physical vehicle systems usually requires a significantly long training time due to their inherent complexity. Furthermore, deploying the trained policies in the real world demands a…

Robotics · Computer Science 2026-02-24 Chinmay Vilas Samak , Tanmay Vilas Samak , Venkat Narayan Krovi

Achieving athletic loco-manipulation on robots requires moving beyond traditional tracking rewards - which simply guide the robot along a reference trajectory - to task rewards that drive truly dynamic, goal-oriented behaviors. Commands…

Robotics · Computer Science 2025-02-18 Nolan Fey , Gabriel B. Margolis , Martin Peticco , Pulkit Agrawal

Deep reinforcement learning agents achieve state-of-the-art performance in a wide range of simulated control tasks. However, successful applications to real-world problems remain limited. One reason for this dichotomy is because the learnt…

Machine Learning · Computer Science 2024-11-27 Rory Young , Nicolas Pugeault

Simulation provides a safe and efficient way to generate useful data for learning complex robotic tasks. However, matching simulation and real-world dynamics can be quite challenging, especially for systems that have a large number of…

Robotics · Computer Science 2021-03-16 Visak Kumar , Sehoon Ha , C. Karen Liu

We propose a fully distributed actor-critic architecture, named Diff-DAC, with application to multitask reinforcement learning (MRL). During the learning process, agents communicate their value and policy parameters to their neighbours,…

Machine Learning · Computer Science 2021-10-26 Sergio Valcarcel Macua , Ian Davies , Aleksi Tukiainen , Enrique Munoz de Cote

Imitation learning methods need significant human supervision to learn policies robust to changes in object poses, physical disturbances, and visual distractors. Reinforcement learning, on the other hand, can explore the environment…

Robotics · Computer Science 2024-11-26 Marcel Torne , Anthony Simeonov , Zechu Li , April Chan , Tao Chen , Abhishek Gupta , Pulkit Agrawal

Reinforcement learning agents learn by encouraging behaviours which maximize their total reward, usually provided by the environment. In many environments, however, the reward is provided after a series of actions rather than each single…

Artificial Intelligence · Computer Science 2022-01-04 Mohammad Reza Bonyadi , Rui Wang , Maryam Ziaei

Deep reinforcement learning (DRL) is a promising approach to solve complex control tasks by learning policies through interactions with the environment. However, the training of DRL policies requires large amounts of training experiences,…

Machine Learning · Computer Science 2023-01-02 Hongpeng Cao , Mirco Theile , Federico G. Wyrwal , Marco Caccamo

Model-based reinforcement learning methods learn a dynamics model with real data sampled from the environment and leverage it to generate simulated data to derive an agent. However, due to the potential distribution mismatch between…

Machine Learning · Computer Science 2020-10-29 Jian Shen , Han Zhao , Weinan Zhang , Yong Yu

The strong dynamic coupling between the manipulator and the base poses a significant challenge to maintaining spacecraft attitude stability, potentially compromising mission safety. In this paper, we propose a Dual-Agent Coordinated…

Robotics · Computer Science 2026-05-26 Yuhui Hu , Dong Zhou , Kaihong Ouyang , Zhongliang Yu , Jianfeng Lv , Xiangyu Shao

Object manipulation, which focuses on learning to perform tasks on similar parts across different types of objects, can be divided into an approaching stage and a manipulation stage. However, previous works often ignore this characteristic…

Robotics · Computer Science 2025-12-17 Bin Fan , Jian-Jian Jiang , Zhuohao Li , Xiao-Ming Wu , Yi-Xiang He , YiHan Yang , Shengbang Liu , Wei-Shi Zheng

The ability to accurately predict others' behavior is central to the safety and efficiency of interactive robotics. Unfortunately, robots often lack access to key information on which these predictions may hinge, such as other agents'…

Robotics · Computer Science 2023-11-02 Haimin Hu , David Isele , Sangjae Bae , Jaime F. Fisac

Reinforcement Learning (RL) has achieved remarkable success in sequential decision tasks. However, recent studies have revealed the vulnerability of RL policies to different perturbations, raising concerns about their effectiveness and…

Machine Learning · Computer Science 2025-07-08 Buqing Nie , Yangqing Fu , Jingtian Ji , Yue Gao

Autonomous agents must often deal with conflicting requirements, such as completing tasks using the least amount of time/energy, learning multiple tasks, or dealing with multiple opponents. In the context of reinforcement learning~(RL),…

Machine Learning · Computer Science 2019-10-30 Santiago Paternain , Luiz F. O. Chamon , Miguel Calvo-Fullana , Alejandro Ribeiro

The framework of Simulation-to-real learning, i.e, learning policies in simulation and transferring those policies to the real world is one of the most promising approaches towards data-efficient learning in robotics. However, due to the…

Robotics · Computer Science 2022-02-01 Rituraj Kaushik , Karol Arndt , Ville Kyrki

We introduce robustness in \textit{restless multi-armed bandits} (RMABs), a popular model for constrained resource allocation among independent stochastic processes (arms). Nearly all RMAB techniques assume stochastic dynamics are precisely…

Machine Learning · Computer Science 2022-06-23 Jackson A. Killian , Lily Xu , Arpita Biswas , Milind Tambe

Simulations are attractive environments for training agents as they provide an abundant source of data and alleviate certain safety concerns during the training process. But the behaviours developed by agents in simulation are often…

Robotics · Computer Science 2018-09-21 Xue Bin Peng , Marcin Andrychowicz , Wojciech Zaremba , Pieter Abbeel

Risk-aware Reinforcement Learning (RL) algorithms like SAC and TD3 were shown empirically to outperform their risk-neutral counterparts in a variety of continuous-action tasks. However, the theoretical basis for the pessimistic objectives…

Machine Learning · Computer Science 2024-05-27 Michal Nauman , Marek Cygan