English
Related papers

Related papers: Learning Visuomotor Policy for Multi-Robot Laser T…

200 papers

Deep reinforcement learning produces robust locomotion policies for legged robots over challenging terrains. To date, few studies have leveraged model-based methods to combine these locomotion skills with the precise control of…

Robotics · Computer Science 2022-01-12 Yuntao Ma , Farbod Farshidian , Takahiro Miki , Joonho Lee , Marco Hutter

Learning to control robots directly based on images is a primary challenge in robotics. However, many existing reinforcement learning approaches require iteratively obtaining millions of robot samples to learn a policy, which can take…

Robotics · Computer Science 2019-08-02 AJ Piergiovanni , Alan Wu , Michael S. Ryoo

Robots equipped with rich sensing modalities (e.g., RGB-D cameras) performing long-horizon tasks motivate the need for policies that are highly memory-efficient. State-of-the-art approaches for controlling robots often use memory…

Robotics · Computer Science 2020-11-17 Meghan Booker , Anirudha Majumdar

In this work we propose an approach to learn a robust policy for solving the pivoting task. Recently, several model-free continuous control algorithms were shown to learn successful policies without prior knowledge of the dynamics of the…

Robotics · Computer Science 2017-03-03 Rika Antonova , Silvia Cruciani , Christian Smith , Danica Kragic

Modular robots can be reconfigured to create a variety of designs from a small set of components. But constructing a robot's hardware on its own is not enough -- each robot needs a controller. One could create controllers for some designs…

Robotics · Computer Science 2022-11-01 Julian Whitman , Howie Choset

The use of multi-camera views simultaneously has been shown to improve the generalization capabilities and performance of visual policies. However, the hardware cost and design constraints in real-world scenarios can potentially make it…

Robotics · Computer Science 2023-12-05 Cihan Acar , Kuluhan Binici , Alp Tekirdağ , Yan Wu

Multi-robot navigation is a challenging task in which multiple robots must be coordinated simultaneously within dynamic environments. We apply deep reinforcement learning (DRL) to learn a decentralized end-to-end policy which maps raw…

Robotics · Computer Science 2022-09-08 Christian Jestel , Hartmut Surmann , Jonas Stenzel , Oliver Urbann , Marius Brehler

Generalist robot policies that can perform many tasks typically require extensive expert data or simulations for training. In this work, we propose a novel Data-Efficient multitask DAgger framework that distills a single multitask policy…

Machine Learning · Computer Science 2025-10-01 Haotian Fu , Ran Gong , Xiaohan Zhang , Maria Vittoria Minniti , Jigarkumar Patel , Karl Schmeckpeper

Letting robots emulate human behavior has always posed a challenge, particularly in scenarios involving multiple robots. In this paper, we presented a framework aimed at achieving multi-agent reinforcement learning for robot control in…

Robotics · Computer Science 2023-05-25 Kangkang Duan , Christine Wun Ki Suen , Zhengbo Zou

For robots to successfully transition from lab settings to everyday environments, they must begin to reason about the risks associated with their actions and make informed, risk-aware decisions. This is particularly true for robots…

Robotics · Computer Science 2026-03-06 Michael Groom , James Wilson , Nick Hawes , Lars Kunze

The main novelty of the proposed approach is that it allows a robot to learn an end-to-end policy which can adapt to changes in the environment during execution. While goal conditioning of policies has been studied in the RL literature,…

Getting robots to navigate to multiple objects autonomously is essential yet difficult in robot applications. One of the key challenges is how to explore environments efficiently with camera sensors only. Existing navigation methods mainly…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Peihao Chen , Dongyu Ji , Kunyang Lin , Weiwen Hu , Wenbing Huang , Thomas H. Li , Mingkui Tan , Chuang Gan

This paper introduces Diffusion Policy, a new way of generating robot behavior by representing a robot's visuomotor policy as a conditional denoising diffusion process. We benchmark Diffusion Policy across 12 different tasks from 4…

Robotics · Computer Science 2024-03-15 Cheng Chi , Zhenjia Xu , Siyuan Feng , Eric Cousineau , Yilun Du , Benjamin Burchfiel , Russ Tedrake , Shuran Song

Modeling generalized robot control policies poses ongoing challenges for language-guided robot manipulation tasks. Existing methods often struggle to efficiently utilize cross-dataset resources or rely on resource-intensive vision-language…

Robotics · Computer Science 2024-11-05 Wenhui Tan , Bei Liu , Junbo Zhang , Ruihua Song , Jianlong Fu

Visuomotor policies trained via behavior cloning are vulnerable to covariate shift, where small deviations from expert trajectories can compound into failure. Common strategies to mitigate this issue involve expanding the training…

Robotics · Computer Science 2025-08-11 Zhanyi Sun , Shuran Song

Neural network-based visuomotor policies enable robots to perform manipulation tasks but remain susceptible to perceptual attacks. For example, conventional 2D adversarial patches are effective under fixed-camera setups, where appearance is…

Robotics · Computer Science 2026-03-06 Chanmi Lee , Minsung Yoon , Woojae Kim , Sebin Lee , Sung-eui Yoon

Reusing large datasets is crucial to scale vision-based robotic manipulators to everyday scenarios due to the high cost of collecting robotic datasets. However, robotic platforms possess varying control schemes, camera viewpoints, kinematic…

Robotics · Computer Science 2023-07-10 Jonathan Yang , Dorsa Sadigh , Chelsea Finn

Developing a safe and efficient collision avoidance policy for multiple robots is challenging in the decentralized scenarios where each robot generate its paths without observing other robots' states and intents. While other distributed…

Robotics · Computer Science 2018-05-22 Pinxin Long , Tingxiang Fan , Xinyi Liao , Wenxi Liu , Hao Zhang , Jia Pan

Learned visuomotor policies are capable of performing increasingly complex manipulation tasks. However, most of these policies are trained on data collected from limited robot positions and camera viewpoints. This leads to poor…

Robotics · Computer Science 2025-09-29 Jingyun Yang , Isabella Huang , Brandon Vu , Max Bajracharya , Rika Antonova , Jeannette Bohg

Autonomous robotic wiping is an important task in various industries, ranging from industrial manufacturing to sanitization in healthcare. Deep reinforcement learning (Deep RL) has emerged as a promising algorithm, however, it often suffers…

Robotics · Computer Science 2025-02-19 Yihong Liu , Dongyeop Kang , Sehoon Ha