English
Related papers

Related papers: Reliable and Scalable Robot Policy Evaluation with…

200 papers

Simulations are attractive environments for training agents as they provide an abundant source of data and alleviate certain safety concerns during the training process. But the behaviours developed by agents in simulation are often…

Robotics · Computer Science 2018-09-21 Xue Bin Peng , Marcin Andrychowicz , Wojciech Zaremba , Pieter Abbeel

Building effective imitation learning methods that enable robots to learn from limited data and still generalize across diverse real-world environments is a long-standing problem in robot learning. We propose Equibot, a robust,…

Robotics · Computer Science 2024-10-30 Jingyun Yang , Zi-ang Cao , Congyue Deng , Rika Antonova , Shuran Song , Jeannette Bohg

Imitation learning methods need significant human supervision to learn policies robust to changes in object poses, physical disturbances, and visual distractors. Reinforcement learning, on the other hand, can explore the environment…

Robotics · Computer Science 2024-11-26 Marcel Torne , Anthony Simeonov , Zechu Li , April Chan , Tao Chen , Abhishek Gupta , Pulkit Agrawal

Most policy search algorithms require thousands of training episodes to find an effective policy, which is often infeasible with a physical robot. This survey article focuses on the extreme other end of the spectrum: how can a robot adapt…

We provide finite-sample performance guarantees for control policies executed on stochastic robotic systems. Given an open- or closed-loop policy and a finite set of trajectory rollouts under the policy, we bound the expected value,…

Robotics · Computer Science 2024-06-17 Joseph A. Vincent , Aaron O. Feldman , Mac Schwager

Designing effective model-based reinforcement learning algorithms is difficult because the ease of data generation must be weighed against the bias of model-generated data. In this paper, we study the role of model usage in policy…

Machine Learning · Computer Science 2021-11-30 Michael Janner , Justin Fu , Marvin Zhang , Sergey Levine

The development of algorithms for automation of subtasks during robotic surgery can be accelerated by the availability of realistic simulation environments. In this work, we focus on one aspect of the realism of a surgical simulator, which…

Robotics · Computer Science 2024-06-12 Juan Antonio Barragan , Hisashi Ishida , Adnan Munawar , Peter Kazanzides

Sim2Real aims at training policies in high-fidelity simulation environments and effectively transferring them to the real world. Despite the developments of accurate simulators and Sim2Real RL approaches, the policies trained purely in…

Machine Learning · Computer Science 2025-10-21 Akhil S Anand , Shambhuraj Sawant , Jasper Hoffmann , Dirk Reinhardt , Sebastien Gros

With the increasing pace of automation, modern robotic systems need to act in stochastic, non-stationary, partially observable environments. A range of algorithms for finding parameterized policies that optimize for long-term average…

Machine Learning · Computer Science 2019-09-04 David Nass , Boris Belousov , Jan Peters

Developing robot controllers in a simulated environment is advantageous but transferring the controllers to the target environment presents challenges, often referred to as the "sim-to-real gap". We present a method for continuous…

Robotics · Computer Science 2022-11-24 Sirui Chen , Keenon Werling , Albert Wu , C. Karen Liu

Reinforcement learning has shown a wide usage in robotics tasks, such as insertion and grasping. However, without a practical sim2real strategy, the policy trained in simulation could fail on the real task. There are also wide researches in…

Robotics · Computer Science 2022-06-07 Yiwen Chen , Xue Li , Sheng Guo , Xian Yao Ng , Marcelo Ang

Despite strong multi-task pretraining, existing policies often exhibit poor task steerability. For example, a robot may fail to respond to a new instruction ``put the bowl in the sink" when moving towards the oven, executing ``close the…

Safety validation is a crucial component in the development and deployment of autonomous systems, such as self-driving vehicles and robotic systems. Ensuring safe operation necessitates extensive testing and verification of control…

Systems and Control · Electrical Eng. & Systems 2023-05-11 Ali Baheri , Mykel J. Kochenderfer

Deep reinforcement learning (RL) has proven a powerful technique in many sequential decision making domains. However, Robotics poses many challenges for RL, most notably training on a physical system can be expensive and dangerous, which…

Robotics · Computer Science 2017-10-19 Lerrel Pinto , Marcin Andrychowicz , Peter Welinder , Wojciech Zaremba , Pieter Abbeel

Being able to transfer existing skills to new situations is a key capability when training robots to operate in unpredictable real-world environments. A successful transfer algorithm should not only minimize the number of samples that the…

Robotics · Computer Science 2020-12-15 Wenhao Yu , C. Karen Liu , Greg Turk

As the complexity of control systems increases, the need for systematic methods to guarantee their efficacy grows as well. However, direct testing of these systems is oftentimes costly, difficult, or impractical. As a result, the test and…

Systems and Control · Electrical Eng. & Systems 2021-09-10 Prithvi Akella , Ugo Rosolia , Aaron D. Ames

Learning robot control policies from physics simulations is of great interest to the robotics community as it may render the learning process faster, cheaper, and safer by alleviating the need for expensive real-world experiments. However,…

Robotics · Computer Science 2021-06-22 Fabio Muratore , Michael Gienger , Jan Peters

Intelligent surgical robots have the potential to revolutionize clinical practice by enabling more precise and automated surgical procedures. However, the automation of such robot for surgical tasks remains under-explored compared to recent…

Robotics · Computer Science 2026-03-10 Chonlam Ho , Jianshu Hu , Lei Song , Hesheng Wang , Qi Dou , Yutong Ban

Robotic assembly is a longstanding challenge, requiring contact-rich interaction and high precision and accuracy. Many applications also require adaptivity to diverse parts, poses, and environments, as well as low cycle times. In other…

Scientific knowledge expands by observing the world, hypothesizing some theories about it, and testing them against collected data. When those theories take the form of statistical models, statistical analyses are involved in the process of…

Machine Learning · Statistics 2026-03-11 Arnaud Delaunoy