English
Related papers

Related papers: Zero-Shot Sim-to-Real Robot Learning: A Dexterous …

200 papers

Reinforcement learning has shown a wide usage in robotics tasks, such as insertion and grasping. However, without a practical sim2real strategy, the policy trained in simulation could fail on the real task. There are also wide researches in…

Robotics · Computer Science 2022-06-07 Yiwen Chen , Xue Li , Sheng Guo , Xian Yao Ng , Marcelo Ang

Modern reinforcement learning (RL) systems capture deep truths about general, human problem-solving. In domains where new data can be simulated cheaply, these systems uncover sequential decision-making policies that far exceed the ability…

Machine Learning · Computer Science 2025-10-07 Scott Jeen

Existing learning approaches to dexterous manipulation use demonstrations or interactions with the environment to train black-box neural networks that provide little control over how the robot learns the skills or how it would perform post…

Robotics · Computer Science 2023-01-25 Abhineet Jain , Jack Kolb , Harish Ravichandar

Learning a generalist control policy for dexterous manipulation typically relies on large-scale datasets. Given the high cost of real-world data collection, a practical alternative is to generate synthetic data through simulation. However,…

Robotics · Computer Science 2026-03-25 Ruixing Jin , Zicheng Zhu , Ruixiang Ouyang , Sheng Xu , Bo Yue , Zhizheng Wu , Guiliang Liu

We study reinforcement learning (RL) in settings where observations are high-dimensional, but where an RL agent has access to abstract knowledge about the structure of the state space, as is the case, for example, when a robot is tasked to…

Machine Learning · Computer Science 2022-05-31 Yao Liu , Dipendra Misra , Miro Dudík , Robert E. Schapire

Imitation learning methods need significant human supervision to learn policies robust to changes in object poses, physical disturbances, and visual distractors. Reinforcement learning, on the other hand, can explore the environment…

Robotics · Computer Science 2024-11-26 Marcel Torne , Anthony Simeonov , Zechu Li , April Chan , Tao Chen , Abhishek Gupta , Pulkit Agrawal

We present CREST, an approach for causal reasoning in simulation to learn the relevant state space for a robot manipulation policy. Our approach conducts interventions using internal models, which are simulations with approximate dynamics…

Robotics · Computer Science 2022-03-15 Tabitha Edith Lee , Jialiang Zhao , Amrita S. Sawhney , Siddharth Girdhar , Oliver Kroemer

Zero-shot learning methods typically assume that the new, unseen classes encountered during deployment come from the same distribution as the the classes in the training set. However, real-world scenarios often involve class distribution…

Machine Learning · Computer Science 2024-12-11 Yuli Slavutsky , Yuval Benjamini

Deep learning-based robotic grasping has made significant progress thanks to algorithmic improvements and increased data availability. However, state-of-the-art models are often trained on as few as hundreds or thousands of unique object…

Dynamic state representation learning is an important task in robot learning. Latent space that can capture dynamics related information has wide application in areas such as accelerating model free reinforcement learning, closing the…

Robotics · Computer Science 2022-07-27 Sirui Chen , Yunhao Liu , Jialong Li , Shang Wen Yao , Tingxiang Fan , Jia Pan

Learning robot skills from scratch is often time-consuming, while reusing data promotes sustainability and improves sample efficiency. This study investigates policy transfer across different robotic platforms, focusing on peg-in-hole task…

Robotics · Computer Science 2026-04-09 Khalil Abuibaid , Vinit Hegiste , Nigora Gafur , Achim Wagner , Martin Ruskowski

Bayesian policy reuse (BPR) is a general policy transfer framework for selecting a source policy from an offline library by inferring the task belief based on some observation signals and a trained observation model. In this paper, we…

Machine Learning · Computer Science 2023-07-14 Jinmei Liu , Zhi Wang , Chunlin Chen , Daoyi Dong

Learning-based approaches, particularly reinforcement learning (RL), have become widely used for developing control policies for autonomous agents, such as locomotion policies for legged robots. RL training typically maximizes a predefined…

Robotics · Computer Science 2025-04-23 Dylan Khor , Bowen Weng

Domain randomization (DR) is widely used in policy learning to improve robustness to modeling error, but remains underexplored in contact-rich sampling-based predictive control (SPC), where rollout quality is highly sensitive to…

Robotics · Computer Science 2026-05-06 Sergio A. Esteban , Junheng Li , Vince Kurtz , Aaron D. Ames

Autonomous visual navigation is an essential element in robot autonomy. Reinforcement learning (RL) offers a promising policy training paradigm. However existing RL methods suffer from high sample complexity, poor sim-to-real transfer, and…

Robotics · Computer Science 2025-07-31 Qianzhong Chen , Jiankai Sun , Naixiang Gao , JunEn Low , Timothy Chen , Mac Schwager

Domain randomization is a simple, effective, and flexible scheme for obtaining robust feedback policies aimed at reducing the sim-to-real gap due to model mismatch. While domain randomization methods have yielded impressive demonstrations…

Systems and Control · Electrical Eng. & Systems 2026-03-17 Alex Nguyen-Le , Nikolai Matni

Object handover is an important skill that we use daily when interacting with other humans. To deploy robots in collaborative setting, like houses, being able to receive and handing over objects safely and efficiently becomes a crucial…

Robotics · Computer Science 2025-06-23 Daniel Frau-Alfaro , Julio Castaño-Amoros , Santiago Puente , Pablo Gil , Roberto Calandra

Robot simulation has been an essential tool for data-driven manipulation tasks. However, most existing simulation frameworks lack either efficient and accurate models of physical interactions with tactile sensors or realistic tactile…

Robotics · Computer Science 2022-08-08 Zilin Si , Zirui Zhu , Arpit Agarwal , Stuart Anderson , Wenzhen Yuan

Many state-of-the art robotic applications utilize series elastic actuators (SEAs) with closed-loop force control to achieve complex tasks such as walking, lifting, and manipulation. Model-free PID control methods are more prone to…

Machine Learning · Computer Science 2025-07-30 Ruturaj Sambhus , Aydin Gokce , Stephen Welch , Connor W. Herron , Alexander Leonessa

The problem of uncertainty is a feature of real world robotics problems and any control framework must contend with it in order to succeed in real applications tasks. Reinforcement Learning is no different, and epistemic uncertainty arising…

Robotics · Computer Science 2024-10-08 Wendyam Eric Lionel Ilboudo , Taisuke Kobayashi , Takamitsu Matsubara