中文
相关论文

相关论文: Zero-shot Sim2Real Adaptation Across Environments

200 篇论文

This paper proposes a simulation-based reinforcement learning algorithm for controlling systems with uncertain and varying system parameters. While simulators are useful for safely learning control policies, the reality gap remains a major…

系统与控制 · 电气工程与系统科学 2026-05-14 Junya Ikemoto

Forklifts are used extensively in various industrial settings and are in high demand for automation. In particular, counterbalance forklifts are highly versatile and employed in diverse scenarios. However, efforts to automate these…

机器人学 · 计算机科学 2025-05-07 Koshi Oishi , Teruki Kato , Hiroya Makino , Seigo Ito

Sim2Real aims at training policies in high-fidelity simulation environments and effectively transferring them to the real world. Despite the developments of accurate simulators and Sim2Real RL approaches, the policies trained purely in…

机器学习 · 计算机科学 2025-10-21 Akhil S Anand , Shambhuraj Sawant , Jasper Hoffmann , Dirk Reinhardt , Sebastien Gros

In order to mitigate the sample complexity of real-world reinforcement learning, common practice is to first train a policy in a simulator where samples are cheap, and then deploy this policy in the real world, with the hope that it…

机器学习 · 计算机科学 2024-10-29 Andrew Wagenmaker , Kevin Huang , Liyiming Ke , Byron Boots , Kevin Jamieson , Abhishek Gupta

Deep reinforcement learning has proven to be successful for learning tasks in simulated environments, but applying same techniques for robots in real-world domain is more challenging, as they require hours of training. To address this,…

机器学习 · 计算机科学 2020-03-24 Janne Karttunen , Anssi Kanervisto , Ville Kyrki , Ville Hautamäki

In recent years, reinforcement learning (RL) has shown remarkable success in robotics when a fast and accurate simulator is available for a given task. When using RL and simulation, more simulator realism is generally beneficial but becomes…

机器人学 · 计算机科学 2026-04-17 Yunfu Deng , Yuhao Li , Josiah P. Hanna

Learning control policies in simulation enables rapid, safe, and cost-effective development of advanced robotic capabilities. However, transferring these policies to the real world remains difficult due to the sim-to-real gap, where…

机器人学 · 计算机科学 2026-01-16 Jiahe Pan , Jiaxu Xing , Rudolf Reiter , Yifan Zhai , Elie Aljalbout , Davide Scaramuzza

Deploying reinforcement learning policies trained in simulation to real autonomous vehicles remains a fundamental challenge, particularly for VLM-guided RL frameworks whose policies are typically learned with simulator-native observations…

机器人学 · 计算机科学 2026-04-07 Zilin Huang , Zhengyang Wan , Zihao Sheng , Boyue Wang , Junwei You , Yue Leng , Sikai Chen

Robot control policies learned in simulation do not often transfer well to the real world. Many existing solutions to this sim-to-real problem, such as the Grounded Action Transformation (GAT) algorithm, seek to correct for or ground these…

机器人学 · 计算机科学 2020-08-05 Siddharth Desai , Haresh Karnan , Josiah P. Hanna , Garrett Warnell , Peter Stone

Soft continuum arms (SCAs) soft and deformable nature presents challenges in modeling and control due to their infinite degrees of freedom and non-linear behavior. This work introduces a reinforcement learning (RL)-based framework for…

机器人学 · 计算机科学 2026-03-13 Hsin-Jung Yang , Mahsa Khosravi , Benjamin Walt , Girish Krishnan , Soumik Sarkar

For a robot to learn a good policy, it often requires expensive equipment (such as sophisticated sensors) and a prepared training environment conducive to learning. However, it is seldom possible to perfectly equip robots for economic…

人工智能 · 计算机科学 2019-07-19 Hélène Plisnier , Denis Steckelmacher , Diederik Roijers , Ann Nowé

Zero-shot sim-to-real transfer of tasks with complex dynamics is a highly challenging and unsolved problem. A number of solutions have been proposed in recent years, but we have found that many works do not present a thorough evaluation in…

机器人学 · 计算机科学 2020-08-18 Eugene Valassakis , Zihan Ding , Edward Johns

If we want to train robots in simulation before deploying them in reality, it seems natural and almost self-evident to presume that reducing the sim2real gap involves creating simulators of increasing fidelity (since reality is what it is).…

机器人学 · 计算机科学 2022-11-29 Joanne Truong , Max Rudolph , Naoki Yokoyama , Sonia Chernova , Dhruv Batra , Akshara Rai

Transferring learning-based models to the real world remains one of the hardest problems in model-free control theory. Due to the cost of data collection on a real robot and the limited sample efficiency of Deep Reinforcement Learning…

机器人学 · 计算机科学 2020-05-01 Thomas Chaffre , Julien Moras , Adrien Chan-Hon-Tong , Julien Marzat

Zero-shot learning methods typically assume that the new, unseen classes encountered during deployment come from the same distribution as the the classes in the training set. However, real-world scenarios often involve class distribution…

机器学习 · 计算机科学 2024-12-11 Yuli Slavutsky , Yuval Benjamini

Reinforcement learning has emerged as a promising methodology for training robot controllers. However, most results have been limited to simulation due to the need for a large number of samples and the lack of automated-yet-safe data…

机器人学 · 计算机科学 2018-03-29 Kendall Lowrey , Svetoslav Kolev , Jeremy Dao , Aravind Rajeswaran , Emanuel Todorov

Reinforcement learning has shown a wide usage in robotics tasks, such as insertion and grasping. However, without a practical sim2real strategy, the policy trained in simulation could fail on the real task. There are also wide researches in…

机器人学 · 计算机科学 2022-06-07 Yiwen Chen , Xue Li , Sheng Guo , Xian Yao Ng , Marcelo Ang

We present a reproducible benchmark for evaluating sim-to-real transfer of Multi-Agent Reinforcement Learning (MARL) policies for Connected and Automated Vehicles (CAVs). The platform, based on the Cyber-Physical Mobility Lab (CPM Lab) [1],…

机器人学 · 计算机科学 2026-05-27 Julius Beerwerth , Jianye Xu , Simon Schäfer , Fynn Belderink , Bassam Alrifaee

In this work, we address the challenge of zero-shot generalization (ZSG) in Reinforcement Learning (RL), where agents must adapt to entirely novel environments without additional training. We argue that understanding and utilizing…

机器学习 · 计算机科学 2024-04-16 Tidiane Camaret Ndir , André Biedenkapp , Noor Awad

The current dominant paradigm for imitation learning relies on strong supervision of expert actions to learn both 'what' and 'how' to imitate. We pursue an alternative paradigm wherein an agent first explores the world without any expert…