English
Related papers

Related papers: An Real-Sim-Real (RSR) Loop Framework for Generali…

200 papers

Nowadays, realistic simulation environments are essential to validate and build reliable robotic solutions. This is particularly true when using Reinforcement Learning (RL) based control policies. To this end, both robotics and RL…

Robotics · Computer Science 2023-10-12 Matteo El-Hariry , Antoine Richard , Miguel Olivares-Mendez

We present $multipanda\_ros2$, a novel open-source ROS2 architecture for multi-robot control of Franka Robotics robots. Leveraging ros2 control, this framework provides native ROS2 interfaces for controlling any number of robots from a…

Robotics · Computer Science 2026-02-03 Jon Škerlj , Seongjin Bien , Abdeldjallil Naceri , Sami Haddadin

Realistic physics engines play a crucial role for learning to manipulate deformable objects such as garments in simulation. By doing so, researchers can circumvent challenges such as sensing the deformation of the object in the realworld.…

Robotics · Computer Science 2025-12-23 David Blanco-Mulero , Oriol Barbany , Gokhan Alcan , Adrià Colomé , Carme Torras , Ville Kyrki

Recent progress in GPU-accelerated, photorealistic simulation has opened a scalable data-generation path for robot learning, where massive physics and visual randomization allow policies to generalize beyond curated environments. Building…

Long-term user engagement (LTE) optimization in sequential recommender systems (SRS) is shown to be suited by reinforcement learning (RL) which finds a policy to maximize long-term rewards. Meanwhile, RL has its shortcomings, particularly…

Information Retrieval · Computer Science 2023-05-09 Xiong-Hui Chen , Bowei He , Yang Yu , Qingyang Li , Zhiwei Qin , Wenjie Shang , Jieping Ye , Chen Ma

We study sim-to-real skill transfer and discovery in the context of robotics control using representation learning. We draw inspiration from spectral decomposition of Markov decision processes. The spectral decomposition brings about…

Machine Learning · Computer Science 2024-04-09 Haitong Ma , Zhaolin Ren , Bo Dai , Na Li

Achieving generalizable embodied policies remains a key challenge. Traditional policy learning paradigms, including both Imitation Learning (IL) and Reinforcement Learning (RL), struggle to cultivate generalizability across diverse…

Robotics · Computer Science 2025-12-04 Yinzhou Tang , Yu Shang , Yinuo Chen , Bingwen Wei , Xin Zhang , Shu'ang Yu , Liangzhi Shi , Chao Yu , Chen Gao , Wei Wu , Yong Li

Imitation learning methods need significant human supervision to learn policies robust to changes in object poses, physical disturbances, and visual distractors. Reinforcement learning, on the other hand, can explore the environment…

Robotics · Computer Science 2024-11-26 Marcel Torne , Anthony Simeonov , Zechu Li , April Chan , Tao Chen , Abhishek Gupta , Pulkit Agrawal

Simulation-to-reality reinforcement learning (RL) faces the critical challenge of reconciling discrepancies between simulated and real-world dynamics, which can severely degrade agent performance. A promising approach involves learning…

Machine Learning · Computer Science 2025-04-04 JB Lanier , Kyungmin Kim , Armin Karamzade , Yifei Liu , Ankita Sinha , Kat He , Davide Corsi , Roy Fox

Rapid progress in imitation learning, foundation models, and large-scale datasets has led to robot manipulation policies that generalize to a wide-range of tasks and environments. However, rigorous evaluation of these policies remains a…

The use of machine learning in cyber-physical systems has attracted the interest of both industry and academia. However, no general solution has yet been found against the unpredictable behavior of neural networks and reinforcement learning…

Robotics · Computer Science 2025-05-01 Federico Nesti , Gianluca D'Amico , Mauro Marinoni , Giorgio Buttazzo

Deep Reinforcement Learning (DRL) has shown remarkable success in solving complex tasks across various research fields. However, transferring DRL agents to the real world is still challenging due to the significant discrepancies between…

Machine Learning · Computer Science 2024-10-22 Dianzhao Li , Ostap Okhrin

In reinforcement learning (RL) research, simulations enable benchmarks between algorithms, as well as prototyping and hyper-parameter tuning of agents. In order to promote RL both in research and real-world applications, frameworks are…

Robotics · Computer Science 2022-12-05 Christian Bitter , Timo Thun , Tobias Meisen

Human videos offer a scalable way to train robot manipulation policies, but lack the action labels needed by standard imitation learning algorithms. Existing cross-embodiment approaches try to map human motion to robot actions, but often…

Sim-to-real transfer trains RL agents in the simulated environments and then deploys them in the real world. Sim-to-real transfer has been widely used in practice because it is often cheaper, safer and much faster to collect samples in…

Machine Learning · Computer Science 2023-03-03 Jiachen Hu , Han Zhong , Chi Jin , Liwei Wang

Multi-agent deep Reinforcement Learning (RL) has made significant progress in developing intelligent game-playing agents in recent years. However, the efficient training of collective robots using multi-agent RL and the transfer of learned…

Robotics · Computer Science 2026-02-25 Rui Zhao , Xihui Li , Yizheng Zhang , Yuzhen Liu , Zhong Zhang , Yufeng Zhang , Cheng Zhou , Zhengyou Zhang , Lei Han

While Reinforcement Learning for Verifiable Rewards (RLVR) is powerful for training large reasoning models, its training dynamics harbor a critical challenge: RL overfitting, where models gain training rewards but lose generalization. Our…

Artificial Intelligence · Computer Science 2025-11-07 Zeng Zhiyuan , Jiashuo Liu , Zhangyue Yin , Ge Zhang , Wenhao Huang , Xipeng Qiu

This article introduces an open framework, called VSSS-RL, for studying Reinforcement Learning (RL) and sim-to-real in robot soccer, focusing on the IEEE Very Small Size Soccer (VSSS) league. We propose a simulated environment in which…

Simulation-to-reality transfer has emerged as a popular and highly successful method to train robotic control policies for a wide variety of tasks. However, it is often challenging to determine when policies trained in simulation are ready…

Ideally, we would place a robot in a real-world environment and leave it there improving on its own by gathering more experience autonomously. However, algorithms for autonomous robotic learning have been challenging to realize in the real…

Machine Learning · Computer Science 2023-11-01 Max Balsells , Marcel Torne , Zihan Wang , Samedh Desai , Pulkit Agrawal , Abhishek Gupta