English
Related papers

Related papers: Impact of Static Friction on Sim2Real in Robotic R…

200 papers

Replicating the remarkable athleticism seen in animals has long been a challenge in robotics control. Although Reinforcement Learning (RL) has demonstrated significant progress in dynamic legged locomotion control, the substantial…

Robotics · Computer Science 2024-05-01 Neil Guan , Shangqun Yu , Shifan Zhu , Donghyun Kim

In multi-agent safety-critical scenarios, traditional autonomous driving frameworks face significant challenges in balancing safety constraints and task performance. These frameworks struggle to quantify dynamic interaction risks in…

Robotics · Computer Science 2025-04-10 Kaifeng Wang , Yinsong Chen , Qi Liu , Xueyuan Li , Xin Gao

Behavior cloning has shown promise for robot manipulation, but real-world demonstrations are costly to acquire at scale. While simulated data offers a scalable alternative, particularly with advances in automated demonstration generation,…

Robotics · Computer Science 2026-01-19 Shuo Cheng , Liqian Ma , Zhenyang Chen , Ajay Mandlekar , Caelan Garrett , Danfei Xu

Autonomous race driving poses a complex control challenge as vehicles must be operated at the edge of their handling limits to reduce lap times while respecting physical and safety constraints. This paper presents a novel reinforcement…

Robotics · Computer Science 2024-06-24 Yuanda Wang , Xin Yuan , Changyin Sun

Sim-to-real transfer remains a major challenge in reinforcement learning (RL) for robotics, as policies trained in simulation often fail to generalize to the real world due to discrepancies in environment dynamics. Domain Randomization (DR)…

Robotics · Computer Science 2025-11-07 Marco Iannotta , Yuxuan Yang , Johannes A. Stork , Erik Schaffernicht , Todor Stoyanov

Reinforcement learning systems require good representations to work well. For decades practical success in reinforcement learning was limited to small domains. Deep reinforcement learning systems, on the other hand, are scalable, not…

Machine Learning · Computer Science 2020-03-18 Sina Ghiassian , Banafsheh Rafiee , Yat Long Lo , Adam White

We present a system for training deep neural networks for object detection using synthetic images. To handle the variability in real-world data, the system relies upon the technique of domain randomization, in which the parameters of the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-25 Jonathan Tremblay , Aayush Prakash , David Acuna , Mark Brophy , Varun Jampani , Cem Anil , Thang To , Eric Cameracci , Shaad Boochoon , Stan Birchfield

Learning contact-rich manipulation skills is essential. Such skills require the robots to interact with the environment with feasible manipulation trajectories and suitable compliance control parameters to enable safe and stable contact.…

Robotics · Computer Science 2023-10-17 Xiang Zhang , Changhao Wang , Lingfeng Sun , Zheng Wu , Xinghao Zhu , Masayoshi Tomizuka

Reinforcement learning (RL) is widely used in autonomous driving tasks and training RL models typically involves in a multi-step process: pre-training RL models on simulators, uploading the pre-trained model to real-life robots, and…

Machine Learning · Computer Science 2019-10-15 Xinle Liang , Yang Liu , Tianjian Chen , Ming Liu , Qiang Yang

Machine learning has facilitated significant advancements across various robotics domains, including navigation, locomotion, and manipulation. Many such achievements have been driven by the extensive use of simulation as a critical tool for…

Most of the current studies on autonomous vehicle decision-making and control tasks based on reinforcement learning are conducted in simulated environments. The training and testing of these studies are carried out under rule-based…

Systems and Control · Electrical Eng. & Systems 2024-04-22 Yuan Lin , Antai Xie , Xiao Liu

Intelligent agents must be able to think fast and slow to perform elaborate manipulation tasks. Reinforcement Learning (RL) has led to many promising results on a range of challenging decision-making tasks. However, in real-world robotics,…

Robotics · Computer Science 2021-10-22 Maximilian Ulmer , Elie Aljalbout , Sascha Schwarz , Sami Haddadin

While Reinforcement Learning (RL) has achieved remarkable progress in legged locomotion control, it often suffers from performance degradation in out-of-distribution (OOD) conditions and discrepancies between the simulation and the real…

Robotics · Computer Science 2025-09-18 Renjie Wang , Shangke Lyu , Donglin Wang

Reinforcement learning (RL) has demonstrated the ability to maintain the plasticity of the policy throughout short-term training in aerial robot control. However, these policies have been shown to loss of plasticity when extended to…

Robotics · Computer Science 2025-03-11 Ali Tahir Karasahin , Ziniu Wu , Basaran Bahadir Kocer

Achieving athletic loco-manipulation on robots requires moving beyond traditional tracking rewards - which simply guide the robot along a reference trajectory - to task rewards that drive truly dynamic, goal-oriented behaviors. Commands…

Robotics · Computer Science 2025-02-18 Nolan Fey , Gabriel B. Margolis , Martin Peticco , Pulkit Agrawal

Bridging the sim-to-real gap remains a fundamental challenge in robotics, as accurate dynamic parameter estimation is essential for reliable model-based control, realistic simulation, and safe deployment of manipulators. Traditional…

Robotics · Computer Science 2025-12-10 Mohammed Elseiagy , Tsige Tadesse Alemayoh , Ranulfo Bezerra , Shotaro Kojima , Kazunori Ohno

Trainable activation functions, whose parameters are optimized alongside network weights, offer increased expressivity compared to fixed activation functions. Specifically, trainable activation functions defined as ratios of polynomials…

Machine Learning · Computer Science 2025-07-22 Rafał Surdej , Michał Bortkiewicz , Alex Lewandowski , Mateusz Ostaszewski , Clare Lyle

In this work we show how to use the Operational Space Control framework (OSC) under joint and cartesian constraints for reinforcement learning in cartesian space. Our method is therefore able to learn fast and with adjustable degrees of…

Artificial Intelligence · Computer Science 2020-02-27 Manuel Kaspar , Juan David Munoz Osorio , Jürgen Bock

Bootstrapping is behind much of the successes of deep Reinforcement Learning. However, learning the value function via bootstrapping often leads to unstable training due to fast-changing target values. Target Networks are employed to…

World models have recently emerged as a promising approach to reinforcement learning (RL), achieving state-of-the-art performance across a wide range of visual control tasks. This work aims to obtain a deep understanding of the robustness…

Machine Learning · Computer Science 2025-01-03 Qiaoyi Fang , Weiyu Du , Hang Wang , Junshan Zhang