English
Related papers

Related papers: Chasing Autonomy: Dynamic Retargeting and Control …

200 papers

Recent advancements in reinforcement learning (RL) have led to significant progress in humanoid robot locomotion, simplifying the design and training of motion policies in simulation. However, the numerous implementation details make…

Robotics · Computer Science 2025-06-19 Yushi Wang , Penghui Chen , Xinyu Han , Feng Wu , Mingguo Zhao

Robotic exoskeletons are exciting technologies for augmenting human mobility. However, designing such a device for seamless integration with the human user and to assist human movement still is a major challenge. This paper aims at…

Robotics · Computer Science 2020-11-13 Xikai Tu , Minhan Li , Ming Liu , Jennie Si , He , Huang

Learning locomotion skills is a challenging problem. To generate realistic and smooth locomotion, existing methods use motion capture, finite state machines or morphology-specific knowledge to guide the motion generation algorithms. Deep…

Machine Learning · Computer Science 2018-05-15 Wenhao Yu , Greg Turk , C. Karen Liu

Reinforcement learning (RL) has emerged as a powerful method to learn robust control policies for bipedal locomotion. Yet, it can be difficult to tune desired robot behaviors due to unintuitive and complex reward design. In comparison,…

Robotics · Computer Science 2026-03-11 Neil Janwani , Varun Madabushi , Maegan Tucker

Automation of hydraulic material handling machinery is currently limited to semi-static pick-and-place cycles. Dynamic throwing motions which utilize the passive joints, can greatly improve time efficiency as well as increase the dumping…

Robotics · Computer Science 2024-11-28 Lennart Werner , Fang Nan , Pol Eyschen , Filippo A. Spinelli , Hongyi Yang , Marco Hutter

Human-to-humanoid imitation learning aims to learn a humanoid whole-body controller from human motion. Motion retargeting is a crucial step in enabling robots to acquire reference trajectories when exploring locomotion skills. However,…

Robotics · Computer Science 2025-09-22 Xingyu Chen , Hanyu Wu , Sikai Wu , Mingliang Zhou , Diyun Xiang , Haodong Zhang

In this survey, we systematically summarize the current literature on studies that apply reinforcement learning (RL) to the motion planning and control of autonomous vehicles. Many existing contributions can be attributed to the pipeline…

Robotics · Computer Science 2021-06-02 Fei Ye , Shen Zhang , Pin Wang , Ching-Yao Chan

Quadrupedal robots are increasingly deployed for load-carrying tasks across diverse terrains. While Model Predictive Control (MPC)-based methods can account for payload variations, they often depend on predefined gait schedules or…

Robotics · Computer Science 2025-05-02 Vamshi Kumar Kurva , Shishir Kolathaya

Reinforcement learning (RL) faces challenges in trajectory planning for urban automated driving due to the poor convergence of RL and the difficulty in designing reward functions. Consequently, few RL-based trajectory planning methods can…

Robotics · Computer Science 2025-07-17 Di Zeng , Ling Zheng , Xiantong Yang , Yinong Li

Humanoid robotics presents significant challenges in artificial intelligence, requiring precise coordination and control of high-degree-of-freedom systems. Designing effective reward functions for deep reinforcement learning (DRL) in this…

Robotics · Computer Science 2025-02-13 Zhenwei Wu , Jinxiong Lu , Yuxiao Chen , Yunxin Liu , Yueting Zhuang , Luhui Hu

Reproducing the diverse and agile locomotion skills of animals has been a longstanding challenge in robotics. While manually-designed controllers have been able to emulate many complex behaviors, building such controllers involves a…

Robotics · Computer Science 2020-07-22 Xue Bin Peng , Erwin Coumans , Tingnan Zhang , Tsang-Wei Lee , Jie Tan , Sergey Levine

Reinforcement learning (RL) has significantly advanced the control of physics-based and robotic characters that track kinematic reference motion. However, methods typically rely on a weighted sum of conflicting reward functions, requiring…

Robotics · Computer Science 2025-05-30 Lucas N. Alegre , Agon Serifi , Ruben Grandia , David Müller , Espen Knoop , Moritz Bächer

Recently, work on reinforcement learning (RL) for bipedal robots has successfully learned controllers for a variety of dynamic gaits with robust sim-to-real demonstrations. In order to maintain balance, the learned controllers have full…

Robotics · Computer Science 2022-05-05 Helei Duan , Ashish Malik , Jeremy Dao , Aseem Saxena , Kevin Green , Jonah Siekmann , Alan Fern , Jonathan Hurst

We present a universal motion representation that encompasses a comprehensive range of motor skills for physics-based humanoid control. Due to the high dimensionality of humanoids and the inherent difficulties in reinforcement learning,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Zhengyi Luo , Jinkun Cao , Josh Merel , Alexander Winkler , Jing Huang , Kris Kitani , Weipeng Xu

Achieving stable and energy-efficient locomotion is essential for humanoid robots to operate continuously in real-world applications. Existing MPC and RL approaches often rely on energy-related metrics embedded within a multi-objective…

Robotics · Computer Science 2026-02-09 Weidong Huang , Jingwen Zhang , Jiongye Li , Shibowen Zhang , Jiayang Wu , Jiayi Wang , Hangxin Liu , Yaodong Yang , Yao Su

Enabling robust whole-body humanoid-object interaction (HOI) remains challenging due to motion data scarcity and the contact-rich nature. We present HDMI (HumanoiD iMitation for Interaction), a simple and general framework that learns…

Robotics · Computer Science 2025-09-30 Haoyang Weng , Yitang Li , Nikhil Sobanbabu , Zihan Wang , Zhengyi Luo , Tairan He , Deva Ramanan , Guanya Shi

Recently, reinforcement learning has become a promising and polular solution for robot legged locomotion. Compared to model-based control, reinforcement learning based controllers can achieve better robustness against uncertainties of…

Robotics · Computer Science 2023-10-09 Yikai Wang , Zheyuan Jiang , Jianyu Chen

Deep reinforcement learning (RL) has emerged as a promising approach for autonomously acquiring complex behaviors from low level sensor observations. Although a large portion of deep RL research has focused on applications in video games…

Robotics · Computer Science 2021-02-08 Julian Ibarz , Jie Tan , Chelsea Finn , Mrinal Kalakrishnan , Peter Pastor , Sergey Levine

Learning generalizable robot manipulation policies, especially for complex multi-fingered humanoids, remains a significant challenge. Existing approaches primarily rely on extensive data collection and imitation learning, which are…

Robotics · Computer Science 2025-09-03 Toru Lin , Kartik Sachdev , Linxi Fan , Jitendra Malik , Yuke Zhu

Developing robust vision-guided controllers for quadrupedal robots in complex environments, with various obstacles, dynamical surroundings and uneven terrains, is very challenging. While Reinforcement Learning (RL) provides a promising…