English
Related papers

Related papers: Terrain Consistent Reference-Guided RL for Humanoi…

200 papers

Deep reinforcement learning (deep RL) holds the promise of automating the acquisition of complex controllers that can map sensory inputs directly to low-level actions. In the domain of robotic locomotion, deep RL could enable learning…

Machine Learning · Computer Science 2019-06-20 Tuomas Haarnoja , Sehoon Ha , Aurick Zhou , Jie Tan , George Tucker , Sergey Levine

Along with the advancement of robot skin technology, there has been notable progress in the development of snake robots featuring body-surface tactile perception. In this study, we proposed a locomotion control framework for snake robots…

Robotics · Computer Science 2023-12-07 Shuo Jiang , Adarsh Salagame , Alireza Ramezani , Lawson Wong

Quadrupedal locomotion over complex terrain has been a long-standing research topic in robotics. While recent reinforcement learning-based locomotion methods improve generalizability and foot-placement precision, they rely on implicit…

Robotics · Computer Science 2026-04-06 Matthew Hwang , Yubin Liu , Ryo Hakoda , Takeshi Oishi

Legged robots are physically capable of traversing a wide range of challenging environments, but designing controllers that are sufficiently robust to handle this diversity has been a long-standing challenge in robotics. Reinforcement…

Robotics · Computer Science 2021-10-12 Laura Smith , J. Chase Kew , Xue Bin Peng , Sehoon Ha , Jie Tan , Sergey Levine

In this paper, we present a framework rooted in control and planning that enables quadrupedal robots to traverse challenging terrains with discrete footholds using visual feedback. Navigating discrete terrain is challenging for quadrupeds…

Robotics · Computer Science 2022-03-07 Ayush Agrawal , Shuxiao Chen , Akshara Rai , Koushil Sreenath

Humanoid robots are well suited for human habitats due to their morphological similarity, but developing controllers for them is a challenging task that involves multiple sub-problems, such as control, planning and perception. In this…

Robotics · Computer Science 2023-10-11 K. Niranjan Kumar , Irfan Essa , Sehoon Ha

Automatically configuring a robotic prosthesis to fit its user's needs and physical conditions is a great technical challenge and a roadblock to the adoption of the technology. Previously, we have successfully developed reinforcement…

Robotics · Computer Science 2021-01-12 Ruofan Wu , Minhan Li , Zhikai Yao , Jennie Si , He , Huang

Recent success in legged robot locomotion is attributed to the integration of reinforcement learning and physical simulators. However, these policies often encounter challenges when deployed in real-world environments due to sim-to-real…

Robotics · Computer Science 2025-06-04 Shaoting Zhu , Linzhan Mou , Derun Li , Baijun Ye , Runhan Huang , Hang Zhao

Robot learning in high-dimensional control settings, such as humanoid locomotion, presents persistent challenges for reinforcement learning (RL) algorithms due to unstable dynamics, complex contact interactions, and sensitivity to…

Robotics · Computer Science 2025-05-21 Khang Nguyen , Khai Nguyen , An T. Le , Jan Peters , Manfred Huber , Ngo Anh Vien , Minh Nhat Vu

Control policy learning for modular robot locomotion has previously been limited to proprioceptive feedback and flat terrain. This paper develops policies for modular systems with vision traversing more challenging environments. These…

Robotics · Computer Science 2023-05-02 Julian Whitman , Howie Choset

Fully autonomous mobile robots have a multitude of potential applications, but guaranteeing robust navigation performance remains an open research problem. For many tasks such as repeated infrastructure inspection, item delivery, or…

Robotics · Computer Science 2021-07-30 Dominic Dall'Osto , Tobias Fischer , Michael Milford

Humans are known to construct cognitive maps of their everyday surroundings using a variety of perceptual inputs. As such, when a human is asked for directions to a particular location, their wayfinding capability in converting this…

Robotics · Computer Science 2020-11-03 Vishnu Sashank Dorbala , Arjun Srinivasan , Aniket Bera

Agile and adaptive maneuvers such as fall recovery, high-speed turning, and sprinting in the wild are challenging for legged systems. We propose a Curricular Hindsight Reinforcement Learning (CHRL) that learns an end-to-end tracking…

Robotics · Computer Science 2023-10-25 Sicen Li , Yiming Pang , Panju Bai , Zhaojin Liu , Jiawei Li , Shihao Hu , Liquan Wang , Gang Wang

Recently reinforcement learning (RL) has emerged as a promising approach for quadrupedal locomotion, which can save the manual effort in conventional approaches such as designing skill-specific controllers. However, due to the complex…

Robotics · Computer Science 2021-09-17 Haojie Shi , Bo Zhou , Hongsheng Zeng , Fan Wang , Yueqiang Dong , Jiangyong Li , Kang Wang , Hao Tian , Max Q. -H. Meng

Learning human-like, robust bipedal walking remains difficult due to hybrid dynamics and terrain variability. We propose a lightweight framework that combines a gait generator network learned from human motion with Proximal Policy…

Robotics · Computer Science 2025-11-24 Yusuf Baran Ates , Omer Morgul

Developing robust autonomous loco-manipulation skills for humanoids remains an open problem in robotics. While RL has been applied successfully to legged locomotion, applying it to complex, interaction-rich manipulation tasks is harder…

We present a unified framework for multi-task locomotion and manipulation policy learning grounded in a contact-explicit representation. Instead of designing different policies for different tasks, our approach unifies the definition of a…

Robotics · Computer Science 2026-05-05 Shafeef Omar , Majid Khadiv

Training robots to navigate diverse environments is a challenging problem as it involves the confluence of several different perception tasks such as mapping and localization, followed by optimal path-planning and control. Recently released…

Robotics · Computer Science 2021-01-07 Kaushik Balakrishnan , Punarjay Chakravarty , Shubham Shrivastava

Autonomous navigation is an essential capability of smart mobility for mobile robots. Traditional methods must have the environment map to plan a collision-free path in workspace. Deep reinforcement learning (DRL) is a promising technique…

Robotics · Computer Science 2019-04-23 Liulong Ma , Yanjie Liu , Jiao Chen , Dong Jin

Deep Reinforcement Learning (RL) has emerged as a promising method to develop humanoid robot locomotion controllers. Despite the robust and stable locomotion demonstrated by previous RL controllers, their behavior often lacks the natural…

Robotics · Computer Science 2025-02-06 Qiyuan Zhang , Chenfan Weng , Guanwu Li , Fulai He , Yusheng Cai