English
Related papers

Related papers: Variable Stiffness for Robust Locomotion through R…

200 papers

Agile and adaptive maneuvers such as fall recovery, high-speed turning, and sprinting in the wild are challenging for legged systems. We propose a Curricular Hindsight Reinforcement Learning (CHRL) that learns an end-to-end tracking…

Robotics · Computer Science 2023-10-25 Sicen Li , Yiming Pang , Panju Bai , Zhaojin Liu , Jiawei Li , Shihao Hu , Liquan Wang , Gang Wang

Electric quadruped robots used in outdoor exploration are susceptible to leg-related electrical or mechanical failures. Unexpected joint power loss and joint locking can immediately pose a falling threat. Typically, controllers lack the…

Robotics · Computer Science 2024-02-15 Taixian Hou , Jiaxin Tu , Xiaofei Gao , Zhiyan Dong , Peng Zhai , Lihua Zhang

Compliance in actuation has been exploited to generate highly dynamic maneuvers such as throwing that take advantage of the potential energy stored in joint springs. However, the energy storage and release could not be well-timed yet. On…

A reinforcement learning (RL) control policy could fail in a new/perturbed environment that is different from the training environment, due to the presence of dynamic variations. For controlling systems with continuous state and action…

Robotics · Computer Science 2022-08-31 Y. Cheng , P. Zhao , F. Wang , D. J. Block , N. Hovakimyan

Standing-up control is crucial for humanoid robots, with the potential for integration into current locomotion and loco-manipulation systems, such as fall recovery. Existing approaches are either limited to simulations that overlook…

Robotics · Computer Science 2025-04-22 Tao Huang , Junli Ren , Huayi Wang , Zirui Wang , Qingwei Ben , Muning Wen , Xiao Chen , Jianan Li , Jiangmiao Pang

Reinforcement learning (RL) offers a powerful approach for robots to learn complex, collaborative skills by combining Dynamic Movement Primitives (DMPs) for motion and Variable Impedance Control (VIC) for compliant interaction. However,…

Robotics · Computer Science 2026-03-03 Shreyas Kumar , Ravi Prakash

We present a reinforcement learning framework for quadrupedal wall-climbing locomotion that explicitly addresses uncertainty in magnetic foot adhesion. A physics-based adhesion model of a quadrupedal magnetic climbing robot is incorporated…

Robotics · Computer Science 2025-10-24 Yong Um , Young-Ha Shin , Joon-Ha Kim , Soonpyo Kwon , Hae-Won Park

The process of robot design is a complex task and the majority of design decisions are still based on human intuition or tedious manual tuning. A more informed way of facing this task is computational design methods where design parameters…

Robotics · Computer Science 2022-10-07 Álvaro Belmonte-Baeza , Joonho Lee , Giorgio Valsecchi , Marco Hutter

Deep reinforcement learning (DRL) is a promising approach for developing legged locomotion skills. However, the iterative design process that is inevitable in practice is poorly supported by the default methodology. It is difficult to…

Robotics · Computer Science 2019-03-25 Zhaoming Xie , Patrick Clary , Jeremy Dao , Pedro Morais , Jonathan Hurst , Michiel van de Panne

In the field of legged robot motion control, reinforcement learning (RL) holds great promise but faces two major challenges: high computational cost for training individual robots and poor generalization of trained models. To address these…

Robotics · Computer Science 2025-04-09 Haodong Huang , Shilong Sun , Zida Zhao , Hailin Huang , Changqing Shen , Wenfu Xu

For legged robots to match the athletic capabilities of humans and animals, they must not only produce robust periodic walking and running, but also seamlessly switch between nominal locomotion gaits and more specialized transient…

Robotics · Computer Science 2022-07-19 Fangzhou Yu , Ryan Batke , Jeremy Dao , Jonathan Hurst , Kevin Green , Alan Fern

The functional demands of robotic systems often require completing various tasks or behaviors under the effect of disturbances or uncertain environments. Of increasing interest is the autonomy for dynamic robots, such as multirotors, motor…

Robotics · Computer Science 2022-09-16 Wyatt Ubellacker , Aaron Ames

Reinforcement learning (RL) has shown great potential in enabling quadruped robots to perform agile locomotion. However, directly training policies to simultaneously handle dual extreme challenges, i.e., extreme underactuation and extreme…

Robotics · Computer Science 2025-07-03 Ziang Zheng , Guojian Zhan , Shiqi Liu , Yao Lyu , Tao Zhang , Shengbo Eben Li

Rigid-bodied robots often lack compliance needed to adapt to unstructured environments, while fully soft robots, though highly adaptable, struggle with scalability and load capacity. In nature, musculoskeletal systems balance strength and…

Computational Engineering, Finance, and Science · Computer Science 2026-05-29 Hiroki Kobayashi , Yuki Takaha , Changyoung Yuhn , Yuki Sato , Sunao Tomita , Atsushi Kawamoto , Tsuyoshi Nomura

Navigating rugged landscapes poses significant challenges for legged locomotion. Multi-legged robots (those with 6 and greater) offer a promising solution for such terrains, largely due to their inherent high static stability, resulting…

Robotics · Computer Science 2024-09-17 Juntao He , Baxi Chong , Zhaochen Xu , Sehoon Ha , Daniel I. Goldman

In recent years, reinforcement learning (RL) based quadrupedal locomotion control has emerged as an extensively researched field, driven by the potential advantages of autonomous learning and adaptation compared to traditional control…

Robotics · Computer Science 2024-10-15 Maurya Gurram , Prakash Kumar Uttam , Shantipal S. Ohol

Reinforcement learning often requires extensive training data. Simulation-to-real transfer offers a promising approach to address this challenge in robotics. While differentiable simulators offer improved sample efficiency through exact…

Robotics · Computer Science 2024-12-02 Severin Bochem , Eduardo Gonzalez-Sanchez , Yves Bicker , Gabriele Fadini

While Reinforcement Learning (RL) has achieved remarkable progress in legged locomotion control, it often suffers from performance degradation in out-of-distribution (OOD) conditions and discrepancies between the simulation and the real…

Robotics · Computer Science 2025-09-18 Renjie Wang , Shangke Lyu , Donglin Wang

Generalizing locomotion policies across diverse legged robots with varying morphologies is a key challenge due to differences in observation/action dimensions and system dynamics. In this work, we propose Multi-Loco, a novel unified…

Robotics · Computer Science 2025-06-16 Shunpeng Yang , Zhen Fu , Zhefeng Cao , Guo Junde , Patrick Wensing , Wei Zhang , Hua Chen

In this paper, we propose a locomotion training framework where a control policy and a state estimator are trained concurrently. The framework consists of a policy network which outputs the desired joint positions and a state estimation…

Robotics · Computer Science 2022-03-03 Gwanghyeon Ji , Juhyeok Mun , Hyeongjun Kim , Jemin Hwangbo