English
Related papers

Related papers: Coordinated Crawling via Reinforcement Learning

200 papers

Reinforcement learning (RL) has shown great potential in enabling quadruped robots to perform agile locomotion. However, directly training policies to simultaneously handle dual extreme challenges, i.e., extreme underactuation and extreme…

Robotics · Computer Science 2025-07-03 Ziang Zheng , Guojian Zhan , Shiqi Liu , Yao Lyu , Tao Zhang , Shengbo Eben Li

Legged robots have significant potential to operate in highly unstructured environments. The design of locomotion control is, however, still challenging. Currently, controllers must be either manually designed for specific robots and tasks,…

Robotics · Computer Science 2021-07-19 Mathias Thor , Poramate Manoonpong

The concept of cognitive radar (CR) enables radar systems to achieve intelligent adaption to a changeable environment with feedback facility from receiver to transmitter. However, the implementation of CR in a fast-changing environment…

Signal Processing · Electrical Eng. & Systems 2021-10-08 Pengfei Liu , Yimin Liu , Tianyao Huang , Yuxiang Lu , Xiqin Wang

Legged robots must adapt their gait to navigate unpredictable environments, a challenge that animals master with ease. However, most deep reinforcement learning (DRL) approaches to quadruped locomotion rely on a fixed gait, limiting…

Robotics · Computer Science 2025-06-24 Joseph Humphreys , Chengxu Zhou

This work provides a complete framework for the simulation, co-optimization, and sim-to-real transfer of the design and control of soft legged robots. The compliance of soft robots provides a form of "mechanical intelligence" -- the ability…

Robotics · Computer Science 2022-02-10 Charles Schaff , Audrey Sedal , Matthew R. Walter

To diagnose, plan, and treat musculoskeletal pathologies, understanding and reproducing muscle recruitment for complex movements is essential. With muscle activations for movements often being highly redundant, nonlinear, and time…

Signal Processing · Electrical Eng. & Systems 2020-07-15 Emanuel Joos , Fabien Péan , Orcun Goksel

Flocks of birds, schools of fish, insects swarms are examples of coordinated motion of a group that arises spontaneously from the action of many individuals. Here, we study flocking behavior from the viewpoint of multi-agent reinforcement…

Physics and Society · Physics 2020-07-08 Mihir Durve , Fernando Peruani , Antonio Celani

Snakes are a remarkable evolutionary success story. Many snake-inspired robots have been proposed over the years. Soft robotic snakes (SRS) with their continuous and smooth bending capability better mimic their biological counterparts'…

Robotics · Computer Science 2020-10-23 Dimuthu D. Arachchige , Yue Chen , Isuru S. Godage

Deep Reinforcement Learning (DRL) enables robots to learn complex behaviors through interaction with the environment. However, due to the unrestricted nature of the learning algorithms, the resulting solutions are often brittle and appear…

Robotics · Computer Science 2025-03-04 Oliver Hausdörfer , Alexander von Rohr , Éric Lefort , Angela Schoellig

This work explores the potential of using differentiable simulation for learning quadruped locomotion. Differentiable simulation promises fast convergence and stable training by computing low-variance first-order gradients using robot…

Robotics · Computer Science 2024-10-16 Yunlong Song , Sangbae Kim , Davide Scaramuzza

Continual learning aims to emulate the human ability to continually accumulate knowledge over sequential tasks. The main challenge is to maintain performance on previously learned tasks after learning new tasks, i.e., to avoid catastrophic…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Yunhao Ge , Yuecheng Li , Shuo Ni , Jiaping Zhao , Ming-Hsuan Yang , Laurent Itti

Humanoid robots have the promise of locomoting like humans, including fast and dynamic running. Recently, reinforcement learning (RL) controllers that can mimic human motions have become popular as they can generate very dynamic behaviors,…

Robotics · Computer Science 2026-03-30 Zachary Olkin , William D. Compton , Ryan M. Bena , Aaron D. Ames

Bounding is one of the important gaits in quadrupedal locomotion for negotiating obstacles. The authors proposed an effective approach that can learn robust bounding gaits more efficiently despite its large variation in dynamic body…

Robotics · Computer Science 2023-10-31 Zhicheng Wang , Anqiao Li , Yixiao Zheng , Anhuan Xie , Zhibin Li , Jun Wu , Qiuguo Zhu

Equipping quadruped robots with manipulators provides unique loco-manipulation capabilities, enabling diverse practical applications. This integration creates a more complex system that has increased difficulties in modeling and control.…

Robotics · Computer Science 2025-07-08 Dianyong Hou , Chengrui Zhu , Zhen Zhang , Zhibin Li , Chuang Guo , Yong Liu

Reinforcement learning (RL) is a framework to optimize a control policy using rewards that are revealed by the system as a response to a control action. In its standard form, RL involves a single agent that uses its policy to accomplish a…

Systems and Control · Electrical Eng. & Systems 2021-11-24 Juan Cervino , Juan Andres Bazerque , Miguel Calvo-Fullana , Alejandro Ribeiro

We study reinforcement learning in settings where sampling an action from the policy must be done concurrently with the time evolution of the controlled system, such as when a robot must decide on the next action while still performing the…

Machine Learning · Computer Science 2020-04-28 Ted Xiao , Eric Jang , Dmitry Kalashnikov , Sergey Levine , Julian Ibarz , Karol Hausman , Alexander Herzog

Reinforcement Learning is an area of Machine Learning focused on how agents can be trained to make sequential decisions, and achieve a particular goal within an arbitrary environment. While learning, they repeatedly take actions based on…

Despite the numerous advances, reinforcement learning remains away from widespread acceptance for autonomous controller design as compared to classical methods due to lack of ability to effectively tackle the reality gap. The reliance on…

Machine Learning · Computer Science 2024-09-23 Narendra Patwardhan , Zequn Wang

Inspired by the vertebrate branch of the animal kingdom, articulated soft robots are robotic systems embedding elastic elements into a classic rigid (skeleton-like) structure. Leveraging on their bodies elasticity, soft robots promise to…

Robotics · Computer Science 2023-09-06 Cosimo Della Santina , Dominic Lakatos , Antonio Bicchi , Alin Albu-Schäffer

Humanoids operating in real-world workspaces must frequently execute task-driven, short-range movements to SE(2) target poses. To be practical, these transitions must be fast, robust, and energy efficient. While learning-based locomotion…

Robotics · Computer Science 2026-04-23 Pranay Dugar , Mohitvishnu S. Gadde , Jonah Siekmann , Yesh Godse , Aayam Shrestha , Alan Fern