English
Related papers

Related papers: Coordinated Crawling via Reinforcement Learning

200 papers

Navigating human-populated environments without causing discomfort is a critical capability for socially-aware agents. While rule-based approaches offer interpretability through predefined psychological principles, they often lack…

Artificial Intelligence · Computer Science 2025-11-17 Yitian Kou , Yihe Gu , Chen Zhou , DanDan Zhu , Shuguang Kuai

Although typically possessing four limbs and short bodies, lizards have evolved a diversity of body plans, from short-bodied and fully-limbed to elongate and nearly limbless. Such diversity in body morphology is hypothesized as adaptations…

Biological Physics · Physics 2022-08-10 Baxi Chong , Tianyu Wang , Eva Erickson , Philip J Bergmann , Daniel I. Goldman

This work developed a kernel-based residual learning framework for quadrupedal robotic locomotion. Initially, a kernel neural network is trained with data collected from an MPC controller. Alongside a frozen kernel network, a residual…

Robotics · Computer Science 2023-02-16 Milo Carroll , Zhaocheng Liu , Mohammadreza Kasaei , Zhibin Li

Legged robots are physically capable of traversing a wide range of challenging environments, but designing controllers that are sufficiently robust to handle this diversity has been a long-standing challenge in robotics. Reinforcement…

Robotics · Computer Science 2021-10-12 Laura Smith , J. Chase Kew , Xue Bin Peng , Sehoon Ha , Jie Tan , Sergey Levine

In order for autonomous mobile robots to navigate in human spaces, they must abide by our social norms. Reinforcement learning (RL) has emerged as an effective method to train sequential decision-making policies that are able to respect…

Robotics · Computer Science 2024-03-01 Adam Sigal , Hsiu-Chin Lin , AJung Moon

Demonstration-guided reinforcement learning (RL) is a promising approach for learning complex behaviors by leveraging both reward feedback and a set of target task demonstrations. Prior approaches for demonstration-guided RL treat every new…

Machine Learning · Computer Science 2021-07-22 Karl Pertsch , Youngwoon Lee , Yue Wu , Joseph J. Lim

Understanding pedestrian behavior is crucial for the safe deployment of Autonomous Vehicles (AVs) in urban environments. Traditional pedestrian behavior models often fall into two categories: mechanistic models, which do not generalize well…

Human-Computer Interaction · Computer Science 2024-09-24 Yueyang Wang , Aravinda Ramakrishnan Srinivasan , Yee Mun Lee , Gustav Markkula

Jumping poses a significant challenge for quadruped robots, despite being crucial for many operational scenarios. While optimisation methods exist for controlling such motions, they are often time-consuming and demand extensive knowledge of…

Robotics · Computer Science 2026-05-19 Riccardo Bussola , Michele Focchi , Giulio Turrisi , Claudio Semini , Luigi Palopoli

Humans' ability to smoothly switch between locomotion and manipulation is a remarkable feature of sensorimotor coordination. Leaning and replication of such human-like strategies can lead to the development of more sophisticated robots…

Robotics · Computer Science 2024-02-22 Jianzhuang Zhao , Francesco Tassi , Yanlong Huang , Elena De Momi , Arash Ajoudani

Inchworm crawling allows for both quasistatic and dynamic gaits at a wide range of actuation frequencies. This locomotion mechanism is common in nonskeletal animals and exploited extensively in the bio-inspired field of soft robotics. In…

Robotics · Computer Science 2020-09-10 Benny Gamus , Amir D. Gat , Yizhar Or

This paper proposes a modular framework to generate robust biped locomotion using a tight coupling between an analytical walking approach and deep reinforcement learning. This framework is composed of six main modules which are…

Robotics · Computer Science 2021-12-23 Mohammadreza Kasaei , Miguel Abreu , Nuno Lau , Artur Pereira , Luis Paulo Reis

Limbless locomotors, from microscopic worms to macroscopic snakes, traverse complex, heterogeneous natural environments typically using undulatory body wave propagation. Theoretical and robophysical models typically emphasize body…

In this paper, we present a new locomotion control method for soft robot snakes. Inspired by biological snakes, our control architecture is composed of two key modules: A deep reinforcement learning (RL) module for achieving adaptive…

Robotics · Computer Science 2020-03-04 Xuan Liu , Renato Gasoto , Cagdas Onal , Jie Fu

Humanoid robots can, in principle, use their legs to go almost anywhere. Developing controllers capable of traversing diverse terrains, however, remains a considerable challenge. Classical controllers are hard to generalize broadly while…

Robotics · Computer Science 2024-10-07 Ilija Radosavovic , Sarthak Kamat , Trevor Darrell , Jitendra Malik

Modern Reinforcement Learning (RL) algorithms promise to solve difficult motor control problems directly from raw sensory inputs. Their attraction is due in part to the fact that they can represent a general class of methods that allow to…

Animals locomote for various reasons: to search for food, find suitable habitat, pursue prey, escape from predators, or seek a mate. The grand scale of biodiversity contributes to the great locomotory design and mode diversity. Various…

Computer Vision and Pattern Recognition · Computer Science 2021-05-27 Soo Min Kang , Richard P. Wildes

This paper addresses the challenge of terrain-adaptive dynamic locomotion in humanoid robots, a problem traditionally tackled by optimization-based methods or reinforcement learning (RL). Optimization-based methods, such as model-predictive…

Robotics · Computer Science 2024-07-30 Shangqun Yu , Nisal Perera , Daniel Marew , Donghyun Kim

The adaptive learning capabilities seen in biological neural networks are largely a product of the self-modifying behavior emerging from online plastic changes in synaptic connectivity. Current methods in Reinforcement Learning (RL) only…

Neural and Evolutionary Computing · Computer Science 2020-06-16 Samuel Schmidgall

Inspired by spiking neural feedback, we propose a spiking controller for efficient locomotion in a soft robotic crawler. Its bistability, akin to neural fast positive feedback, combined with a sensorimotor slow negative feedback loop,…

Systems and Control · Electrical Eng. & Systems 2026-02-19 Juncal Arbelaiz , Alessio Franci , Naomi Ehrich Leonard , Rodolphe Sepulchre , Bassam Bamieh

Legged robots must exhibit robust and agile locomotion across diverse, unstructured terrains, a challenge exacerbated under blind locomotion settings where terrain information is unavailable. This work introduces a hierarchical…

Robotics · Computer Science 2025-11-05 Matheus P. Angarola , Francisco Affonso , Marcelo Becker