English
Related papers

Related papers: DeepQ Stepper: A framework for reactive dynamic wa…

200 papers

Not until recently, robust robot locomotion has been achieved by deep reinforcement learning (DRL). However, for efficient learning of parametrized bipedal walking, developed references are usually required, limiting the performance to that…

Robotics · Computer Science 2021-12-14 Chong Zhang , Qi Wu , Liqian Ma , Hongyuan Su

Dense 3D reconstruction and ego-motion estimation are key challenges in autonomous driving and robotics. Compared to the complex, multi-modal systems deployed today, multi-camera systems provide a simpler, low-cost alternative. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Aron Schmied , Tobias Fischer , Martin Danelljan , Marc Pollefeys , Fisher Yu

Locomotion on dynamic rigid surface (i.e., rigid surface accelerating in an inertial frame) presents complex challenges for controller design, which are essential for deploying humanoid robots in dynamic real-world environments such as…

Robotics · Computer Science 2024-09-16 Yuan Gao , Victor Paredes , Yukai Gong , Zijian He , Ayonga Hereid , Yan Gu

This work presents an extended framework for learning-based bipedal locomotion that incorporates a heuristic step-planning strategy guided by desired torso velocity tracking. The framework enables precise interaction between a humanoid…

Robotics · Computer Science 2025-12-01 William Suliman , Ekaterina Chaikovskaia , Egor Davydenko , Roman Gorbachev

Mobile robot navigation in complex and dynamic environments is a challenging but important problem. Reinforcement learning approaches fail to solve these tasks efficiently due to reward sparsities, temporal complexities and…

Robotics · Computer Science 2018-04-30 Xi Chen , Ali Ghadirzadeh , John Folkesson , Patric Jensfelt

Planning collision-free motions for robots with many degrees of freedom is challenging in environments with complex obstacle geometries. Recent work introduced the idea of speeding up the planning by encoding prior experience of successful…

Robotics · Computer Science 2024-05-28 Johannes Tenhumberg , Darius Burschka , Berthold Bäuml

Adaptive recovery from fall incidents are essential skills for the practical deployment of wheeled-legged robots, which uniquely combine the agility of legs with the speed of wheels for rapid recovery. However, traditional methods relying…

Robotics · Computer Science 2025-10-09 Boyuan Deng , Luca Rossini , Jin Wang , Weijie Wang , Dimitrios Kanoulas , Nikolaos Tsagarakis

We present a novel control strategy for dynamic legged locomotion in complex scenarios, that considers information about the morphology of the terrain in contexts when only on-board mapping and computation are available. The strategy is…

Getting up from an arbitrary fallen state is a basic human skill. Existing methods for learning this skill often generate highly dynamic and erratic get-up motions, which do not resemble human get-up strategies, or are based on tracking…

Graphics · Computer Science 2022-08-30 Tianxin Tao , Matthew Wilson , Ruiyu Gou , Michiel van de Panne

We tackle the problem of perceptive locomotion in dynamic environments. In this problem, a quadrupedal robot must exhibit robust and agile walking behaviors in response to environmental clutter and moving obstacles. We present a…

Robotics · Computer Science 2023-02-21 Mingyo Seo , Ryan Gupta , Yifeng Zhu , Alexy Skoutnev , Luis Sentis , Yuke Zhu

State-of-the-art reinforcement learning is now able to learn versatile locomotion, balancing and push-recovery capabilities for bipedal robots in simulation. Yet, the reality gap has mostly been overlooked and the simulated results hardly…

Robotics · Computer Science 2023-01-02 Alexis Duburcq , Fabian Schramm , Guilhem Boéris , Nicolas Bredeche , Yann Chevaleyre

Deep reinforcement learning is a promising approach to learning policies in uncontrolled environments that do not require domain knowledge. Unfortunately, due to sample inefficiency, deep RL applications have primarily focused on simulated…

Robotics · Computer Science 2022-08-17 Laura Smith , Ilya Kostrikov , Sergey Levine

Automated assessment of human motion plays a vital role in rehabilitation, enabling objective evaluation of patient performance and progress. Unlike general human activity recognition, rehabilitation motion assessment focuses on analyzing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Ali Ismail-Fawaz , Maxime Devanne , Stefano Berretti , Jonathan Weber , Germain Forestier

This paper presents a technique for navigation of mobile robot with Deep Q-Network (DQN) combined with Gated Recurrent Unit (GRU). The DQN integrated with the GRU allows action skipping for improved navigation performance. This technique…

Robotics · Computer Science 2021-12-08 Inhwan Kim , Sarvar Hussain Nengroo , Dongsoo Har

We present a new framework to generate human-like lower-limb trajectories in periodic and non-periodic walking conditions. In our method, walking dynamics is encoded in 3LP, a linear simplified model composed of three pendulums to model…

Robotics · Computer Science 2018-03-28 Salman Faraji , Auke Jan Ijspeert

For legged robots to match the athletic capabilities of humans and animals, they must not only produce robust periodic walking and running, but also seamlessly switch between nominal locomotion gaits and more specialized transient…

Robotics · Computer Science 2022-07-19 Fangzhou Yu , Ryan Batke , Jeremy Dao , Jonathan Hurst , Kevin Green , Alan Fern

The main novelty of the proposed approach is that it allows a robot to learn an end-to-end policy which can adapt to changes in the environment during execution. While goal conditioning of policies has been studied in the RL literature,…

Transformers have proven highly effective across various applications, especially in handling sequential data such as natural languages and time series. However, transformer models often lack clear interpretability, and the success of…

Machine Learning · Computer Science 2025-12-01 Wei Shi , Yuan Cao

This paper addresses the problem of legged locomotion in non-flat terrain. As legged robots such as quadrupeds are to be deployed in terrains with geometries which are difficult to model and predict, the need arises to equip them with the…

Robotics · Computer Science 2020-02-03 Vassilios Tsounis , Mitja Alge , Joonho Lee , Farbod Farshidian , Marco Hutter

Quadrupedal robots with manipulators offer strong mobility and adaptability for grasping in unstructured, dynamic environments through coordinated whole-body control. However, existing research has predominantly focused on static-object…

Robotics · Computer Science 2025-08-13 Qiwei Liang , Boyang Cai , Rongyi He , Hui Li , Tao Teng , Haihan Duan , Changxin Huang , Runhao Zeng