English
Related papers

Related papers: DeepQ Stepper: A framework for reactive dynamic wa…

200 papers

Humans can balance very well during walking, even when perturbed. But it seems difficult to achieve robust walking for bipedal robots. Here we describe the simplest balance controller that leads to robust walking for a linear inverted…

Robotics · Computer Science 2022-11-14 Linqi Ye , Xueqian Wang , Houde Liu , Bin Liang

Understanding the traversability of terrain is essential for autonomous robot navigation, particularly in unstructured environments such as natural landscapes. Although traditional methods, such as occupancy mapping, provide a basic…

This paper presents a method which can track and 3D reconstruct the non-rigid surface motion of human performance using a moving RGB-D camera. 3D reconstruction of marker-less human performance is a challenging problem due to the large…

Computer Vision and Pattern Recognition · Computer Science 2018-10-10 Shafeeq Elanattil , Peyman Moghadam , Simon Denman , Sridha Sridharan , Clinton Fookes

In this paper, we propose a reinforcement learning-based algorithm for trajectory optimization for constrained dynamical systems. This problem is motivated by the fact that for most robotic systems, the dynamics may not always be known.…

Machine Learning · Statistics 2020-03-05 Kei Ota , Devesh K. Jha , Tomoaki Oiki , Mamoru Miura , Takashi Nammoto , Daniel Nikovski , Toshisada Mariyama

Industrial robots are widely used in various manufacturing environments due to their efficiency in doing repetitive tasks such as assembly or welding. A common problem for these applications is to reach a destination without colliding with…

Robotics · Computer Science 2023-01-18 Teham Bhuiyan , Linh Kästner , Yifan Hu , Benno Kutschank , Jens Lambrecht

Controlled execution of dynamic motions in quadrupedal robots, especially those with articulated soft bodies, presents a unique set of challenges that traditional methods struggle to address efficiently. In this study, we tackle these…

Robotics · Computer Science 2024-03-05 Francecso Vezzi , Jiatao Ding , Antonin Raffin , Jens Kober , Cosimo Della Santina

In this paper, an online adaptation algorithm for bipedal walking on uneven surfaces with height uncertainty is proposed. In order to generate walking patterns on flat terrains, the trajectories in the task space are planned to satisfy the…

Robotics · Computer Science 2017-03-31 Majid Khadiv , S. Ali. A. Moosavian , Aghil Yousefi-Koma , Hessam Maleki , Majid Sadedel

This paper presents a deep Q-network (DQN)-based gain-scheduling framework for safety-critical quadcopter trajectory tracking. Instead of directly learning control inputs, the proposed approach selects from a finite set of pre-certified…

Systems and Control · Electrical Eng. & Systems 2026-03-04 Hossein Rastgoftar , Muhammad J. H. Zahed

This paper makes two scientific contributions to the field of exoskeleton-based action and movement recognition. First, it presents a novel machine learning and pattern recognition-based framework that can detect a wide range of actions and…

Robotics · Computer Science 2022-04-28 Nirmalya Thakur , Chia Y. Han

Today's robotic quadruped systems can robustly walk over a diverse range of rough but continuous terrains, where the terrain elevation varies gradually. Locomotion on discontinuous terrains, such as those with gaps or obstacles, presents a…

Robotics · Computer Science 2021-11-01 Gabriel B. Margolis , Tao Chen , Kartik Paigwar , Xiang Fu , Donghyun Kim , Sangbae Kim , Pulkit Agrawal

Robots that navigate among pedestrians use collision avoidance algorithms to enable safe and efficient operation. Recent works present deep reinforcement learning as a framework to model the complex interactions and cooperation. However,…

Robotics · Computer Science 2018-05-08 Michael Everett , Yu Fan Chen , Jonathan P. How

We present a computationally efficient method for online planning of bipedal walking trajectories with push recovery. In particular, the proposed methodology fits control architectures where the Divergent-Component-of-Motion (DCM) is…

A motion-based control interface promises flexible robot operations in dangerous environments by combining user intuitions with the robot's motor capabilities. However, designing a motion interface for non-humanoid robots, such as…

Robotics · Computer Science 2022-04-29 Sunwoo Kim , Maks Sorokin , Jehee Lee , Sehoon Ha

Locomotion of legged machines faces the problems of model complexity and computational costs. Algorithms based on complex models and/or reinforcement learning exist to solve the walking control task. In this project, we aim to develop a…

Robotics · Computer Science 2018-05-17 Kendeas Theofanous

Quality-Diversity (QD) algorithms can discover large and complex behavioural repertoires consisting of both diverse and high-performing skills. However, the generation of behavioural repertoires has mainly been limited to simulation…

Machine Learning · Computer Science 2022-07-12 Bryan Lim , Alexander Reichenbach , Antoine Cully

Although robotic applications increasingly demand versatile and dynamic object handling, most existing techniques are predominantly focused on grasp-based manipulation, limiting their applicability in non-prehensile tasks. To address this…

Robotics · Computer Science 2025-02-25 Hamidreza Raei , Elena De Momi , Arash Ajoudani

In order to solve the problem of frequent deceleration of unmanned vehicles when approaching obstacles, this article uses a Deep Q-Network (DQN) and its extension, the Double Deep Q-Network (DDQN), to develop a local navigation system that…

Robotics · Computer Science 2024-04-29 Hao Liu , Yi Shen , Wenjing Zhou , Yuelin Zou , Chang Zhou , Shuyao He

Learning adaptable policies is crucial for robots to operate autonomously in our complex and quickly changing world. In this work, we present a new meta-learning method that allows robots to quickly adapt to changes in dynamics. In contrast…

Robotics · Computer Science 2020-07-31 Xingyou Song , Yuxiang Yang , Krzysztof Choromanski , Ken Caluwaerts , Wenbo Gao , Chelsea Finn , Jie Tan

Collision-free planning is essential for bipedal robots operating within unstructured environments. This paper presents a real-time Model Predictive Control (MPC) framework that addresses both body and foot avoidance for dynamic bipedal…

Robotics · Computer Science 2025-05-21 Tianze Wang , Christian Hubicki

High-speed legged navigation in discrete and geometrically complex environments is a challenging task because of the high-degree-of-freedom dynamics and long-horizon, nonconvex nature of the optimization problem. In this work, we propose a…

Robotics · Computer Science 2025-06-04 Hyeongjun Kim , Hyunsik Oh , Jeongsoo Park , Yunho Kim , Donghoon Youm , Moonkyu Jung , Minho Lee , Jemin Hwangbo