English
Related papers

Related papers: Hierarchical Reinforcement Learning Framework for …

200 papers

Safe and real-time navigation is fundamental for humanoid robot applications. However, existing bipedal robot navigation frameworks often struggle to balance computational efficiency with the precision required for stable locomotion. We…

Robotics · Computer Science 2025-06-04 Chengyang Peng , Zhihao Zhang , Shiting Gong , Sankalp Agrawal , Keith A. Redmill , Ayonga Hereid

The design of feedback controllers for bipedal robots is challenging due to the hybrid nature of its dynamics and the complexity imposed by high-dimensional bipedal models. In this paper, we present a novel approach for the design of…

Robotics · Computer Science 2018-10-05 Guillermo A. Castillo , Bowen Weng , Ayonga Hereid , Wei Zhang

Off-road navigation on vertically challenging terrain, involving steep slopes and rugged boulders, presents significant challenges for wheeled robots both at the planning level to achieve smooth collision-free trajectories and at the…

Robotics · Computer Science 2024-10-29 Tong Xu , Chenhui Pan , Xuesu Xiao

Dexterous manipulation tasks usually have multiple objectives, and the priorities of these objectives may vary at different phases of a manipulation task. Varying priority makes a robot hardly or even failed to learn an optimal policy with…

Robotics · Computer Science 2023-09-15 Lingfeng Tao , Jiucai Zhang , Xiaoli Zhang

With the increasing presence of robots in our every-day environments, improving their social skills is of utmost importance. Nonetheless, social robotics still faces many challenges. One bottleneck is that robotic behaviors need to be often…

Robotics · Computer Science 2023-08-08 Anand Ballou , Xavier Alameda-Pineda , Chris Reinke

This paper presents a control framework that combines model-based optimal control and reinforcement learning (RL) to achieve versatile and robust legged locomotion. Our approach enhances the RL training process by incorporating on-demand…

Robotics · Computer Science 2024-10-01 Dongho Kang , Jin Cheng , Miguel Zamora , Fatemeh Zargarbashi , Stelian Coros

Deep reinforcement learning (DRL) has been proven to be a powerful paradigm for learning complex control policy autonomously. Numerous recent applications of DRL in robotic grasping have successfully trained DRL robotic agents end-to-end,…

Robotics · Computer Science 2020-07-03 Zhixin Chen , Mengxiang Lin , Zhixin Jia , Shibo Jian

This paper presents a novel model-free reinforcement learning (RL) framework to design feedback control policies for 3D bipedal walking. Existing RL algorithms are often trained in an end-to-end manner or rely on prior knowledge of some…

Robotics · Computer Science 2019-10-07 Guillermo A. Castillo , Bowen Weng , Wei Zhang , Ayonga Hereid

We provide a framework for accelerating reinforcement learning (RL) algorithms by heuristics constructed from domain knowledge or offline data. Tabula rasa RL algorithms require environment interactions or computation that scales with the…

Machine Learning · Computer Science 2021-11-23 Ching-An Cheng , Andrey Kolobov , Adith Swaminathan

Apart from discriminative models for classification and object detection tasks, the application of deep convolutional neural networks to basic research utilizing natural imaging data has been somewhat limited; particularly in cases where a…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 R. Ian Etheredge , Manfred Schartl , Alex Jordan

Understanding pedestrian behavior is crucial for the safe deployment of Autonomous Vehicles (AVs) in urban environments. Traditional pedestrian behavior models often fall into two categories: mechanistic models, which do not generalize well…

Human-Computer Interaction · Computer Science 2024-09-24 Yueyang Wang , Aravinda Ramakrishnan Srinivasan , Yee Mun Lee , Gustav Markkula

Accurate lower-limb joint kinematic estimation is critical for applications such as patient monitoring, rehabilitation, and exoskeleton control. While previous studies have employed wearable sensor-based deep learning (DL) models for…

Robotics · Computer Science 2024-11-26 Changseob Song , Bogdan Ivanyuk-Skulskyi , Adrian Krieger , Kaitao Luo , Inseung Kang

Goal-conditioned Hierarchical Reinforcement Learning (HRL) is a promising approach for scaling up reinforcement learning (RL) techniques. However, it often suffers from training inefficiency as the action space of the high-level, i.e., the…

Machine Learning · Computer Science 2022-08-23 Tianren Zhang , Shangqi Guo , Tian Tan , Xiaolin Hu , Feng Chen

Model predictive control (MPC) has demonstrated effectiveness for humanoid bipedal locomotion; however, its applicability in challenging environments, such as rough and slippery terrain, is limited by the difficulty of modeling terrain…

Robotics · Computer Science 2025-09-24 Junnosuke Kamohara , Feiyang Wu , Chinmayee Wamorkar , Seth Hutchinson , Ye Zhao

Humanoid robots have demonstrated robust locomotion capabilities using Reinforcement Learning (RL)-based approaches. Further, to obtain human-like behaviors, existing methods integrate human motion-tracking or motion prior in the RL…

Robotics · Computer Science 2025-06-13 Dewei Wang , Xinmiao Wang , Xinzhe Liu , Jiyuan Shi , Yingnan Zhao , Chenjia Bai , Xuelong Li

Academic research in the field of autonomous vehicles has reached high popularity in recent years related to several topics as sensor technologies, V2X communications, safety, security, decision making, control, and even legal and…

Machine Learning · Computer Science 2020-01-31 Szilárd Aradi

Ultra-reliable low latency communications (URLLC) service is envisioned to enable use cases with strict reliability and latency requirements in 5G. One approach for enabling URLLC services is to leverage Reinforcement Learning (RL) to…

Systems and Control · Electrical Eng. & Systems 2023-07-26 Wei Shi , Milad Ganjalizadeh , Hossein Shokri Ghadikolaei , Marina Petrova

As an emerging technology, Connected Autonomous Vehicles (CAVs) are believed to have the ability to move through intersections in a faster and safer manner, through effective Vehicle-to-Everything (V2X) communication and global observation.…

Multiagent Systems · Computer Science 2022-07-26 Guanzhou Li , Jianping Wu , Yujing He

Reinforcement learning (RL) for bipedal locomotion has recently demonstrated robust gaits over moderate terrains using only proprioceptive sensing. However, such blind controllers will fail in environments where robots must anticipate and…

Robotics · Computer Science 2024-07-10 Helei Duan , Bikram Pandit , Mohitvishnu S. Gadde , Bart van Marum , Jeremy Dao , Chanho Kim , Alan Fern

Hierarchical reinforcement learning (HRL) has recently shown promising advances on speeding up learning, improving the exploration, and discovering intertask transferable skills. Most recent works focus on HRL with two levels, i.e., a…

Machine Learning · Computer Science 2018-11-14 Yuhang Song , Jianyi Wang , Thomas Lukasiewicz , Zhenghua Xu , Mai Xu