English
Related papers

Related papers: Hierarchical Learning Framework for Whole-Body Mod…

200 papers

Applying Deep Reinforcement Learning (DRL) to Human-Robot Cooperation (HRC) in dynamic control problems is promising yet challenging as the robot needs to learn the dynamics of the controlled system and dynamics of the human partner. In…

Robotics · Computer Science 2023-09-15 Lingfeng Tao , Michael Bowman , Jiucai Zhang , Xiaoli Zhang

This paper presents a layered control approach for real-time trajectory planning and control of robust cooperative locomotion by two holonomically constrained quadrupedal robots. A novel interconnected network of reduced-order models, based…

Robotics · Computer Science 2022-11-15 Jeeseop Kim , Randall T Fawcett , Vinay R Kamidi , Aaron D Ames , Kaveh Akbari Hamed

In recent years, the field of legged robotics has seen growing interest in enhancing the capabilities of these robots through the integration of articulated robotic arms. However, achieving successful loco-manipulation, especially involving…

Robotics · Computer Science 2024-03-21 Alberto Rigo , Muqun Hu , Satyandra K. Gupta , Quan Nguyen

In this paper, we propose a cost-matching approach for optimal humanoid locomotion within a Model Predictive Control (MPC)-based Reinforcement Learning (RL) framework. A parameterized MPC formulation with centroidal dynamics is trained to…

Robotics · Computer Science 2026-03-31 Wenqi Cai , Kyriakos G. Vamvoudakis , Sébastien Gros , Anthony Tzes

Safety remains a central challenge in control of dynamical systems, particularly when the boundaries of unsafe sets are complex (e.g., nonconvex, nonsmooth) or unknown. This paper proposes a learning-enabled framework for safety-critical…

Systems and Control · Electrical Eng. & Systems 2025-09-16 Shuo Liu , Zhe Huang , Jun Zeng , Koushil Sreenath , Calin A. Belta

This paper presents a hierarchical framework based on deep reinforcement learning that learns a diversity of policies for humanoid balance control. Conventional zero moment point based controllers perform limited actions during…

Robotics · Computer Science 2020-05-21 Chuanyu Yang , Taku Komura , Zhibin Li

Model Predictive Control (MPC) is a common tool for the control of nonlinear, real-world systems, such as legged robots. However, solving MPC quickly enough to enable its use in real-time is often challenging. One common solution is given…

Systems and Control · Electrical Eng. & Systems 2024-09-20 Zachary Olkin , Aaron D. Ames

The embodied learning of human motor control requires whole-body neuro-actuated musculoskeletal dynamics, while the internal muscle-driven processes underlying movement remain inaccessible to direct measurement. Computational modeling…

Robotics · Computer Science 2026-04-01 Yunyue Wei , Chenhui Zuo , Shanning Zhuang , Haixin Gong , Yaming Liu , Yanan Sui

Humanoid robots are machines built with an anthropomorphic shape. Despite decades of research into the subject, it is still challenging to tackle the robot locomotion problem from an algorithmic point of view. For example, these machines…

Robotics · Computer Science 2020-04-28 Stefano Dafarra

In this paper, we explore spatial-aware humanoid whole-body manipulation task. Compared with tabletop settings, this task poses two key challenges: 1) Spatial understanding is challenging in complex 3D environments with diverse spatial…

Robotics · Computer Science 2026-05-21 Zhizhao Liang , Yi-Lin Wei , Xuhang Chen , Mu Lin , Yi-Xiang He , Zhexi Luo , Jun-Hui Liu , Kun-Yu Lin , Wei-Shi Zheng

Sequence models in reinforcement learning require task knowledge to estimate the task policy. This paper presents a hierarchical algorithm for learning a sequence model from demonstrations. The high-level mechanism guides the low-level…

Machine Learning · Computer Science 2022-09-22 André Correia , Luís A. Alexandre

Humanoid robots offer significant advantages for search and rescue tasks, thanks to their capability to traverse rough terrains and perform transportation tasks. In this study, we present a task and motion planning framework for search and…

Robotics · Computer Science 2024-09-24 Abdulaziz Shamsah , Jesse Jiang , Ziwon Yoon , Samuel Coogan , Ye Zhao

This paper proposes a novel orientation-aware model predictive control (MPC) for dynamic humanoid walking that can plan footstep locations online. Instead of a point-mass model, this work uses the augmented single rigid body model (aSRBM)…

Robotics · Computer Science 2022-07-26 Yanran Ding , Charles Khazoom , Matthew Chignoli , Sangbae Kim

A motion-based control interface promises flexible robot operations in dangerous environments by combining user intuitions with the robot's motor capabilities. However, designing a motion interface for non-humanoid robots, such as…

Robotics · Computer Science 2022-04-29 Sunwoo Kim , Maks Sorokin , Jehee Lee , Sehoon Ha

Humanoid robots hold great promise in assisting humans in diverse environments and tasks, due to their flexibility and adaptability leveraging human-like morphology. However, research in humanoid robots is often bottlenecked by the costly…

Robotics · Computer Science 2024-06-21 Carmelo Sferrazza , Dun-Ming Huang , Xingyu Lin , Youngwoon Lee , Pieter Abbeel

As robotic systems move from highly structured environments to open worlds, incorporating uncertainty from dynamics learning or state estimation into the control pipeline is essential for robust performance. In this paper we present a…

Systems and Control · Electrical Eng. & Systems 2021-09-14 Robert Dyro , James Harrison , Apoorva Sharma , Marco Pavone

Inspired by the unique neurophysiology of the octopus, we propose a hierarchical framework that simplifies the coordination of multiple soft arms by decomposing control into high-level decision making, low-level motor activation, and local…

Whole-body loco-manipulation for quadruped robots with arms remains a challenging problem, particularly in achieving multi-task control. To address this, we propose MLM, a reinforcement learning framework driven by both real-world and…

As reinforcement learning for humanoid robots evolves from single-task to multi-skill paradigms, efficiently expanding new skills while avoiding catastrophic forgetting has become a key challenge in embodied intelligence. Existing…

Robotics · Computer Science 2026-04-15 Yifei Yan , Linqi Ye

Robotic tasks which involve uncertainty--due to variation in goal, environment configuration, or confidence in task model--may require human input to instruct or adapt the robot. In tasks with physical contact, several existing methods for…

Robotics · Computer Science 2026-02-17 Kevin Haninger , Christian Hegeler , Luka Peternel