English
Related papers

Related papers: Template Model Inspired Task Space Learning for Ro…

200 papers

This study presents an enhanced theoretical formulation for bipedal hierarchical control frameworks under uneven terrain conditions. Specifically, owing to the inherent limitations of the Linear Inverted Pendulum Model (LIPM) in handling…

Robotics · Computer Science 2025-04-04 Yapeng Shi , Sishu Li , Yongqiang Wu , Junjie Liu , Xiaokun Leng , Xizhe Zang , Songhao Piao

An important function of autonomous microrobots is the ability to perform robust movement over terrain. This paper explores an edge ML approach to microrobot locomotion, allowing for on-device, lower latency control under compute, memory,…

Robotics · Computer Science 2026-01-01 Yichen Liu , Kesava Viswanadha , Zhongyu Li , Nelson Lojo , Kristofer S. J. Pister

Hybrid locomotion of wheeled-legged robots has recently attracted increasing attention due to their advantages of combining the agility of legged locomotion and the efficiency of wheeled motion. But along with expanded performance, the…

Robotics · Computer Science 2025-10-14 Jingyuan Sun , Hongyu Ji , Zihan Qu , Chaoran Wang , Mingyu Zhang

In this paper, we propose a model-free reinforcement learning method to synthesize control policies for motion planning problems with continuous states and actions. The robot is modelled as a labeled discrete-time Markov decision process…

Artificial Intelligence · Computer Science 2020-10-01 Chuanzheng Wang , Yinan Li , Stephen L. Smith , Jun Liu

Contact-based decision and planning methods are becoming increasingly important to endow higher levels of autonomy for legged robots. Formal synthesis methods derived from symbolic systems have great potential for reasoning about high-level…

Robotics · Computer Science 2022-01-04 Ye Zhao , Yinan Li , Luis Sentis , Ufuk Topcu , Jun Liu

Traversing narrow paths is challenging for humanoid robots due to the sparse and safety-critical footholds required. Purely template-based or end-to-end reinforcement learning-based methods suffer from such harsh terrains. This paper…

Robotics · Computer Science 2025-09-23 TianChen Huang , Runchen Xu , Yu Wang , Wei Gao , Shiwu Zhang

Generating dynamic motions for legged robots remains a challenging problem. While reinforcement learning has achieved notable success in various legged locomotion tasks, producing highly dynamic behaviors often requires extensive reward…

Robotics · Computer Science 2026-01-01 Dongyun Kang , Min-Gyu Kim , Tae-Gyu Song , Hajun Kim , Sehoon Ha , Hae-Won Park

Complex high-dimensional spaces with high Degree-of-Freedom and complicated action spaces, such as humanoid robots equipped with dexterous hands, pose significant challenges for reinforcement learning (RL) algorithms, which need to wisely…

Robotics · Computer Science 2025-02-25 Zifeng Zhuang , Diyuan Shi , Runze Suo , Xiao He , Hongyin Zhang , Ting Wang , Shangke Lyu , Donglin Wang

Realizing bipedal locomotion on humanoid robots with point feet is especially challenging due to their highly underactuated nature, high degrees of freedom, and hybrid dynamics resulting from impacts. With the goal of addressing this…

Robotics · Computer Science 2024-06-21 Adrian B. Ghansah , Jeeseop Kim , Kejun Li , Aaron D. Ames

Despite major advancements in control design that are robust to unplanned disturbances, bipedal robots are still susceptible to falling over and struggle to negotiate rough terrains. By utilizing thrusters in our bipedal robot, we can…

Reinforcement learning (RL) often necessitates a meticulous Markov Decision Process (MDP) design tailored to each task. This work aims to address this challenge by proposing a systematic approach to behavior synthesis and control for…

Robotics · Computer Science 2024-10-18 Jean-Pierre Sleiman , Mayank Mittal , Marco Hutter

In recent years, research on humanoid robots has garnered significant attention, particularly in reinforcement learning based control algorithms, which have achieved major breakthroughs. Compared to traditional model-based control…

Robotics · Computer Science 2025-03-12 Qiang Zhang , Gang Han , Jingkai Sun , Wen Zhao , Jiahang Cao , Jiaxu Wang , Hao Cheng , Lingfeng Zhang , Yijie Guo , Renjing Xu

Bipedal robots are gaining global recognition due to their potential applications and advancements in artificial intelligence, particularly through Deep Reinforcement Learning (DRL). While DRL has significantly advanced bipedal locomotion,…

Robotics · Computer Science 2026-01-09 Lingfan Bao , Joseph Humphreys , Tianhu Peng , Chengxu Zhou

The remarkable athletic intelligence displayed by humans in complex dynamic movements such as dancing and gymnastics suggests that the balance mechanism in biological beings is decoupled from specific movement patterns. This decoupling…

Robotics · Computer Science 2024-04-15 Jiayi Li , Linqi Ye , Yi Cheng , Houde Liu , Bin Liang

This paper presents a framework that leverages both control theory and machine learning to obtain stable and robust bipedal locomotion without the need for manual parameter tuning. Traditionally, gaits are generated through trajectory…

Robotics · Computer Science 2021-03-31 Maegan Tucker , Noel Csomay-Shanklin , Wen-Loong Ma , Aaron D. Ames

Reinforcement learning (RL) is effective in many robotic applications, but it requires extensive exploration of the state-action space, during which behaviors can be unsafe. This significantly limits its applicability to large robots with…

Robotics · Computer Science 2026-01-05 Mehdi Heydari Shahna , Pauli Mustalahti , Jouni Mattila

Quadrupedal robots are increasingly deployed for load-carrying tasks across diverse terrains. While Model Predictive Control (MPC)-based methods can account for payload variations, they often depend on predefined gait schedules or…

Robotics · Computer Science 2025-05-02 Vamshi Kumar Kurva , Shishir Kolathaya

Industrial robots are widely used in diverse manufacturing environments. Nonetheless, how to enable robots to automatically plan trajectories for changing tasks presents a considerable challenge. Further complexities arise when robots…

Robotics · Computer Science 2025-02-27 Siddharth Singh , Tian Yu , Qing Chang , John Karigiannis , Shaopeng Liu

In this paper, we present a novel control framework to achieve robust push recovery on bipedal robots while locomoting. The key contribution is the unification of hybrid system models of locomotion with a reduced-order model predictive…

Robotics · Computer Science 2025-04-29 Min Dai , Aaron D. Ames

We present a new walking foot-placement controller based on 3LP, a 3D model of bipedal walking that is composed of three pendulums to simulate falling, swing and torso dynamics. Taking advantage of linear equations and closed-form solutions…

Robotics · Computer Science 2018-11-12 Salman Faraji , Philippe Muellhaupt , Auke J. Ijspeert