English
Related papers

Related papers: Structural Optimization of Lightweight Bipedal Rob…

200 papers

Legged robots pose one of the greatest challenges in robotics. Dynamic and agile maneuvers of animals cannot be imitated by existing methods that are crafted by humans. A compelling alternative is reinforcement learning, which requires…

Reinforcement learning (RL) has demonstrated impressive performance in legged locomotion over various challenging environments. However, due to the sim-to-real gap and lack of explainability, unconstrained RL policies deployed in the real…

Robotics · Computer Science 2025-06-06 Haoyu Wang , Ruyi Zhou , Liang Ding , Tie Liu , Zhelin Zhang , Peng Xu , Haibo Gao , Zongquan Deng

Reduced-order models (ROM) are popular in online motion planning due to their simplicity. A good ROM for control captures critical task-relevant aspects of the full dynamics while remaining low dimensional. However, planning within the…

Robotics · Computer Science 2024-04-04 Yu-Ming Chen , Jianshu Hu , Michael Posa

Online reinforcement learning (RL) methods are often data-inefficient or unreliable, making them difficult to train on real robotic hardware, especially quadruped robots. Learning robotic tasks from pre-collected data is a promising…

Robotics · Computer Science 2024-10-28 Hongyin Zhang , Shuyu Yang , Donglin Wang

Bipedal walking is one of the most difficult but exciting challenges in robotics. The difficulties arise from the complexity of high-dimensional dynamics, sensing and actuation limitations combined with real-time and computational…

Robotics · Computer Science 2021-06-02 Diego Rodriguez , Sven Behnke

Safe reinforcement learning (Safe RL) refers to a class of techniques that aim to prevent RL algorithms from violating constraints in the process of decision-making and exploration during trial and error. In this paper, a novel model-free…

Systems and Control · Electrical Eng. & Systems 2024-08-14 Homayoun Honari , Mehran Ghafarian Tamizi , Homayoun Najjaran

This work aims to push the limits of agility for bipedal robots by enabling a torque-controlled bipedal robot to perform robust and versatile dynamic jumps in the real world. We present a reinforcement learning framework for training a…

Robotics · Computer Science 2023-06-02 Zhongyu Li , Xue Bin Peng , Pieter Abbeel , Sergey Levine , Glen Berseth , Koushil Sreenath

Quadruped robots face limitations in long-range navigation efficiency due to their reliance on legs. To ameliorate the limitations, we introduce a Reinforcement Learning-based Active Transporter Riding method (\textit{RL-ATR}), inspired by…

Robotics · Computer Science 2026-02-10 Minsung Yoon , Sung-Eui Yoon

Both the design and control of a robot play equally important roles in its task performance. However, while optimal control is well studied in the machine learning and robotics community, less attention is placed on finding the optimal…

Robotics · Computer Science 2022-01-25 Jagdeep Singh Bhatia , Holly Jackson , Yunsheng Tian , Jie Xu , Wojciech Matusik

Faced with complex and unstructured construction environments, wheeled and tracked robots exhibit significant limitations in terrain adaptability and flexibility, making it difficult to meet the requirements of autonomous operation.…

Robotics · Computer Science 2025-07-23 Xiao Liu , Xianlong Yang , Weijun Wang , Wei Feng

Quadrupedal locomotion is a complex, open-ended problem vital to expanding autonomous vehicle reach. Traditional reinforcement learning approaches often fall short due to training instability and sample inefficiency. We propose a novel…

Robotics · Computer Science 2024-11-14 Martin Robert , Simon Brodeur , Francois Ferland

Evolutionary Reinforcement Learning (ERL), which integrates Evolutionary Algorithms (EAs) and Reinforcement Learning (RL) for optimization, has demonstrated remarkable performance advancements. By fusing both approaches, ERL has emerged as…

Neural and Evolutionary Computing · Computer Science 2026-05-26 Pengyi Li , Jianye Hao , Hongyao Tang , Xian Fu , Yan Zheng , Ke Tang

This study investigates formal-method-based trajectory optimization (TO) for bipedal locomotion, focusing on scenarios where the robot encounters external perturbations at unforeseen times. Our key research question centers around the…

Robotics · Computer Science 2023-10-18 Zhaoyuan Gu , Rongming Guo , William Yates , Yipu Chen , Ye Zhao

Athletic robots demand a whole-body actuation system design that utilizes motors up to the boundaries of their performance. However, creating such robots poses challenges of integrating design principles and reasoning of practical design…

Robotics · Computer Science 2023-07-24 Youngwoo Sim , Guillermo Colin , Joao Ramos

Bipedal robots are gaining global recognition due to their potential applications and advancements in artificial intelligence, particularly through Deep Reinforcement Learning (DRL). While DRL has significantly advanced bipedal locomotion,…

Robotics · Computer Science 2026-01-09 Lingfan Bao , Joseph Humphreys , Tianhu Peng , Chengxu Zhou

While the animals' Fin-to-Limb evolution has been well-researched in biology, such morphological transformation remains under-adopted in the modern design of advanced robotic limbs. This paper investigates a novel class of overconstrained…

Model-based approaches for planning and control for bipedal locomotion have a long history of success. It can provide stability and safety guarantees while being effective in accomplishing many locomotion tasks. Model-free reinforcement…

Robotics · Computer Science 2023-10-17 Yu-Ming Chen , Hien Bui , Michael Posa

Sim-to-real reinforcement learning (RL) for humanoid robots with high-gear ratio actuators remains challenging due to complex actuator dynamics and the absence of torque sensors. To address this, we propose a novel RL framework leveraging…

Robotics · Computer Science 2025-04-14 Sotaro Katayama , Yuta Koda , Norio Nagatsuka , Masaya Kinoshita

Cyber-physical systems (CPS) require the joint optimization of discrete cyber actions and continuous physical parameters under stringent safety logic constraints. However, existing hierarchical approaches often compromise global optimality,…

Machine Learning · Computer Science 2025-11-04 Guangxi Wan , Peng Zeng , Xiaoting Dong , Chunhe Song , Shijie Cui , Dong Li , Qingwei Dong , Yiyang Liu , Hongfei Bai

Machine learning algorithms have found several applications in the field of robotics and control systems. The control systems community has started to show interest towards several machine learning algorithms from the sub-domains such as…

Robotics · Computer Science 2018-07-18 Arun Kumar , Navneet Paul , S N Omkar