English
Related papers

Related papers: Development of a PPO-Reinforcement Learned Walking…

200 papers

Bipedal locomotion makes humanoid robots inherently prone to falls, causing catastrophic damage to the expensive sensors, actuators, and structural components of full-scale robots. To address this critical barrier to real-world deployment,…

Robotics · Computer Science 2025-11-25 Ziyu Meng , Tengyu Liu , Le Ma , Yingying Wu , Ran Song , Wei Zhang , Siyuan Huang

Safety is a crucial property of every robotic platform: any control policy should always comply with actuator limits and avoid collisions with the environment and humans. In reinforcement learning, safety is even more fundamental for…

Robotics · Computer Science 2023-03-02 Puze Liu , Kuo Zhang , Davide Tateo , Snehal Jauhri , Zhiyuan Hu , Jan Peters , Georgia Chalvatzaki

Quadruped robots are proliferating in industrial environments where they carry sensor payloads and serve as autonomous inspection platforms. Despite the advantages of legged robots over their wheeled counterparts on rough and uneven…

Robotics · Computer Science 2025-07-23 Dylan Vogel , Robert Baines , Joseph Church , Julian Lotzer , Karl Werner , Marco Hutter

Biped robots usually adopt feet with a rigid structure that simplifies walking on flat grounds and yet hinders ground adaptation in unstructured environments, thus jeopardizing stability. We recently explored in the SoftFoot the idea of…

Robotics · Computer Science 2026-04-28 Anna Pace , Giorgio Grioli , Alice Ghezzi , Antonio Bicchi , Manuel G. Catalano

While soft robot manipulators offer compelling advantages over rigid counterparts, including inherent compliance, safe human-robot interaction, and the ability to conform to complex geometries, accurate forward modeling from low-dimensional…

Robotics · Computer Science 2026-03-23 Ziyong Ma , Uksang Yoo , Jonathan Francis , Weiming Zhi , Jeffrey Ichnowski , Jean Oh

Proximal Policy Optimization (PPO) is widely used in reinforcement learning due to its strong empirical performance, yet it lacks formal guarantees for policy improvement and convergence. PPO's clipped surrogate objective is motivated by a…

Machine Learning · Computer Science 2026-02-02 Razvan-Andrei Lascu , David Šiška , Łukasz Szpruch

Recently, as the demand for cleaning robots has steadily increased, therefore household electricity consumption is also increasing. To solve this electricity consumption issue, the problem of efficient path planning for cleaning robot has…

Robotics · Computer Science 2022-08-18 Woohyeon Moon , Bumgeun Park , Sarvar Hussain Nengroo , Taeyoung Kim , Dongsoo Har

Reinforcement learning (RL) is a general and well-known method that a robot can use to learn an optimal control policy to solve a particular task. We would like to build a versatile robot that can learn multiple tasks, but using RL for each…

Artificial Intelligence · Computer Science 2015-12-01 Lisa Lee

In this paper, a hierarchical and robust framework for learning bipedal locomotion is presented and successfully implemented on the 3D biped robot Digit built by Agility Robotics. We propose a cascade-structure controller that combines the…

Robotics · Computer Science 2021-03-30 Guillermo A. Castillo , Bowen Weng , Wei Zhang , Ayonga Hereid

Socially aware robot navigation, where a robot is required to optimize its trajectory to maintain comfortable and compliant spatial interactions with humans in addition to reaching its goal without collisions, is a fundamental yet…

Robotics · Computer Science 2022-08-02 Ruiqi Wang , Weizheng Wang , Byung-Cheol Min

Robotic manipulators are widely used in various industries for complex and repetitive tasks. However, they remain vulnerable to unexpected hardware failures. In this study, we address the challenge of enabling a robotic manipulator to…

Robotics · Computer Science 2024-09-24 Tan-Hanh Pham , Godwyll Aikins , Tri Truong , Kim-Doang Nguyen

Utilizing orthoses and exoskeleton technology in various applications and medical industries, particularly to help elderly and ordinary people in their daily activities is a new growing field for research institutes. In this paper, after…

Robotics · Computer Science 2021-08-12 S. Ali A. Moosavian , Mahdi Nabipour , Farshid Absalan , Vahid Akbari

Humans excel at robust bipedal walking in complex natural environments. In each step, they adequately tune the interaction of biomechanical muscle dynamics and neuronal signals to be robust against uncertainties in ground conditions.…

While significant research progress has been made in robot learning for control, unique challenges arise when simultaneously co-optimizing morphology. Existing work has typically been tailored for particular environments or representations.…

During learning trials, systems are exposed to different failure conditions which may break robotic parts before a safe behavior is discovered. Humans contour this problem by grounding their learning to a safer structure/control first and…

Robotics · Computer Science 2021-04-06 Keyan Zhai , Chu'an Li , Andre Rosendo

This paper introduces a novel approach for modeling the dynamics of soft robots, utilizing a differentiable filter architecture. The proposed approach enables end-to-end training to learn system dynamics, noise characteristics, and temporal…

Robotics · Computer Science 2023-08-22 Xiao Liu , Shuhei Ikemoto , Yuhei Yoshimitsu , Heni Ben Amor

Outdoor navigation on sidewalks in urban environments is the key technology behind important human assistive applications, such as last-mile delivery or neighborhood patrol. This paper aims to develop a quadruped robot that follows a route…

Robotics · Computer Science 2021-09-14 Maks Sorokin , Jie Tan , C. Karen Liu , Sehoon Ha

In pursuit of the time-optimal path tracking (TOPT) trajectory of a robot manipulator along a preset path, a beforehand identified robot dynamic model is usually used to obtain the required optimal trajectory for perfect tracking. However,…

Robotics · Computer Science 2019-08-06 Jiadong Xiao , Lin Li , Tie Zhang , Yanbiao Zou

Passive deformation due to compliance is a commonly used benefit of soft robots, providing opportunities to achieve robust actuation with few active degrees of freedom. Soft growing robots in particular have shown promise in navigation of…

Robotics · Computer Science 2026-04-21 Francesco Fuentes , Serigne Diagne , Zachary Kingston , Laura H. Blumenschein

Finding a path free from obstacles that poses minimal risk is critical for safe navigation. People who are sighted and people who are visually impaired require navigation safety while walking on a sidewalk. In this research we developed an…

Computer Vision and Pattern Recognition · Computer Science 2020-09-29 Faruk Ahmed , Md Sultan Mahmud , Kazi Ashraf Moinuddin , Mohammed Istiaque Hyder , Mohammed Yeasin
‹ Prev 1 3 4 5 6 7 10 Next ›