English
Related papers

Related papers: Hovering Flight of Soft-Actuated Insect-Scale Micr…

200 papers

Complex high-dimensional spaces with high Degree-of-Freedom and complicated action spaces, such as humanoid robots equipped with dexterous hands, pose significant challenges for reinforcement learning (RL) algorithms, which need to wisely…

Robotics · Computer Science 2025-02-25 Zifeng Zhuang , Diyuan Shi , Runze Suo , Xiao He , Hongyin Zhang , Ting Wang , Shangke Lyu , Donglin Wang

Recently, safe reinforcement learning (RL) with the actor-critic structure for continuous control tasks has received increasing attention. It is still challenging to learn a near-optimal control policy with safety and convergence…

Machine Learning · Computer Science 2024-02-06 Xinglong Zhang , Yaoqian Peng , Biao Luo , Wei Pan , Xin Xu , Haibin Xie

The rapid growth of the low-altitude economy has driven the widespread adoption of unmanned aerial vehicles (UAVs). This growing deployment presents new challenges for UAV trajectory planning in complex urban environments. However, existing…

Artificial Intelligence · Computer Science 2025-11-27 Yanwei Gong , Junchao Fan , Ruichen Zhang , Dusit Niyato , Yingying Yao , Xiaolin Chang

Designing robust controllers for precise trajectory tracking with quadrotors is challenging due to nonlinear dynamics and underactuation, and becomes harder with flexible cable-suspended payloads that add degrees of freedom and hybrid…

Robotics · Computer Science 2025-10-02 Mintae Kim , Jiaze Cai , Koushil Sreenath

Reinforcement learning (RL) for motion planning of multi-degree-of-freedom robots still suffers from low efficiency in terms of slow training speed and poor generalizability. In this paper, we propose a novel RL-based robot motion planning…

Robotics · Computer Science 2024-08-20 Zengjie Zhang , Jayden Hong , Amir Soufi Enayati , Homayoun Najjaran

This paper presents a novel deep reinforcement learning-based system for 3D mapless navigation for Unmanned Aerial Vehicles (UAVs). Instead of using a image-based sensing approach, we propose a simple learning system that uses only a few…

Robotic systems are increasingly employed for industrial automation, with contact-rich tasks like polishing requiring dexterity and compliant behaviour. These tasks are difficult to model, making classical control challenging. Deep…

Robotics · Computer Science 2025-06-03 Emma Cramer , Lukas Jäschke , Sebastian Trimpe

The paper presents a technique using reinforcement learning (RL) to adapt the control gains of a quadcopter controller. Specifically, we employed Proximal Policy Optimization (PPO) to train a policy which adapts the gains of a cascaded…

Systems and Control · Electrical Eng. & Systems 2024-03-13 Mike Timmerman , Aryan Patel , Tim Reinhart

Visual navigation is essential for many applications in robotics, from manipulation, through mobile robotics to automated driving. Deep reinforcement learning (DRL) provides an elegant map-free approach integrating image processing,…

Robotics · Computer Science 2020-10-22 Jonáš Kulhánek , Erik Derner , Robert Babuška

The advent of deep learning (DL) gave rise to significant breakthroughs in Reinforcement Learning (RL) research. Deep Reinforcement Learning (DRL) algorithms have reached super-human level skills when applied to vision-based control…

Robotics · Computer Science 2022-10-17 Muhammed Murat Özbek , Süleyman Yıldırım , Muhammet Aksoy , Eric Kernin , Emre Koyuncu

Despite the considerable potential of reinforcement learning (RL), robotic control tasks predominantly rely on imitation learning (IL) due to its better sample efficiency. However, it is costly to collect comprehensive expert demonstrations…

Machine Learning · Computer Science 2024-05-22 Hengyuan Hu , Suvir Mirchandani , Dorsa Sadigh

This paper presents the first decentralized method to enable real-world 6-DoF manipulation of a cable-suspended load using a team of Micro-Aerial Vehicles (MAVs). Our method leverages multi-agent reinforcement learning (MARL) to train an…

Robotics · Computer Science 2025-11-06 Jack Zeng , Andreu Matoses Gimenez , Eugene Vinitsky , Javier Alonso-Mora , Sihao Sun

Motion planning and control are crucial components of robotics applications like automated driving. Here, spatio-temporal hard constraints like system dynamics and safety boundaries (e.g., obstacles) restrict the robot's motions. Direct…

Robotics · Computer Science 2023-08-29 Christopher Diehl , Janis Adamek , Martin Krüger , Frank Hoffmann , Torsten Bertram

Flying through body-size narrow gaps in the environment is one of the most challenging moments for an underactuated multirotor. We explore a purely data-driven method to master this flight skill in simulation, where a neural network…

Robotics · Computer Science 2024-09-04 Tianyue Wu , Yeke Chen , Tianyang Chen , Guangyu Zhao , Fei Gao

In recent years, unmanned aerial vehicles (UAVs) have been considered for telecommunications purposes as relays, caches, or IoT data collectors. In addition to being easy to deploy, their maneuverability allows them to adjust their location…

Signal Processing · Electrical Eng. & Systems 2019-07-16 Enes Krijestorac , Samer Hanna , Danijela Cabric

Deep Reinforcement Learning (RL) has emerged as a powerful method for addressing complex control problems, particularly those involving underactuated robotic systems. However, in some cases, policies may require refinement to achieve…

Robotics · Computer Science 2025-07-15 Marco Calì , Alberto Sinigaglia , Niccolò Turcato , Ruggero Carli , Gian Antonio Susto

The ability to recover from a fall is an essential feature for a legged robot to navigate in challenging environments robustly. Until today, there has been very little progress on this topic. Current solutions mostly build upon…

Robotics · Computer Science 2024-12-20 Joonho Lee , Jemin Hwangbo , Marco Hutter

Our goal in this work is to expand the theory and practice of robot locomotion by addressing critical challenges associated with the robotic biomimicry of bat aerial locomotion. Bats are known for their pronounced, fast wing articulations,…

Robotics · Computer Science 2021-04-01 Eric Sihite , Atefe Darabi , Pravin Dangol , Andrew Lessieur , Alireza Ramezani

Aerial robots interacting with objects must perform precise, contact-rich maneuvers under uncertainty. In this paper, we study the problem of aerial ball juggling using a quadrotor equipped with a racket, a task that demands accurate…

Developing the flocking behavior for a dynamic squad of fixed-wing UAVs is still a challenge due to kinematic complexity and environmental uncertainty. In this paper, we deal with the decentralized flocking and collision avoidance problem…

Systems and Control · Electrical Eng. & Systems 2021-07-26 Chao Yan , Xiaojia Xiang , Chang Wang , Zhen Lan