English
Related papers

Related papers: Deep Reinforcement Learning-based Quadcopter Contr…

200 papers

The dominant way to control a robot manipulator uses hand-crafted differential equations leveraging some form of inverse kinematics / dynamics. We propose a simple, versatile joint-level controller that dispenses with differential equations…

Robotics · Computer Science 2021-08-23 Visak Kumar , David Hoeller , Balakumar Sundaralingam , Jonathan Tremblay , Stan Birchfield

Deep reinforcement learning (RL) is an optimization-driven framework for producing control strategies for general dynamical systems without explicit reliance on process models. Good results have been reported in simulation. Here we…

Systems and Control · Electrical Eng. & Systems 2022-01-14 Nathan P. Lawrence , Michael G. Forbes , Philip D. Loewen , Daniel G. McClement , Johan U. Backstrom , R. Bhushan Gopaluni

A quadcopter is an under-actuated system with only four control inputs for six degrees of freedom, and yet the human control of a quadcopter is simple enough to be learned with some practice. In this work, we consider the problem of human…

Robotics · Computer Science 2020-04-07 Pratik Prajapati , Sagar Parekh , Vineet Vashista

Targets search and detection encompasses a variety of decision problems such as coverage, surveillance, search, observing and pursuit-evasion along with others. In this paper we develop a multi-agent deep reinforcement learning (MADRL)…

Robotics · Computer Science 2021-03-18 Roi Yehoshua , Juan Heredia-Juesas , Yushu Wu , Christopher Amato , Jose Martinez-Lorenzo

Attitude control of fixed-wing unmanned aerial vehicles (UAVs) is a difficult control problem in part due to uncertain nonlinear dynamics, actuator constraints, and coupled longitudinal and lateral motions. Current state-of-the-art…

Systems and Control · Electrical Eng. & Systems 2023-04-20 Eivind Bøhn , Erlend M. Coates , Dirk Reinhardt , Tor Arne Johansen

Inverted landing is a routine behavior among a number of animal fliers. However, mastering this feat poses a considerable challenge for robotic fliers, especially to perform dynamic perching with rapid body rotations (or flips) and landing…

Robotics · Computer Science 2024-03-04 Bryan Habas , Bo Cheng

Designing effective low-level robot controllers often entail platform-specific implementations that require manual heuristic parameter tuning, significant system knowledge, or long design times. With the rising number of robotic and…

Accurate diagnosis of propeller faults is crucial for ensuring the safe and efficient operation of quadrotors. Training a fault classifier using simulated data and deploying it on a real quadrotor is a cost-effective and safe approach.…

Robotics · Computer Science 2023-02-10 Wei Zhang , Junjie Tong , Fang Liao , Yunfeng Zhang

Reinforcement learning control of an underground loader is investigated in simulated environment, using a multi-agent deep neural network approach. At the start of each loading cycle, one agent selects the dig position from a depth camera…

Robotics · Computer Science 2021-09-22 Sofi Backman , Daniel Lindmark , Kenneth Bodin , Martin Servin , Joakim Mörk , Håkan Löfgren

Flying quadrotors in tight formations is a challenging problem. It is known that in the near-field airflow of a quadrotor, the aerodynamic effects induced by the propellers are complex and difficult to characterize. Although machine…

Robotics · Computer Science 2024-10-15 Kong Yao Chee , Pei-An Hsieh , George J. Pappas , M. Ani Hsieh

This paper presents an online reinforcement-learning framework for safe gain scheduling of a nonlinear quadcopter controller. Rather than learning thrust and torque commands directly, the proposed method selects gain vectors online from a…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Muhammad Junayed Hasan Zahed , Chieh Tsai , Salim Hariri , Hossein Rastgoftar

Future Mars missions will require advanced guidance, navigation, and control algorithms for the powered descent phase to target specific surface locations and achieve pinpoint accuracy (landing error ellipse $<$ 5 m radius). The latter…

Systems and Control · Computer Science 2018-10-23 Brian Gaudet , Richard Linares , Roberto Furfaro

In the evolving landscape of high-speed agile quadrotor flight, achieving precise trajectory tracking at the platform's operational limits is paramount. Controllers must handle actuator constraints, exhibit robustness to disturbances, and…

Robotics · Computer Science 2025-10-15 Lukas Pries , Markus Ryll

Contemporary autopilot systems for unmanned aerial vehicles (UAVs) are far more limited in their flight envelope as compared to experienced human pilots, thereby restricting the conditions UAVs can operate in and the types of missions they…

Robotics · Computer Science 2019-11-14 Eivind Bøhn , Erlend M. Coates , Signe Moe , Tor Arne Johansen

In robotics, contemporary strategies are learning-based, characterized by a complex black-box nature and a lack of interpretability, which may pose challenges in ensuring stability and safety. To address these issues, we propose integrating…

Robotics · Computer Science 2024-08-23 Mehdi Heydari Shahna , Seyed Adel Alizadeh Kolagar , Jouni Mattila

The superiority of Multi-Robot Systems (MRS) in various complex environments is unquestionable. However, in complex situations such as search and rescue, environmental monitoring, and automated production, robots are often required to work…

Robotics · Computer Science 2024-08-22 Bin Wu , C Steve Suh

This paper summarizes in depth the state of the art of aerial swarms, covering both classical and new reinforcement-learning-based approaches for their management. Then, it proposes a hybrid AI system, integrating deep reinforcement…

Artificial Intelligence · Computer Science 2025-01-16 Raúl Arranz , David Carramiñana , Gonzalo de Miguel , Juan A. Besada , Ana M. Bernardos

This paper explores the impact of dynamic entropy tuning in Reinforcement Learning (RL) algorithms that train a stochastic policy. Its performance is compared against algorithms that train a deterministic one. Stochastic policies optimize a…

Robotics · Computer Science 2025-12-23 Youssef Mahran , Zeyad Gamal , Ayman El-Badawy

The growing potential of quadcopters in various domains, such as aerial photography, search and rescue, and infrastructure inspection, underscores the need for real-time control under strict safety and operational constraints. This…

Robotics · Computer Science 2025-05-01 Mohsen Amiri , Mehdi Hosseinzadeh

Humans are remarkably data-efficient when adapting to new unseen conditions, like driving a new car. In contrast, modern robotic control systems, like neural network policies trained using Reinforcement Learning (RL), are highly specialized…

Robotics · Computer Science 2026-04-07 Jonas Eschmann , Dario Albani , Giuseppe Loianno