English
Related papers

Related papers: Empirical evaluation of a Q-Learning Algorithm for…

200 papers

This paper presents an estimation and control algorithm for an aerial manipulator using a hexacopter with a 2-DOF robotic arm. The unknown parameters of a payload are estimated by an on-line estimator based on parametrization of the aerial…

Robotics · Computer Science 2016-01-12 Hyeonbeom Lee , Suseong Kim , H. Jin Kim

In this paper, we present a deep reinforcement learning method for quadcopter bypassing the obstacle on the flying path. In the past study, the algorithm only controls the forward direction about quadcopter. In this letter, we use two…

Artificial Intelligence · Computer Science 2018-11-13 Tung-Cheng Wu , Shau-Yin Tseng , Chin-Feng Lai , Chia-Yu Ho , Ying-Hsun Lai

Reinforcement learning is an effective way to solve the decision-making problems. It is a meaningful and valuable direction to investigate autonomous air combat maneuver decision-making method based on reinforcement learning. However, when…

Artificial Intelligence · Computer Science 2023-02-14 Yu-Jie Wei , Hong-Peng Zhang , Chang-Qiang Huang

A long-cherished vision of drones is to autonomously traverse through clutter to reach every corner of the world using onboard sensing and computation. In this paper, we combine onboard 3D lidar sensing and sim-to-real reinforcement…

Robotics · Computer Science 2025-03-04 Guangtong Xu , Tianyue Wu , Zihan Wang , Qianhao Wang , Fei Gao

Tilt-rotor aerial robots enable omnidirectional maneuvering through thrust vectoring, but introduce significant control challenges due to the strong coupling between joint and rotor dynamics. While model-based controllers can achieve high…

Robotics · Computer Science 2026-02-26 Wentao Zhang , Zhaoqi Ma , Jinjie Li , Huayi Wang , Haokun Liu , Junichiro Sugihara , Chen Chen , Yicheng Chen , Moju Zhao

Learning has propelled the cutting edge of performance in robotic control to new heights, allowing robots to operate with high performance in conditions that were previously unimaginable. The majority of the work, however, assumes that the…

Robotics · Computer Science 2018-03-13 Christopher D. McKinnon , Angela P. Schoellig

In the event of a total loss of thrust, a pilot must identify a reachable landing site and subsequently execute a forced landing. To do so, they must estimate which region on the ground can be reached safely in gliding flight. We call this…

Optimization and Control · Mathematics 2024-07-30 Giovanni Piccioli

Realtime model learning proves challenging for complex dynamical systems, such as drones flying in variable wind conditions. Machine learning technique such as deep neural networks have high representation power but is often too slow to…

Robotics · Computer Science 2022-05-26 Michael O'Connell , Guanya Shi , Xichen Shi , Soon-Jo Chung

In this study, we applied reinforcement learning based on the proximal policy optimization algorithm to perform motion planning for an unmanned aerial vehicle (UAV) in an open space with static obstacles. The application of reinforcement…

Robotics · Computer Science 2020-12-17 Sanghyun Kim , Jongmin Park , Jae-Kwan Yun , Jiwon Seo

Reinforcement learning is of increasing importance in the field of robot control and simulation plays a~key role in this process. In the unmanned aerial vehicles (UAVs, drones), there is also an increase in the number of published…

Robotics · Computer Science 2023-07-27 Pawel Miera , Hubert Szolc , Tomasz Kryjak

We use Reinforcement Meta-Learning to optimize an adaptive integrated guidance, navigation, and control system suitable for exoatmospheric interception of a maneuvering target. The system maps observations consisting of strapdown seeker…

Systems and Control · Electrical Eng. & Systems 2021-12-14 Brian Gaudet , Roberto Furfaro , Richard Linares , Andrea Scorsoglio

Exploring planetary bodies with lower gravity, such as the moon and Mars, allows legged robots to utilize jumping as an efficient form of locomotion thus giving them a valuable advantage over traditional rovers for exploration. Motivated by…

Robotics · Computer Science 2025-03-06 Jørgen Anker Olsen , Grzegorz Malczyk , Kostas Alexis

This paper presents a reinforcement learning-based path-following controller for a fixed-wing small uncrewed aircraft system (sUAS) that is robust to uncertainties in the aerodynamic model of the sUAS. The controller is trained using the…

Optimization and Control · Mathematics 2025-10-21 Dennis J. Marquis , Blake Wilhelm , Devaprakash Muniraj , Mazen Farhood

When applying Dynamic Power Management (DPM) technique to pervasively deployed embedded systems, the technique needs to be very efficient so that it is feasible to implement the technique on low end processor and tight-budget memory.…

Other Computer Science · Computer Science 2011-11-09 Min Li , Xiaobo Wu , Richard Yao , Xiaolang Yan

This paper explores the optimization of Ground Delay Programs (GDP), a prevalent Traffic Management Initiative used in Air Traffic Management (ATM) to reconcile capacity and demand discrepancies at airports. Employing Reinforcement Learning…

Machine Learning · Computer Science 2024-08-15 Ke Liu , Fan Hu , Hui Lin , Xi Cheng , Jianan Chen , Jilin Song , Siyuan Feng , Gaofeng Su , Chen Zhu

Reaching fast and autonomous flight requires computationally efficient and robust algorithms. To this end, we train Guidance & Control Networks to approximate optimal control policies ranging from energy-optimal to time-optimal flight. We…

Robotics · Computer Science 2023-05-05 Sebastien Origer , Christophe De Wagter , Robin Ferede , Guido C. H. E. de Croon , Dario Izzo

A novel framework is proposed for quality of experience (QoE)-driven deployment and dynamic movement of multiple unmanned aerial vehicles (UAVs). The problem of joint non-convex three-dimensional (3D) deployment and dynamic movement of the…

Signal Processing · Electrical Eng. & Systems 2019-06-12 Xiao Liu , Yuanwei Liu , Yue Chen

Modern astronomical experiments are designed to achieve multiple scientific goals, from studies of galaxy evolution to cosmic acceleration. These goals require data of many different classes of night-sky objects, each of which has a…

Instrumentation and Methods for Astrophysics · Physics 2023-12-01 Franco Terranova , M. Voetberg , Brian Nord , Amanda Pagul

This paper proposes a robust control design method using reinforcement-learning for controlling partially-unknown dynamical systems under uncertain conditions. The method extends the optimal reinforcement-learning algorithm with a new…

Systems and Control · Electrical Eng. & Systems 2020-04-17 Phuong D. Ngo , Fred Godtliebsen

Reinforcement learning suffers from limitations in real practices primarily due to the number of required interactions with virtual environments. It results in a challenging problem because we are implausible to obtain a local optimal…

Machine Learning · Computer Science 2024-10-28 Qizhen Wu , Kexin Liu , Lei Chen