English
Related papers

Related papers: Empirical evaluation of a Q-Learning Algorithm for…

200 papers

Unmanned Aerial Vehicles (UAVs) have been emerging as an effective solution for IoT data collection networks thanks to their outstanding flexibility, mobility, and low operation costs. However, due to the limited energy and uncertainty from…

Networking and Internet Architecture · Computer Science 2021-06-22 Nam H. Chu , Dinh Thai Hoang , Diep N. Nguyen , Nguyen Van Huynh , Eryk Dutkiewicz

Q-learning is a promising method for solving optimal control problems for uncertain systems without the explicit need for system identification. However, approaches for continuous-time Q-learning have limited provable safety guarantees,…

Systems and Control · Electrical Eng. & Systems 2024-01-30 Soutrik Bandyopadhyay , Shubhendu Bhasin

As the demands of autonomous mobile robots are increasing in recent years, the requirement of the path planning/navigation algorithm should not be content with the ability to reach the target without any collisions, but also should try to…

Robotics · Computer Science 2021-10-05 Jian Zhang

Applying reinforcement learning to robotic systems poses a number of challenging problems. A key requirement is the ability to handle continuous state and action spaces while remaining within a limited time and resource budget.…

Machine Learning · Computer Science 2020-06-29 Benjamin van Niekerk , Andreas Damianou , Benjamin Rosman

Visual exploration and smart data collection via autonomous vehicles is an attractive topic in various disciplines. Disturbances like wind significantly influence both the power consumption of the flying robots and the performance of the…

Signal Processing · Electrical Eng. & Systems 2021-01-27 Amir Niaraki , Jeremy Roghair , Ali Jannesari

Reinforcement learning (RL) is a class of artificial intelligence algorithms being used to design adaptive optimal controllers through online learning. This paper presents a model-free, real-time, data-efficient Q-learning-based algorithm…

Systems and Control · Electrical Eng. & Systems 2023-10-11 Ali Aalipour , Alireza Khani

This work contributes a novel deep navigation policy that enables collision-free flight of aerial robots based on a modular approach exploiting deep collision encoding and reinforcement learning. The proposed solution builds upon a deep…

Robotics · Computer Science 2024-02-07 Mihir Kulkarni , Kostas Alexis

We present an online model-based reinforcement learning algorithm suitable for controlling complex robotic systems directly in the real world. Unlike prevailing sim-to-real pipelines that rely on extensive offline simulation and model-free…

Robotics · Computer Science 2026-05-07 Fang Nan , Hao Ma , Qinghua Guan , Josie Hughes , Michael Muehlebach , Marco Hutter

In this paper, we present an online planning-scheduling approach for battery-powered autonomous aerial robots. The approach consists of simultaneously planning a coverage path and scheduling onboard computational tasks. We further derive a…

Robotics · Computer Science 2022-12-29 Adam Seewald , Héctor García de Marina , Henrik Skov Midtiby , Ulrik Pagh Schultz

Reinforcement learning (RL) has demonstrated the ability to maintain the plasticity of the policy throughout short-term training in aerial robot control. However, these policies have been shown to loss of plasticity when extended to…

Robotics · Computer Science 2025-03-11 Ali Tahir Karasahin , Ziniu Wu , Basaran Bahadir Kocer

This study presents a real-time guidance strategy for an unmanned aerial vehicles (UAVs) that can be used to enhance their flight endurance by utilizing {\sl insitu} measurements of wind speeds and wind gradients. In these strategies,…

Optimization and Control · Mathematics 2015-01-30 Kamran Turkoglu

Offline reinforcement learning leverages large datasets to train policies without interactions with the environment. The learned policies may then be deployed in real-world settings where interactions are costly or dangerous. Current…

Machine Learning · Computer Science 2022-06-29 Matthias Weissenbacher , Samarth Sinha , Animesh Garg , Yoshinobu Kawahara

We explore the reinforcement learning approach to designing controllers by extensively discussing the case of a quadcopter attitude controller. We provide all details allowing to reproduce our approach, starting with a model of the dynamics…

Artificial Intelligence · Computer Science 2021-07-28 Nicola Bernini , Mikhail Bessa , Rémi Delmas , Arthur Gold , Eric Goubault , Romain Pennec , Sylvie Putot , François Sillion

Tried-and-true flapping wing robot simulation is essential in developing flapping wing mechanisms and algorithms. This paper presents a novel application-oriented flapping wing platform, highly compatible with various mechanical designs and…

Robotics · Computer Science 2023-03-09 Chen Qian , Yongchun Fang , Fan jia , Jifu Yan , Yiming Liang , Tiefeng Li

Inverted landing in a rapid and robust manner is a challenging feat for aerial robots, especially while depending entirely on onboard sensing and computation. In spite of this, this feat is routinely performed by biological fliers such as…

Robotics · Computer Science 2023-04-26 Bryan Habas , Jack W. Langelaan , Bo Cheng

Model-based reinforcement learning strategies are believed to exhibit more significant sample complexity than model-free strategies to control dynamical systems,such as quadcopters.This belief that Model-based strategies that involve the…

Machine Learning · Computer Science 2019-12-02 Ashutosh Kumar Tiwari , Sandeep Varma Nadimpalli

This paper evaluates and compares the performance of model-free and model-based reinforcement learning for the attitude control of fixed-wing unmanned aerial vehicles using PID as a reference point. The comparison focuses on their ability…

Robotics · Computer Science 2024-09-27 David Olivares , Pierre Fournier , Pavan Vasishta , Julien Marzat

The focus of this paper is behavior modeling for pilots of unmanned aerial vehicles. The pilot is assumed to make decisions that optimize an unknown cost functional, which is estimated from observed trajectories using a novel inverse…

Systems and Control · Electrical Eng. & Systems 2023-07-26 Jared Town , Zachary Morrison , Rushikesh Kamalapurkar

Animals learn to adapt speed of their movements to their capabilities and the environment they observe. Mobile robots should also demonstrate this ability to trade-off aggressiveness and safety for efficiently accomplishing tasks. The aim…

Robotics · Computer Science 2024-07-11 Guangyu Zhao , Tianyue Wu , Yeke Chen , Fei Gao

In this paper, a novel Q-learning scheduling method for the current controller of switched reluctance motor (SRM) drive is investigated. Q-learning algorithm is a class of reinforcement learning approaches that can find the best…

Systems and Control · Electrical Eng. & Systems 2020-06-16 Hamad A. Alharkan , Sepehr Saadatmand , Mehdi Ferdowsi , Pourya Shamsi