English
Related papers

Related papers: Empirical evaluation of a Q-Learning Algorithm for…

200 papers

Path Planning methods for autonomous control of Unmanned Aerial Vehicle (UAV) swarms are on the rise because of all the advantages they bring. There are more and more scenarios where autonomous control of multiple UAVs is required. Most of…

Artificial Intelligence · Computer Science 2023-08-28 Alejandro Puente-Castro , Daniel Rivero , Eurico Pedrosa , Artur Pereira , Nuno Lau , Enrique Fernandez-Blanco

We introduce Air Learning, an open-source simulator, and a gym environment for deep reinforcement learning research on resource-constrained aerial robots. Equipped with domain randomization, Air Learning exposes a UAV agent to a diverse set…

Robotics · Computer Science 2022-11-15 Srivatsan Krishnan , Behzad Boroujerdian , William Fu , Aleksandra Faust , Vijay Janapa Reddi

This paper presents a data-driven optimal control policy for a micro flapping wing unmanned aerial vehicle. First, a set of optimal trajectories are computed off-line based on a geometric formulation of dynamics that captures the nonlinear…

Robotics · Computer Science 2022-06-09 Tejaswi K. C. , Taeyoung Lee

The autonomous operation of flexible-wing aircraft is technically challenging and has never been presented within literature. The lack of an exact modeling framework is due to the complex nonlinear aerodynamic relationships governed by the…

Systems and Control · Electrical Eng. & Systems 2021-03-31 Mohammed Abouheaf , Nathaniel Mailhot , Wail Gueaieb , Davide Spinello

Controlled gliding is one of the most energetically efficient modes of transportation for natural and human powered fliers. Here we demonstrate that gliding and landing strategies with different optimality criteria can be identified through…

Robotics · Computer Science 2018-07-11 Guido Novati , Lakshminarayanan Mahadevan , Petros Koumoutsakos

Learning to control robots without requiring engineered models has been a long-term goal, promising diverse and novel applications. Yet, reinforcement learning has only achieved limited impact on real-time robot control due to its high…

Robotics · Computer Science 2020-08-05 Philip Becker-Ehmck , Maximilian Karl , Jan Peters , Patrick van der Smagt

Airborne Wind Energy is a lightweight technology that allows power extraction from the wind using airborne devices such as kites and gliders, where the airfoil orientation can be dynamically controlled in order to maximize performance. The…

Fluid Dynamics · Physics 2022-03-29 N. Orzan , C. Leone , A. Mazzolini , J. Oyero , A. Celani

A self-learning optimal control algorithm for episodic fixed-horizon manufacturing processes with time-discrete control actions is proposed and evaluated on a simulated deep drawing process. The control model is built during consecutive…

Systems and Control · Computer Science 2020-01-07 Johannes Dornheim , Norbert Link , Peter Gumbsch

Unmanned Aerial Vehicles need an online path planning capability to move in high-risk missions in unknown and complex environments to complete them safely. However, many algorithms reported in the literature may not return reliable…

Current networking protocols deem inefficient in accommodating the two key challenges of Unmanned Aerial Vehicle (UAV) networks, namely the network connectivity loss and energy limitations. One approach to solve these issues is using…

Networking and Internet Architecture · Computer Science 2021-03-25 Arnau Rovira-Sugranes , Fatemeh Afghah , Junsuo Qu , Abolfazl Razi

The development of machine learning algorithms has been gathering relevance to address the increasing modelling complexity of manufacturing decision-making problems. Reinforcement learning is a methodology with great potential due to the…

Machine Learning · Computer Science 2023-04-18 Miguel Neves , Miguel Vieira , Pedro Neto

This paper introduces and analyzes an improved Q-learning algorithm for discrete-time linear time-invariant systems. The proposed method does not require any knowledge of the system dynamics, and it enjoys significant efficiency advantages…

Systems and Control · Electrical Eng. & Systems 2023-04-03 Victor G. Lopez , Mohammad Alsalti , Matthias A. Müller

This study evaluates the application of a discrete action space reinforcement learning method (Q-learning) to the continuous control problem of robot inverted pendulum balancing. To speed up the learning process and to overcome technical…

Robotics · Computer Science 2023-12-06 Mohammad Safeea , Pedro Neto

Attitude control of a novel regional truss-braced wing aircraft with low stability characteristics is addressed in this paper using Reinforcement Learning (RL). In recent years, RL has been increasingly employed in challenging applications,…

Systems and Control · Electrical Eng. & Systems 2022-10-25 Mohsen Zahmatkesh , Seyyed Ali Emami , Afshin Banazadeh , Paolo Castaldi

Quadrotors have demonstrated remarkable versatility, yet their full aerobatic potential remains largely untapped due to inherent underactuation and the complexity of aggressive maneuvers. Traditional approaches, separating trajectory…

Robotics · Computer Science 2025-06-02 Zhichao Han , Xijie Huang , Zhuxiu Xu , Jiarui Zhang , Yuze Wu , Mingyang Wang , Tianyue Wu , Fei Gao

Current control algorithms for aerial robots struggle with robustness in dynamic environments and adverse conditions. Model-based reinforcement learning (RL) has shown strong potential in handling these challenges while remaining…

Robotics · Computer Science 2025-11-25 Eashan Vytla , Bhavanishankar Kalavakolanu , Andrew Perrault , Matthew McCrink

We propose a novel adaptive reinforcement learning control approach for fault tolerant control of degrading systems that is not preceded by a fault detection and diagnosis step. Therefore, \textit{a priori} knowledge of faults that may…

Systems and Control · Electrical Eng. & Systems 2020-08-12 Ibrahim Ahmed , Marcos Quiñones-Grueiro , Gautam Biswas

Model-based reinforcement learning is an effective approach for controlling an unknown system. It is based on a longstanding pipeline familiar to the control community in which one performs experiments on the environment to collect a…

Systems and Control · Electrical Eng. & Systems 2024-08-14 Bruce D. Lee , Ingvar Ziemann , George J. Pappas , Nikolai Matni

Dynamic soaring enables sustained flight by extracting energy from wind shear, yet it is commonly understood as a cycle-level maneuver that assumes stable flow conditions. In realistic unsteady environments, however, such assumptions are…

Fluid Dynamics · Physics 2026-04-15 Lunbing Chen , Jixin Lu , Yufei Yin , Jinpeng Huang , Yang Xiang , Hong Liu

This paper addresses the problem of guiding a quadrotor through a predefined sequence of waypoints in cluttered environments, aiming to minimize the flight time while avoiding collisions. Previous approaches either suffer from prolonged…

Robotics · Computer Science 2024-07-01 Wei Xiao , Zhaohan Feng , Ziyu Zhou , Jian Sun , Gang Wang , Jie Chen
‹ Prev 1 2 3 10 Next ›