English
Related papers

Related papers: Toward Trusted Onboard AI: Advancing Small Satelli…

200 papers

As the number of spacecraft in orbit continues to increase, it is becoming more challenging for human operators to manage each mission. As a result, autonomous control methods are needed to reduce this burden on operators. One method of…

Systems and Control · Electrical Eng. & Systems 2024-12-17 Kyle Dunlap , Nathaniel Hamilton , Kerianne L. Hobbs

The growing need for autonomous on-orbit services such as inspection, maintenance, and situational awareness calls for intelligent spacecraft capable of complex maneuvers around large orbital targets. Traditional control systems often fall…

Robotics · Computer Science 2025-10-28 Matteo El-Hariry , Andrej Orsula , Matthieu Geist , Miguel Olivares-Mendez

Autonomy is a key challenge for future space exploration endeavours. Deep Reinforcement Learning holds the promises for developing agents able to learn complex behaviours simply by interacting with their environment. This paper investigates…

Robotics · Computer Science 2025-05-02 Matteo El Hariry , Andrea Cini , Giacomo Mellone , Alessandro Balossino

In recent years, unmanned aerial vehicle (UAV) related technology has expanded knowledge in the area, bringing to light new problems and challenges that require solutions. Furthermore, because the technology allows processes usually carried…

Artificial Intelligence · Computer Science 2022-12-08 Cristian Millán-Arias , Ruben Contreras , Francisco Cruz , Bruno Fernandes

Unmanned Aerial Vehicles (UAVs) are increasingly used in automated inspection, delivery, and navigation tasks that require reliable autonomy. This project develops a reinforcement learning (RL) approach to enable a single UAV to…

Robotics · Computer Science 2025-09-18 Salim Oyinlola , Nitesh Subedi , Soumik Sarkar

Multi-rotor UAVs suffer from a restricted range and flight duration due to limited battery capacity. Autonomous landing on a 2D moving platform offers the possibility to replenish batteries and offload data, thus increasing the utility of…

Robotics · Computer Science 2024-05-17 Pascal Goldschmid , Aamir Ahmad

The exponential growth of Low Earth Orbit (LEO) satellites has revolutionised Earth Observation (EO) missions, addressing challenges in climate monitoring, disaster management, and more. However, autonomous coordination in multi-satellite…

Artificial Intelligence · Computer Science 2025-11-06 Mohamad A. Hady , Siyi Hu , Mahardhika Pratama , Jimmy Cao , Ryszard Kowalczyk

Attitude control is essential for many satellite missions. Classical controllers, however, are time-consuming to design and sensitive to model uncertainties and variations in operational boundary conditions. Deep Reinforcement Learning…

Robotics · Computer Science 2026-04-09 Kirill Djebko , Tom Baumann , Erik Dilger , Frank Puppe , Sergio Montenegro

Reinforcement learning (RL) algorithms can achieve state-of-the-art performance in decision-making and continuous control tasks. However, applying RL algorithms on safety-critical systems still needs to be well justified due to the…

Robotics · Computer Science 2022-11-22 Mahmoud Selim , Amr Alanwar , M. Watheq El-Kharashi , Hazem M. Abbas , Karl H. Johansson

Compared with model-based control and optimization methods, reinforcement learning (RL) provides a data-driven, learning-based framework to formulate and solve sequential decision-making problems. The RL framework has become promising due…

Systems and Control · Electrical Eng. & Systems 2024-07-29 Pouria Razzaghi , Amin Tabrizian , Wei Guo , Shulu Chen , Abenezer Taye , Ellis Thompson , Alexis Bregeon , Ali Baheri , Peng Wei

Underwater target localization using range-only and single-beacon (ROSB) techniques with autonomous vehicles has been used recently to improve the limitations of more complex methods, such as long baseline and ultra-short baseline systems.…

Robotics · Computer Science 2023-01-18 Ivan Masmitja , Mario Martin , Kakani Katija , Spartacus Gomariz , Joan Navarro

This paper proposes a novel Reinforcement Learning (RL) approach for sim-to-real policy transfer of Vertical Take-Off and Landing Unmanned Aerial Vehicle (VTOL-UAV). The proposed approach is designed for VTOL-UAV landing on offshore docking…

Robotics · Computer Science 2024-08-01 Ali M. Ali , Aryaman Gupta , Hashim A. Hashim

Reinforcement learning (RL) has been a promising essence in future 5G-beyond and 6G systems. Its main advantage lies in its robust model-free decision-making in complex and large-dimension wireless environments. However, most existing RL…

Robotics · Computer Science 2025-02-04 Eslam Eldeeb , Hirley Alves

This work investigates resource optimization in heterogeneous satellite clusters performing autonomous Earth Observation (EO) missions using Reinforcement Learning (RL). In the proposed setting, two optical satellites and one Synthetic…

Artificial Intelligence · Computer Science 2025-11-18 Mohamad A. Hady , Siyi Hu , Mahardhika Pratama , Zehong Cao , Ryszard Kowalczyk

Reinforcement Learning (RL), among other learning-based methods, represents powerful tools to solve complex robotic tasks (e.g., actuation, manipulation, navigation, etc.), with the need for real-world data to train these systems as one of…

Robotics · Computer Science 2020-07-28 Kenzo Lobos-Tsunekawa , Tatsuya Harada

Recently, reinforcement learning (RL) has been extensively studied and achieved promising results in a wide range of control tasks. Meanwhile, autonomous underwater vehicle (AUV) is an important tool for executing complex and challenging…

Robotics · Computer Science 2019-11-28 Yachu Hsu , Hui Wu , Keyou You , Shiji Song

We address the challenge of enhancing navigation autonomy for planetary space rovers using reinforcement learning (RL). The ambition of future space missions necessitates advanced autonomous navigation capabilities for rovers to meet…

Reinforcement Learning (RL) has demonstrated a great potential for automatically solving decision-making problems in complex uncertain environments. RL proposes a computational approach that allows learning through interaction in an…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-18 Yisel Garí , David A. Monge , Elina Pacini , Cristian Mateos , Carlos García Garino

A reinforcement learning (RL) based methodology is proposed and implemented for online fine-tuning of PID controller gains, thus, improving quadrotor effective and accurate trajectory tracking. The RL agent is first trained offline on a…

Systems and Control · Electrical Eng. & Systems 2025-02-10 Serhat Sönmez , Luca Montecchio , Simone Martini , Matthew J. Rutherford , Alessandro Rizzo , Margareta Stefanovic , Kimon P. Valavanis

Reinforcement learning (RL) offers transformative potential for robotic control in space. We present the first on-orbit demonstration of RL-based autonomous control of a free-flying robot, the NASA Astrobee, aboard the International Space…

Robotics · Computer Science 2026-04-01 Kenneth Stewart , Samantha Chapin , Roxana Leontie , Carl Glen Henshaw
‹ Prev 1 2 3 10 Next ›