English
Related papers

Related papers: Toward Trusted Onboard AI: Advancing Small Satelli…

200 papers

In recent years, on-policy reinforcement learning (RL) has been successfully applied to many different continuous control tasks. While RL algorithms are often conceptually simple, their state-of-the-art implementations take numerous low-…

Offline reinforcement learning (RL) has emerged as a promising framework for addressing robot social navigation challenges. However, inherent uncertainties in pedestrian behavior and limited environmental interaction during training often…

Robotics · Computer Science 2025-10-02 Run Su , Hao Fu , Shuai Zhou , Yingao Fu

Reinforcement learning (RL) is a flexible and efficient method for programming micro-robots in complex environments. Here we investigate whether reinforcement learning can provide insights into biological systems when trained to perform…

Biological Physics · Physics 2024-04-03 Samuel Tovey , Christoph Lohrmann , Christian Holm

Reinforcement learning (RL) is a powerful machine learning technique that enables an intelligent agent to learn an optimal policy that maximizes the cumulative rewards in sequential decision making. Most of methods in the existing…

Machine Learning · Statistics 2023-01-06 Chengchun Shi , Zhengling Qi , Jianing Wang , Fan Zhou

The development of satellite constellation applications is rapidly advancing due to increasing user demands, reduced operational costs, and technological advancements. However, a significant gap in the existing literature concerns…

Machine Learning · Computer Science 2024-09-05 Hassan El Alami , Danda B. Rawat

We transform reinforcement learning (RL) into a form of supervised learning (SL) by turning traditional RL on its head, calling this Upside Down RL (UDRL). Standard RL predicts rewards, while UDRL instead uses rewards as task-defining…

Artificial Intelligence · Computer Science 2020-06-24 Juergen Schmidhuber

We propose a two-component data-driven controller to safely perform docking maneuvers for satellites. Reinforcement Learning is used to deduce an optimal control policy based on measurement data. To safeguard the learning phase, an…

Optimization and Control · Mathematics 2024-07-30 Simon Gottschalk , Lukas Lanza , Karl Worthmann , Kerstin Lux-Gottschalk

In this work, we first describe a framework for the application of Reinforcement Learning (RL) control to a radar system that operates in a congested spectral setting. We then compare the utility of several RL algorithms through a…

Machine Learning · Computer Science 2020-06-24 Charles E. Thornton , R. Michael Buehrer , Anthony F. Martone , Kelly D. Sherbondy

This paper introduces a full solution for decentralized routing in Low Earth Orbit satellite constellations based on continual Deep Reinforcement Learning (DRL). This requires addressing multiple challenges, including the partial knowledge…

Machine Learning · Computer Science 2024-05-22 Federico Lozano-Cuadra , Beatriz Soret , Israel Leyva-Mayorga , Petar Popovski

The next-generation wireless technologies, including beyond 5G and 6G networks, are paving the way for transformative applications such as vehicle platooning, smart cities, and remote surgery. These innovations are driven by a vast array of…

Multiagent Systems · Computer Science 2026-01-05 Eslam Eldeeb , Hirley Alves

This paper presents a reinforcement learning (RL) environment for developing an autonomous underwater robotic coral sampling agent, a crucial coral reef conservation and research task. Using software-in-the-loop (SIL) and…

Robotics · Computer Science 2025-07-24 Daniel Correa , Tero Kaarlela , Jose Fuentes , Paulo Padrao , Alain Duran , Leonardo Bobadilla

Reinforcement Learning (RL) enables an intelligent agent to optimise its performance in a task by continuously taking action from an observed state and receiving a feedback from the environment in form of rewards. RL typically uses tables…

Artificial Intelligence · Computer Science 2025-01-28 Alberto Castagna

Industry 4.0 is driven by demands like shorter time-to-market, mass customization of products, and batch size one production. Reinforcement Learning (RL), a machine learning paradigm shown to possess a great potential in improving and…

Artificial Intelligence · Computer Science 2023-06-05 Georg Schäfer , Reuf Kozlica , Stefan Wegenkittl , Stefan Huber

As space becomes more congested, on orbit inspection is an increasingly relevant activity whether to observe a defunct satellite for planning repairs or to de-orbit it. However, the task of on orbit inspection itself is challenging,…

Robotics · Computer Science 2023-05-02 Joshua Aurand , Steven Cutlip , Henry Lei , Kendra Lang , Sean Phillips

Deep reinforcement learning (RL) has been successfully applied to a variety of game-like environments. However, the application of deep RL to visual navigation with realistic environments is a challenging task. We propose a novel learning…

Robotics · Computer Science 2019-11-12 Jonáš Kulhánek , Erik Derner , Tim de Bruin , Robert Babuška

Reinforcement learning (RL) is a machine learning paradigm where an autonomous agent learns to make an optimal sequence of decisions by interacting with the underlying environment. The promise demonstrated by RL-guided workflows in…

Cryptography and Security · Computer Science 2022-08-31 Satwik Patnaik , Vasudev Gohil , Hao Guo , Jeyavijayan , Rajendran

The increasing number of satellites and orbital debris has made space congestion a critical issue, threatening satellite safety and sustainability. Challenges such as collision avoidance, station-keeping, and orbital maneuvering require…

Machine Learning · Computer Science 2025-10-16 Alexandre Oliveira , Katarina Dyreby , Francisco Caldas , Cláudia Soares

This paper investigates the problem of on-orbit spacecraft inspection using a single free-flying deputy spacecraft, equipped with an optical sensor, whose controller is a neural network control system trained with Reinforcement Learning…

Robotics · Computer Science 2023-08-08 David van Wijk , Kyle Dunlap , Manoranjan Majji , Kerianne L. Hobbs

Ballbot (i.e. Ball balancing robot) navigation usually relies on methods rooted in control theory (CT), and works that apply Reinforcement learning (RL) to the problem remain rare while generally being limited to specific subtasks (e.g.…

Robotics · Computer Science 2026-02-02 Achkan Salehi

Vision-driven autonomous flight and obstacle avoidance of Unmanned Aerial Vehicles (UAVs) along complex riverine environments for tasks like rescue and surveillance requires a robust control policy, which is yet difficult to obtain due to…

Robotics · Computer Science 2025-08-14 Zihan Wang , Jianwen Li , Nina Mahmoudian