English
Related papers

Related papers: OrbitZoo: Real Orbital Systems Challenges for Rein…

200 papers

The exponential growth of Low Earth Orbit (LEO) satellites has revolutionised Earth Observation (EO) missions, addressing challenges in climate monitoring, disaster management, and more. However, autonomous coordination in multi-satellite…

Artificial Intelligence · Computer Science 2025-11-06 Mohamad A. Hady , Siyi Hu , Mahardhika Pratama , Jimmy Cao , Ryszard Kowalczyk

This work investigates resource optimization in heterogeneous satellite clusters performing autonomous Earth Observation (EO) missions using Reinforcement Learning (RL). In the proposed setting, two optical satellites and one Synthetic…

Artificial Intelligence · Computer Science 2025-11-18 Mohamad A. Hady , Siyi Hu , Mahardhika Pratama , Zehong Cao , Ryszard Kowalczyk

As the orbital environment around Earth becomes increasingly crowded with debris, active debris removal (ADR) missions face significant challenges in ensuring safe operations while minimizing the risk of in-orbit collisions. This study…

Artificial Intelligence · Computer Science 2026-02-06 Agni Bandyopadhyay , Gunther Waxenegger-Wilfing

Learning effective reinforcement learning (RL) policies to solve real-world complex tasks can be quite challenging without a high-fidelity simulation environment. In most cases, we are only given imperfect simulators with simplified…

Machine Learning · Computer Science 2025-10-16 Haoyi Niu , Shubham Sharma , Yiwen Qiu , Ming Li , Guyue Zhou , Jianming Hu , Xianyuan Zhan

Despite the popularity of multi-agent reinforcement learning (RL) in simulated and two-player applications, its success in messy real-world applications has been limited. A key challenge lies in its generalizability across problem…

Machine Learning · Computer Science 2024-10-22 Vindula Jayawardana , Baptiste Freydt , Ao Qu , Cameron Hickert , Zhongxia Yan , Cathy Wu

The development of satellite constellation applications is rapidly advancing due to increasing user demands, reduced operational costs, and technological advancements. However, a significant gap in the existing literature concerns…

Machine Learning · Computer Science 2024-09-05 Hassan El Alami , Danda B. Rawat

Nowadays, realistic simulation environments are essential to validate and build reliable robotic solutions. This is particularly true when using Reinforcement Learning (RL) based control policies. To this end, both robotics and RL…

Robotics · Computer Science 2023-10-12 Matteo El-Hariry , Antoine Richard , Miguel Olivares-Mendez

Solving real-world complex tasks using reinforcement learning (RL) without high-fidelity simulation environments or large amounts of offline data can be quite challenging. Online RL agents trained in imperfect simulation environments can…

Machine Learning · Computer Science 2025-04-17 Haoyi Niu , Tianying Ji , Bingqi Liu , Haocheng Zhao , Xiangyu Zhu , Jianying Zheng , Pengfei Huang , Guyue Zhou , Jianming Hu , Xianyuan Zhan

The growing need for autonomous on-orbit services such as inspection, maintenance, and situational awareness calls for intelligent spacecraft capable of complex maneuvers around large orbital targets. Traditional control systems often fall…

Robotics · Computer Science 2025-10-28 Matteo El-Hariry , Andrej Orsula , Matthieu Geist , Miguel Olivares-Mendez

A RL (Reinforcement Learning) algorithm was developed for command automation onboard a 3U CubeSat. This effort focused on the implementation of macro control action RL, a technique in which an onboard agent is provided with compiled…

Systems and Control · Electrical Eng. & Systems 2025-07-31 Cannon Whitney , Joseph Melville

Low-thrust trajectory design and in-flight control remain two of the most challenging topics for new-generation satellite operations. Most of the solutions currently implemented are based on reference trajectories and lead to sub-optimal…

Machine Learning · Computer Science 2022-11-16 Carlos M. Casas , Belen Carro , Antonio Sanchez-Esguevillas

With the increasingly congested and contested space environment, safe and effective satellite operation has become increasingly challenging. As a result, there is growing interest in autonomous satellite capabilities, with common machine…

Robotics · Computer Science 2025-03-03 Henry Lei , Joshua Aurand , Zachary S. Lippay , Sean Phillips

Reinforcement learning (RL) has proven its worth in a series of artificial domains, and is beginning to show some successes in real-world scenarios. However, much of the research advances in RL are hard to leverage in real-world systems due…

Machine Learning · Computer Science 2021-03-05 Gabriel Dulac-Arnold , Nir Levine , Daniel J. Mankowitz , Jerry Li , Cosmin Paduraru , Sven Gowal , Todd Hester

Modern astronomical experiments are designed to achieve multiple scientific goals, from studies of galaxy evolution to cosmic acceleration. These goals require data of many different classes of night-sky objects, each of which has a…

Instrumentation and Methods for Astrophysics · Physics 2023-12-01 Franco Terranova , M. Voetberg , Brian Nord , Amanda Pagul

Robust reinforcement learning (RL) aims to learn policies that remain effective despite uncertainties in its environment, which frequently arise in real-world applications due to variations in environment dynamics. The robust RL methods…

Machine Learning · Computer Science 2025-05-30 Linh Le Pham Van , Minh Hoang Nguyen , Hung Le , Hung The Tran , Sunil Gupta

Safety remains a central obstacle preventing widespread use of RL in the real world: learning new tasks in uncertain environments requires extensive exploration, but safety requires limiting exploration. We propose Recovery RL, an algorithm…

The design and deployment of autonomous systems for space missions require robust solutions to navigate strict reliability constraints, extended operational duration, and communication challenges. This study evaluates the stability and…

Robotics · Computer Science 2025-03-04 Henry Lei , Zachary S. Lippay , Anonto Zaman , Joshua Aurand , Amin Maghareh , Sean Phillips

The proliferation of large-scale low Earth orbit (LEO) satellite constellations is driving the need for intelligent routing strategies that can effectively deliver data to terrestrial networks under rapidly time-varying topologies and…

Networking and Internet Architecture · Computer Science 2026-01-21 Sivaram Krishnan , Zhouyou Gu , Jihong Park , Sung-Min Oh , Jinho Choi

We address the challenge of enhancing navigation autonomy for planetary space rovers using reinforcement learning (RL). The ambition of future space missions necessitates advanced autonomous navigation capabilities for rovers to meet…

Reinforcement learning (RL) is playing an increasingly important role in fields such as robotic control and autonomous driving. However, the gap between simulation and the real environment remains a major obstacle to the practical…

Machine Learning · Computer Science 2025-06-17 Zhilin Lin , Shiliang Sun
‹ Prev 1 2 3 10 Next ›