English
Related papers

Related papers: OrbitZoo: Real Orbital Systems Challenges for Rein…

200 papers

Recently, there has been growing interest in autonomous shipping due to its potential to improve maritime efficiency and safety. The use of advanced technologies, such as artificial intelligence, can address the current navigational and…

Machine Learning · Computer Science 2024-11-08 Bavo Lesy , Ali Anwar , Siegfried Mercelis

In the field of autonomous robots, reinforcement learning (RL) is an increasingly used method to solve the task of dynamic obstacle avoidance for mobile robots, autonomous ships, and drones. A common practice to train those agents is to use…

Robotics · Computer Science 2022-12-09 Fabian Hart , Ostap Okhrin

Autonomous spacecraft control for mission phases such as launch, ascent, stage separation, and orbit insertion remains a critical challenge due to the need for adaptive policies that generalize across dynamically distinct regimes. While…

Machine Learning · Computer Science 2025-11-17 Amit Jain , Victor Rodriguez-Fernandez , Richard Linares

Recent research using Reinforcement Learning (RL) to learn autonomous control for spacecraft operations has shown great success. However, a recent study showed their performance could be improved by changing the action space, i.e. control…

Machine Learning · Computer Science 2025-01-13 Nathaniel Hamilton , Kyle Dunlap , Kerianne L Hobbs

In this work, we study model-based reinforcement learning (RL) in unknown stabilizable linear dynamical systems. When learning a dynamical system, one needs to stabilize the unknown dynamics in order to avoid system blow-ups. We propose an…

Machine Learning · Computer Science 2022-06-06 Sahin Lale , Kamyar Azizzadenesheli , Babak Hassibi , Anima Anandkumar

Autonomous mapping of unknown environments is a critical challenge, particularly in scenarios where time is limited. Multi-agent systems can enhance efficiency through collaboration, but the scalability of motion-planning algorithms remains…

Robotics · Computer Science 2026-01-06 Sriram Rajasekar , Ashwini Ratnoo

Modern reinforcement learning (RL) systems capture deep truths about general, human problem-solving. In domains where new data can be simulated cheaply, these systems uncover sequential decision-making policies that far exceed the ability…

Machine Learning · Computer Science 2025-10-07 Scott Jeen

Ballbot (i.e. Ball balancing robot) navigation usually relies on methods rooted in control theory (CT), and works that apply Reinforcement learning (RL) to the problem remain rare while generally being limited to specific subtasks (e.g.…

Robotics · Computer Science 2026-02-02 Achkan Salehi

Task offloading, crucial for balancing computational loads across devices in networks such as the Internet of Things, poses significant optimization challenges, including minimizing latency and energy usage under strict communication and…

Machine Learning · Computer Science 2024-10-10 Frederico Metelo , Stevo Racković , Pedro Ákos Costa , Cláudia Soares

Recent research has turned to Reinforcement Learning (RL) to solve challenging decision problems, as an alternative to hand-tuned heuristics. RL can learn good policies without the need for modeling the environment's dynamics. Despite this…

Machine Learning · Computer Science 2023-01-30 Pouya Hamadanian , Malte Schwarzkopf , Siddartha Sen , Mohammad Alizadeh

Due to the lack of information such as the space environment condition and resident space objects' (RSOs') body characteristics, current orbit predictions that are solely grounded on physics-based models may fail to achieve required…

Earth and Planetary Astrophysics · Physics 2018-03-16 Hao Peng , Xiaoli Bai

Recent breakthroughs in technology have led to a thriving "new space" culture in low-Earth orbit (LEO) in which performance and cost considerations dominate over resilience and reliability as mission goals. These advances create a manifold…

Networking and Internet Architecture · Computer Science 2022-10-21 Gregory Stock , Juan A. Fraire , Holger Hermanns , Eduardo Cruz , Alastair Isaacs , Zhana Imbrosh

Reinforcement learning (RL) policies deployed in safety-critical systems, such as unmanned aerial vehicle (UAV) navigation in dynamic airspace, are vulnerable to out-ofdistribution (OOD) adversarial attacks in the observation space. These…

Machine Learning · Computer Science 2025-06-27 Deepak Kumar Panda , Adolfo Perrusquia , Weisi Guo

Reinforcement Learning (RL) is an emerging approach to control many dynamical systems for which classical control approaches are not applicable or insufficient. However, the resultant policies may not generalize to variations in the…

Robotics · Computer Science 2023-11-13 Abdel Gafoor Haddad , Mohammed B. Mohiuddin , Igor Boiko , Yahya Zweiri

Driven by inherent uncertainty and the sim-to-real gap, robust reinforcement learning (RL) seeks to improve resilience against the complexity and variability in agent-environment sequential interactions. Despite the existence of a large…

Machine Learning · Computer Science 2025-02-28 Shangding Gu , Laixi Shi , Muning Wen , Ming Jin , Eric Mazumdar , Yuejie Chi , Adam Wierman , Costas Spanos

Reinforcement Learning (RL) can effectively learn complex policies. However, learning these policies often demands extensive trial-and-error interactions with the environment. In many real-world scenarios, this approach is not practical due…

Machine Learning · Computer Science 2024-02-19 Linh Le Pham Van , Hung The Tran , Sunil Gupta

Unmanned Aerial Vehicles (UAVs) increasingly enhance the Quality of Service (QoS) in wireless networks due to their flexibility and cost-effectiveness. However, optimizing UAV placement in dynamic, obstacle-prone environments remains a…

Networking and Internet Architecture · Computer Science 2026-01-30 Kamran Shafafi , Manuel Ricardo , Rui Campos

This paper introduces a full solution for decentralized routing in Low Earth Orbit satellite constellations based on continual Deep Reinforcement Learning (DRL). This requires addressing multiple challenges, including the partial knowledge…

Machine Learning · Computer Science 2024-05-22 Federico Lozano-Cuadra , Beatriz Soret , Israel Leyva-Mayorga , Petar Popovski

We introduce UnrealZoo, a collection of over 100 photo-realistic 3D virtual worlds built on Unreal Engine, designed to reflect the complexity and variability of open-world environments. We also provide a rich variety of playable entities,…

Artificial Intelligence · Computer Science 2025-08-13 Fangwei Zhong , Kui Wu , Churan Wang , Hao Chen , Hai Ci , Zhoujun Li , Yizhou Wang

We consider the challenge of developing agents that efficiently interact with high-dimensional, evolving environments, towards a view of practical reinforcement learning (RL) agents interacting with open worlds, of which they witness and…

Machine Learning · Computer Science 2026-05-26 Shruti Mishra , Michael Chang , Vamsi Spandan , Shmuel M. Rubinstein