English
Related papers

Related papers: Close-Proximity Satellite Operations through Deep …

200 papers

In recent years, the amalgamation of satellite communications and aerial platforms into space-air-ground integrated network (SAGINs) has emerged as an indispensable area of research for future communications due to the global coverage…

Information Theory · Computer Science 2024-01-03 Chong Huang , Gaojie Chen , Pei Xiao , Yue Xiao , Zhu Han , Jonathon A. Chambers

Since deep neural networks' resurgence, reinforcement learning has gradually strengthened and surpassed humans in many conventional games. However, it is not easy to copy these accomplishments to autonomous driving because state spaces are…

Robotics · Computer Science 2023-02-14 B. Udugama

In recent years, deep reinforcement learning (DRL) approaches have generated highly successful controllers for a myriad of complex domains. However, the opaque nature of these models limits their applicability in aerospace systems and…

Machine learning (ML) is increasingly used to automate networking tasks, in a paradigm known as zero-touch network and service management (ZSM). In particular, Deep Reinforcement Learning (DRL) techniques have recently gathered much…

Networking and Internet Architecture · Computer Science 2022-07-14 Ovidiu Iacoboaiea , Jonatan Krolikowski , Zied Ben Houidi , Dario Rossi

Deep reinforcement learning (DRL) algorithms have recently gained wide attention in the wireless networks domain. They are considered promising approaches for solving dynamic radio resource management (RRM) problems in next-generation…

Networking and Internet Architecture · Computer Science 2022-09-29 Ahmad M. Nagib , Hatem Abou-zeid , Hossam S. Hassanein

The exponential growth of Low Earth Orbit (LEO) satellites has revolutionised Earth Observation (EO) missions, addressing challenges in climate monitoring, disaster management, and more. However, autonomous coordination in multi-satellite…

Artificial Intelligence · Computer Science 2025-11-06 Mohamad A. Hady , Siyi Hu , Mahardhika Pratama , Jimmy Cao , Ryszard Kowalczyk

Visual navigation is essential for many applications in robotics, from manipulation, through mobile robotics to automated driving. Deep reinforcement learning (DRL) provides an elegant map-free approach integrating image processing,…

Robotics · Computer Science 2020-10-22 Jonáš Kulhánek , Erik Derner , Robert Babuška

With the continual adoption of Uncrewed Aerial Vehicles (UAVs) across a wide-variety of application spaces, robust aerial manipulation remains a key research challenge. Aerial manipulation tasks require interacting with objects in the…

Robotics · Computer Science 2024-07-02 Cora A. Dimmig , Marin Kobilarov

The Internet of Things (IoT) extends the Internet connectivity into billions of IoT devices around the world, where the IoT devices collect and share information to reflect status of the physical world. The Autonomous Control System (ACS),…

Machine Learning · Computer Science 2020-04-14 Lei Lei , Yue Tan , Kan Zheng , Shiwen Liu , Kuan Zhang , Xuemin , Shen

This work investigates resource optimization in heterogeneous satellite clusters performing autonomous Earth Observation (EO) missions using Reinforcement Learning (RL). In the proposed setting, two optical satellites and one Synthetic…

Artificial Intelligence · Computer Science 2025-11-18 Mohamad A. Hady , Siyi Hu , Mahardhika Pratama , Zehong Cao , Ryszard Kowalczyk

The use of robotics in controlled environments has flourished over the last several decades and training robots to perform tasks using control strategies developed from dynamical models of their hardware have proven very effective. However,…

Robotics · Computer Science 2019-07-16 Zach Dwiel , Madhavun Candadai , Mariano Phielipp

Deep Reinforcement Learning is quickly becoming a popular method for training autonomous Unmanned Aerial Vehicles (UAVs). Our work analyzes the effects of measurement uncertainty on the performance of Deep Reinforcement Learning (DRL) based…

Robotics · Computer Science 2023-03-14 Bhaskar Joshi , Dhruv Kapur , Harikumar Kandath

Deep reinforcement learning (DRL) has become a powerful tool for complex decision-making in machine learning and AI. However, traditional methods often assume perfect action execution, overlooking the uncertainties and deviations between an…

Robotics · Computer Science 2025-07-02 Oren Fivel , Matan Rudman , Kobi Cohen

Reinforcement Learning (RL) is increasingly applied to large-scale decision-making problems like logistics, scheduling, and recommender systems, but existing algorithms struggle with the curse of dimensionality in such large discrete action…

Machine Learning · Computer Science 2026-05-12 Heiko Hoppe , Fabian Akkerman , Wouter van Heeswijk , Maximilian Schiffer

Air transportation is undergoing a rapid evolution globally with the introduction of Advanced Air Mobility (AAM) and with it comes novel challenges and opportunities for transforming aviation. As AAM operations introduce increasing…

Artificial Intelligence · Computer Science 2024-07-02 Luis E. Alvarez , Marc W. Brittain , Steven D. Young

Multi-robot navigation is a challenging task in which multiple robots must be coordinated simultaneously within dynamic environments. We apply deep reinforcement learning (DRL) to learn a decentralized end-to-end policy which maps raw…

Robotics · Computer Science 2022-09-08 Christian Jestel , Hartmut Surmann , Jonas Stenzel , Oliver Urbann , Marius Brehler

The growing performance demands and higher deployment densities of next-generation wireless systems emphasize the importance of adopting strategies to manage the energy efficiency of mobile networks. In this demo, we showcase a framework…

Networking and Internet Architecture · Computer Science 2026-01-07 Matteo Bordin , Andrea Lacava , Michele Polese , Francesca Cuomo , Tommaso Melodia

Adoption of machine learning (ML)-enabled cyber-physical systems (CPS) are becoming prevalent in various sectors of modern society such as transportation, industrial, and power grids. Recent studies in deep reinforcement learning (DRL) have…

Machine Learning · Computer Science 2020-07-15 Kai Liang Tan , Yasaman Esfandiari , Xian Yeow Lee , Aakanksha , Soumik Sarkar

This report investigates the application of deep reinforcement learning (DRL) algorithms for dynamic resource allocation in wireless communication systems. An environment that includes a base station, multiple antennas, and user equipment…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-14 Shubham Malhotra , Fnu Yashu , Muhammad Saqib , Dipkumar Mehta , Jagdish Jangid , Sachin Dixit

Autonomous navigation in unstructured environments is essential for field and planetary robotics, where robots must efficiently reach goals while avoiding obstacles under uncertain conditions. Conventional algorithmic approaches often…

Robotics · Computer Science 2025-10-28 Shreya Santra , Thomas Robbins , Kazuya Yoshida