English
Related papers

Related papers: Meta-Reinforcement Learning for Trajectory Design …

200 papers

The recent growth of emergent network applications (e.g., satellite networks, vehicular networks) is increasing the complexity of managing modern communication networks. As a result, the community proposed the Digital Twin Networks (DTN) as…

Networking and Internet Architecture · Computer Science 2022-02-02 Carlos Güemes-Palau , Paul Almasan , Shihan Xiao , Xiangle Cheng , Xiang Shi , Pere Barlet-Ros , Albert Cabellos-Aparicio

This letter investigates the reconfigurable intelligent surface (RIS)-assisted multiple-input single-output (MISO) wireless system, where both half-duplex (HD) and full-duplex (FD) operating modes are considered together, for the first time…

Signal Processing · Electrical Eng. & Systems 2021-10-12 Alice Faisal , Ibrahim Al-Nahhal , Octavia A. Dobre , Telex M. N. Ngatched

This paper presents a novel reinforcement learning framework for trajectory tracking of unmanned aerial vehicles in cluttered environments using a dual-agent architecture. Traditional optimization methods for trajectory tracking face…

Robotics · Computer Science 2024-11-01 Shaswat Garg , Houman Masnavi , Baris Fidan , Farrokh Janabi-Sharifi

Mobile edge computing (MEC) is a promising technique to improve the computational capacity of smart devices (SDs) in Internet of Things (IoT). However, the performance of MEC is restricted due to its fixed location and limited service…

Networking and Internet Architecture · Computer Science 2025-08-04 Saichao Liu , Geng Sun , Chuang Zhang , Xuejie Liu , Jiacheng Wang , Changyuan Zhao , Dusit Niyato

The optimal dispatch of energy storage systems (ESSs) presents formidable challenges due to the uncertainty introduced by fluctuations in dynamic prices, demand consumption, and renewable-based energy generation. By exploiting the…

Systems and Control · Electrical Eng. & Systems 2023-07-27 Shengren Hou , Edgar Mauricio Salazar Duque , Peter Palensky , Pedro P. Vergara

Reinforcement learning (RL) is a goal-oriented learning solution that has proven to be successful for Neural Architecture Search (NAS) on the CIFAR and ImageNet datasets. However, a limitation of this approach is its high computational…

Neural and Evolutionary Computing · Computer Science 2019-12-04 J. Gomez Robles , J. Vanschoren

Autonomous indoor navigation of UAVs presents numerous challenges, primarily due to the limited precision of GPS in enclosed environments. Additionally, UAVs' limited capacity to carry heavy or power-intensive sensors, such as overheight…

Robotics · Computer Science 2024-12-25 Kangtong Mo , Linyue Chu , Xingyu Zhang , Xiran Su , Yang Qian , Yining Ou , Wian Pretorius

Deep reinforcement learning (DRL) faces significant challenges in addressing the hard-exploration problems in tasks with sparse or deceptive rewards and large state spaces. These challenges severely limit the practical application of DRL.…

Machine Learning · Computer Science 2024-01-03 Guojian Wang , Faguo Wu , Xiao Zhang , Ning Guo , Zhiming Zheng

Autonomous navigation capabilities play a critical role in service robots operating in environments where human interactions are pivotal, due to the dynamic and unpredictable nature of these environments. However, the variability in human…

Robotics · Computer Science 2024-04-09 Mannan Saeed Muhammad , Estrella Montero

In this paper, we propose a novel joint deep reinforcement learning (DRL)-based solution to optimize the utility of an uncrewed aerial vehicle (UAV)-assisted communication network. To maximize the number of users served within the…

Networking and Internet Architecture · Computer Science 2025-01-03 Xuli Cai , Poonam Lohan , Burak Kantarci

Unmanned aerial vehicles (UAVs) with multiple antennas have recently been explored to improve capacity in wireless networks. However, the strict energy constraint of UAVs, given their simultaneous flying and communication tasks, renders the…

Signal Processing · Electrical Eng. & Systems 2024-05-21 Hosein Zarini , Maryam Farajzadeh Dehkordi , Armin Farhadi , Mohammad Robat Mili , Ali Movaghar , Mehdi Rasti , Yonghui Li , Kai-Kit Wong

Unmanned Aerial Vehicles (UAVs) are increasingly used in automated inspection, delivery, and navigation tasks that require reliable autonomy. This project develops a reinforcement learning (RL) approach to enable a single UAV to…

Robotics · Computer Science 2025-09-18 Salim Oyinlola , Nitesh Subedi , Soumik Sarkar

Creating safe paths in unknown and uncertain environments is a challenging aspect of leader-follower formation control. In this architecture, the leader moves toward the target by taking optimal actions, and followers should also avoid…

Robotics · Computer Science 2024-02-28 Behnaz Hadi , Alireza Khosravi , Pouria Sarhadi

Millimeter-wave (mmWave) is a key enabler for next-generation transportation systems. However, in an urban city scenario, mmWave is highly susceptible to blockages and shadowing. Therefore, base station (BS) placement is a crucial task in…

Signal Processing · Electrical Eng. & Systems 2024-04-24 Ahmed Al-Tahmeesschi , Jukka Talvitie , Miguel López-Benítez , Hamed Ahmadi , Laura Ruotsalainen

In the era of 5G mobile communication, there has been a significant surge in research focused on unmanned aerial vehicles (UAVs) and mobile edge computing technology. UAVs can serve as intelligent servers in edge computing environments,…

Multiagent Systems · Computer Science 2023-09-06 Zhengrong Song , Chuan Ma , Ming Ding , Howard H. Yang , Yuwen Qian , Xiangwei Zhou

Drone base stations (DBSs) can enhance network coverage and area capacity by moving supply towards demand when required. This degree of freedom could be especially useful for future applications with extreme demands, such as ultra reliable…

Networking and Internet Architecture · Computer Science 2017-09-22 Elham Kalantari , Irem Bor-Yaliniz , Abbas Yongacoglu , Halim Yanikomeroglu

Motile microorganisms develop effective swimming gaits to adapt to complex biological environments. Translating this adaptability to smart microrobots presents significant challenges in motion planning and stroke design. In this work, we…

Robotics · Computer Science 2025-06-03 Yuyang Lai , Sina Heydari , On Shun Pak , Yi Man

Urban railway systems increasingly rely on communication based train control (CBTC) systems, where optimal deployment of access points (APs) in tunnels is critical for robust wireless coverage. Traditional methods, such as empirical…

Signal Processing · Electrical Eng. & Systems 2025-09-30 Kunyu Wu , Qiushi Zhao , Zihan Feng , Yunxi Mu , Hao Qin , Xinyu Zhang , Xingqi Zhang

This paper introduces a learning-based visual planner for agile drone flight in cluttered environments. The proposed planner generates collision-free waypoints in milliseconds, enabling drones to perform agile maneuvers in complex…

Robotics · Computer Science 2025-11-21 Minwoo Kim , Geunsik Bae , Jinwoo Lee , Woojae Shin , Changseung Kim , Myong-Yol Choi , Heejung Shin , Hyondong Oh

Distance-based reward mechanisms in deep reinforcement learning (DRL) navigation systems suffer from critical safety limitations in dynamic environments, frequently resulting in collisions when visibility is restricted. We propose DRL-NSUO,…

Robotics · Computer Science 2025-03-04 Mingao Tan , Shanze Wang , Biao Huang , Zhibo Yang , Rongfei Chen , Xiaoyu Shen , Wei Zhang