English
Related papers

Related papers: DHEA-MECD: An Embodied Intelligence-Powered DRL Al…

200 papers

Autonomous underwater vehicle (AUV) plays an increasingly important role in ocean exploration. Existing AUVs are usually not fully autonomous and generally limited to pre-planning or pre-programming tasks. Reinforcement learning (RL) and…

Artificial Intelligence · Computer Science 2020-01-13 Qilei Zhang , Jinying Lin , Qixin Sha , Bo He , Guangliang Li

With the growth of sensing, control and robotic technologies, autonomous underwater vehicles (AUVs) have become useful assistants to human divers for performing various underwater operations. In the current practice, the divers are required…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Jing Yang , James P. Wilson , Shalabh Gupta

Ultra-dense edge computing (UDEC) has great potential, especially in the 5G era, but it still faces challenges in its current solutions, such as the lack of: i) efficient utilization of multiple 5G resources (e.g., computation,…

Networking and Internet Architecture · Computer Science 2020-09-23 Shuai Yu , Xu Chen , Zhi Zhou , Xiaowen Gong , Di Wu

In this work, we adopt the emerging technology of mobile edge computing (MEC) in the Unmanned aerial vehicles (UAVs) for communication-computing systems, to optimize the age of information (AoI) in the network. We assume that tasks are…

Signal Processing · Electrical Eng. & Systems 2022-06-22 Marjan Tajik , Mohammadreza Maleki , Nader Mokari , Mohammad Reza Javan , Hamid Saeedi , Bile Peng , Eduard A. Jorswieck

The potential of artificial upwelling (AU) as a means of lifting nutrient-rich bottom water to the surface, stimulating seaweed growth, and consequently enhancing ocean carbon sequestration, has been gaining increasing attention in recent…

Machine Learning · Computer Science 2024-05-01 Yiyuan Zhang , Wei Fan

As intelligent transportation systems been implemented broadly and unmanned arial vehicles (UAVs) can assist terrestrial base stations acting as multi-access edge computing (MEC) to provide a better wireless network communication for…

Machine Learning · Computer Science 2022-02-21 Xiaoyu Dai , Kaoru Ota , Mianxiong Dong

The Pickup and Delivery Problem (PDP) is a fundamental and challenging variant of the Vehicle Routing Problem, characterized by tightly coupled pickup--delivery pairs, precedence constraints, and spatial layouts that often exhibit…

Machine Learning · Computer Science 2026-03-12 Wentao Wang , Lifeng Han , Guangyu Zou

The advent of fifth generation (5G) networks has opened new avenues for enhancing connectivity, particularly in challenging environments like remote areas or disaster-struck regions. Unmanned aerial vehicles (UAVs) have been identified as a…

Networking and Internet Architecture · Computer Science 2023-12-25 Yuhui Wang , Junaid Farooq

Energy-aware control for multiple unmanned aerial vehicles (UAVs) is one of the major research interests in UAV based networking. Yet few existing works have focused on how the network should react around the timing when the UAV lineup is…

Machine Learning · Computer Science 2020-09-21 Ran Zhang , Miao Wang , Lin X. Cai

Multi-connectivity involves dynamic cluster formation among distributed access points (APs) and coordinated resource allocation from these APs, highlighting the need for efficient mobility management strategies for users with…

Networking and Internet Architecture · Computer Science 2026-01-29 Irshad A. Meer , Karl-Ludwig Besser , Mustafa Ozger , Dominic Schupke , H. Vincent Poor , Cicek Cavdar

In recent years, the amalgamation of satellite communications and aerial platforms into space-air-ground integrated network (SAGINs) has emerged as an indispensable area of research for future communications due to the global coverage…

Information Theory · Computer Science 2024-01-03 Chong Huang , Gaojie Chen , Pei Xiao , Yue Xiao , Zhu Han , Jonathon A. Chambers

We propose a novel benchmark environment for Safe Reinforcement Learning focusing on aquatic navigation. Aquatic navigation is an extremely challenging task due to the non-stationary environment and the uncertainties of the robotic…

Machine Learning · Computer Science 2021-12-21 Enrico Marchesini , Davide Corsi , Alessandro Farinelli

Training robots to navigate diverse environments is a challenging problem as it involves the confluence of several different perception tasks such as mapping and localization, followed by optimal path-planning and control. Recently released…

Robotics · Computer Science 2021-01-07 Kaushik Balakrishnan , Punarjay Chakravarty , Shubham Shrivastava

This paper proposes a cooperative strategy of connected and automated vehicles (CAVs) longitudinal control for partially connected and automated traffic environment based on deep reinforcement learning (DRL) algorithm, which enhances the…

Systems and Control · Electrical Eng. & Systems 2020-12-04 Haotian Shi , Yang Zhou , Keshu Wu , Xin Wang , Yangxin Lin , Bin Ran

Image retrieval (IR) has emerged as a promising approach for self-localization in unmanned aerial vehicles (UAVs). However, IR-based methods face several challenges: 1) Pre- and post-processing incur significant computational and storage…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Ming Dai , Enhui Zheng , Jiahao Chen , Lei Qi , Zhenhua Feng , Wankou Yang

Deep Reinforcement Learning (DRL) is gaining attention as a potential approach to design trajectories for autonomous unmanned aerial vehicles (UAV) used as flying access points in the context of cellular or Internet of Things (IoT)…

Information Theory · Computer Science 2022-02-07 Omid Esrafilian , Harald Bayerlein , David Gesbert

Autonomous indoor navigation of UAVs presents numerous challenges, primarily due to the limited precision of GPS in enclosed environments. Additionally, UAVs' limited capacity to carry heavy or power-intensive sensors, such as overheight…

Robotics · Computer Science 2024-12-25 Kangtong Mo , Linyue Chu , Xingyu Zhang , Xiran Su , Yang Qian , Yining Ou , Wian Pretorius

Unmanned Aerial Vehicles (UAVs) offer agile, secure and efficient solutions for communication relay networks. However, their modeling and control are challenging, and the mismatch between simulations and actual conditions limits real-world…

Robotics · Computer Science 2025-01-31 Yousef Emami , Kai Li , Luis Almeida , Sai Zou , Wei Ni

Unmanned aerial vehicles (UAVs) have been widely used in military warfare. In this paper, we formulate the autonomous motion control (AMC) problem as a Markov decision process (MDP) and propose an advanced deep reinforcement learning (DRL)…

Artificial Intelligence · Computer Science 2022-07-05 Zijian Hu , Xiaoguang Gao , Kaifang Wan , Qianglong Wang , Yiwei Zhai

Designing intelligent microrobots that can autonomously navigate and perform instructed routines in blood vessels, a complex and crowded environment with obstacles including dense cells, different flow patterns and diverse vascular…

Soft Condensed Matter · Physics 2021-03-25 Yuguang Yang , Michael A. Bevan , Bo Li