English
Related papers

Related papers: DHEA-MECD: An Embodied Intelligence-Powered DRL Al…

200 papers

Modern control systems are increasingly turning to machine learning algorithms to augment their performance and adaptability. Within this context, Deep Reinforcement Learning (DRL) has emerged as a promising control framework, particularly…

Machine Learning · Computer Science 2024-04-02 Thomas Nakken Larsen , Eirik Runde Barlaug , Adil Rasheed

Multi-access Edge Computing (MEC) addresses computational and battery limitations in devices by allowing them to offload computation tasks. To overcome the difficulties in establishing line-of-sight connections, integrating unmanned aerial…

Networking and Internet Architecture · Computer Science 2023-12-15 Pyae Sone Aung , Loc X. Nguyen , Yan Kyaw Tun , Zhu Han , Choong Seon Hong

The low-altitude economy (LAE), driven by unmanned aerial vehicles (UAVs) and other aircraft, has revolutionized fields such as transportation, agriculture, and environmental monitoring. In the upcoming six-generation (6G) era, UAV-assisted…

Machine Learning · Computer Science 2025-01-14 Geng Sun , Weilong Ma , Jiahui Li , Zemin Sun , Jiacheng Wang , Dusit Niyato , Shiwen Mao

This study presents a novel environment-aware reinforcement learning (RL) framework designed to augment the operational capabilities of autonomous underwater vehicles (AUVs) in underwater environments. Departing from traditional RL…

Systems and Control · Electrical Eng. & Systems 2025-12-02 Yimian Ding , Jingzehua Xu , Guanwen Xie , Shuai Zhang , Yi Li

Previous works showed that Deep-RL can be applied to perform mapless navigation, including the medium transition of Hybrid Unmanned Aerial Underwater Vehicles (HUAUVs). This paper presents new approaches based on the state-of-the-art…

In this paper, we present our proposed approach for active tracking to increase the autonomy of Unmanned Aerial Vehicles (UAVs) using event cameras, low-energy imaging sensors that offer significant advantages in speed and dynamic range.…

Robotics · Computer Science 2024-10-22 Ala Souissi , Hajer Fradi , Panagiotis Papadakis

The empowering unmanned aerial vehicles (UAVs) have been extensively used in providing intelligence such as target tracking. In our field experiments, a pre-trained convolutional neural network (CNN) is deployed at the UAV to identify a…

Image and Video Processing · Electrical Eng. & Systems 2020-08-19 Bo Yang , Xuelin Cao , Chau Yuen , Lijun Qian

Deep reinforcement learning (RL) has been successfully applied to a variety of game-like environments. However, the application of deep RL to visual navigation with realistic environments is a challenging task. We propose a novel learning…

Robotics · Computer Science 2019-11-12 Jonáš Kulhánek , Erik Derner , Tim de Bruin , Robert Babuška

Deep reinforcement learning (DRL) methods have demonstrated potential for autonomous navigation and obstacle avoidance of unmanned ground vehicles (UGVs) in crowded environments. Most existing approaches rely on single-frame observation and…

Robotics · Computer Science 2026-01-01 Ruitong Li , Lin Zhang , Yuenan Zhao , Chengxin Liu , Ran Song , Wei Zhang

Deep Reinforcement Learning (DRL) offers a robust alternative to traditional control methods for autonomous underwater docking, particularly in adapting to unpredictable environmental conditions. However, bridging the "sim-to-real" gap and…

Robotics · Computer Science 2026-03-13 Alaaeddine Chaarani , Narcis Palomeras , Pere Ridao

This paper presents UnderwaterVLA, a novel framework for autonomous underwater navigation that integrates multimodal foundation models with embodied intelligence systems. Underwater operations remain difficult due to hydrodynamic…

In this paper, we consider depth control problems of an autonomous underwater vehicle (AUV) for tracking the desired depth trajectories. Due to the unknown dynamical model of the AUV, the problems cannot be solved by most of model-based…

Robotics · Computer Science 2017-11-23 Hui Wu , Shiji Song , Keyou You , Cheng Wu

Connected and automated vehicles (CAVs) have recently gained prominence in traffic research due to advances in communication technology and autonomous driving. Various longitudinal control strategies for CAVs have been developed to enhance…

Systems and Control · Electrical Eng. & Systems 2024-06-25 Jingyuan Zhou , Longhao Yan , Kaidi Yang

An unmanned aerial vehicle (UAV)-aided mobile edge computing (MEC) framework is proposed, where several UAVs having different trajectories fly over the target area and support the user equipments (UEs) on the ground. We aim to jointly…

Signal Processing · Electrical Eng. & Systems 2020-09-24 Liang Wang , Kezhi Wang , Cunhua Pan , Wei Xu , Nauman Aslam , Lajos Hanzo

With the widespread adoption of electric vehicles (EVs), navigating for EV drivers to select a cost-effective charging station has become an important yet challenging issue due to dynamic traffic conditions, fluctuating electricity prices,…

Machine Learning · Computer Science 2025-02-28 Tianyang Qi , Shibo Chen , Jun Zhang

End-to-end autonomous driving offers a streamlined alternative to the traditional modular pipeline, integrating perception, prediction, and planning within a single framework. While Deep Reinforcement Learning (DRL) has recently gained…

Artificial Intelligence · Computer Science 2024-09-27 Siyi Lu , Lei He , Shengbo Eben Li , Yugong Luo , Jianqiang Wang , Keqiang Li

Many underwater tasks, such as cable-and-wreckage inspection and search-and-rescue, can benefit from robust Human-Robot Interaction (HRI) capabilities. With the recent advancements in vision-based underwater HRI methods, Autonomous…

Robotics · Computer Science 2025-03-14 Sadman Sakib Enan , Junaed Sattar

Accurate control of autonomous marine robots still poses challenges due to the complex dynamics of the environment. In this paper, we propose a Deep Reinforcement Learning (DRL) approach to train a controller for autonomous surface vessel…

Timely delivery of delay-sensitive information over dynamic, heterogeneous networks is increasingly essential for a range of interactive applications, such as industrial automation, self-driving vehicles, and augmented reality. However,…

Networking and Internet Architecture · Computer Science 2025-10-14 Vincenzo Norman Vitale , Antonia Maria Tulino , Andreas F. Molisch , Jaime Llorca

Effective patient monitoring is vital for timely interventions and improved healthcare outcomes. Traditional monitoring systems often struggle to handle complex, dynamic environments with fluctuating vital signs, leading to delays in…

Machine Learning · Computer Science 2024-10-30 Thanveer Shaik , Xiaohui Tao , Lin Li , Haoran Xie , Hong-Ning Dai , Feng Zhao , Jianming Yong