English
Related papers

Related papers: A Twin Delayed Deep Deterministic Policy Gradient …

200 papers

In the face of growing urban populations and the escalating number of vehicles on the roads, managing transportation efficiently and ensuring safety have become critical challenges. To tackle these issues, the development of intelligent…

Machine Learning · Computer Science 2023-08-08 Badr Ben Elallid , Amine Abouaomar , Nabil Benamar , Abdellatif Kobbane

In this paper, a novel deep reinforcement learning (DRL)-based method is proposed to navigate the robot team through unknown complex environments, where the geometric centroid of the robot team aims to reach the goal position while avoiding…

Robotics · Computer Science 2019-07-04 Juntong Lin , Xuyun Yang , Peiwei Zheng , Hui Cheng

Unmanned Surface Vehicles technology (USVs) is an exciting topic that essentially deploys an algorithm to safely and efficiently performs a mission. Although reinforcement learning is a well-known approach to modeling such a task,…

Machine Learning · Computer Science 2020-03-24 Mohammad Etemad , Nader Zare , Mahtab Sarvmaili , Amilcar Soares , Bruno Brandoli Machado , Stan Matwin

Traditional decision and planning frameworks for self-driving vehicles (SDVs) scale poorly in new scenarios, thus they require tedious hand-tuning of rules and parameters to maintain acceptable performance in all foreseeable cases.…

Robotics · Computer Science 2021-08-02 Peide Cai , Hengli Wang , Yuxiang Sun , Ming Liu

Visual navigation is essential for many applications in robotics, from manipulation, through mobile robotics to automated driving. Deep reinforcement learning (DRL) provides an elegant map-free approach integrating image processing,…

Robotics · Computer Science 2020-10-22 Jonáš Kulhánek , Erik Derner , Robert Babuška

The concept of a digital twin (DT) plays a pivotal role in the ongoing digital transformation and has achieved significant strides for various wireless applications in recent years. In particular, the field of autonomous vehicles is a…

Networking and Internet Architecture · Computer Science 2024-01-18 Kui Wang , Tao Yu , Zongdian Li , Kei Sakaguchi , Omar Hashash , Walid Saad

Efficient navigation in dynamic environments is crucial for autonomous robots interacting with moving agents and static obstacles. We present a novel deep reinforcement learning approach that improves robot navigation and interaction with…

Robotics · Computer Science 2025-09-30 Yury Kolomeytsev , Dmitry Golembiovsky

Unsignalized intersections pose safety and efficiency challenges due to complex traffic flows and blind spots. In this paper, a digital twin (DT)-based cooperative driving system with roadside unit (RSU)-centric architecture is proposed for…

Systems and Control · Electrical Eng. & Systems 2025-09-19 Taoyuan Yu , Kui Wang , Zongdian Li , Tao Yu , Kei Sakaguchi , Walid Saad

Unmanned aerial vehicles (UAVs) are emerging as key enablers for low-altitude wireless network (LAWN), particularly when terrestrial networks are unavailable. In such scenarios, the environmental topology is typically unknown; hence,…

Signal Processing · Electrical Eng. & Systems 2025-10-29 Jihao Luo , Zesong Fei , Xinyi Wang , Le Zhao , Yuanhao Cui , Guangxu Zhu , Dusit Niyato

This paper presents the first end-to-end framework that combines guidance, navigation, and centralised task allocation for multiple UAVs performing autonomous search-and-rescue (SAR) in GNSS-denied indoor environments. A Twin Delayed Deep…

Robotics · Computer Science 2026-02-17 Thomas Hickling , Maxwell Hogan , Abdulla Tammam , Nabil Aouf

Collaborative heterogeneous robot systems can greatly improve the efficiency of target search and navigation tasks. In this paper, we design a heterogeneous robot system consisting of a UAV and a UGV for search and rescue missions in…

Robotics · Computer Science 2024-05-21 Yun Chen , Jiaping Xiao

Efficient and reliable UAV navigation in cluttered and dynamic environments remains challenging. We propose SWIFT-Nav: Stability-aware Waypoint-level Integration of Fuzzy arbitration and TD3 for Navigation, a TD3-based navigation framework…

Robotics · Computer Science 2025-12-19 Shuaidong Ji , Mahdi Bamdad , Francisco Cruz

The vehicular metaverse is envisioned as a blended immersive domain that promises to bring revolutionary changes to the automotive industry. As a core component of vehicular metaverses, Vehicle Twins (VTs) are digital twins that cover the…

Artificial Intelligence · Computer Science 2025-05-06 Yingkai Kang , Jinbo Wen , Jiawen Kang , Tao Zhang , Hongyang Du , Dusit Niyato , Rong Yu , Shengli Xie

We present methods and applications for the development of digital twins (DT) for urban traffic management. While the majority of studies on the DT focus on its ``eyes," which is the emerging sensing and perception like object detection and…

Systems and Control · Electrical Eng. & Systems 2026-02-05 Yongjie Fu , Mehmet K. Turkcan , Mahshid Ghasemi , Zhaobin Mo , Chengbo Zang , Abhishek Adhikari , Zoran Kostic , Gil Zussman , Xuan Di

In recent years, learning-based approaches have demonstrated significant promise in addressing intricate navigation tasks. Traditional methods for training deep neural network navigation policies rely on meticulously designed reward…

Robotics · Computer Science 2023-12-01 Wenzhe Cai , Teng Wang , Guangran Cheng , Lele Xu , Changyin Sun

Autonomous Ground Vehicles (AGVs) are essential tools for a wide range of applications stemming from their ability to operate in hazardous environments with minimal human operator input. Effective motion planning is paramount for successful…

Robotics · Computer Science 2023-09-04 Shathushan Sivashangaran , Azim Eskandarian

Digital twins (DTs) have driven major advancements across various industrial domains over the past two decades. With the rapid advancements in autonomous driving and vehicle-to-everything (V2X) technologies, integrating DTs into vehicular…

Systems and Control · Electrical Eng. & Systems 2024-02-21 Kui Wang , Zongdian Li , Kazuma Nonomura , Tao Yu , Kei Sakaguchi , Omar Hashash , Walid Saad

Vehicle-road collaboration is a promising approach for enhancing the safety and efficiency of autonomous driving by extending the intelligence of onboard systems to smart roadside infrastructures. The introduction of digital twins (DTs),…

Systems and Control · Electrical Eng. & Systems 2024-10-21 Kui Wang , Kazuma Nonomura , Zongdian Li , Tao Yu , Kei Sakaguchi , Omar Hashash , Walid Saad , Changyang She , Yonghui Li

Road inspection is crucial for maintaining road serviceability and ensuring traffic safety, as road defects gradually develop and compromise functionality. Traditional inspection methods, which rely on manual evaluations, are…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Yikang Zhang , Chuang-Wei Liu , Jiahang Li , Yingbing Chen , Jie Cheng , Rui Fan

To implement the intelligent transportation digital twin (ITDT), unmanned aerial vehicles (UAVs) are scheduled to process the sensing data from the roadside sensors. At this time, generative artificial intelligence (GAI) technologies such…

Machine Learning · Computer Science 2026-04-10 Xiaohuan Li , Junchuan Fan , Bingqi Zhang , Rong Yu , Xumin Huang , Qian Chen