English
Related papers

Related papers: A Twin Delayed Deep Deterministic Policy Gradient …

200 papers

While measures, such as traffic calming and advance driver assistance systems, can improve safety for Vulnerable Road Users (VRUs), their effectiveness ultimately relies on the responsible behavior of drivers and pedestrians who must adhere…

Robotics · Computer Science 2023-12-19 Erik Rua , Kazi Hasan Shakib , Sagar Dasgupta , Mizanur Rahman , Steven Jones

In this paper, a deep reinforcement learning (DRL) method is proposed to address the problem of UAV navigation in an unknown environment. However, DRL algorithms are limited by the data efficiency problem as they typically require a huge…

Robotics · Computer Science 2020-08-07 Lei He , Nabil Aouf , James F. Whidborne , Bifeng Song

This paper addresses the challenging problem of enabling reliable immersive teleoperation in scenarios where an Unmanned Aerial Vehicle (UAV) is remotely controlled by an operator via a cellular network. Such scenarios can be quite critical…

Human-Computer Interaction · Computer Science 2023-08-29 Nassim Sehad , Xinyi Tu , Akash Rajasekaran , Hamed Hellaoui , Riku Jäntti , Mérouane Debbah

The capability of UAVs for efficient autonomous navigation and obstacle avoidance in complex and unknown environments is critical for applications in agricultural irrigation, disaster relief and logistics. In this paper, we propose the DPRL…

Robotics · Computer Science 2024-12-10 Junqiao Wang , Zhongliang Yu , Dong Zhou , Jiaqi Shi , Runran Deng

Connected and automated vehicles (CAVs) are supposed to share the road with human-driven vehicles (HDVs) in a foreseeable future. Therefore, considering the mixed traffic environment is more pragmatic, as the well-planned operation of CAVs…

Systems and Control · Electrical Eng. & Systems 2024-09-05 Xishun Liao , Xuanpeng Zhao , Ziran Wang , Zhouqiao Zhao , Kyungtae Han , Rohit Gupta , Matthew J. Barth , Guoyuan Wu

This paper addresses the challenge of collision-free motion planning in automated navigation within complex environments. Utilizing advancements in Deep Reinforcement Learning (DRL) and sensor technologies like LiDAR, we propose the TD3-DWA…

Robotics · Computer Science 2024-05-27 Hao Liu , Yi Shen , Chang Zhou , Yuelin Zou , Zijun Gao , Qi Wang

Autonomous navigation in partially observable environments requires agents to reason beyond immediate sensor input, exploit occlusion, and ensure safety while progressing toward a goal. These challenges arise in many robotics domains, from…

Robotics · Computer Science 2026-04-21 Mihir Chauhan , Damon Conover , Aniket Bera

Real-world quadruped navigation is constrained by a scale mismatch between high-level navigation decisions and low-level gait execution, as well as by instabilities under out-of-distribution environmental changes. Such variations challenge…

Robotics · Computer Science 2026-03-09 Sijia Li , Haoyu Wang , Shenghai Yuan , Yizhuo Yang , Thien-Minh Nguyen

Collision-free, goal-directed navigation in environments containing unknown static and dynamic obstacles is still a great challenge, especially when manual tuning of navigation policies or costly motion prediction needs to be avoided. In…

Robotics · Computer Science 2023-03-03 Jorge de Heuvel , Weixian Shi , Xiangyu Zeng , Maren Bennewitz

With the rapidly growing expansion in the use of UAVs, the ability to autonomously navigate in varying environments and weather conditions remains a highly desirable but as-of-yet unsolved challenge. In this work, we use Deep Reinforcement…

Computer Vision and Pattern Recognition · Computer Science 2019-12-13 Bruna G. Maciel-Pearson , Letizia Marchegiani , Samet Akcay , Amir Atapour-Abarghouei , James Garforth , Toby P. Breckon

This paper presents a hierarchical path-planning and control framework that combines a high-level Deep Q-Network (DQN) for discrete sub-goal selection with a low-level Twin Delayed Deep Deterministic Policy Gradient (TD3) controller for…

Robotics · Computer Science 2025-10-31 Xiaoyi He , Danggui Chen , Zhenshuo Zhang , Zimeng Bai

In this paper, we study a digital twin (DT)-empowered integrated sensing, communication, and computation network. Specifically, the users perform radar sensing and computation offloading on the same spectrum, while unmanned aerial vehicles…

Signal Processing · Electrical Eng. & Systems 2023-10-27 Bin Li , Wenshuai Liu , Wancheng Xie , Ning Zhang , Yan Zhang

A robotic solution for the unmanned ground vehicles (UGVs) to execute the highly complex task of object manipulation in an autonomous mode is presented. This paper primarily focuses on developing an autonomous robotic system capable of…

Robotics · Computer Science 2021-12-16 Mohit Vohra , Laxmidhar Behera

In this paper, a novel, dual-mode model predictive control framework is introduced that combines the dynamic window approach to navigation with reference tracking controllers. This adds a deliberative component to the obstacle avoidance…

Systems and Control · Computer Science 2018-08-20 Greg Droge

Autonomous visual navigation is an essential element in robot autonomy. Reinforcement learning (RL) offers a promising policy training paradigm. However existing RL methods suffer from high sample complexity, poor sim-to-real transfer, and…

Robotics · Computer Science 2025-07-31 Qianzhong Chen , Jiankai Sun , Naixiang Gao , JunEn Low , Timothy Chen , Mac Schwager

This paper presents a sensor-level mapless collision avoidance algorithm for use in mobile robots that map raw sensor data to linear and angular velocities and navigate in an unknown environment without a map. An efficient training strategy…

Artificial Intelligence · Computer Science 2021-02-24 Hanlin Niu , Ze Ji , Farshad Arvin , Barry Lennox , Hujun Yin , Joaquin Carrasco

We present a target-driven navigation system to improve mapless visual navigation in indoor scenes. Our method takes a multi-view observation of a robot and a target as inputs at each time step to provide a sequence of actions that move the…

Robotics · Computer Science 2022-05-10 Qiaoyun Wu , Xiaoxi Gong , Kai Xu , Dinesh Manocha , Jingxuan Dong , Jun Wang

Perception is necessary for autonomous navigation in an unknown area crowded with obstacles. It's challenging for a robot to navigate safely without any sensors that can sense the environment, resulting in a $\textit{blind}$ robot, and…

Robotics · Computer Science 2023-10-23 Zhehan Li , Rui Mao , Nanhe Chen , Chao Xu , Fei Gao , Yanjun Cao

Integration of reinforcement learning with unmanned aerial vehicles (UAVs) to achieve autonomous flight has been an active research area in recent years. An important part focuses on obstacle detection and avoidance for UAVs navigating…

Artificial Intelligence · Computer Science 2021-03-12 Jeremy Roghair , Kyungtae Ko , Amir Ehsan Niaraki Asli , Ali Jannesari

In unseen and complex outdoor environments, collision avoidance navigation for unmanned aerial vehicle (UAV) swarms presents a challenging problem. It requires UAVs to navigate through various obstacles and complex backgrounds. Existing…

Robotics · Computer Science 2024-07-16 Jiafan Zhuang , Gaofei Han , Zihao Xia , Boxi Wang , Wenji Li , Dongliang Wang , Zhifeng Hao , Ruichu Cai , Zhun Fan