English
Related papers

Related papers: A Twin Delayed Deep Deterministic Policy Gradient …

200 papers

Unmanned Surface Vehicles (USVs) are pivotal in marine exploration, but their sensors' accuracy is compromised by the dynamic marine environment. Traditional calibration methods fall short in these conditions. This paper introduces a deep…

Robotics · Computer Science 2024-06-10 Yi Shen , Hao Liu , Chang Zhou , Wentao Wang , Zijun Gao , Qi Wang

High-speed, low-latency obstacle avoidance that is insensitive to sensor noise is essential for enabling multiple decentralized robots to function reliably in cluttered and dynamic environments. While other distributed multi-agent collision…

Artificial Intelligence · Computer Science 2017-07-07 Pinxin Long , Wenxi Liu , Jia Pan

This paper deploys the Deep Deterministic Policy Gradient (DDPG) algorithm for longitudinal and lateral control of a simulated car to solve a path following task. The DDPG agent was implemented using PyTorch and trained and evaluated on a…

Robotics · Computer Science 2021-04-14 Georg Hess , William Ljungbergh

In the vehicular mixed reality (MR) Metaverse, the distance between physical and virtual entities can be overcome by fusing the physical and virtual environments with multi-dimensional communications in autonomous driving systems. Assisted…

Artificial Intelligence · Computer Science 2023-02-17 Minrui Xu , Dusit Niyato , Junlong Chen , Hongliang Zhang , Jiawen Kang , Zehui Xiong , Shiwen Mao , Zhu Han

We present a novel system, AdVENTR for autonomous robot navigation in unstructured outdoor environments that consist of uneven and vegetated terrains. Our approach is general and can enable both wheeled and legged robots to handle outdoor…

Robotics · Computer Science 2023-11-16 Kasun Weerakoon , Adarsh Jagan Sathyamoorthy , Mohamed Elnoor , Dinesh Manocha

Deep Reinforcement Learning (Deep-RL) techniques for motion control have been continuously used to deal with decision-making problems for a wide variety of robots. Previous works showed that Deep-RL can be applied to perform mapless…

In this paper, we investigate an unmanned aerial vehicle (UAV)-assisted Internet-of-Things (IoT) system in a sophisticated three-dimensional (3D) environment, where the UAV's trajectory is optimized to efficiently collect data from multiple…

Information Theory · Computer Science 2022-01-20 Yang Wang , Zhen Gao , Jun Zhang , Xianbin Cao , Dezhi Zheng , Yue Gao , Derrick Wing Kwan Ng , Marco Di Renzo

Trajectory prediction is crucial for autonomous driving, enabling vehicles to navigate safely by anticipating the movements of surrounding road users. However, current deep learning models often lack trustworthiness as their predictions can…

Heading towards navigational autonomy in unmanned surface vehicles (USVs) in the maritime sector can fundamentally lead towards safer waters as well as reduced operating costs, while also providing a range of exciting new capabilities for…

Robotics · Computer Science 2023-07-14 Andrew Alexander Vekinis , Stavros Perantonis

An autonomous vessel (AV) is a complex cyber-physical system (CPS) with software enabling many key functionalities, e.g., navigation software enables an AV to autonomously or semi-autonomously follow a path to its destination. Digital twins…

Robotics · Computer Science 2025-10-16 Erblin Isaku , Hassan Sartaj , Shaukat Ali

The evolution and growing automation of collaborative robots introduce more complexity and unpredictability to systems, highlighting the crucial need for robot's adaptability and flexibility to address the increasing complexities of their…

Robotics · Computer Science 2024-03-21 Yuzhu Sun , Mien Van , Stephen McIlvanna , Nguyen Minh Nhat , Kabirat Olayemi , Jack Close , Seán McLoone

The challenge of traversability estimation is a crucial aspect of autonomous navigation in unstructured outdoor environments such as forests. It involves determining whether certain areas are passable or risky for robots, taking into…

Robotics · Computer Science 2025-01-14 Fetullah Atas , Grzegorz Cielniak , Lars Grimstad

Autonomous UAV navigation using reinforcement learning (RL) is vulnerable to adversarial attacks that manipulate sensor inputs, potentially leading to unsafe behavior and mission failure. Although robust RL methods provide partial…

Machine Learning · Computer Science 2025-12-16 Deepak Kumar Panda , Weisi Guo

Deep Reinforcement Learning (DRL) offers a robust alternative to traditional control methods for autonomous underwater docking, particularly in adapting to unpredictable environmental conditions. However, bridging the "sim-to-real" gap and…

Robotics · Computer Science 2026-03-13 Alaaeddine Chaarani , Narcis Palomeras , Pere Ridao

Traffic accident anticipation aims to accurately and promptly predict the occurrence of a future accident from dashcam videos, which is vital for a safety-guaranteed self-driving system. To encourage an early and accurate decision, existing…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Wentao Bao , Qi Yu , Yu Kong

Unmanned Aerial Vehicles (UAVs) offer significant potential in dynamic, perception-intensive tasks such as search and rescue and environmental monitoring; however, their effectiveness is severely restricted by conventional pre-planned…

Multiagent Systems · Computer Science 2025-04-16 Yuhan Hu , Yirong Sun , Yanjun Chen , Xinghao Chen , Xiaoyu Shen , Wei Zhang

For highly automated driving above SAE level~3, behavior generation algorithms must reliably consider the inherent uncertainties of the traffic environment, e.g. arising from the variety of human driving styles. Such uncertainties can…

Artificial Intelligence · Computer Science 2021-02-08 Julian Bernhard , Stefan Pollok , Alois Knoll

Path planning is crucial for the navigation of autonomous vehicles, yet these vehicles face challenges in complex and real-world environments. Although a global view may be provided, it is often outdated, necessitating the reliance of…

Robotics · Computer Science 2025-05-21 Seung Hun Lee , Wonse Jo , Lionel P. Robert , Dawn M. Tilbury

In this article, we explore the feasibility of applying proximal policy optimization, a state-of-the-art deep reinforcement learning algorithm for continuous control tasks, on the dual-objective problem of controlling an underactuated…

Machine Learning · Computer Science 2019-12-20 Eivind Meyer , Haakon Robinson , Adil Rasheed , Omer San

This paper presents Deep-PANTHER, a learning-based perception-aware trajectory planner for unmanned aerial vehicles (UAVs) in dynamic environments. Given the current state of the UAV, and the predicted trajectory and size of the obstacle,…

Robotics · Computer Science 2023-02-15 Jesus Tordesillas , Jonathan P. How