English
Related papers

Related papers: A Twin Delayed Deep Deterministic Policy Gradient …

200 papers

An unmanned surface vehicle (USV) can perform complex missions by continuously observing the state of its surroundings and taking action toward a goal. A SWARM of USVs working together can complete missions faster, and more effectively than…

Robotics · Computer Science 2024-09-02 Shrudhi R S , Sreyash Mohanty , Susan Elias

The objective of this study is to develop a model-free workspace trajectory planner for space manipulators using a Twin Delayed Deep Deterministic Policy Gradient (TD3) agent to enable safe and reliable debris capture. A local control…

Robotics · Computer Science 2025-10-09 Vincent Lam , Robin Chhabra

Visual imitation learning frameworks allow robots to learn manipulation skills from expert demonstrations. While existing approaches mainly focus on policy design, they often neglect the structure and capacity of visual encoders, limiting…

Robotics · Computer Science 2025-09-24 Shijia Ge , Yinxin Zhang , Shuzhao Xie , Weixiang Zhang , Mingcai Zhou , Zhi Wang

This work focuses on the problem of visual target navigation, which is very important for autonomous robots as it is closely related to high-level tasks. To find a special object in unknown environments, classical and learning-based…

Robotics · Computer Science 2023-12-27 Bangguo Yu , Hamidreza Kasaei , Ming Cao

Reach-Avoid-Stay (RAS) optimal control enables systems such as robots and air taxis to reach their targets, avoid obstacles, and stay near the target. However, current methods for RAS often struggle with handling complex, dynamic…

Systems and Control · Electrical Eng. & Systems 2024-10-10 Gabriel Chenevert , Jingqi Li , Achyuta kannan , Sangjae Bae , Donggun Lee

Sim-to-real gap has long posed a significant challenge for robot learning in simulation, preventing the deployment of learned models in the real world. Previous work has primarily focused on domain randomization and system identification to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Ziyang Xie , Zhizheng Liu , Zhenghao Peng , Wayne Wu , Bolei Zhou

Autonomous navigation of terrestrial robots using Reinforcement Learning (RL) from LIDAR observations remains challenging due to the high dimensionality of sensor data and the sample inefficiency of model-free approaches. Conventional…

One of the challenges faced by Autonomous Aerial Vehicles is reliable navigation through urban environments. Factors like reduction in precision of Global Positioning System (GPS), narrow spaces and dynamically moving obstacles make the…

Robotics · Computer Science 2025-12-16 Nishant Doshi , Amey Sutavani , Sanket Gujar

Urban congestion at signalized intersections leads to significant delays, economic losses, and increased emissions. Existing deep learning models often lack spatial generalizability, rely on complex architectures, and struggle with…

Machine Learning · Computer Science 2025-05-16 Nooshin Yousefzadeh , Rahul Sengupta , Jeremy Dilmore , Sanjay Ranka

Teams of UGVs patrolling harsh and complex 3D environments can experience interference and spatial conflicts with one another. Neglecting the occurrence of these events crucially hinders both soundness and reliability of a patrolling…

Robotics · Computer Science 2019-06-25 Luigi Freda , Mario Gianni , Fiora Pirri , Abel Gawel , Renaud Dube , Roland Siegwart , Cesar Cadena

The technological and scientific challenges involved in the development of autonomous vehicles (AVs) are currently of primary interest for many automobile companies and research labs. However, human-controlled vehicles are likely to remain…

Machine Learning · Computer Science 2020-06-22 Ran Emuna , Avinoam Borowsky , Armin Biess

Collision-free motion is essential for mobile robots. Most approaches to collision-free and efficient navigation with wheeled robots require parameter tuning by experts to obtain good navigation behavior. This study investigates the…

Robotics · Computer Science 2024-08-08 Hamid Taheri , Seyed Rasoul Hosseini , Mohammad Ali Nekoui

This work presents a novel data-driven multi-layered planning and control framework for the safe navigation of a class of unmanned ground vehicles (UGVs) in the presence of unknown stationary obstacles and additive modeling uncertainties.…

Robotics · Computer Science 2024-03-06 Skylar X. Wei , Lu Gan , Joel W. Burdick

Autonomous system navigation is a well-researched and evolving field. Recent advancements in improving robot navigation have sparked increased interest among researchers and practitioners, especially in the use of sensing data. However,…

Networking and Internet Architecture · Computer Science 2024-11-20 Sunday Amatare , Gaurav Singh , Raul Shakya , Aavash Kharel , Ahmed Alkhateeb , Debashri Roy

Autonomous vehicle platforms of varying spatial scales are employed within the research and development spectrum based on space, safety and monetary constraints. However, deploying and validating autonomy algorithms across varying…

Robotics · Computer Science 2024-10-22 Tanmay Vilas Samak , Chinmay Vilas Samak , Venkat Narayan Krovi

This paper proposes a distributed guiding-vector-field (DGVF) controller for cross-domain unmanned systems (CDUSs) consisting of heterogeneous unmanned aerial vehicles (UAVs) and unmanned surface vehicles (USVs), to achieve coordinated…

Robotics · Computer Science 2023-12-19 Bin-Bin Hu , Hai-Tao Zhang , Bin Liu , Jianing Ding , Yifan Xu , Chuanshang Luo , Haosen Cao

Mobile robots operating in crowded environments require the ability to navigate among humans and surrounding obstacles efficiently while adhering to safety standards and socially compliant mannerisms. This scale of the robot navigation…

Robotics · Computer Science 2025-08-15 Yung Chuen Ng , Qi Wen Shervina Lim , Chun Ye Tan , Zhen Hao Gan , Meng Yee Michael Chuah

While deep reinforcement learning (RL) methods have achieved unprecedented successes in a range of challenging problems, their applicability has been mainly limited to simulation or game domains due to the high sample complexity of the…

Artificial Intelligence · Computer Science 2017-09-26 Siyi Li , Tianbo Liu , Chi Zhang , Dit-Yan Yeung , Shaojie Shen

Autonomous navigation in underwater environments remains a major challenge due to the absence of GPS, degraded visibility, and the presence of submerged obstacles. This article investigates these issues through the case of the BlueROV2, an…

Machine Learning · Computer Science 2025-12-12 Zamirddine Mari , Mohamad Motasem Nawaf , Pierre Drap

Cooperation of automated vehicles (AVs) can improve safety, efficiency and comfort in traffic. Digital twins of Cooperative Intelligent Transport Systems (C-ITS) play an important role in monitoring, managing and improving traffic.…

Robotics · Computer Science 2023-08-24 Raphael van Kempen , Laurenz Adrian Heidrich , Bastian Lampe , Timo Woopen , Lutz Eckstein