English
Related papers

Related papers: RFPPO: Motion Dynamic RRT based Fluid Field - PPO …

200 papers

In this paper, an algorithm for Unmanned Aircraft Systems Traffic Management (UTM) for a finite number of unmanned aerial vehicles (UAVs) is proposed. This algorithm is developed by combining the Rapidly-Exploring Random Trees (RRT) and…

Robotics · Computer Science 2023-03-01 Himanshu , Jinraj V Pushpangathan , Harikumar Kandath

Reaching tasks with random targets and obstacles is a challenging task for robotic manipulators. In this study, we propose a novel model-free reinforcement learning approach based on proximal policy optimization (PPO) for training a deep…

Robotics · Computer Science 2023-02-10 Yongliang Wang , Hamidreza Kasaei

Safe UAV navigation is challenging due to the complex environment structures, dynamic obstacles, and uncertainties from measurement noises and unpredictable moving obstacle behaviors. Although plenty of recent works achieve safe navigation…

Robotics · Computer Science 2022-03-15 Zhefan Xu , Di Deng , Yiping Dong , Kenji Shimada

Collision-free mobile robot navigation is an important problem for many robotics applications, especially in cluttered environments. In such environments, obstacles can be static or dynamic. Dynamic obstacles can additionally be…

Robotics · Computer Science 2023-02-28 Baskın Şenbaşlar , Gaurav S. Sukhatme

Optical computing holds promise for high-speed, energy-efficient information processing, with diffractive optical networks emerging as a flexible platform for implementing task-specific transformations. A challenge, however, is the…

Machine Learning · Computer Science 2026-01-05 Yuhang Li , Shiqi Chen , Tingyu Gong , Aydogan Ozcan

Despite extensive developments in motion planning of autonomous aerial vehicles (AAVs), existing frameworks faces the challenges of local minima and deadlock in complex dynamic environments, leading to increased collision risks. To address…

Robotics · Computer Science 2026-05-29 Junzhi Li , Teng Long , Jingliang Sun , Jianxin Zhong

The navigation of robots in dynamic urban environments, requires elaborated anticipative strategies for the robot to avoid collisions with dynamic objects, like bicycles or pedestrians, and to be human aware. We have developed and analyzed…

Robotics · Computer Science 2022-10-18 Óscar Gil , Alberto Sanfeliu

Fixed-wing Unmanned Aerial Vehicles (UAVs) are one of the most commonly used platforms for the burgeoning Low-altitude Economy (LAE) and Urban Air Mobility (UAM), due to their long endurance and high-speed capabilities. Classical obstacle…

Robotics · Computer Science 2024-11-28 Haochen Chai , Meimei Su , Yang Lyu , Zhunga Liu , Chunhui Zhao , Quan Pan

Autonomous navigation in underwater environments remains a major challenge due to the absence of GPS, degraded visibility, and the presence of submerged obstacles. This article investigates these issues through the case of the BlueROV2, an…

Machine Learning · Computer Science 2025-12-12 Zamirddine Mari , Mohamad Motasem Nawaf , Pierre Drap

Continuum robots, characterized by their high flexibility and infinite degrees of freedom (DoFs), have gained prominence in applications such as minimally invasive surgery and hazardous environment exploration. However, the intrinsic…

Robotics · Computer Science 2023-09-26 Peiyu Luo , Shilong Yao , Yiyao Yue , Jiankun Wang , Hong Yan , Max Q. -H. Meng

Autonomous robot person-following (RPF) systems are crucial for personal assistance and security but suffer from target loss due to occlusions in dynamic, unknown environments. Current methods rely on pre-built maps and assume static…

Robotics · Computer Science 2025-07-14 Hanjing Ye , Kuanqi Cai , Yu Zhan , Bingyi Xia , Arash Ajoudani , Hong Zhang

Trust region policy optimization (TRPO) is a popular and empirically successful policy search algorithm in Reinforcement Learning (RL) in which a surrogate problem, that restricts consecutive policies to be 'close' to one another, is…

Machine Learning · Computer Science 2019-12-13 Lior Shani , Yonathan Efroni , Shie Mannor

Autonomous systems, including robots and drones, face significant challenges when navigating through dynamic environments, particularly within urban settings where obstacles, fluctuating traffic, and pedestrian activity are constantly…

Robotics · Computer Science 2024-11-20 Daniel Ajeleye

The unmanned aerial vehicle (UAV)-enabled communication technology is regarded as an efficient and effective solution for some special application scenarios where existing terrestrial infrastructures are overloaded to provide reliable…

Networking and Internet Architecture · Computer Science 2022-09-20 Jinjing Wang , Xindi Wang

High-Altitude Platform Stations (HAPS) offer a promising solution for wide-area wireless coverage in maritime regions lacking terrestrial infrastructure. However, maintaining reliable performance is challenging due to dynamic ship mobility…

Signal Processing · Electrical Eng. & Systems 2026-05-08 Azim Akhtarshenas , German Svistunov , Matteo Bernabè , Kuangyu Zheng , David López-Pérez

Trust Region Policy Optimization (TRPO) and Proximal Policy Optimization (PPO) are among the most successful policy gradient approaches in deep reinforcement learning (RL). While these methods achieve state-of-the-art performance across a…

Machine Learning · Computer Science 2020-06-22 Ahmed Touati , Amy Zhang , Joelle Pineau , Pascal Vincent

Deep reinforcement learning (DRL) is one of the promising approaches for introducing robots into complicated environments. The recent remarkable progress of DRL stands on regularization of policy, which allows the policy to improve stably…

Machine Learning · Computer Science 2023-07-04 Taisuke Kobayashi

This work considers a Motion Planning Problem with Dynamic Obstacles (MPDO) in 2D that requires finding a minimum-arrival-time collision-free trajectory for a point robot between its start and goal locations amid dynamic obstacles moving…

Robotics · Computer Science 2022-06-03 Zhongqiang Ren , Sivakumar Rathinam , Howie Choset

Any industrial system goes along with objectives to be met (e.g. economic performance), disturbances to handle (e.g. market fluctuations, catalyst decay, unexpected variations in uncontrolled flow rates and compositions,...), and…

Optimization and Control · Mathematics 2021-08-20 Aris Papasavvas

This paper considers a trajectory planning problem for a robot navigating complex terrains, which arises in applications ranging from autonomous mining vehicles to planetary rovers. The problem seeks to find a low-cost dynamically feasible…

Robotics · Computer Science 2024-07-04 Yilin Cai , Zhongqiang Ren