English
Related papers

Related papers: RFPPO: Motion Dynamic RRT based Fluid Field - PPO …

200 papers

We present a novel outdoor navigation algorithm to generate stable and efficient actions to navigate a robot to reach a goal. We use a multi-stage training pipeline and show that our approach produces policies that result in stable and…

Robotics · Computer Science 2022-12-07 Jing Liang , Kasun Weerakoon , Tianrui Guan , Nare Karapetyan , Dinesh Manocha

It is necessary for a mobile robot to be able to efficiently plan a path from its starting, or current, location to a desired goal location. This is a trivial task when the environment is static. However, the operational environment of the…

Robotics · Computer Science 2017-04-18 Devin Connell , Hung Manh La

Previous studies on automatic berthing systems based on artificial neural network (ANN) showed great berthing performance by training the ANN with ship berthing data as training data. However, because the ANN requires a large amount of…

Machine Learning · Computer Science 2021-12-06 Daesoo Lee

Existing multi-agent deep reinforcement learning (MADRL) methods for multi-UAV navigation face challenges in generalization, particularly when applied to unseen complex environments. To address these limitations, we propose a…

Multiagent Systems · Computer Science 2024-10-22 Anning Wei , Jintao Liang , Kaiyuan Lin , Ziyue Li , Rui Zhao

Planning in environments with moving obstacles remains a significant challenge in robotics. While many works focus on navigation and path planning in obstacle-dense spaces, traversing such congested regions is often avoidable by selecting…

Robotics · Computer Science 2025-06-23 Yaroslav Marchukov , Luis Montano

This paper introduces a new algorithm for trajectory optimization, Decoupled Reduced-space and Adaptive Feasibility-repair Trajectory Optimization (DRAFTO). It first constructs a constrained objective that accounts for smoothness, safety,…

Robotics · Computer Science 2026-03-13 Yichang Feng , Xiao Liang , Minghui Zheng

Instability and slowness are two main problems in deep reinforcement learning. Even if proximal policy optimization (PPO) is the state of the art, it still suffers from these two problems. We introduce an improved algorithm based on…

Machine Learning · Computer Science 2019-10-01 Zhenyu Zhang , Xiangfeng Luo , Tong Liu , Shaorong Xie , Jianshu Wang , Wei Wang , Yang Li , Yan Peng

Performative prediction aims to model scenarios where predictive outcomes subsequently influence the very systems they target. The pursuit of a performative optimum (PO) -- minimizing performative risk -- is generally reliant on modeling of…

Machine Learning · Computer Science 2025-02-11 Songkai Xue , Yuekai Sun

Motion planning is a crucial aspect of robot autonomy as it involves identifying a feasible motion path to a destination while taking into consideration various constraints, such as input, safety, and performance constraints, without…

Robotics · Computer Science 2023-06-14 Dengyu Zhang , Guobin Zhu , Qingrui Zhang

Proximal Policy Optimization (PPO) is a popular model-free reinforcement learning algorithm, esteemed for its simplicity and efficacy. However, due to its inherent on-policy nature, its proficiency in harnessing data from disparate policies…

Machine Learning · Computer Science 2024-06-07 Yaozhong Gan , Renye Yan , Xiaoyang Tan , Zhe Wu , Junliang Xing

Challenges in traversing dynamic clutters lie mainly in the efficient perception of the environmental dynamics and the generation of evasive behaviors considering obstacle movement. Previous solutions have made progress in explicitly…

Robotics · Computer Science 2025-12-11 Bowen Xu , Zexuan Yan , Minghao Lu , Xiyu Fan , Yi Luo , Youshen Lin , Zhiqiang Chen , Yeke Chen , Qiyuan Qiao , Peng Lu

Recent advances in trajectory replanning have enabled quadrotor to navigate autonomously in unknown environments. However, high-speed navigation still remains a significant challenge. Given very limited time, existing methods have no strong…

Robotics · Computer Science 2020-07-08 Boyu Zhou , Jie Pan , Fei Gao , Shaojie Shen

Trajectory planning for teleoperated space manipulators involves challenges such as accurately modeling system dynamics, particularly in free-floating modes with non-holonomic constraints, and managing time delays that increase model…

Robotics · Computer Science 2024-08-13 Bo Xia , Xianru Tian , Bo Yuan , Zhiheng Li , Bin Liang , Xueqian Wang

Probabilistic sampling methods have become very popular to solve single-shot path planning problems. Rapidly-exploring Random Trees (RRTs) in particular have been shown to be efficient in solving high dimensional problems. Even though…

Artificial Intelligence · Computer Science 2009-12-02 Nicolas A. Barriga , Mauricio Araya-López

Reinforcement learning (RL) has become a cornerstone for fine-tuning Large Language Models (LLMs), with Proximal Policy Optimization (PPO) serving as the de facto standard algorithm. Despite its ubiquity, we argue that the core ratio…

Machine Learning · Computer Science 2026-05-27 Penghui Qi , Xiangxin Zhou , Zichen Liu , Tianyu Pang , Chao Du , Min Lin , Wee Sun Lee

The problem of mixed static and dynamic obstacle avoidance is essential for path planning in highly dynamic environment. However, the paths formed by grid edges can be longer than the true shortest paths in the terrain since their headings…

Artificial Intelligence · Computer Science 2021-03-01 Junxiao Xue , Xiangyan Kong , Bowei Dong , Mingliang Xu

Proximal policy optimization (PPO) is one of the most successful deep reinforcement-learning methods, achieving state-of-the-art performance across a wide range of challenging tasks. However, its optimization behavior is still far from…

Machine Learning · Computer Science 2020-01-15 Yuhui Wang , Hao He , Chao Wen , Xiaoyang Tan

Ground robots navigating in complex, dynamic environments must compute collision-free trajectories to avoid obstacles safely and efficiently. Nonconvex optimization is a popular method to compute a trajectory in real-time. However, these…

Robotics · Computer Science 2024-10-07 Oscar de Groot , Laura Ferranti , Dariu M. Gavrila , Javier Alonso-Mora

Motivated by the problem of pursuit-evasion, we present a motion planning framework that combines energy-based diffusion models with artificial potential fields for robust real time trajectory generation in complex environments. Our…

Robotics · Computer Science 2025-10-17 Wondmgezahu Teshome , Kian Behzad , Octavia Camps , Michael Everett , Milad Siami , Mario Sznaier

The conventional Artificial Potential Field (APF) is fundamentally limited by the local minima issue and its inability to account for the kinematics of moving obstacles. This paper addresses the critical challenge of autonomous collision…

Systems and Control · Electrical Eng. & Systems 2025-12-10 Nikita Vaibhav Pavle , Shrreya Rajneesh , Rakesh Kumar Sahoo , Manoranjan Sinha