中文
相关论文

相关论文: RFPPO: Motion Dynamic RRT based Fluid Field - PPO …

200 篇论文

We study reinforcement learning in hybrid discrete-continuous action spaces, such as settings where the discrete component selects a regime (or index) and the continuous component optimizes within it -- a structure common in robotics,…

机器学习 · 计算机科学 2026-05-15 Matias Alvo , Daniel Russo , Yash Kanoria

On-policy deep reinforcement learning algorithms have low data utilization and require significant experience for policy improvement. This paper proposes a proximal policy optimization algorithm with prioritized trajectory replay (PTR-PPO)…

机器学习 · 计算机科学 2021-12-09 Xingxing Liang , Yang Ma , Yanghe Feng , Zhong Liu

Proximal policy optimization (PPO) has yielded state-of-the-art results in policy search, a subfield of reinforcement learning, with one of its key points being the use of a surrogate objective function to restrict the step size at each…

机器学习 · 计算机科学 2020-12-07 Wangshu Zhu , Andre Rosendo

Model-free reinforcement learning algorithms have seen remarkable progress, but key challenges remain. Trust Region Policy Optimization (TRPO) is known for ensuring monotonic policy improvement through conservative updates within a trust…

机器学习 · 计算机科学 2025-07-29 Zhengpeng Xie , Qiang Zhang , Fan Yang , Marco Hutter , Renjing Xu

As mini UAVs become increasingly useful in the civilian work domain, the need for a method for them to operate safely in a cluttered environment is growing, especially for fixed-wing UAVs as they are incapable of following the…

机器人学 · 计算机科学 2024-04-24 Astik Srivastava , P. B. Sujit

Local navigation in cluttered environments often suffers from dense obstacles and frequent local minima. Conventional local planners rely on heuristics and are prone to failure, while deep reinforcement learning(DRL)based approaches provide…

机器人学 · 计算机科学 2026-03-18 Jiwon Park , Dongkyu Lee , I Made Aswin Nahrendra , Jaeyoung Lim , Hyun Myung

Reactive trajectory optimization for robotics presents formidable challenges, demanding the rapid generation of purposeful robot motion in complex and swiftly changing dynamic environments. While much existing research predominantly…

机器人学 · 计算机科学 2023-10-04 Apan Dastider , Hao Fang , Mingjie Lin

Diffusion models exhibit impressive scalability in robotic task learning, yet they struggle to adapt to novel, highly dynamic environments. This limitation primarily stems from their constrained replanning ability: they either operate at a…

机器人学 · 计算机科学 2025-07-16 Xi Ye , Rui Heng Yang , Jun Jin , Yinchuan Li , Amir Rasouli

Proximal Policy Optimization (PPO) is a highly popular model-free reinforcement learning (RL) approach. However, we observe that in a continuous action space, PPO can prematurely shrink the exploration variance, which leads to slow progress…

机器学习 · 计算机科学 2020-11-04 Perttu Hämäläinen , Amin Babadi , Xiaoxiao Ma , Jaakko Lehtinen

In this paper, we investigate the obstacle avoidance and navigation problem in the robotic control area. For solving such a problem, we propose revised Deep Deterministic Policy Gradient (DDPG) and Proximal Policy Optimization algorithms…

机器人学 · 计算机科学 2020-04-13 Daniel Zhang , Colleen P. Bailey

Robots have become increasingly prevalent in dynamic and crowded environments such as airports and shopping malls. In these scenarios, the critical challenges for robot navigation are reliability and timely arrival at predetermined…

机器人学 · 计算机科学 2023-09-21 Zhirui Sun , Boshu Lei , Peijia Xie , Fugang Liu , Junjie Gao , Ying Zhang , Jiankun Wang

Proximal Policy Optimization (PPO) has been broadly applied to robotics learning, showcasing stable training performance. However, the fixed clipping bound setting may limit the performance of PPO. Specifically, there is no theoretical…

机器学习 · 计算机科学 2024-11-07 Ziqi Zhang , Jingzehua Xu , Zifeng Zhuang , Hongyin Zhang , Jinxin Liu , Donglin wang , Shuai Zhang

Deep reinforcement learning (DRL) finds extensive application in autonomous drone navigation within complex, high-risk environments. However, its practical deployment faces a safety-exploration dilemma: soft penalty mechanisms encourage…

机器人学 · 计算机科学 2026-05-04 Wentao Chen , Jingtang Chen , Mingjian Fu , Tiantian Li , Youfeng Su , Wenxi Liu , Yuanlong Yu

Contemporary autopilot systems for unmanned aerial vehicles (UAVs) are far more limited in their flight envelope as compared to experienced human pilots, thereby restricting the conditions UAVs can operate in and the types of missions they…

机器人学 · 计算机科学 2019-11-14 Eivind Bøhn , Erlend M. Coates , Signe Moe , Tor Arne Johansen

Flow-field reconstruction from sparse sensor measurements remains a central challenge in modern fluid dynamics, as the need for high-fidelity data often conflicts with practical limits on sensor deployment. Existing deep learning-based…

计算工程、金融与科学 · 计算机科学 2026-05-15 Ruoyan Li , Guancheng Wan , Zijie Huang , Zixiao Liu , Haixin Wang , Xiao Luo , Wei Wang , Yizhou Sun

Cooperative path-finding in multi-agent systems demands scalable solutions to navigate agents from their origins to destinations without conflict. Despite the breadth of research, scalability remains hampered by increased computational…

多智能体系统 · 计算机科学 2024-07-30 Jinmingwu Jiang , Kaigui Wu , Haiyang Liu , Ren Zhang , Jingxin Liu , Yong He , Xipeng Kou

Safe flight in dynamic environments requires unmanned aerial vehicles (UAVs) to make effective decisions when navigating cluttered spaces with moving obstacles. Traditional approaches often decompose decision-making into hierarchical…

机器人学 · 计算机科学 2025-02-25 Zhefan Xu , Xinming Han , Haoyu Shen , Hanyu Jin , Kenji Shimada

When, in addition to stability, position synchronization is also desired in bilateral teleoperation, Time Domain Passivity Approach (TDPA) alone might not be able to fulfill the desired objective. This is due to an undesired effect caused…

机器人学 · 计算机科学 2020-02-12 Andre Coelho , Christian Ott , Harsimran Singh , Fernando Lizarralde , Konstantin Kondak

Due to the strong nonlinearity and nonholonomic dynamics, despite the various general trajectory optimization methods presented, few of them can guarantee efficient computation and physical feasibility for relatively complicated fixed-wing…

机器人学 · 计算机科学 2025-04-10 Junzhi Li , Jingliang Sun , Teng Long , Zhenlin Zhou

This paper presents a robust computationally efficient real-time collision avoidance algorithm for Unmanned Aerial Vehicle (UAV), namely Memory-based Wall Following-Artificial Potential Field (MWF-APF) method. The new algorithm switches…

机器人学 · 计算机科学 2021-02-09 Han Wang , Muqing Cao , Hao Jiang , Lihua Xie