中文
相关论文

相关论文: Beyond PID Controllers: PPO with Neuralized PID Po…

200 篇论文

In this thesis, advanced design technique in sliding mode control (SMC) is presented with focus on PID (Proportional-Integral-Derivative) type Sliding surfaces based Sliding mode control with improved power rate exponential reaching law for…

系统与控制 · 电气工程与系统科学 2022-07-25 Kirtiman Singh

Reinforcement learning (RL) is a promising tool to solve robust optimal well control problems where the model parameters are highly uncertain, and the system is partially observable in practice. However, RL of robust control policies often…

机器学习 · 计算机科学 2022-07-14 Atish Dixit , Ahmed H. ElSheikh

Proximal policy optimization (PPO) algorithm is a deep reinforcement learning algorithm with outstanding performance, especially in continuous control tasks. But the performance of this method is still affected by its exploration ability.…

机器学习 · 计算机科学 2020-11-12 Junwei Zhang , Zhenghao Zhang , Shuai Han , Shuai Lü

Proximal Policy Optimization (PPO) has been broadly applied to robotics learning, showcasing stable training performance. However, the fixed clipping bound setting may limit the performance of PPO. Specifically, there is no theoretical…

机器学习 · 计算机科学 2024-11-07 Ziqi Zhang , Jingzehua Xu , Zifeng Zhuang , Hongyin Zhang , Jinxin Liu , Donglin wang , Shuai Zhang

Proximal policy optimization(PPO) has been proposed as a first-order optimization method for reinforcement learning. We should notice that an exterior penalty method is used in it. Often, the minimizers of the exterior penalty functions…

机器学习 · 计算机科学 2018-12-18 Cheng Zeng , Hongming Zhang

Proximal Policy Optimization (PPO) is a popular deep policy gradient algorithm. In standard implementations, PPO regularizes policy updates with clipped probability ratios, and parameterizes policies with either continuous Gaussian…

机器学习 · 计算机科学 2020-09-24 Chloe Ching-Yun Hsu , Celestine Mendler-Dünner , Moritz Hardt

We introduce Proximal Policy Distillation (PPD), a novel policy distillation method that integrates student-driven distillation and Proximal Policy Optimization (PPO) to increase sample efficiency and to leverage the additional rewards that…

机器学习 · 计算机科学 2026-05-11 Giacomo Spigler

Flow-field reconstruction from sparse sensor measurements remains a central challenge in modern fluid dynamics, as the need for high-fidelity data often conflicts with practical limits on sensor deployment. Existing deep learning-based…

计算工程、金融与科学 · 计算机科学 2026-05-15 Ruoyan Li , Guancheng Wan , Zijie Huang , Zixiao Liu , Haixin Wang , Xiao Luo , Wei Wang , Yizhou Sun

We propose a new sample-efficient methodology, called Supervised Policy Update (SPU), for deep reinforcement learning. Starting with data generated by the current policy, SPU formulates and solves a constrained optimization problem in the…

机器学习 · 计算机科学 2018-12-27 Quan Vuong , Yiming Zhang , Keith W. Ross

Unmanned aerial vehicles (UAVs) are seen as a promising technology to perform a wide range of tasks in wireless communication networks. In this work, we consider the deployment of a group of UAVs to collect the data generated by IoT…

最优化与控制 · 数学 2023-03-16 Mouhamed Naby Ndiaye , El Houcine Bergou , Hajar El Hammouti

The aim of this research is to design a PID Controller using particle swarm optimization (PSO) algorithm for multiple-input multiple output (MIMO) Takagi-Sugeno fuzzy model. The conventional gain tuning of PID controller (such as…

系统与控制 · 计算机科学 2013-06-27 Adel Taeib , Ali Ltaeif , Abdelkader Chaari

This paper tackles the growing issue of excessive data transmission in networks. With increasing traffic, backhaul links and core networks are under significant traffic, leading to the investigation of caching solutions at edge routers.…

网络与互联网体系结构 · 计算机科学 2024-10-31 Farnaz Niknia , Ping Wang , Zixu Wang , Aakash Agarwal , Adib S. Rezaei

This paper focuses on the active flow control of a computational fluid dynamics simulation over a range of Reynolds numbers using deep reinforcement learning (DRL). More precisely, the proximal policy optimization (PPO) method is used to…

流体动力学 · 物理学 2020-06-24 Hongwei Tang , Jean Rabault , Alexander Kuhnle , Yan Wang , Tongguang Wang

PPO (Proximal Policy Optimization) is a state-of-the-art policy gradient algorithm that has been successfully applied to complex computer games such as Dota 2 and Honor of Kings. In these environments, an agent makes compound actions…

机器学习 · 计算机科学 2023-01-27 Xiulei Song , Yizhao Jin , Greg Slabaugh , Simon Lucas

The recent remarkable progress of deep reinforcement learning (DRL) stands on regularization of policy for stable and efficient learning. A popular method, named proximal policy optimization (PPO), has been introduced for this purpose. PPO…

机器学习 · 计算机科学 2023-07-04 Taisuke Kobayashi

Reinforcement Learning (RL) has made significant strides in various domains, and policy gradient methods like Proximal Policy Optimization (PPO) have gained popularity due to their balance in performance, training stability, and…

机器学习 · 计算机科学 2025-05-21 Andrei Cozma , Landon Harris , Hairong Qi

Advances in reinforcement learning (RL) often rely on massive compute resources and remain notoriously sample inefficient. In contrast, the human brain is able to efficiently learn effective control strategies using limited resources. This…

机器学习 · 计算机科学 2024-01-30 Burcu Küçükoğlu , Walraaf Borkent , Bodo Rueckauer , Nasir Ahmad , Umut Güçlü , Marcel van Gerven

Proton pencil beam scanning (PBS) treatment planning for head and neck (H&N) cancers is a time-consuming and experience-demanding task where a large number of planning objectives are involved. Deep reinforcement learning (DRL) has recently…

定量方法 · 定量生物学 2024-09-19 Qingqing Wang , Chang Chang

We study episodic reinforcement learning (RL) in non-stationary linear kernel Markov decision processes (MDPs). In this setting, both the reward function and the transition kernel are linear with respect to the given feature maps and are…

机器学习 · 计算机科学 2024-12-24 Han Zhong , Zhongren Chen , Zhuoran Yang , Zhaoran Wang , Csaba Szepesvári

We propose a physics-informed neural network policy iteration (PINN-PI) framework for solving stochastic optimal control problems governed by second-order Hamilton--Jacobi--Bellman (HJB) equations. At each iteration, a neural network is…

机器学习 · 计算机科学 2025-08-05 Yeongjong Kim , Yeoneung Kim , Minseok Kim , Namkyeong Cho