English
Related papers

Related papers: Optimize Wider, Not Deeper: Consensus Aggregation …

200 papers

As the most successful variant and improvement for Trust Region Policy Optimization (TRPO), proximal policy optimization (PPO) has been widely applied across various domains with several advantages: efficient data utilization, easy…

Machine Learning · Computer Science 2019-02-15 Xiangxiang Chu

This paper tackles the growing issue of excessive data transmission in networks. With increasing traffic, backhaul links and core networks are under significant traffic, leading to the investigation of caching solutions at edge routers.…

Networking and Internet Architecture · Computer Science 2024-10-31 Farnaz Niknia , Ping Wang , Zixu Wang , Aakash Agarwal , Adib S. Rezaei

Reinforcement Learning, particularly through policy gradient methods, has played a central role in enabling reasoning capabilities of Large Language Models. However, the optimization stability of policy gradients in this setting remains…

Machine Learning · Computer Science 2026-03-03 Luckeciano C. Melo , Alessandro Abate , Yarin Gal

Trust-region methods based on Kullback-Leibler divergence are pervasively used to stabilize policy optimization in reinforcement learning. In this paper, we exploit more flexible metrics and examine two natural extensions of policy…

Machine Learning · Computer Science 2023-06-27 Jun Song , Niao He , Lijun Ding , Chaoyue Zhao

We propose a new sample-efficient methodology, called Supervised Policy Update (SPU), for deep reinforcement learning. Starting with data generated by the current policy, SPU formulates and solves a constrained optimization problem in the…

Machine Learning · Computer Science 2018-12-27 Quan Vuong , Yiming Zhang , Keith W. Ross

Policy optimization is a fundamental principle for designing reinforcement learning algorithms, and one example is the proximal policy optimization algorithm with a clipped surrogate objective (PPO-Clip), which has been popularly used in…

Machine Learning · Computer Science 2022-09-02 Nai-Chieh Huang , Ping-Chun Hsieh , Kuo-Hao Ho , Hsuan-Yu Yao , Kai-Chun Hu , Liang-Chun Ouyang , I-Chen Wu

Proximal Policy Optimization (PPO) dominates reinforcement learning and LLM alignment but relies on a "hard clipping" mechanism that discards valuable gradients. Conversely, unconstrained methods like SPO expose the optimization to…

Artificial Intelligence · Computer Science 2026-05-07 Yiheng Zhang , Yiming Wang , Kaiyan Zhao , Zhenglin Wan , Jiayu Chen , Leong Hou U

Recently, GRPO-based reinforcement learning has shown remarkable progress in optimizing flow-matching models, effectively improving their alignment with task-specific rewards. Within these frameworks, the policy update relies on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Jing Wang , Jiajun Liang , Jie Liu , Henglin Liu , Gongye Liu , Jun Zheng , Wanyuan Pang , Ao Ma , Zhenyu Xie , Xintao Wang , Meng Wang , Pengfei Wan , Xiaodan Liang

Proximal policy optimization (PPO) algorithm is a deep reinforcement learning algorithm with outstanding performance, especially in continuous control tasks. But the performance of this method is still affected by its exploration ability.…

Machine Learning · Computer Science 2020-11-12 Junwei Zhang , Zhenghao Zhang , Shuai Han , Shuai Lü

By leveraging differentiable dynamics, Reparameterization Policy Gradient (RPG) achieves high sample efficiency. However, current approaches are hindered by two critical limitations: the under-utilization of computationally expensive…

Machine Learning · Computer Science 2026-02-09 Hai Zhong , Xun Wang , Zhuoran Li , Longbo Huang

Approaches to policy optimization have been motivated from diverse principles, based on how the parametric model is interpreted (e.g. value versus policy representation) or how the learning objective is formulated, yet they share a common…

Machine Learning · Computer Science 2022-06-20 Ramki Gummadi , Saurabh Kumar , Junfeng Wen , Dale Schuurmans

We revisit Proximal Policy Optimization (PPO) from a function-space perspective. Our analysis decouples policy evaluation and improvement in a reproducing kernel Hilbert space (RKHS): (i) A kernelized temporal-difference (TD) critic…

Machine Learning · Computer Science 2025-09-30 Lu Zou , Wendi Ren , Weizhong Zhang , Liang Ding , Shuang Li

Policy optimization methods are popular reinforcement learning algorithms, because their incremental and on-policy nature makes them more stable than the value-based counterparts. However, the same properties also make them slow to converge…

Machine Learning · Computer Science 2021-07-01 Andrea Zanette , Ching-An Cheng , Alekh Agarwal

We introduce the Pontryagin-Guided Direct Policy Optimization (PG-DPO) framework for high-dimensional continuous-time portfolio choice. Our approach combines Pontryagin's Maximum Principle (PMP) with backpropagation through time (BPTT) to…

Portfolio Management · Quantitative Finance 2025-09-12 Jeonggyu Huh , Jaegi Jeon , Hyeng Keun Koo , Byung Hwa Lim

We study reinforcement learning in hybrid discrete-continuous action spaces, such as settings where the discrete component selects a regime (or index) and the continuous component optimizes within it -- a structure common in robotics,…

Machine Learning · Computer Science 2026-05-15 Matias Alvo , Daniel Russo , Yash Kanoria

Neural implicit mapping has emerged as a powerful paradigm for robotic navigation and scene understanding. However, real-world robotic deployment requires continual adaptation to changing environments under strict memory and computation…

Robotics · Computer Science 2026-05-29 Xunlan Zhou , Hongrui Zhao , Negar Mehr

Proximal Policy Optimization (PPO) is widely used in continuous control due to its robustness and stable training, yet it remains sample-inefficient in tasks with expensive interactions and high-dimensional action spaces. This paper…

Machine Learning · Computer Science 2025-12-16 Tianci Gao , Konstantin A. Neusypin , Dmitry D. Dmitriev , Bo Yang , Shengren Rao

Proximal Policy Optimization (PPO) methods learn a policy by iteratively performing multiple mini-batch optimization epochs of a surrogate objective with one set of sampled data. Ratio clipping PPO is a popular variant that clips the…

Machine Learning · Computer Science 2022-02-02 Mingfei Sun , Vitaly Kurin , Guoqing Liu , Sam Devlin , Tao Qin , Katja Hofmann , Shimon Whiteson

We introduce a constrained optimization method for policy gradient reinforcement learning, which uses a virtual trust region to regulate each policy update. In addition to using the proximity of one single old policy as the normal trust…

Machine Learning · Computer Science 2022-09-19 Hung Le , Thommen Karimpanal George , Majid Abdolshah , Dung Nguyen , Kien Do , Sunil Gupta , Svetha Venkatesh

Consensus-based optimization (CBO) is a multi-agent metaheuristic derivative-free optimization algorithm that has proven to be capable of globally minimizing nonconvex nonsmooth functions across a diverse range of applications while being…

Optimization and Control · Mathematics 2025-12-12 Sabrina Bonandin , Konstantin Riedl , Sara Veneruso