English
Related papers

Related papers: Momentum-Based Policy Gradient Methods

200 papers

In the field of reinforcement learning there has been recent progress towards safety and high-confidence bounds on policy performance. However, to our knowledge, no practical methods exist for determining high-confidence policy performance…

Artificial Intelligence · Computer Science 2018-06-26 Daniel S. Brown , Scott Niekum

Traditional model-based reinforcement learning approaches learn a model of the environment dynamics without explicitly considering how it will be used by the agent. In the presence of misspecified model classes, this can lead to poor…

Machine Learning · Computer Science 2020-10-20 Pierluca D'Oro , Alberto Maria Metelli , Andrea Tirinzoni , Matteo Papini , Marcello Restelli

Reinforcement learning is essential for neural architecture search and hyperparameter optimization, but the conventional approaches impede widespread use due to prohibitive time and computational costs. Inspired by DeepSeek-V3 multi-token…

Machine Learning · Computer Science 2025-06-19 Zheng Li , Jerry Cheng , Huanying Helen Gu

Policy gradient methods have become a standard for training reinforcement learning agents in a scalable and efficient manner. However, they do not account for transition uncertainty, whereas learning robust policies can be computationally…

Machine Learning · Computer Science 2023-12-12 Navdeep Kumar , Esther Derman , Matthieu Geist , Kfir Levy , Shie Mannor

We are interested in learning models of non-stationary environments, which can be framed as a multi-task learning problem. Model-free reinforcement learning algorithms can achieve good asymptotic performance in multi-task learning at a cost…

Machine Learning · Computer Science 2020-11-24 Elahe Aghapour , Nora Ayanian

Modern deep policy gradient methods achieve effective performance on simulated robotic tasks, but they all require large replay buffers or expensive batch updates, or both, making them incompatible for real systems with resource-limited…

Machine Learning · Computer Science 2025-05-22 Gautham Vasan , Mohamed Elsayed , Alireza Azimi , Jiamin He , Fahim Shariar , Colin Bellinger , Martha White , A. Rupam Mahmood

Policy-based algorithms are among the most widely adopted techniques in model-free RL, thanks to their strong theoretical groundings and good properties in continuous action spaces. Unfortunately, these methods require precise and…

Machine Learning · Computer Science 2023-06-14 Luca Sabbioni , Francesco Corda , Marcello Restelli

This paper presents a model-free approximation for the Hessian of the performance of deterministic policies to use in the context of Reinforcement Learning based on Quasi-Newton steps in the policy parameters. We show that the approximate…

Machine Learning · Computer Science 2022-03-29 Arash Bahari Kordabad , Hossein Nejatbakhsh Esfahani , Wenqi Cai , Sebastien Gros

Many recent algorithms for reinforcement learning are model-free and founded on the Bellman equation. Here we present a method founded on the costate equation and models of the state dynamics. We use the costate -- the gradient of cost with…

Machine Learning · Computer Science 2018-10-04 Bita Behrouzi , Xuefei Liu , Douglas Tweed

This work considers the sample and computational complexity of obtaining an $\epsilon$-optimal policy in a discounted Markov Decision Process (MDP), given only access to a generative model. In this work, we study the effectiveness of the…

Machine Learning · Computer Science 2020-04-07 Alekh Agarwal , Sham Kakade , Lin F. Yang

This paper develops a policy learning method for tuning a pre-trained policy to adapt to additional tasks without altering the original task. A method named Adaptive Policy Gradient (APG) is proposed in this paper, which combines Bellman's…

Machine Learning · Computer Science 2025-09-29 Wenjian Hao , Zehui Lu , Zihao Liang , Tianyu Zhou , Shaoshuai Mou

We propose Fractional Policy Gradients (FPG), a reinforcement learning framework incorporating fractional calculus for long-term temporal modeling in policy optimization. Standard policy gradient approaches face limitations from Markovian…

Machine Learning · Computer Science 2025-07-02 Urvi Pawar , Kunal Telangi

Maximum entropy deep reinforcement learning (RL) methods have been demonstrated on a range of challenging continuous tasks. However, existing methods either suffer from severe instability when training on large off-policy data or cannot…

Machine Learning · Computer Science 2019-09-10 Wenjie Shi , Shiji Song , Cheng Wu

One of the most crucial challenges faced by the Li-ion battery community concerns the search for the minimum time charging without irreversibly damaging the cells. This can fall into solving large-scale nonlinear optimal control problems…

Systems and Control · Electrical Eng. & Systems 2020-06-26 Saehong Park , Andrea Pozzi , Michael Whitmeyer , Hector Perez , Won Tae Joe , Davide M Raimondo , Scott Moura

For over a decade, model-based reinforcement learning has been seen as a way to leverage control-based domain knowledge to improve the sample-efficiency of reinforcement learning agents. While model-based agents are conceptually appealing,…

Machine Learning · Computer Science 2021-05-28 Brandon Amos , Samuel Stanton , Denis Yarats , Andrew Gordon Wilson

In this paper, we propose a novel algorithm named STOchastic Recursive Momentum for Policy Gradient (STORM-PG), which operates a SARAH-type stochastic recursive variance-reduced policy gradient in an exponential moving average fashion.…

Machine Learning · Statistics 2020-03-10 Huizhuo Yuan , Xiangru Lian , Ji Liu , Yuren Zhou

Gradient descent-based optimization methods underpin the parameter training of neural networks, and hence comprise a significant component in the impressive test results found in a number of applications. Introducing stochasticity is key to…

Machine Learning · Computer Science 2021-06-01 Nikola B. Kovachki , Andrew M. Stuart

Stateful policies play an important role in reinforcement learning, such as handling partially observable environments, enhancing robustness, or imposing an inductive bias directly into the policy structure. The conventional method for…

Machine Learning · Computer Science 2023-11-08 Firas Al-Hafez , Guoping Zhao , Jan Peters , Davide Tateo

We focus on developing efficient and reliable policy optimization strategies for robot learning with real-world data. In recent years, policy gradient methods have emerged as a promising paradigm for training control policies in simulation.…

Machine Learning · Computer Science 2023-11-07 Tyler Westenbroek , Jacob Levy , David Fridovich-Keil

Many engineering problems have multiple objectives, and the overall aim is to optimize a non-linear function of these objectives. In this paper, we formulate the problem of maximizing a non-linear concave function of multiple long-term…

Machine Learning · Computer Science 2025-09-23 Qinbo Bai , Mridul Agarwal , Vaneet Aggarwal