English
Related papers

Related papers: ETGL-DDPG: A Deep Deterministic Policy Gradient Al…

200 papers

This paper presents a robust reinforcement learning algorithm called robust deterministic policy gradient (RDPG), which reformulates the H-infinity control problem as a two-player zero-sum dynamic game between a user and an adversary. The…

Robotics · Computer Science 2025-12-04 Taeho Lee , Donghwan Lee

In long-horizon tasks, recent agents based on Large Language Models (LLMs) face a significant challenge that sparse, outcome-based rewards make it difficult to assign credit to intermediate steps. Previous methods mainly focus on creating…

Machine Learning · Computer Science 2025-09-12 Jiawei Wang , Jiacai Liu , Yuqian Fu , Yingru Li , Xintao Wang , Yuan Lin , Yu Yue , Lin Zhang , Yang Wang , Ke Wang

We consider the joint design and control of discrete-time stochastic dynamical systems over a finite time horizon. We formulate the problem as a multi-step optimization problem under uncertainty seeking to identify a system design and a…

Machine Learning · Computer Science 2022-01-07 Adrien Bolland , Ioannis Boukas , Mathias Berger , Damien Ernst

We propose a novel policy gradient method for multi-agent reinforcement learning, which leverages two different variance-reduction techniques and does not require large batches over iterations. Specifically, we propose a momentum-based…

Machine Learning · Computer Science 2021-12-07 Zhanhong Jiang , Xian Yeow Lee , Sin Yong Tan , Kai Liang Tan , Aditya Balu , Young M. Lee , Chinmay Hegde , Soumik Sarkar

Mobile edge computing (MEC) allows appliances to offload workloads to neighboring MEC servers that have the potential for computation-intensive tasks with limited computational capabilities. This paper studied how deep reinforcement…

Information Theory · Computer Science 2025-06-04 Nguyen Chi Long , Trinh Van Chien , Ta Hai Tung , Van Son Nguyen , Trong-Minh Hoang , Nguyen Ngoc Hai Dang

We test the performance of deep deterministic policy gradient (DDPG), a deep reinforcement learning algorithm, able to handle continuous state and action spaces, to learn Nash equilibria in a setting where firms compete in prices. These…

Computer Science and Game Theory · Computer Science 2025-09-30 Christoph Graf , Viktor Zobernig , Johannes Schmidt , Claude Klöckl

Direct policy gradient methods for reinforcement learning are a successful approach for a variety of reasons: they are model free, they directly optimize the performance metric of interest, and they allow for richly parameterized policies.…

Machine Learning · Computer Science 2020-08-14 Alekh Agarwal , Mikael Henaff , Sham Kakade , Wen Sun

Deep Deterministic Policy Gradient (DDPG) algorithm is one of the most well-known reinforcement learning methods. However, this method is inefficient and unstable in practical applications. On the other hand, the bias and variance of the Q…

Machine Learning · Computer Science 2020-07-02 Shuai Han , Wenbo Zhou , Shuai Lü , Jiayu Yu

We propose Deterministic Sequencing of Exploration and Exploitation (DSEE) algorithm with interleaving exploration and exploitation epochs for model-based RL problems that aim to simultaneously learn the system model, i.e., a Markov…

Machine Learning · Computer Science 2022-12-21 Piyush Gupta , Vaibhav Srivastava

We introduce the ``soft Deep MaxPain'' (softDMP) algorithm, which integrates the optimization of long-term policy entropy into reward-punishment reinforcement learning objectives. Our motivation is to facilitate a smoother variation of…

Machine Learning · Computer Science 2024-09-16 Jiexin Wang , Eiji Uchibe

Deep Reinforcement Learning (DRL) suffers from uncertainties and inaccuracies in the observation signal in realworld applications. Adversarial attack is an effective method for evaluating the robustness of DRL agents. However, existing…

Machine Learning · Computer Science 2025-01-09 Tianyang Duan , Zongyuan Zhang , Zheng Lin , Yue Gao , Ling Xiong , Yong Cui , Hongbin Liang , Xianhao Chen , Heming Cui , Dong Huang

We propose expected policy gradients (EPG), which unify stochastic policy gradients (SPG) and deterministic policy gradients (DPG) for reinforcement learning. Inspired by expected sarsa, EPG integrates (or sums) across actions when…

Machine Learning · Statistics 2020-05-05 Kamil Ciosek , Shimon Whiteson

Deep learning and reinforcement learning methods have recently been used to solve a variety of problems in continuous control domains. An obvious application of these techniques is dexterous manipulation tasks in robotics which are…

Changes in demand, various hydrological inputs, and environmental stressors are among the issues that water managers and policymakers face on a regular basis. These concerns have sparked interest in applying different techniques to…

Machine Learning · Computer Science 2024-03-08 Sadegh Sadeghi Tabas , Vidya Samadi

This paper deploys the Deep Deterministic Policy Gradient (DDPG) algorithm for longitudinal and lateral control of a simulated car to solve a path following task. The DDPG agent was implemented using PyTorch and trained and evaluated on a…

Robotics · Computer Science 2021-04-14 Georg Hess , William Ljungbergh

Recent work on exploration in reinforcement learning (RL) has led to a series of increasingly complex solutions to the problem. This increase in complexity often comes at the expense of generality. Recent empirical studies suggest that,…

Machine Learning · Computer Science 2020-06-03 Will Dabney , Georg Ostrovski , André Barreto

Reinforcement learning (RL) enables agents to take decision based on a reward function. However, in the process of learning, the choice of values for learning algorithm parameters can significantly impact the overall learning process. In…

Neural and Evolutionary Computing · Computer Science 2019-05-13 Adarsh Sehgal , Hung Manh La , Sushil J. Louis , Hai Nguyen

This paper investigates the motion planning of autonomous dynamical systems modeled by Markov decision processes (MDP) with unknown transition probabilities over continuous state and action spaces. Linear temporal logic (LTL) is used to…

Machine Learning · Computer Science 2022-01-25 Mingyu Cai , Mohammadhosein Hasanbeig , Shaoping Xiao , Alessandro Abate , Zhen Kan

With reinforcement learning, an agent could learn complex behaviors from high-level abstractions of the task. However, exploration and reward shaping remained challenging for existing methods, especially in scenarios where the extrinsic…

Machine Learning · Computer Science 2020-06-11 Jie Chen , Wenjun Xu

Path-planning for autonomous vehicles in threat-laden environments is a fundamental challenge. While traditional optimal control methods can find ideal paths, the computational time is often too slow for real-time decision-making. To solve…

Optimization and Control · Mathematics 2026-04-15 Qiang Le , Yaguang Yang , Isaac E. Weintraub