中文
相关论文

相关论文: Deep Q-Learning versus Proximal Policy Optimizatio…

200 篇论文

We present a novel reinforcement learning (RL) environment designed to both optimize industrial sorting systems and study agent behavior in evolving spaces. In simulating material flow within a sorting process our environment follows the…

机器学习 · 计算机科学 2025-03-14 Tom Maus , Nico Zengeler , Tobias Glasmachers

Efficient mobility management and load balancing are critical to sustaining Quality of Service (QoS) in dense, highly dynamic 5G radio access networks. We present a deep reinforcement learning framework based on Proximal Policy Optimization…

网络与互联网体系结构 · 计算机科学 2026-05-13 Mehrshad Eskandarpour , Hossein Soleimani

Reinforcement learning is time-consuming for complex tasks due to the need for large amounts of training data. Recent advances in GPU-based simulation, such as Isaac Gym, have sped up data collection thousands of times on a commodity GPU.…

机器学习 · 计算机科学 2023-07-25 Zechu Li , Tao Chen , Zhang-Wei Hong , Anurag Ajay , Pulkit Agrawal

We present a proximal policy optimization (PPO) agent trained through curriculum learning (CL) principles and meticulous reward engineering to optimize a real-world high-throughput waste sorting facility. Our work addresses the challenge of…

机器学习 · 计算机科学 2024-07-24 Abhijeet Pendyala , Asma Atamna , Tobias Glasmachers

In this paper, we provide the details of implementing various reinforcement learning (RL) algorithms for controlling a Cart-Pole system. In particular, we describe various RL concepts such as Q-learning, Deep Q Networks (DQN), Double DQN,…

机器人学 · 计算机科学 2020-06-15 Swagat Kumar

Despite the great empirical success of deep reinforcement learning, its theoretical foundation is less well understood. In this work, we make the first attempt to theoretically understand the deep Q-network (DQN) algorithm (Mnih et al.,…

机器学习 · 计算机科学 2020-02-25 Jianqing Fan , Zhaoran Wang , Yuchen Xie , Zhuoran Yang

Autonomous UAV inspection of confined industrial infrastructure, such as ventilation ducts, demands robust navigation policies where collisions are unacceptable. While Deep Reinforcement Learning (DRL) offers a powerful paradigm for…

In sequence generation task, many works use policy gradient for model optimization to tackle the intractable backpropagation issue when maximizing the non-differentiable evaluation metrics or fooling the discriminator in adversarial…

计算与语言 · 计算机科学 2018-08-27 Yi-Lin Tuan , Jinzhi Zhang , Yujia Li , Hung-yi Lee

We present a novel definition of the reinforcement learning state, actions and reward function that allows a deep Q-network (DQN) to learn to control an optimization hyperparameter. Using Q-learning with experience replay, we train two DQNs…

最优化与控制 · 数学 2016-06-21 Samantha Hansen

Reinforcement learning (RL) is a promising approach for deriving control policies for complex systems. As we show in two control problems, the derived policies from using the Proximal Policy Optimization (PPO) and Deep Q-Network (DQN)…

机器学习 · 计算机科学 2022-04-05 Jan de Priester , Ricardo G. Sanfelice , Nathan van de Wouw

Deep reinforcement learning (DRL) is one of the promising approaches for introducing robots into complicated environments. The recent remarkable progress of DRL stands on regularization of policy, which allows the policy to improve stably…

机器学习 · 计算机科学 2023-07-04 Taisuke Kobayashi

In this study, we analyze and compare the performance of state-of-the-art deep reinforcement learning algorithms for solving the supply chain inventory management problem. This complex sequential decision-making problem consists of…

机器学习 · 计算机科学 2025-01-07 Francesco Stranieri , Fabio Stella

Dynamic Algorithm Configuration (DAC) studies the efficient identification of control policies for parameterized optimization algorithms. Numerous studies leverage Reinforcement Learning (RL) to address DAC challenges; however, applying RL…

机器学习 · 计算机科学 2026-04-03 Tai Nguyen , Phong Le , André Biedenkapp , Carola Doerr , Nguyen Dang

On-policy deep reinforcement learning algorithms have low data utilization and require significant experience for policy improvement. This paper proposes a proximal policy optimization algorithm with prioritized trajectory replay (PTR-PPO)…

机器学习 · 计算机科学 2021-12-09 Xingxing Liang , Yang Ma , Yanghe Feng , Zhong Liu

Deep Reinforcement Learning (DRL) is a paradigm of artificial intelligence where an agent uses a neural network to learn which actions to take in a given environment. DRL has recently gained traction from being able to solve complex…

软件工程 · 计算机科学 2025-11-03 Rajdeep Singh Hundal , Yan Xiao , Xiaochun Cao , Jin Song Dong , Manuel Rigger

We extend directed quantum circuit synthesis (DQCS) with reinforcement learning from purely discrete gate selection to parameterized quantum state preparation with continuous single-qubit rotations \(R_x\), \(R_y\), and \(R_z\). We compare…

This work studies reinforcement learning (RL) in the context of multi-period supply chains subject to constraints, e.g., on production and inventory. We introduce Distributional Constrained Policy Optimization (DCPO), a novel approach for…

机器学习 · 计算机科学 2023-02-06 Jaime Sabal Bermúdez , Antonio del Rio Chanona , Calvin Tsay

Intelligent traffic lights in smart cities can optimally reduce traffic congestion. In this study, we employ reinforcement learning to train the control agent of a traffic light on a simulator of urban mobility. As a difference from…

机器学习 · 计算机科学 2021-12-28 Yue Zhu , Mingyu Cai , Chris Schwarz , Junchao Li , Shaoping Xiao

Proximal Policy Optimization (PPO) is a highly popular policy-based deep reinforcement learning (DRL) approach. However, we observe that the homogeneous exploration process in PPO could cause an unexpected stability issue in the training…

机器学习 · 计算机科学 2022-12-14 Qisheng Zhang , Zhen Guo , Audun Jøsang , Lance M. Kaplan , Feng Chen , Dong H. Jeong , Jin-Hee Cho

Deep reinforcement learning has been able to solve various tasks successfully, however, due to the construction of policy gradient and training dynamics, tuning deep reinforcement learning models remains challenging. As one of the most…

机器学习 · 计算机科学 2026-02-11 Hanyong Wang , Menglong Yang