English
Related papers

Related papers: Actor-Director-Critic: A Novel Deep Reinforcement …

200 papers

Combining off-policy reinforcement learning methods with function approximators such as neural networks has been found to lead to overestimation of the value function and sub-optimal solutions. Improvement such as TD3 has been proposed to…

Machine Learning · Computer Science 2021-09-09 Bo Zhou , Kejiao Li , Hongsheng Zeng , Fan Wang , Hao Tian

Recently, there has been tremendous efforts by network operators and equipment vendors to adopt intelligence and openness in the next generation radio access network (RAN). The goal is to reach a RAN that can self-optimize in a highly…

Networking and Internet Architecture · Computer Science 2021-10-04 Shahram Mollahasani , Melike Erol-Kantarci , Rodney Wilson

There is a growing interest in integrating machine learning techniques and optimization to solve challenging optimization problems. In this work, we propose a deep reinforcement learning methodology for the job shop scheduling problem…

Optimization and Control · Mathematics 2023-11-22 Marta Monaci , Valerio Agasucci , Giorgio Grani

We introduce a reinforcement learning method for a class of non-Markov systems; our approach extends the actor-critic framework given by Rose et al. [New J. Phys. 23 013013 (2021)] for obtaining scaled cumulant generating functions…

Statistical Mechanics · Physics 2026-03-09 Venkata D. Pamulaparthy , Rosemary J. Harris

Synchronizing decisions across multiple agents in realistic settings is problematic since it requires agents to wait for other agents to terminate and communicate about termination reliably. Ideally, agents should learn and execute…

Machine Learning · Computer Science 2022-10-12 Yuchen Xiao , Weihao Tan , Christopher Amato

Deep reinforcement learning (DRL) has great potential for acquiring the optimal action in complex environments such as games and robot control. However, it is difficult to analyze the decision-making of the agent, i.e., the reasons it…

Machine Learning · Computer Science 2021-03-09 Hidenori Itaya , Tsubasa Hirakawa , Takayoshi Yamashita , Hironobu Fujiyoshi , Komei Sugiura

The actor-critic (AC) framework has achieved strong empirical success in off-policy reinforcement learning but suffers from the "moving target" problem, where the evaluated policy changes continually. Functional critics, or…

Machine Learning · Computer Science 2026-02-10 Qinxun Bai , Yuxuan Han , Wei Xu , Zhengyuan Zhou

In decentralized cooperative multi-agent reinforcement learning, agents can aggregate information from one another to learn policies that maximize a team-average objective function. Despite the willingness to cooperate with others, the…

Systems and Control · Electrical Eng. & Systems 2022-07-27 Martin Figura , Yixuan Lin , Ji Liu , Vijay Gupta

Advancements in reinforcement learning have led to the development of sophisticated models capable of learning complex decision-making tasks. However, efficiently integrating world models with decision transformers remains a challenge. In…

While deep reinforcement learning has achieved tremendous successes in various applications, most existing works only focus on maximizing the expected value of total return and thus ignore its inherent stochasticity. Such stochasticity is…

Machine Learning · Computer Science 2023-09-19 Han Zhong , Xun Deng , Ethan X. Fang , Zhuoran Yang , Zhaoran Wang , Runze Li

In this study, we investigate the use of global information to speed up the learning process and increase the cumulative rewards of reinforcement learning (RL) in competition tasks. Within the actor-critic RL, we introduce multiple…

Machine Learning · Computer Science 2020-03-03 Zehong Cao , Chin-Teng Lin

We introduce D2AC, a new model-free reinforcement learning (RL) algorithm designed to train expressive diffusion policies online effectively. At its core is a policy improvement objective that avoids the high variance of typical policy…

Machine Learning · Computer Science 2026-05-25 Lunjun Zhang , Shuo Han , Hanrui Lyu , Bradly C Stadie

Recent studies have greatly improved reinforcement learning, and an increased interest in real-world implementation has emerged. In many cases, the implementation is challenged by time-varying disturbances as it introduces hidden states,…

Machine Learning · Computer Science 2026-03-04 Saki Omi , Hyo-Sang Shin , Namhoon Cho , Antonios Tsourdos

Dynamic Reinforcement Learning (Dynamic RL), proposed in this paper, directly controls system dynamics, instead of the actor (action-generating neural network) outputs at each moment, bringing about a major qualitative shift in…

Machine Learning · Computer Science 2025-02-17 Katsunari Shibata

The exploitation of extra state information has been an active research area in multi-agent reinforcement learning (MARL). QMIX represents the joint action-value using a non-negative function approximator and achieves the best performance,…

Artificial Intelligence · Computer Science 2020-12-21 Jianyu Su , Stephen Adams , Peter A. Beling

The growing demand on high-quality and low-latency multimedia services has led to much interest in edge caching techniques. Motivated by this, we in this paper consider edge caching at the base stations with unknown content popularity…

Information Theory · Computer Science 2019-05-15 Chen Zhong , M. Cenk Gursoy , Senem Velipasalar

The hierarchical interaction between the actor and critic in actor-critic based reinforcement learning algorithms naturally lends itself to a game-theoretic interpretation. We adopt this viewpoint and model the actor and critic interaction…

Machine Learning · Computer Science 2021-09-28 Liyuan Zheng , Tanner Fiez , Zane Alumbaugh , Benjamin Chasnov , Lillian J. Ratliff

This scientific paper propose a novel portfolio optimization model using an improved deep reinforcement learning algorithm. The objective function of the optimization model is the weighted sum of the expectation and value at risk(VaR) of…

Machine Learning · Computer Science 2022-08-30 Boyi Jin

Deterministic-policy actor-critic algorithms for continuous control improve the actor by plugging its actions into the critic and ascending the action-value gradient, which is obtained by chaining the actor's Jacobian matrix with the…

Artificial Intelligence · Computer Science 2020-10-23 Pierluca D'Oro , Wojciech Jaśkowski

Adaptive Mixed-Criticality (AMC) is a fixed-priority preemptive scheduling algorithm for mixed-criticality hard real-time systems. It dominates many other scheduling algorithms for mixed-criticality systems, but does so at the cost of…

Operating Systems · Computer Science 2024-11-04 Bruno Mendes , Pedro F. Souto , Pedro C. Diniz