English
Related papers

Related papers: Deep Reinforcement Learning with Surrogate Agent-E…

200 papers

The cooperation among AI systems, and between AI systems and humans is becoming increasingly important. In various real-world tasks, an agent needs to cooperate with unknown partner agent types. This requires the agent to assess the…

Machine Learning · Computer Science 2021-10-05 Antti Keurulainen , Isak Westerlund , Ariel Kwiatkowski , Samuel Kaski , Alexander Ilin

As AI becomes more prevalent throughout society, effective methods of integrating humans and AI systems that leverage their respective strengths and mitigate risk have become an important priority. In this paper, we introduce the paradigm…

Machine Learning · Computer Science 2023-10-24 Jiayi Wang , Zhengling Qi , Chengchun Shi

In this paper, we implement three state-of-art continuous reinforcement learning algorithms, Deep Deterministic Policy Gradient (DDPG), Proximal Policy Optimization (PPO) and Policy Gradient (PG)in portfolio management. All of them are…

Portfolio Management · Quantitative Finance 2018-11-20 Zhipeng Liang , Hao Chen , Junhao Zhu , Kangkang Jiang , Yanran Li

In this paper we design and evaluate a Deep-Reinforcement Learning agent that optimizes routing. Our agent adapts automatically to current traffic conditions and proposes tailored configurations that attempt to minimize the network delay.…

Networking and Internet Architecture · Computer Science 2017-09-22 Giorgio Stampa , Marta Arias , David Sanchez-Charles , Victor Muntes-Mulero , Albert Cabellos

Entropy regularization is an important idea in reinforcement learning, with great success in recent algorithms like Soft Q Network (SQN) and Soft Actor-Critic (SAC1). In this work, we extend this idea into the on-policy realm. We propose…

Machine Learning · Computer Science 2020-10-19 Jingbin Liu , Xinyang Gu , Shuai Liu

Sample efficiency in the face of computationally expensive simulations is a common concern in surrogate modeling. Current strategies to minimize the number of samples needed are not as effective in simulated environments with wide state…

Machine Learning · Computer Science 2025-09-03 Julen Cestero , Marco Quartulli , Marcello Restelli

As AI technology advances, research in playing text-based games with agents has becomeprogressively popular. In this paper, a novel approach to agent design and agent learning ispresented with the context of reinforcement learning. A model…

Computation and Language · Computer Science 2025-09-04 Haonan Wang , Mingjia Zhao , Junfeng Sun , Wei Liu

Reinforcement learning has shown strong performance in robotic manipulation, but learned policies often degrade in performance when test conditions differ from the training distribution. This limitation is especially important in…

Robotics · Computer Science 2026-04-02 Shaifalee Saxena , Rafael Fierro , Alexander Scheinker

Challenging problems of deep reinforcement learning systems with regard to the application on real systems are their adaptivity to changing environments and their efficiency w.r.t. computational resources and data. In the application of…

Machine Learning · Computer Science 2022-02-18 Maria Kalweit , Gabriel Kalweit , Moritz Werling , Joschka Boedecker

Agents that interact with other agents often do not know a priori what the other agents' strategies are, but have to maximise their own online return while interacting with and learning about others. The optimal adaptive behaviour under…

Machine Learning · Computer Science 2022-04-19 Luisa Zintgraf , Sam Devlin , Kamil Ciosek , Shimon Whiteson , Katja Hofmann

In this paper, a new offline actor-critic learning algorithm is introduced: Sampled Policy Gradient (SPG). SPG samples in the action space to calculate an approximated policy gradient by using the critic to evaluate the samples. This…

Artificial Intelligence · Computer Science 2018-09-18 Anton Orell Wiehe , Nil Stolt Ansó , Madalina M. Drugan , Marco A. Wiering

This paper presents a novel safe reinforcement learning algorithm for strategic bidding of Virtual Power Plants (VPPs) in day-ahead electricity markets. The proposed algorithm utilizes the Deep Deterministic Policy Gradient (DDPG) method to…

Systems and Control · Electrical Eng. & Systems 2023-09-13 Ognjen Stanojev , Lesia Mitridati , Riccardo de Nardis di Prata , Gabriela Hug

This paper proposes a reinforcement learning--based framework for cryptocurrency portfolio management using the Soft Actor--Critic (SAC) and Deep Deterministic Policy Gradient (DDPG) algorithms. Traditional portfolio optimization methods…

Computational Finance · Quantitative Finance 2025-11-27 Kamal Paykan

Adopting reasonable strategies is challenging but crucial for an intelligent agent with limited resources working in hazardous, unstructured, and dynamic environments to improve the system's utility, decrease the overall cost, and increase…

Artificial Intelligence · Computer Science 2023-12-06 Qin Yang , Ramviyas Parasuraman

Evolutionary Reinforcement Learning (ERL), training the Reinforcement Learning (RL) policies with Evolutionary Algorithms (EAs), have demonstrated enhanced exploration capabilities and greater robustness than using traditional policy…

Machine Learning · Computer Science 2025-05-30 Bingdong Li , Mei Jiang , Hong Qian , Ke Tang , Aimin Zhou , Peng Yang

The study of decentralized learning or independent learning in cooperative multi-agent reinforcement learning has a history of decades. Recently empirical studies show that independent PPO (IPPO) can obtain good performance, close to or…

Machine Learning · Computer Science 2022-11-08 Kefan Su , Zongqing Lu

Oilfield development related decisions are made using reservoir simulation-based optimization study in which different production scenarios and well controls are compared. Such simulations are computationally expensive and so surrogate…

Machine Learning · Computer Science 2022-03-01 Ajitabh Kumar

Many cooperative multi-agent problems require agents to learn individual tasks while contributing to the collective success of the group. This is a challenging task for current state-of-the-art multi-agent reinforcement algorithms that are…

Multiagent Systems · Computer Science 2020-03-25 Hassam Ullah Sheikh , Ladislau Bölöni

A fundamental challenge in multiagent reinforcement learning is to learn beneficial behaviors in a shared environment with other simultaneously learning agents. In particular, each agent perceives the environment as effectively…

An effective way to achieve intelligence is to simulate various intelligent behaviors in the human brain. In recent years, bio-inspired learning methods have emerged, and they are different from the classical mathematical programming…

Artificial Intelligence · Computer Science 2019-04-01 Jieneng Chen , Jingye Chen , Ruiming Zhang , Xiaobin Hu