English
Related papers

Related papers: Hierarchical Soft Actor-Critic: Adversarial Explor…

200 papers

We propose a new simulation-based estimation method, adversarial estimation, for structural models. The estimator is formulated as the solution to a minimax problem between a generator (which generates simulated observations using the…

Econometrics · Economics 2024-01-09 Tetsuya Kaji , Elena Manresa , Guillaume Pouliot

Deep Reinforcement Learning (DRL) algorithms for continuous action spaces are known to be brittle toward hyperparameters as well as \cut{being}sample inefficient. Soft Actor Critic (SAC) proposes an off-policy deep actor critic algorithm…

Machine Learning · Computer Science 2019-06-10 Patrick Nadeem Ward , Ariella Smofsky , Avishek Joey Bose

Shared feature spaces for actor-critic methods aims to capture generalized latent representations to be used by the policy and value function with the hopes for a more stable and sample-efficient optimization. However, such a paradigm…

Machine Learning · Computer Science 2021-06-25 Dom Huh

Machine learning is being integrated into a growing number of critical systems with far-reaching impacts on society. Unexpected behaviour and unfair decision processes are coming under increasing scrutiny due to this widespread use and its…

Machine Learning · Computer Science 2020-09-02 Pieter Delobelle , Paul Temple , Gilles Perrouin , Benoît Frénay , Patrick Heymans , Bettina Berendt

This paper extends off-policy reinforcement learning to the multi-agent case in which a set of networked agents communicating with their neighbors according to a time-varying graph collaboratively evaluates and improves a target policy…

Machine Learning · Computer Science 2019-11-20 Wesley Suttle , Zhuoran Yang , Kaiqing Zhang , Zhaoran Wang , Tamer Basar , Ji Liu

Previous work on adversarially robust neural networks for image classification requires large training sets and computationally expensive training procedures. On the other hand, few-shot learning methods are highly vulnerable to adversarial…

Machine Learning · Computer Science 2020-10-16 Micah Goldblum , Liam Fowl , Tom Goldstein

Imitation learning algorithms can be used to learn a policy from expert demonstrations without access to a reward signal. However, most existing approaches are not applicable in multi-agent settings due to the existence of multiple (Nash)…

Machine Learning · Computer Science 2018-07-27 Jiaming Song , Hongyu Ren , Dorsa Sadigh , Stefano Ermon

The implementation of a multi-microgrid (MMG) system with multiple renewable energy sources enables the facilitation of electricity trading. To tackle the energy management problem of a MMG system, which consists of multiple renewable…

Systems and Control · Electrical Eng. & Systems 2023-04-06 Jiankai Gao , Yang Li , Bin Wang , Haibo Wu

The two-time scale nature of SAC, which is an actor-critic algorithm, is characterised by the fact that the critic estimate has not converged for the actor at any given time, but since the critic learns faster than the actor, it ensures…

Hierarchical agents have the potential to solve sequential decision making tasks with greater sample efficiency than their non-hierarchical counterparts because hierarchical agents can break down tasks into sets of subtasks that only…

Artificial Intelligence · Computer Science 2019-09-05 Andrew Levy , George Konidaris , Robert Platt , Kate Saenko

In cooperative stochastic games multiple agents work towards learning joint optimal actions in an unknown environment to achieve a common goal. In many real-world applications, however, constraints are often imposed on the actions that can…

Multiagent Systems · Computer Science 2020-07-14 Raghuram Bharadwaj Diddigi , Sai Koti Reddy Danda , Prabuchandran K. J. , Shalabh Bhatnagar

Recent advances in deep Reinforcement Learning (RL) have created unprecedented opportunities for intelligent automation, where a machine can autonomously learn an optimal policy for performing a given task. However, current deep RL…

Machine Learning · Computer Science 2021-05-27 Zohreh Raziei , Mohsen Moghaddam

This study develops and evaluates a deep reinforcement learning framework for dynamic portfolio allocation across global equity markets. The Soft Actor-Critic algorithm is used to learn continuous portfolio weights within a Markov Decision…

Portfolio Management · Quantitative Finance 2026-05-19 Kamil Kashif , Robert Ślepaczuk

Discrete-action algorithms have been central to numerous recent successes of deep reinforcement learning. However, applying these algorithms to high-dimensional action tasks requires tackling the combinatorial increase of the number of…

Machine Learning · Computer Science 2019-01-28 Arash Tavakoli , Fabio Pardo , Petar Kormushev

Actor-Critic models are a class of model-free deep reinforcement learning (RL) algorithms that have demonstrated effectiveness across various robot learning tasks. While considerable research has focused on improving training stability and…

Robotics · Computer Science 2025-10-01 Hanlan Yang , Itamar Mishani , Luca Pivetti , Zachary Kingston , Maxim Likhachev

Extracting relevant information from a stream of high-dimensional observations is a central challenge for deep reinforcement learning agents. Actor-critic algorithms add further complexity to this challenge, as it is often unclear whether…

In this paper I present several algorithmic techniques for improving the decision process of multiple types of agents behaving in environments where their interests are in conflict. The interactions between the agents are modelled by using…

Computer Science and Game Theory · Computer Science 2009-08-04 Mugurel Ionut Andreica

We propose Deep Q-Networks (DQN) with model-based exploration, an algorithm combining both model-free and model-based approaches that explores better and learns environments with sparse rewards more efficiently. DQN is a general-purpose,…

Machine Learning · Computer Science 2019-03-25 Stephen Zhen Gou , Yuyang Liu

Decision transformers recast reinforcement learning as a conditional sequence generation problem, offering a simple but effective alternative to traditional value or policy-based methods. A recent key development in this area is the…

Machine Learning · Computer Science 2024-12-16 Zhe Wang , Haozhu Wang , Yanjun Qi

Many recent successful off-policy multi-agent reinforcement learning (MARL) algorithms for cooperative partially observable environments focus on finding factorized value functions, leading to convoluted network structures. Building on the…

Machine Learning · Computer Science 2023-10-27 Raphaël Avalos , Mathieu Reymond , Ann Nowé , Diederik M. Roijers