中文
相关论文

相关论文: Distributed Soft Actor-Critic with Multivariate Re…

200 篇论文

In this paper, we present a new intrinsically motivated actor-critic algorithm for learning continuous motor skills directly from raw visual input. Our neural architecture is composed of a critic and an actor network. Both networks receive…

机器学习 · 计算机科学 2019-02-19 Muhammad Burhan Hafez , Cornelius Weber , Matthias Kerzel , Stefan Wermter

Delayed and sparse rewards present a fundamental obstacle for reinforcement-learning (RL) agents, which struggle to assign credit for actions whose benefits emerge many steps later. The sliding-tile game 2048 epitomizes this challenge:…

机器学习 · 计算机科学 2025-07-28 Prady Saligram , Tanvir Bhathal , Robby Manihani

Reactive stepping and push recovery for biped robots is often restricted to flat terrains because of the difficulty in computing capture regions for nonlinear dynamic models. In this paper, we address this limitation by using reinforcement…

机器人学 · 计算机科学 2020-10-29 Avadesh Meduri , Majid Khadiv , Ludovic Righetti

Soft robotic manipulators offer operational advantage due to their compliant and deformable structures. However, their inherently nonlinear dynamics presents substantial challenges. Traditional analytical methods often depend on simplifying…

机器人学 · 计算机科学 2024-10-28 Uljad Berdica , Matthew Jackson , Niccolò Enrico Veronese , Jakob Foerster , Perla Maiolino

Drawing an inspiration from behavioral studies of human decision making, we propose here a more general and flexible parametric framework for reinforcement learning that extends standard Q-learning to a two-stream model for processing…

机器学习 · 计算机科学 2020-04-15 Baihan Lin , Guillermo Cecchi , Djallel Bouneffouf , Jenna Reinen , Irina Rish

We introduce a sequence-conditioned critic for Soft Actor--Critic (SAC) that models trajectory context with a lightweight Transformer and trains on aggregated $N$-step targets. Unlike prior approaches that (i) score state--action pairs in…

机器学习 · 计算机科学 2025-09-30 Dong Tian , Onur Celik , Gerhard Neumann

We propose a distributed deep learning model to successfully learn control policies directly from high-dimensional sensory input using reinforcement learning. The model is based on the deep Q-network, a convolutional neural network trained…

机器学习 · 计算机科学 2015-10-16 Hao Yi Ong , Kevin Chavez , Augustus Hong

We introduce D2AC, a new model-free reinforcement learning (RL) algorithm designed to train expressive diffusion policies online effectively. At its core is a policy improvement objective that avoids the high variance of typical policy…

机器学习 · 计算机科学 2026-05-25 Lunjun Zhang , Shuo Han , Hanrui Lyu , Bradly C Stadie

Turbulent diffusion causes particles placed in proximity to separate. We investigate the required swimming efforts to maintain an active particle close to its passively advected counterpart. We explore optimally balancing these efforts by…

系统与控制 · 电气工程与系统科学 2024-11-12 Christopher Koh , Laurent Pagnier , Michael Chertkov

We study the statistical properties of trainable agents moving in discrete space. After introducing the mathematical framework, we first analyze the dynamics of two completely random walkers, mutually competing in a chaser-target…

Multi-agent reinforcement learning involves multiple agents interacting with each other and a shared environment to complete tasks. When rewards provided by the environment are sparse, agents may not receive immediate feedback on the…

机器学习 · 计算机科学 2021-03-31 Baicen Xiao , Bhaskar Ramasubramanian , Radha Poovendran

In this paper, we consider the problem of actor-critic reinforcement learning. Firstly, we extend the actor-critic architecture to actor-critic-N architecture by introducing more critics beyond rewards. Secondly, we combine the reward-based…

机器学习 · 计算机科学 2020-06-15 Weiya Ren

This paper introduces two learning schemes for distributed agents in Reinforcement Learning (RL) environments, namely Reward-Weighted (R-Weighted) and Loss-Weighted (L-Weighted) gradient merger. The R/L weighted methods replace standard…

机器学习 · 计算机科学 2024-08-20 Martin Holen , Per-Arne Andersen , Kristian Muri Knausgård , Morten Goodwin

Text-based games are a popular testbed for language-based reinforcement learning (RL). In previous work, deep Q-learning is commonly used as the learning agent. Q-learning algorithms are challenging to apply to complex real-world domains…

机器学习 · 计算机科学 2023-06-28 Weichen Li , Rati Devidze , Sophie Fellenz

Drawing an inspiration from behavioral studies of human decision making, we propose here a general parametric framework for a reinforcement learning problem, which extends the standard Q-learning approach to incorporate a two-stream…

机器学习 · 计算机科学 2019-11-14 Baihan Lin , Djallel Bouneffouf , Guillermo Cecchi

In many robotic applications, some aspects of the system dynamics can be modeled accurately while others are difficult to obtain or model. We present a novel reinforcement learning (RL) method for continuous state and action spaces that…

人工智能 · 计算机科学 2017-06-06 Tomoki Nishi , Prashant Doshi , Michael R. James , Danil Prokhorov

To date, distributional reinforcement learning (distributional RL) methods have exclusively focused on the discounted setting, where an agent aims to optimize a discounted sum of rewards over time. In this work, we extend distributional RL…

机器学习 · 计算机科学 2026-01-14 Juan Sebastian Rojas , Chi-Guhn Lee

This paper presents a novel approach to multi-agent reinforcement learning (RL) for linear systems with convex polytopic constraints. Existing work on RL has demonstrated the use of model predictive control (MPC) as a function approximator…

系统与控制 · 电气工程与系统科学 2025-01-06 Samuel Mallick , Filippo Airaldi , Azita Dabiri , Bart De Schutter

Deep reinforcement learning (RL) has proven a powerful technique in many sequential decision making domains. However, Robotics poses many challenges for RL, most notably training on a physical system can be expensive and dangerous, which…

机器人学 · 计算机科学 2017-10-19 Lerrel Pinto , Marcin Andrychowicz , Peter Welinder , Wojciech Zaremba , Pieter Abbeel

Deep Reinforcement Learning is emerging as a promising approach for the continuous control task of robotic arm movement. However, the challenges of learning robust and versatile control capabilities are still far from being resolved for…