English
Related papers

Related papers: STAS: Spatial-Temporal Return Decomposition for Mu…

200 papers

Complex multi-robot missions often require heterogeneous teams to jointly optimize task allocation, scheduling, and path planning to improve team performance under strict constraints. We formalize these complexities into a new class of…

Robotics · Computer Science 2026-01-07 Jiazhen Liu , Glen Neville , Jinwoo Park , Sonia Chernova , Harish Ravichandar

Deep reinforcement learning in partially observable environments is a difficult task in itself, and can be further complicated by a sparse reward signal. Most tasks involving navigation in three-dimensional environments provide the agent…

Machine Learning · Computer Science 2023-10-17 Matvey Gerasyov , Ilya Makarov

Rewards play an essential role in reinforcement learning. In contrast to rule-based game environments with well-defined reward functions, complex real-world robotic applications, such as contact-rich manipulation, lack explicit and…

Machine Learning · Computer Science 2022-05-30 Yuning Wu , Jieliang Luo , Hui Li

Signal Temporal Logic (STL) is a powerful framework for describing the complex temporal and logical behaviour of the dynamical system. Numerous studies have attempted to employ reinforcement learning to learn a controller that enforces STL…

Systems and Control · Electrical Eng. & Systems 2023-12-05 Naman Saxena , Gorantla Sandeep , Pushpak Jagtap

Multi-agent hierarchical reinforcement learning (MAHRL) has been studied as an effective means to solve intelligent decision problems in complex and large-scale environments. However, most current MAHRL algorithms follow the traditional way…

Artificial Intelligence · Computer Science 2024-11-05 Chanjuan Liu , Jinmiao Cong , Bingcai Chen , Yaochu Jin , Enqiang Zhu

Continual Reinforcement Learning (CRL) is essential for developing agents that can learn, adapt, and accumulate knowledge over time. However, a fundamental challenge persists as agents must strike a delicate balance between plasticity,…

Machine Learning · Computer Science 2025-03-11 Chengqi Zheng , Haiyan Yin , Jianda Chen , Terence Ng , Yew-Soon Ong , Ivor Tsang

This paper presents the first sufficient conditions that guarantee the stability and almost sure convergence of multi-timescale stochastic approximation (SA) iterates. It extends the existing results on one-timescale and two-timescale SA…

Systems and Control · Electrical Eng. & Systems 2025-10-16 Rohan Deb , Swetha Ganesh , Shalabh Bhatnagar

The difficulty of appropriately assigning credit is particularly heightened in cooperative MARL with sparse reward, due to the concurrent time and structural scales involved. Automatic subgoal generation (ASG) has recently emerged as a…

Machine Learning · Computer Science 2023-10-03 Wenhao Li , Dan Qiao , Baoxiang Wang , Xiangfeng Wang , Bo Jin , Hongyuan Zha

Centralized training with decentralized execution (CTDE) has been the dominant paradigm in multi-agent reinforcement learning (MARL), but its reliance on global state information during training introduces scalability, robustness, and…

Machine Learning · Computer Science 2026-01-27 Shahil Shaik , Jonathon M. Smereka , Yue Wang

Recently, deep multiagent reinforcement learning (MARL) has become a highly active research area as many real-world problems can be inherently viewed as multiagent systems. A particularly interesting and widely applicable class of problems…

Multiagent Systems · Computer Science 2020-02-11 Yaodong Yang , Jianye Hao , Guangyong Chen , Hongyao Tang , Yingfeng Chen , Yujing Hu , Changjie Fan , Zhongyu Wei

Social intelligence, the ability to navigate complex interpersonal interactions, presents a fundamental challenge for language agents. Training such agents via reinforcement learning requires solving the credit assignment problem:…

Artificial Intelligence · Computer Science 2026-04-22 Xiachong Feng , Yi Jiang , Xiaocheng Feng , Deyi Yin , Libo Qin , Yangfan Ye , Lei Huang , Weitao Ma , Yuxuan Gu , Chonghan Qin , Bing Qin , Lingpeng Kong

Efficient collaboration in the centralized training with decentralized execution (CTDE) paradigm remains a challenge in cooperative multi-agent systems. We identify divergent action tendencies among agents as a significant obstacle to…

Multiagent Systems · Computer Science 2024-08-30 Junkai Zhang , Yifan Zhang , Xi Sheryl Zhang , Yifan Zang , Jian Cheng

This paper studies fully decentralized cooperative multi-agent reinforcement learning, where each agent solely observes the states, its local actions, and the shared rewards. The inability to access other agents' actions often leads to…

Machine Learning · Computer Science 2026-05-12 Chao Li , Bingkun Bao , Yang Gao

In this report, we introduce the Winner method for HACS Temporal Action Localization Challenge 2019. Temporal action localization is challenging since a target proposal may be related to several other candidate proposals in an untrimmed…

Computer Vision and Pattern Recognition · Computer Science 2019-12-10 Songyang Zhang , Houwen Peng , Le Yang , Jianlong Fu , Jiebo Luo

In tabular multi-agent reinforcement learning with average-cost criterion, a team of agents sequentially interacts with the environment and observes local incentives. We focus on the case that the global reward is a sum of local rewards,…

Optimization and Control · Mathematics 2021-10-26 Alec Koppel , Amrit Singh Bedi , Bhargav Ganguly , Vaneet Aggarwal

For reinforcement learning systems to be widely adopted, their users must understand and trust them. We present a theoretical analysis of explaining reinforcement learning using Shapley values, following a principled approach from game…

Machine Learning · Computer Science 2023-06-12 Daniel Beechey , Thomas M. S. Smith , Özgür Şimşek

We study the problem of cooperative multi-agent reinforcement learning with a single joint reward signal. This class of learning problems is difficult because of the often large combined action and observation spaces. In the fully…

Adapting pre-trained models with broad capabilities has become standard practice for learning a wide range of downstream tasks. The typical approach of fine-tuning different models for each task is performant, but incurs a substantial…

In user-agent interaction scenarios such as recommendation, brainstorming, and code suggestion, Large Language Models (LLMs) often generate sets of candidate recommendations where the objective is to maximize the collective utility of the…

Artificial Intelligence · Computer Science 2026-04-01 Rui Ai , Yu Pan , David Simchi-Levi , Chonghuan Wang

In this paper, we propose a novel Spatial Balance Attention block for spatiotemporal forecasting. To strike a balance between obeying spatial proximity and capturing global correlation, we partition the spatial graph into a set of subgraphs…

Machine Learning · Computer Science 2025-09-24 Hongyi Chen , Xiucheng Li , Xinyang Chen , Jing Li , Kehai Chen , Liqiang Nie