English
Related papers

Related papers: Agent-Temporal Credit Assignment for Optimal Polic…

200 papers

Reinforcement learning for embodied agents is a challenging problem. The accumulated reward to be optimized is often a very rugged function, and gradient methods are impaired by many local optimizers. We demonstrate, in an experimental…

Artificial Intelligence · Computer Science 2016-06-01 Guido Montufar , Keyan Ghazi-Zahedi , Nihat Ay

In this paper, we propose capturing and utilizing \textit{Temporal Information through Graph-based Embeddings and Representations} or \textbf{TIGER} to enhance multi-agent reinforcement learning (MARL). We explicitly model how inter-agent…

Machine Learning · Computer Science 2025-11-13 Nikunj Gupta , Ludwika Twardecka , James Zachary Hare , Jesse Milzman , Rajgopal Kannan , Viktor Prasanna

We study the problem of cooperative multi-agent reinforcement learning with a single joint reward signal. This class of learning problems is difficult because of the often large combined action and observation spaces. In the fully…

Recent advances in deep reinforcement learning algorithms have shown great potential and success for solving many challenging real-world problems, including Go game and robotic applications. Usually, these algorithms need a carefully…

Machine Learning · Computer Science 2019-06-03 Yang Liu , Yunan Luo , Yuanyi Zhong , Xi Chen , Qiang Liu , Jian Peng

Many real-world robot learning problems, such as pick-and-place or arriving at a destination, can be seen as a problem of reaching a goal state as soon as possible. These problems, when formulated as episodic reinforcement learning tasks,…

Robotics · Computer Science 2024-07-10 Gautham Vasan , Yan Wang , Fahim Shahriar , James Bergstra , Martin Jagersand , A. Rupam Mahmood

Agentic Reinforcement Learning (RL) shows promise for complex tasks, but Text-to-SQL remains mostly restricted to single-turn paradigms. A primary bottleneck is the credit assignment problem. In traditional paradigms, rewards are determined…

Artificial Intelligence · Computer Science 2026-03-18 Long Li , Zhijian Zhou , Jiangxuan Long , Peiyang Liu , Weidi Xu , Zhe Wang , Shirui Pan , Chao Qu

Multiagent reinforcement learning (MARL) can solve complex cooperative tasks. However, the efficiency of existing MARL methods relies heavily on well-defined reward functions. Multiagent tasks with sparse reward feedback are especially…

Artificial Intelligence · Computer Science 2022-08-08 Qingxu Fu , Tenghai Qiu , Zhiqiang Pu , Jianqiang Yi , Wanmai Yuan

One approach for improving sample efficiency in cooperative multi-agent learning is to decompose overall tasks into sub-tasks that can be assigned to individual agents. We study this problem in the context of reward machines: symbolic tasks…

Multiagent Systems · Computer Science 2025-02-20 Ameesh Shah , Niklas Lauffer , Thomas Chen , Nikhil Pitta , Sanjit A. Seshia

Consider a typical organization whose worker agents seek to collectively cooperate for its general betterment. However, each individual agent simultaneously seeks to act to secure a larger chunk than its co-workers of the annual increment…

Machine Learning · Computer Science 2020-10-19 Keyang He , Bikramjit Banerjee , Prashant Doshi

With the rapid advancement of large language models and vision-language models, employing large models as Web Agents has become essential for automated web interaction. However, training Web Agents with reinforcement learning faces critical…

Machine Learning · Computer Science 2025-09-22 Ziyuan Chen , Zhenghui Zhao , Zhangye Han , Miancan Liu , Xianhang Ye , Yiqing Li , Hongbo Min , Jinkui Ren , Xiantao Zhang , Guitao Cao

Present bias, the tendency to overvalue immediate rewards while undervaluing future ones, is a well-known barrier to achieving long-term goals. As artificial intelligence and behavioral economics increasingly focus on this phenomenon, the…

Computer Science and Game Theory · Computer Science 2024-09-18 Yasunori Akagi , Hideaki Kim , Takeshi Kurashima

Cooperative multi-agent reinforcement learning (MARL) is a challenging task, as agents must learn complex and diverse individual strategies from a shared team reward. However, existing methods struggle to distinguish and exploit important…

Multiagent Systems · Computer Science 2023-05-26 Xunhan Hu , Jian Zhao , Wengang Zhou , Ruili Feng , Houqiang Li

Prioritized Experience Replay (PER) enables the model to learn more about relatively important samples by artificially changing their accessed frequencies. However, this non-uniform sampling method shifts the state-action distribution that…

Machine Learning · Computer Science 2023-11-27 Zhuoying Chen , Huiping Li , Zhaoxu Wang

Many Multi-Agent Reinforcement Learning (MARL) agents fail to adapt properly to cooperating with agents trained with the same objectives but different seeds, algorithms, or other training differences. This is the problem of Zero-Shot…

Machine Learning · Computer Science 2026-04-29 Keenan Powell , Peihong Yu , Pratap Tokekar

The intelligent control of the traffic signal is critical to the optimization of transportation systems. To achieve global optimal traffic efficiency in large-scale road networks, recent works have focused on coordination among…

Artificial Intelligence · Computer Science 2020-09-17 Junjia Liu , Huimin Zhang , Zhuang Fu , Yao Wang

Inferring reward functions from demonstrations and pairwise preferences are auspicious approaches for aligning Reinforcement Learning (RL) agents with human intentions. However, state-of-the art methods typically focus on learning a single…

Machine Learning · Computer Science 2022-01-04 Markus Peschl , Arkady Zgonnikov , Frans A. Oliehoek , Luciano C. Siebert

Reinforcement learning algorithms in multi-agent systems deliver highly resilient and adaptable solutions for common problems in telecommunications,aerospace, and industrial robotics. However, achieving an optimal global goal remains a…

Multiagent Systems · Computer Science 2021-05-18 Changgang Zheng , Shufan Yang , Juan Parra-Ullauri , Antonio Garcia-Dominguez , Nelly Bencomo

How to train a generalizable meta-policy by continually learning a sequence of tasks? It is a natural human skill yet challenging to achieve by current reinforcement learning: the agent is expected to quickly adapt to new tasks (plasticity)…

Machine Learning · Computer Science 2023-06-06 Yijun Yang , Tianyi Zhou , Jing Jiang , Guodong Long , Yuhui Shi

Reinforcement Learning (RL) algorithms can suffer from poor sample efficiency when rewards are delayed and sparse. We introduce a solution that enables agents to learn temporally extended actions at multiple levels of abstraction in a…

Machine Learning · Computer Science 2019-03-11 Andrew Levy , Robert Platt , Kate Saenko

In multi-vehicle cooperative driving tasks involving high-frequency continuous control, traditional state-based reward functions suffer from the issue of vanishing reward differences. This phenomenon results in a low signal-to-noise ratio…

Artificial Intelligence · Computer Science 2025-11-24 Ye Han , Lijun Zhang , Dejian Meng , Zhuang Zhang