中文
相关论文

相关论文: ARMS: Automatic Reward Shaping for Sparse-Reward M…

200 篇论文

Intrinsic motivation and reward shaping guide reinforcement learning (RL) agents by adding pseudo-rewards, which can lead to useful emergent behaviors. However, they can also encourage counterproductive exploits, e.g., fixation with noisy…

机器学习 · 计算机科学 2025-03-25 Aly Lidayan , Michael Dennis , Stuart Russell

Multi-agent systems are trained to maximize shared cost objectives, which typically reflect system-level efficiency. However, in the resource-constrained environments of mobility and transportation systems, efficiency may be achieved at the…

多智能体系统 · 计算机科学 2024-10-30 Jasmine Jerry Aloor , Siddharth Nayak , Sydney Dolan , Hamsa Balakrishnan

In the real world, people/entities usually find matches independently and autonomously, such as finding jobs, partners, roommates, etc. It is possible that this search for matches starts with no initial knowledge of the environment. We…

机器学习 · 计算机科学 2021-12-07 Kshitija Taywade , Judy Goldsmith , Brent Harrison

Reinforcement learning (RL) has recently proven great success in various domains. Yet, the design of the reward function requires detailed domain expertise and tedious fine-tuning to ensure that agents are able to learn the desired…

机器人学 · 计算机科学 2023-03-06 Murad Dawood , Nils Dengler , Jorge de Heuvel , Maren Bennewitz

The main challenge in developing effective reinforcement learning (RL) pipelines is often the design and tuning the reward functions. Well-designed shaping reward can lead to significantly faster learning. Naively formulated rewards,…

机器人学 · 计算机科学 2023-07-20 Se Hwan Jeon , Steve Heim , Charles Khazoom , Sangbae Kim

Agent-based models (ABMs) have shown promise for modelling various real world phenomena incompatible with traditional equilibrium analysis. However, a critical concern is the manual definition of behavioural rules in ABMs. Recent…

多智能体系统 · 计算机科学 2024-02-02 Benjamin Patrick Evans , Sumitra Ganesh

In graph-structured multi-agent reinforcement learning (MARL) adversarial tasks such as pursuit and confrontation, agents must coordinate under highly dynamic interactions, where sparse rewards hinder efficient policy learning. We propose…

机器学习 · 计算机科学 2025-11-12 Ruochuan Shi , Runyu Lu , Yuanheng Zhu , Dongbin Zhao

Deep Multi-agent Reinforcement Learning (MARL) relies on neural networks with numerous parameters in multi-agent scenarios, often incurring substantial computational overhead. Consequently, there is an urgent need to expedite training and…

机器学习 · 计算机科学 2024-10-01 Pihe Hu , Shaolong Li , Zhuoran Li , Ling Pan , Longbo Huang

Previous work has shown that when multiple selfish Autonomous Vehicles (AVs) are introduced to future cities and start learning optimal routing strategies using Multi-Agent Reinforcement Learning (MARL), they may destabilize traffic…

多智能体系统 · 计算机科学 2025-10-15 Anastasia Psarou , Łukasz Gorczyca , Dominik Gaweł , Rafał Kucharski

Reward modeling is central to alignment pipelines such as RLHF, RLAIF, and PPO-based policy optimization, yet its reliability is constrained by limited and heterogeneous human preference data that are expensive to collect at scale. While…

机器学习 · 计算机科学 2026-05-26 Payel Bhattacharjee , Osvaldo Simeone , Ravi Tandon

Efficient exploration is important for reinforcement learners to achieve high rewards. In multi-agent systems, coordinated exploration and behaviour is critical for agents to jointly achieve optimal outcomes. In this paper, we introduce a…

Reward Models (RMs) are crucial for online alignment of language models (LMs) with human preferences. However, RM-based preference-tuning is vulnerable to reward hacking, whereby LM policies learn undesirable behaviors from flawed RMs. By…

计算与语言 · 计算机科学 2026-03-05 Daniel Fein , Max Lamparth , Violet Xiang , Mykel J. Kochenderfer , Nick Haber

Efficient and effective learning is one of the ultimate goals of the deep reinforcement learning (DRL), although the compromise has been made in most of the time, especially for the application of robot manipulations. Learning is always…

机器学习 · 计算机科学 2020-03-06 Yongle Luo , Kun Dong , Lili Zhao , Zhiyong Sun , Chao Zhou , Bo Song

Many Multi-Agent Reinforcement Learning (MARL) agents fail to adapt properly to cooperating with agents trained with the same objectives but different seeds, algorithms, or other training differences. This is the problem of Zero-Shot…

机器学习 · 计算机科学 2026-04-29 Keenan Powell , Peihong Yu , Pratap Tokekar

In this paper, we propose a novel framework for designing a fast convergent multi-agent reinforcement learning (MARL)-based medium access control (MAC) protocol operating in a single cell scenario. The user equipments (UEs) are cast as…

网络与互联网体系结构 · 计算机科学 2023-03-01 Luciano Miuccio , Salvatore Riolo , Mehdi Bennis , Daniela Panno

The necessity for cooperation among intelligent machines has popularised cooperative multi-agent reinforcement learning (MARL) in the artificial intelligence (AI) research community. However, many research endeavors have been focused on…

多智能体系统 · 计算机科学 2022-08-04 Jakub Grudzien Kuba , Xidong Feng , Shiyao Ding , Hao Dong , Jun Wang , Yaodong Yang

In recent years Landmark Complexes have been successfully employed for localization-free and metric-free autonomous exploration using a group of sensing-limited and communication-limited robots in a GPS-denied environment. To ensure rapid…

机器人学 · 计算机科学 2022-09-27 Xiatao Sun , Yuwei Wu , Subhrajit Bhattacharya , Vijay Kumar

Finding meaningful and accurate dense rewards is a fundamental task in the field of reinforcement learning (RL) that enables agents to explore environments more efficiently. In traditional RL settings, agents learn optimal policies through…

人工智能 · 计算机科学 2025-12-05 Shuyuan Zhang

The difficulty of appropriately assigning credit is particularly heightened in cooperative MARL with sparse reward, due to the concurrent time and structural scales involved. Automatic subgoal generation (ASG) has recently emerged as a…

机器学习 · 计算机科学 2023-10-03 Wenhao Li , Dan Qiao , Baoxiang Wang , Xiangfeng Wang , Bo Jin , Hongyuan Zha

In this paper, we consider cooperative multi-agent reinforcement learning (MARL) with sparse reward. To tackle this problem, we propose a novel method named MASER: MARL with subgoals generated from experience replay buffer. Under the…

机器学习 · 计算机科学 2022-06-23 Jeewon Jeon , Woojun Kim , Whiyoung Jung , Youngchul Sung