English
Related papers

Related papers: Counterfactual Conditional Likelihood Rewards for …

200 papers

Measuring the contribution of individual agents is challenging in cooperative multi-agent reinforcement learning (MARL). In cooperative MARL, team performance is typically inferred from a single shared global reward. Arguably, among the…

Artificial Intelligence · Computer Science 2024-01-29 Omayma Mahjoub , Ruan de Kock , Siddarth Singh , Wiem Khlifi , Abidine Vall , Kale-ab Tessera , Arnu Pretorius

Reward engineering and designing an incentive reward function are non-trivial tasks to train agents in complex environments. Furthermore, an inaccurate reward function may lead to a biased behaviour which is far from an efficient and…

Robotics · Computer Science 2021-05-04 Saeed Tafazzol , Erfan Fathi , Mahdi Rezaei , Ehsan Asali

Collaborations among various entities, such as companies, research labs, AI agents, and edge devices, have become increasingly crucial for achieving machine learning tasks that cannot be accomplished by a single entity alone. This is likely…

Machine Learning · Computer Science 2023-05-29 Xinran Wang , Qi Le , Ahmad Faraz Khan , Jie Ding , Ali Anwar

Exploration is a fundamental aspect of reinforcement learning (RL), and its effectiveness is a deciding factor in the performance of RL algorithms, especially when facing sparse extrinsic rewards. Recent studies have shown the effectiveness…

Machine Learning · Computer Science 2023-05-19 Shanchuan Wan , Yujin Tang , Yingtao Tian , Tomoyuki Kaneko

We present evidence of substantial benefit from efficient exploration in gathering human feedback to improve large language models. In our experiments, an agent sequentially generates queries while fitting a reward model to the feedback…

Machine Learning · Computer Science 2024-06-06 Vikranth Dwaracherla , Seyed Mohammad Asghari , Botao Hao , Benjamin Van Roy

In the early stages of human life, babies develop their skills by exploring different scenarios motivated by their inherent satisfaction rather than by extrinsic rewards from the environment. This behavior, referred to as intrinsic…

Machine Learning · Computer Science 2022-02-25 Alain Andres , Esther Villar-Rodriguez , Javier Del Ser

There is a growing interest in Multi-Agent Reinforcement Learning (MARL) as the first steps towards building general intelligent agents that learn to make low and high-level decisions in non-stationary complex environments in the presence…

Artificial Intelligence · Computer Science 2020-01-01 Marco Jerome Gasparrini , Ricard Solé , Martí Sánchez-Fibla

Efficient exploration is necessary to achieve good sample efficiency for reinforcement learning in general. From small, tabular settings such as gridworlds to large, continuous and sparse reward settings such as robotic object manipulation…

Machine Learning · Computer Science 2019-06-20 Zhaohan Daniel Guo , Emma Brunskill

Scientific discovery still relies heavily on the manual efforts of individual researchers, leading to limited exploration, redundant trials, and reduced reproducibility. Human-participant data analysis competitions generate diverse…

Multiagent Systems · Computer Science 2026-03-05 Satoshi Oyama , Yuko Sakurai , Hisashi Kashima

Multi-agent reinforcement learning (MARL) has reached competitive performance on cooperative tasks against scripted adversaries, yet most methods train agents at a single fixed difficulty throughout the entire run. We term this…

Artificial Intelligence · Computer Science 2026-05-07 Weiqiang Jin , Yang Liu , Shixiang Tang , Jinhu Qi , Wentao Zhang , Junli Wang , Biao Zhao , Hongyang Du

Efficient exploration remains one of the longstanding problems of deep reinforcement learning. Instead of depending solely on extrinsic rewards from the environments, existing methods use intrinsic rewards to enhance exploration. However,…

Machine Learning · Computer Science 2024-12-09 SuMin Oh , WanSoo Kim , HyunJin Kim

In cooperative multi-agent reinforcement learning (MARL), how to design a suitable reward signal to accelerate learning and stabilize convergence is a critical problem. The global reward signal assigns the same global reward to all agents…

Artificial Intelligence · Computer Science 2020-03-10 Hangyu Mao , Zhibo Gong , Zhen Xiao

We propose an improved algorithm by identifying and encouraging cooperative behavior in multi-agent environments. First, we analyze the shortcomings of existing algorithms in addressing multi-agent reinforcement learning problems. Then,…

Multiagent Systems · Computer Science 2025-08-21 Junjie Qi , Siqi Mao , Tianyi Tan

Many real-world multiagent learning problems involve safety concerns. In these setups, typical safe reinforcement learning algorithms constrain agents' behavior, limiting exploration -- a crucial component for discovering effective…

Multiagent Systems · Computer Science 2025-08-27 Ayhan Alp Aydeniz , Enrico Marchesini , Robert Loftin , Christopher Amato , Kagan Tumer

Designing protocols enhancing cooperation for multi-agent systems remains a grand challenge. Cheap talk, defined as costless, non-binding communication before formal action, serves as a pivotal solution. However, existing theoretical…

Multiagent Systems · Computer Science 2026-03-03 Zhao Song , Chen Shen , Zhen Wang , The Anh Han

Multi-agent systems often require agents to collaborate with or compete against other agents with diverse goals, behaviors, or strategies. Agent modeling is essential when designing adaptive policies for intelligent machine agents in…

Multiagent Systems · Computer Science 2025-07-29 Wenhao Ma , Yu-Cheng Chang , Jie Yang , Yu-Kai Wang , Chin-Teng Lin

The multi-agent setting is intricate and unpredictable since the behaviors of multiple agents influence one another. To address this environmental uncertainty, distributional reinforcement learning algorithms that incorporate uncertainty…

Machine Learning · Computer Science 2023-03-06 Jihwan Oh , Joonkee Kim , Minchan Jeong , Se-Young Yun

In cooperative multi-agent reinforcement learning (CMARL), it is critical for agents to achieve a balance between self-exploration and team collaboration. However, agents can hardly accomplish the team task without coordination and they…

Machine Learning · Computer Science 2023-09-28 Shaowei Zhang , Jiahan Cao , Lei Yuan , Yang Yu , De-Chuan Zhan

Multi-agent hierarchical reinforcement learning (MAHRL) has been studied as an effective means to solve intelligent decision problems in complex and large-scale environments. However, most current MAHRL algorithms follow the traditional way…

Artificial Intelligence · Computer Science 2024-11-05 Chanjuan Liu , Jinmiao Cong , Bingcai Chen , Yaochu Jin , Enqiang Zhu

Deep reinforcement learning (DRL) has been proven its efficiency in capturing users' dynamic interests in recent literature. However, training a DRL agent is challenging, because of the sparse environment in recommender systems (RS), DRL…

Information Retrieval · Computer Science 2022-09-20 Xiaocong Chen , Siyu Wang , Lina Yao , Lianyong Qi , Yong Li