English
Related papers

Related papers: Counterfactual Conditional Likelihood Rewards for …

200 papers

Many cooperative multiagent reinforcement learning environments provide agents with a sparse team-based reward, as well as a dense agent-specific reward that incentivizes learning basic skills. Training policies solely on the team-based…

Machine Learning · Computer Science 2020-10-13 Shauharda Khadka , Somdeb Majumdar , Santiago Miret , Stephen McAleer , Kagan Tumer

The success of teams in robotics, nature, and society often depends on the division of labor among diverse specialists; however, a principled explanation for when such diversity surpasses a homogeneous team is still missing. Focusing on…

Multiagent Systems · Computer Science 2026-03-03 Michael Amir , Matteo Bettini , Amanda Prorok

The Centralized Training with Decentralized Execution (CTDE) paradigm is widely used in cooperative multi-agent reinforcement learning. However, conventional methods based on CTDE can suffer from value underestimation and converge to…

Multiagent Systems · Computer Science 2026-05-05 Ruoning Zhang , Siying Wang , Wenyu Chen , Yang Zhou , Zhitong Zhao , Zixuan Zhang , Ruijie Zhang , Stefano V. Albrecht

In lifelong learning, an agent learns throughout its entire life without resets, in a constantly changing environment, as we humans do. Consequently, lifelong learning comes with a plethora of research problems such as continual domain…

Reinforcement learning (RL) agents improve through trial-and-error, but when reward is sparse and the agent cannot discover successful action sequences, learning stagnates. This has been a notable problem in training deep RL agents to…

Artificial Intelligence · Computer Science 2018-02-27 Evan Zheran Liu , Kelvin Guu , Panupong Pasupat , Tianlin Shi , Percy Liang

With the advancements of artificial intelligence (AI), we're seeing more scenarios that require AI to work closely with other agents, whose goals and strategies might not be known beforehand. However, existing approaches for training…

Artificial Intelligence · Computer Science 2024-03-25 Zuyuan Zhang , Hanhan Zhou , Mahdi Imani , Taeyoung Lee , Tian Lan

Standard computer vision systems assume access to intelligently captured inputs (e.g., photos from a human photographer), yet autonomously capturing good observations is a major challenge in itself. We address the problem of learning to…

Computer Vision and Pattern Recognition · Computer Science 2019-06-28 Santhosh K. Ramakrishnan , Dinesh Jayaraman , Kristen Grauman

A reinforcement learning agent tries to maximize its cumulative payoff by interacting in an unknown environment. It is important for the agent to explore suboptimal actions as well as to pick actions with highest known rewards. Yet, in…

Machine Learning · Computer Science 2019-01-23 Reazul Hasan Russel

We consider a novel variant of the contextual bandit problem (i.e., the multi-armed bandit with side-information, or context, available to a decision-maker) where the reward associated with each context-based decision may not always be…

Machine Learning · Computer Science 2020-07-21 Djallel Bouneffouf , Sohini Upadhyay , Yasaman Khazaeni

Safe exploration aims at addressing the limitations of Reinforcement Learning (RL) in safety-critical scenarios, where failures during trial-and-error learning may incur high costs. Several methods exist to incorporate external knowledge or…

Machine Learning · Computer Science 2023-07-13 Xiaotong Ji , Antonio Filieri

Fast adapting to unknown peers (partners or opponents) with different strategies is a key challenge in multi-agent games. To do so, it is crucial for the agent to probe and identify the peer's strategy efficiently, as this is the…

Artificial Intelligence · Computer Science 2024-08-12 Long Ma , Yuanfei Wang , Fangwei Zhong , Song-Chun Zhu , Yizhou Wang

Reward shaping is effective in addressing the sparse-reward challenge in reinforcement learning (RL) by providing immediate feedback through auxiliary, informative rewards. Based on the reward shaping strategy, we propose a novel multi-task…

Machine Learning · Computer Science 2025-10-28 Haozhe Ma , Zhengding Luo , Thanh Vinh Vo , Kuankuan Sima , Tze-Yun Leong

This paper investigates the dynamics of competition among organizations with unequal expertise. Multi-agent reinforcement learning has been used to simulate and understand the impact of various incentive schemes designed to offset such…

Computer Science and Game Theory · Computer Science 2022-01-06 Paramita Koley , Aurghya Maiti , Sourangshu Bhattacharya , Niloy Ganguly

We study cooperative multi-agent reinforcement learning in the setting of reward-free exploration, where multiple agents jointly explore an unknown MDP in order to learn its dynamics (without observing rewards). We focus on a tabular…

Machine Learning · Computer Science 2026-05-14 Idan Barnea , Orin Levy , Yishay Mansour

Reinforcement Learning with Verifiable Rewards (RLVR) is a powerful paradigm for enhancing the reasoning ability of Large Language Models (LLMs). Yet current RLVR methods often explore poorly, leading to premature convergence and entropy…

Computation and Language · Computer Science 2025-09-12 Runpeng Dai , Linfeng Song , Haolin Liu , Zhenwen Liang , Dian Yu , Haitao Mi , Zhaopeng Tu , Rui Liu , Tong Zheng , Hongtu Zhu , Dong Yu

Reinforcement learning (RL) agents are particularly hard to train when rewards are sparse. One common solution is to use intrinsic rewards to encourage agents to explore their environment. However, recent intrinsic exploration methods often…

Machine Learning · Computer Science 2022-11-23 Jesse Mu , Victor Zhong , Roberta Raileanu , Minqi Jiang , Noah Goodman , Tim Rocktäschel , Edward Grefenstette

Role-Playing Language Agents (RPLAs) have emerged as a significant application direction for Large Language Models (LLMs). Existing approaches typically rely on prompt engineering or supervised fine-tuning to enable models to imitate…

Computation and Language · Computer Science 2025-07-24 Cheng Liu , Yifei Lu , Fanghua Ye , Jian Li , Xingyu Chen , Feiliang Ren , Zhaopeng Tu , Xiaolong Li

The recent adoption of machine learning as a tool in real world decision making has spurred interest in understanding how these decisions are being made. Counterfactual Explanations are a popular interpretable machine learning technique…

Machine Learning · Computer Science 2021-10-05 Andrew O'Brien , Edward Kim

Collaborative multi-agent exploration of unknown environments is crucial for search and rescue operations. Effective real-world deployment must address challenges such as limited inter-agent communication and static and dynamic obstacles.…

Robotics · Computer Science 2024-12-31 Gabriele Calzolari , Vidya Sumathy , Christoforos Kanellakis , George Nikolakopoulos

To promote cooperation in Multi-Agent Reinforcement Learning, the reward signals of all agents can be aggregated together, forming global rewards that are commonly known as the fully cooperative setting. However, global rewards are usually…

Machine Learning · Computer Science 2026-01-30 Bang Giang Le , Viet Cuong Ta