English
Related papers

Related papers: Belief States for Cooperative Multi-Agent Reinforc…

200 papers

In practical applications, we can rarely assume full observability of a system's environment, despite such knowledge being important for determining a reactive control system's precise interaction with its environment. Therefore, we propose…

Machine Learning · Computer Science 2022-06-24 Edi Muskardin , Martin Tappler , Bernhard K. Aichernig , Ingo Pill

In this paper, we consider the problem of social learning, where a group of agents embedded in a social network are interested in learning an underlying state of the world. Agents have incomplete, noisy, and heterogeneous sources of…

Machine Learning · Computer Science 2024-03-27 Mahyar JafariNodeh , Amir Ajorlou , Ali Jadbabaie

Learning to coordinate many agents in partially observable and highly dynamic environments requires both informative representations and data-efficient training. To address this challenge, we present a novel model-based multi-agent…

Machine Learning · Computer Science 2026-02-16 Zhizun Wang , David Meger

Large language models (LLMs) are increasingly deployed on long-horizon tasks in partially observable environments, where they must act while inferring and tracking a complex environment state over many steps. This leads to two challenges:…

Computation and Language · Computer Science 2026-05-13 Joykirat Singh , Zaid Khan , Archiki Prasad , Justin Chih-Yao Chen , Akshay Nambi , Hyunji Lee , Elias Stengel-Eskin , Mohit Bansal

An experiment is performed to reconstruct an unknown photonic quantum state with a limited amount of copies. A semi-quantum reinforcement learning approach is employed to adapt one qubit state, an "agent," to an unknown quantum state, an…

We study provable multi-agent reinforcement learning (RL) in the general framework of partially observable stochastic games (POSGs). To circumvent the known hardness results and the use of computationally intractable oracles, we advocate…

Machine Learning · Computer Science 2026-03-16 Xiangyu Liu , Kaiqing Zhang

Reinforcement learning aims to learn optimal policies from interaction with environments whose dynamics are unknown. Many methods rely on the approximation of a value function to derive near-optimal policies. In partially observable…

Machine Learning · Computer Science 2022-09-13 Gaspard Lambrechts , Adrien Bolland , Damien Ernst

In an unfamiliar setting, a model-based reinforcement learning agent can be limited by the accuracy of its world model. In this work, we present a novel, training-free approach to improving the performance of such agents separately from…

Machine Learning · Computer Science 2024-02-26 Martin Benfeghoul , Umais Zahid , Qinghai Guo , Zafeirios Fountas

We investigate estimating a human's world belief state using a robot's observations in a dynamic, 3D, and partially observable environment. The methods are grounded in mental model theory, which posits that human decision making, contextual…

Robotics · Computer Science 2026-04-14 Jack Kolb , Aditya Garg , Nikolai Warner , Karen M. Feigh

Applications of Reinforcement Learning (RL), in which agents learn to make a sequence of decisions despite lacking complete information about the latent states of the controlled system, that is, they act under partial observability of the…

Machine Learning · Computer Science 2022-05-26 Qinghua Liu , Alan Chung , Csaba Szepesvári , Chi Jin

Reinforcement learning methods require careful design involving a reward function to obtain the desired action policy for a given task. In the absence of hand-crafted reward functions, prior work on the topic has proposed several methods…

Machine Learning · Computer Science 2018-10-16 Daiki Kimura , Subhajit Chaudhury , Ryuki Tachibana , Sakyasingha Dasgupta

Many real-world tasks involve multiple agents with partial observability and limited communication. Learning is challenging in these settings due to local viewpoints of agents, which perceive the world as non-stationary due to…

Machine Learning · Computer Science 2018-05-23 Shayegan Omidshafiei , Jason Pazis , Christopher Amato , Jonathan P. How , John Vian

Many important robotics problems are partially observable in the sense that a single visual or force-feedback measurement is insufficient to reconstruct the state. Standard approaches involve learning a policy over beliefs or…

Robotics · Computer Science 2021-10-22 Hai Nguyen , Brett Daley , Xinchao Song , Christopher Amato , Robert Platt

We consider the multi-agent reinforcement learning setting with imperfect information in which each agent is trying to maximize its own utility. The reward function depends on the hidden state (or goal) of both agents, so the agents must…

Artificial Intelligence · Computer Science 2018-03-28 Roberta Raileanu , Emily Denton , Arthur Szlam , Rob Fergus

The traditional approach to POMDPs is to convert them into fully observed MDPs by considering a belief state as an information state. However, a belief-state based approach requires perfect knowledge of the system dynamics and is therefore…

Systems and Control · Electrical Eng. & Systems 2024-10-01 Amit Sinha , Aditya Mahajan

The ability to learn and execute optimal control policies safely is critical to realization of complex autonomy, especially where task restarts are not available and/or the systems are safety-critical. Safety requirements are often…

Systems and Control · Electrical Eng. & Systems 2021-10-06 S M Nahid Mahmud , Moad Abudia , Scott A Nivison , Zachary I. Bell , Rushikesh Kamalapurkar

This work examines a social learning problem, where dispersed agents connected through a network topology interact locally to form their opinions (beliefs) as regards certain hypotheses of interest. These opinions evolve over time, since…

Signal Processing · Electrical Eng. & Systems 2023-01-26 Michele Cirillo , Virginia Bordignon , Vincenzo Matta , Ali H. Sayed

In a multi-agent system, agents share their local observations to gain global situational awareness for decision making and collaboration using a message passing system. When to send a message, how to encode a message, and how to leverage…

Multiagent Systems · Computer Science 2024-07-01 Qinwei Huang , Chen Luo , Alex B. Wu , Simon Khan , Hai Li , Qinru Qiu

Most works on multi-agent reinforcement learning focus on scenarios where the state of the environment is fully observable. In this work, we consider a cooperative policy evaluation task in which agents are not assumed to observe the…

Machine Learning · Computer Science 2023-05-17 Mert Kayaalp , Fatima Ghadieh , Ali H. Sayed

We apply recent advances in deep generative modeling to the task of imitation learning from biological agents. Specifically, we apply variations of the variational recurrent neural network model to a multi-agent setting where we learn…

Machine Learning · Computer Science 2020-07-02 Michael Teng , Tuan Anh Le , Adam Scibior , Frank Wood