English
Related papers

Related papers: Scalable Planning and Learning for Multiagent POMD…

200 papers

Multi-agent systems are often limited in terms of persistenceand scalability. This issue is more prevalent for applications inwhich agent states changes frequently. This makes the existingmethods less usable as they increase the agent's…

Artificial Intelligence · Computer Science 2020-09-18 Nauman Khalid , Ghalib Ahmed Tahir , Peter Bloodsworth

We consider the online planning problem for a team of agents to discover and track an unknown and time-varying number of moving objects from onboard sensor measurements with uncertain measurement-object origins. Since the onboard sensors…

Multiagent Systems · Computer Science 2024-07-09 Hoa Van Nguyen , Ba-Ngu Vo , Ba-Tuong Vo , Hamid Rezatofighi , Damith C. Ranasinghe

Planning and learning in Partially Observable MDPs (POMDPs) are among the most challenging tasks in both the AI and Operation Research communities. Although solutions to these problems are intractable in general, there might be special…

Artificial Intelligence · Computer Science 2012-07-09 Eyal Even-Dar , Sham M. Kakade , Yishay Mansour

Multi-Agent Path Finding (MAPF) involves determining paths for multiple agents to travel simultaneously and collision-free through a shared area toward given goal locations. This problem is computationally complex, especially when dealing…

Artificial Intelligence · Computer Science 2026-03-02 Paul Friedrich , Yulun Zhang , Michael Curry , Ludwig Dierks , Stephen McAleer , Jiaoyang Li , Tuomas Sandholm , Sven Seuken

Partial observability is a common challenge in many reinforcement learning applications, which requires an agent to maintain memory, infer latent states, and integrate this past information into exploration. This challenge leads to a number…

Machine Learning · Computer Science 2020-10-27 Chi Jin , Sham M. Kakade , Akshay Krishnamurthy , Qinghua Liu

Development of guidance, navigation and control frameworks/algorithms for swarms attracted significant attention in recent years. That being said, algorithms for planning swarm allocations/trajectories for engaging with enemy swarms is…

Artificial Intelligence · Computer Science 2022-12-07 Umut Demir , A. Sadik Satir , Gulay Goktas Sever , Cansu Yikilmaz , Nazim Kemal Ure

Many interventions, such as vaccines in clinical trials or coupons in online marketplaces, must be assigned sequentially without full knowledge of their effects. Multi-armed bandit algorithms have proven successful in such settings.…

Machine Learning · Statistics 2026-05-07 Aidan Gleich , Eric Laber , Alexander Volfovsky

Many real-world multi-agent systems exhibit nonlinear dynamics and complex inter-agent interactions. As these systems increase in scale, the main challenges arise from achieving scalability and handling nonconvexity. To address these…

Optimization and Control · Mathematics 2025-10-22 Taehyun Yoon , Augustinos D. Saravanos , Evangelos A. Theodorou

The multinomial probit model is a popular tool for analyzing choice behaviour as it allows for correlation between choice alternatives. Because current model specifications employ a full covariance matrix of the latent utilities for the…

Econometrics · Economics 2021-03-25 Ruben Loaiza-Maya , Didier Nibbering

The design of autonomous agents that can interact effectively with other agents without prior coordination is a core problem in multi-agent systems. Type-based reasoning methods achieve this by maintaining a belief over a set of potential…

Artificial Intelligence · Computer Science 2023-06-12 Jonathon Schwartz , Hanna Kurniawati , Marcus Hutter

In this paper we consider infinite horizon discounted dynamic programming problems with finite state and control spaces, partial state observations, and a multiagent structure. We discuss and compare algorithms that simultaneously or…

Robotics · Computer Science 2020-11-10 Sushmita Bhattacharya , Siva Kailas , Sahil Badyal , Stephanie Gil , Dimitri Bertsekas

Bayesian approaches provide a principled solution to the exploration-exploitation trade-off in Reinforcement Learning. Typical approaches, however, either assume a fully observable environment or scale poorly. This work introduces the…

Artificial Intelligence · Computer Science 2018-11-15 Sammie Katt , Frans Oliehoek , Christopher Amato

Learning in POMDPs is known to be significantly harder than in MDPs. In this paper, we consider the online learning problem for episodic POMDPs with unknown transition and observation models. We propose a Posterior Sampling-based…

Machine Learning · Computer Science 2024-10-24 Dengwang Tang , Dongze Ye , Rahul Jain , Ashutosh Nayyar , Pierluigi Nuzzo

Reinforcement learning algorithms require a large amount of samples; this often limits their real-world applications on even simple tasks. Such a challenge is more outstanding in multi-agent tasks, as each step of operation is more costly…

Machine Learning · Computer Science 2022-09-05 Yali Du , Chengdong Ma , Yuchen Liu , Runji Lin , Hao Dong , Jun Wang , Yaodong Yang

We consider the challenging problem of online planning for a team of agents to autonomously search and track a time-varying number of mobile objects under the practical constraint of detection range limited onboard sensors. A standard POMDP…

Multiagent Systems · Computer Science 2020-06-23 Hoa Van Nguyen , Hamid Rezatofighi , Ba-Ngu Vo , Damith C. Ranasinghe

Reinforcement learning-based path planning for multi-agent systems of varying size constitutes a research topic with increasing significance as progress in domains such as urban air mobility and autonomous aerial vehicles continues.…

Robotics · Computer Science 2022-03-22 Marc R. Schlichting , Stefan Notter , Walter Fichter

The ability to continuously acquire new knowledge and skills is crucial for autonomous agents. Existing methods are typically based on either fixed-size models that struggle to learn a large number of diverse behaviors, or growing-size…

Machine Learning · Computer Science 2023-03-03 Jean-Baptiste Gaya , Thang Doan , Lucas Caccia , Laure Soulier , Ludovic Denoyer , Roberta Raileanu

In open agent systems, the set of agents that are cooperating or competing changes over time and in ways that are nontrivial to predict. For example, if collaborative robots were tasked with fighting wildfires, they may run out of…

Multiagent Systems · Computer Science 2019-11-21 Adam Eck , Maulik Shah , Prashant Doshi , Leen-Kiat Soh

Solving partially observable Markov decision processes (POMDPs) is highly intractable in general, at least in part because the optimal policy may be infinitely large. In this paper, we explore the problem of finding the optimal policy from…

Artificial Intelligence · Computer Science 2013-01-30 Nicolas Meuleau , Kee-Eung Kim , Leslie Pack Kaelbling , Anthony R. Cassandra

It has long been recognized that multi-agent reinforcement learning (MARL) faces significant scalability issues due to the fact that the size of the state and action spaces are exponentially large in the number of agents. In this paper, we…

Optimization and Control · Mathematics 2020-06-12 Guannan Qu , Yiheng Lin , Adam Wierman , Na Li