English
Related papers

Related papers: Multi-Agent Decentralized Belief Propagation on Gr…

200 papers

Many multi-agent systems (MASs) are situated in stochastic environments. Some such systems that are based on the partially observable Markov decision process (POMDP) do not take the benevolence of other agents for granted. We propose a new…

Artificial Intelligence · Computer Science 2018-05-15 Gavin Rens , Abhaya Nayak , Thomas Meyer

The problem of controlling multi-agent systems under different models of information sharing among agents has received significant attention in the recent literature. In this paper, we consider a setup where rather than committing to a…

Optimization and Control · Mathematics 2021-04-23 Sagar Sudhakara , Dhruva Kartik , Rahul Jain , Ashutosh Nayyar

Distributed integrated sensing and communication (DISAC) systems are key enablers for 6G networks, offering the capability to jointly track multiple targets using spatially distributed base stations (BSs). A fundamental challenge in DISAC…

Signal Processing · Electrical Eng. & Systems 2025-07-01 Liping Bai , Yu Ge , Henk Wymeersch

We study the problem of jointly selecting sensing agents and synthesizing decentralized active perception policies for the chosen subset of agents within a Decentralized Partially Observable Markov Decision Process (Dec-POMDP) framework.…

Systems and Control · Electrical Eng. & Systems 2026-03-11 Chongyang Shi , Wesley A. Suttle , Michael Dorothy , Jie Fu

In this paper, we investigate learning temporal abstractions in cooperative multi-agent systems, using the options framework (Sutton et al, 1999). First, we address the planning problem for the decentralized POMDP represented by the…

Artificial Intelligence · Computer Science 2020-03-23 Jhelum Chakravorty , Nadeem Ward , Julien Roy , Maxime Chevalier-Boisvert , Sumana Basu , Andrei Lupu , Doina Precup

We address real-time sampling and estimation of autoregressive Markovian sources in dynamic yet structurally similar multi-hop wireless networks. Each node caches samples from others and communicates over wireless collision channels, aiming…

Machine Learning · Computer Science 2026-01-27 Xingran Chen , Navid NaderiAlizadeh , Alejandro Ribeiro , Shirin Saeedi Bidokhti

Active classification, i.e., the sequential decision-making process aimed at data acquisition for classification purposes, arises naturally in many applications, including medical diagnosis, intrusion detection, and object tracking. In this…

Systems and Control · Computer Science 2018-10-02 Bo Wu , Mohamadreza Ahmadi , Suda Bharadwaj , Ufuk Topcu

In numerous settings, agents lack sufficient data to directly learn a model. Collaborating with other agents may help, but it introduces a bias-variance trade-off, when local data distributions differ. A key challenge is for each agent to…

Machine Learning · Computer Science 2025-02-20 Franco Galante , Giovanni Neglia , Emilio Leonardi

We present an algorithm for the problem of linear distributed estimation of a parameter in a network where a set of agents are successively taking measurements. The approach considers a roaming token in a network that carries the estimate,…

Systems and Control · Computer Science 2018-07-05 Lucas Balthazar , João Xavier , Bruno Sinopoli

We consider the problem of imitation learning from expert demonstrations in partially observable Markov decision processes (POMDPs). Belief representations, which characterize the distribution over the latent states in a POMDP, have been…

Machine Learning · Computer Science 2019-06-25 Tanmay Gangwani , Joel Lehman , Qiang Liu , Jian Peng

We study the decentralized multi-agent multi-armed bandit problem for agents that communicate with probability over a network defined by a $d$-regular graph. Every edge in the graph has probabilistic weight $p$ to account for the…

Machine Learning · Statistics 2021-10-12 Udari Madhushani , Naomi Ehrich Leonard

In this paper, we investigate distributed inference schemes, over binary-valued Markov random fields, which are realized by the belief propagation (BP) algorithm. We first show that a decision variable obtained by the BP algorithm in a…

Information Theory · Computer Science 2019-09-19 Younes Abdi , Tapani Ristaniemi

This paper presents an intelligent and adaptive agent that employs deception to recognize a cyber adversary's intent. Unlike previous approaches to cyber deception, which mainly focus on delaying or confusing the attackers, we focus on…

Multiagent Systems · Computer Science 2020-07-21 Aditya Shinde , Prashant Doshi , Omid Setayeshfar

This paper presents a trust-based predictive multi-agent consensus protocol that analyses neighbours' anticipation data and makes coordination decisions. Agents in the network share their future predicted data over a finite look-ahead…

Systems and Control · Electrical Eng. & Systems 2025-07-18 Venkatraman Renganathan , Sabyasachi Mondal , Antonios Tsourdos

In this paper we describe a decision process framework allowing an agent to decide what information it should reveal to its neighbours within a communication graph in order to maximise its utility. We assume that these neighbours can pass…

Artificial Intelligence · Computer Science 2013-12-18 Chatschik Bisdikian , Federico Cerutti , Yuqing Tang , Nir Oren

When human operators of cyber-physical systems encounter surprising behavior, they often consider multiple hypotheses that might explain it. In some cases, taking information-gathering actions such as additional measurements or control…

Artificial Intelligence · Computer Science 2024-11-22 Ofer Dagan , Tyler Becker , Zachary N. Sunberg

We consider a distributionally robust Partially Observable Markov Decision Process (DR-POMDP), where the distribution of the transition-observation probabilities is unknown at the beginning of each decision period, but their realizations…

Optimization and Control · Mathematics 2020-12-09 Hideaki Nakao , Ruiwei Jiang , Siqian Shen

Belief propagation (BP) algorithm is a widely used message-passing method for inference in graphical models. BP on loop-free graphs converges in linear time. But for graphs with loops, BP's performance is uncertain, and the understanding of…

Machine Learning · Statistics 2020-06-30 Dong Liu , Minh Thành Vu , Zuxing Li , Lars K. Rasmussen

Partially observable Markov decision processes (POMDPs) form an attractive and principled framework for agent planning under uncertainty. Point-based approximate techniques for POMDPs compute a policy based on a finite set of points…

Artificial Intelligence · Computer Science 2011-09-13 M. T. J. Spaan , N. Vlassis

Markov Decision Process (MDP) presents a mathematical framework to formulate the learning processes of agents in reinforcement learning. MDP is limited by the Markovian assumption that a reward only depends on the immediate state and…

Machine Learning · Computer Science 2024-06-04 Bohao Qu , Xiaofeng Cao , Jielong Yang , Hechang Chen , Chang Yi , Ivor W. Tsang , Yew-Soon Ong