English
Related papers

Related papers: Heterogeneous Stochastic Interactions for Multiple…

200 papers

Consider a consensus-driven multi-agent dynamic system. The interaction range, which defines the set of neighbors for each agent, plays a key role in influencing connectivity of the underlying network. In this paper, we assume the system is…

Systems and Control · Electrical Eng. & Systems 2020-04-28 Saad J Saleh

Assistive multi-armed bandit problems can be used to model team situations between a human and an autonomous system like a domestic service robot. To account for human biases such as the risk-aversion described in the Cumulative Prospect…

Robotics · Computer Science 2021-04-13 Michael Koller , Timothy Patten , Markus Vincze

We study the cooperative stochastic $k$-armed bandit problem, where a network of $m$ agents collaborate to find the optimal action. In contrast to most prior work on this problem, which focuses on extending a specific algorithm to the…

Machine Learning · Computer Science 2024-11-01 Benjamin Howson , Sarah Filippi , Ciara Pike-Burke

We study decentralized multi-agent multi-armed bandits in fully heavy-tailed settings, where clients communicate over sparse random graphs with heavy-tailed degree distributions and observe heavy-tailed (homogeneous or heterogeneous) reward…

Machine Learning · Computer Science 2025-02-03 Xingyu Wang , Mengfan Xu

We investigate top-$m$ arm identification, a basic problem in bandit theory, in a multi-agent learning model in which agents collaborate to learn an objective function. We are interested in designing collaborative learning algorithms that…

Machine Learning · Computer Science 2022-11-29 Nikolai Karpov , Qin Zhang

We consider a bandit problem which involves sequential sampling from two populations (arms). Each arm produces a noisy reward realization which depends on an observable random covariate. The goal is to maximize cumulative expected reward.…

Statistics Theory · Mathematics 2010-03-09 Philippe Rigollet , Assaf Zeevi

In this paper, we study a novel Stochastic Network Utility Maximization (NUM) problem where the utilities of agents are unknown. The utility of each agent depends on the amount of resource it receives from a network operator/controller. The…

Machine Learning · Computer Science 2020-06-18 Arun Verma , Manjesh K. Hanawal

We consider a fully decentralized multi-player stochastic multi-armed bandit setting where the players cannot communicate with each other and can observe only their own actions and rewards. The environment may appear differently to…

Machine Learning · Computer Science 2021-12-30 Akshayaa Magesh , Venugopal V. Veeravalli

Generalized from the concept of consensus, this paper considers a group of edge agreements, i.e. constraints defined for neighboring agents, in which each pair of neighboring agents is required to satisfy one edge agreement constraint. Edge…

Optimization and Control · Mathematics 2023-12-04 Zehui Lu , Shaoshuai Mou

Best arm identification (or, pure exploration) in multi-armed bandits is a fundamental problem in machine learning. In this paper we study the distributed version of this problem where we have multiple agents, and they want to learn the…

Machine Learning · Computer Science 2019-09-02 Chao Tao , Qin Zhang , Yuan Zhou

Decision-making under uncertainty is a fundamental problem encountered frequently and can be formulated as a stochastic multi-armed bandit problem. In the problem, the learner interacts with an environment by choosing an action at each…

Machine Learning · Statistics 2024-05-24 Jonathan Gornet , Bruno Sinopoli

The staggering feats of AI systems have brought to attention the topic of AI Alignment: aligning a "superintelligent" AI agent's actions with humanity's interests. Many existing frameworks/algorithms in alignment study the problem on a…

Machine Learning · Computer Science 2024-10-22 Hong Jun Jeon , Benjamin Van Roy

Adaptive synchronization protocols for heterogeneous multi-agent network are investigated. The interaction between each of the agents is carried out through a directed graph. We highlight the lack of communication between agents and the…

Systems and Control · Electrical Eng. & Systems 2020-10-07 Miguel F. Arevalo-Castiblanco , Duvan A. Tellez-Castro , Jorge Sofrony , Eduardo Mojica-Nava

We study the stochastic Multiplayer Multi-Armed Bandit (MMAB) problem, where multiple players select arms to maximize their cumulative rewards. Collisions occur when two or more players select the same arm, resulting in no reward, and are…

Machine Learning · Computer Science 2025-10-09 Daoyuan Zhou , Xuchuang Wang , Lin Yang , Yang Gao

The real world is awash with multi-agent problems that require collective action by self-interested agents, from the routing of packets across a computer network to the management of irrigation systems. Such systems have local incentives…

Multiagent Systems · Computer Science 2021-02-16 Michiel A. Bakker , Richard Everett , Laura Weidinger , Iason Gabriel , William S. Isaac , Joel Z. Leibo , Edward Hughes

Understanding, predicting, and learning from other people's actions are fundamental human social-cognitive skills. Little is known about how and when we consider other's actions and outcomes when making our own decisions. We developed a…

Neurons and Cognition · Quantitative Biology 2019-05-21 Julia Anna Adrian , Siddharth Siddharth , Syed Zain Ali Baquar , Tzyy-Ping Jung , Gedeon Deák

In various economic environments, people observe other people with whom they strategically interact. We can model such information-sharing relations as an information network, and the strategic interactions as a game on the network. When…

Methodology · Statistics 2019-11-27 Nathan Canen , Jacob Schwartz , Kyungchul Song

This paper proposes a novel policy for a group of agents to, individually as well as collectively, solve a multi armed bandit (MAB) problem. The policy relies solely on the information that an agent has obtained through sampling of the…

Machine Learning · Computer Science 2020-02-24 Pathmanathan Pankayaraj , D. H. S. Maithripala

Contextual bandits are a form of multi-armed bandit in which the agent has access to predictive side information (known as the context) for each arm at each time step, and have been used to model personalized news recommendation, ad…

Machine Learning · Statistics 2017-05-25 Aniket Anand Deshmukh , Urun Dogan , Clayton Scott

This paper considers a multi-armed bandit (MAB) problem in which multiple mobile agents receive rewards by sampling from a collection of spatially dispersed stochastic processes, called bandits. The goal is to formulate a decentralized…

Machine Learning · Computer Science 2020-04-01 Pathmanathan Pankayaraj , D. H. S. Maithripala , J. M. Berg