English
Related papers

Related papers: Coordinated Multi-Armed Bandits for Improved Spati…

200 papers

We study a structured multi-agent multi-armed bandit (MAMAB) problem in a dynamic environment. A graph reflects the information-sharing structure among agents, and the arms' reward distributions are piecewise-stationary with several unknown…

Machine Learning · Computer Science 2023-06-12 Xiaotong Cheng , Setareh Maghsudi

In human-computer interaction applications like hand gesture recognition, supervised learning models are often trained on a large population of users to achieve high task accuracy. However, due to individual variability in sensor signals…

Human-Computer Interaction · Computer Science 2025-09-12 Duke Lin , Michael Paskett , Ying Yang

Designing efficient channel access schemes for wireless communications without any prior knowledge about the nature of environments has been a very challenging issue, especially when the channel states distribution of all spectrum resources…

Networking and Internet Architecture · Computer Science 2016-11-17 Pan Zhou , Tao Jiang

Restless multi-armed bandits (RMABs) have been widely utilized to address resource allocation problems with Markov reward processes (MRPs). Existing works often assume that the dynamics of MRPs are known prior, which makes the RMAB problem…

Machine Learning · Computer Science 2024-06-13 Jingwen Tong , Xinran Li , Liqun Fu , Jun Zhang , Khaled B. Letaief

Traffic optimization challenges, such as load balancing, flow scheduling, and improving packet delivery time, are difficult online decision-making problems in wide area networks (WAN). Complex heuristics are needed for instance to find…

Networking and Internet Architecture · Computer Science 2021-12-01 Shan Sun , Mariam Kiran , Wei Ren

This paper introduces a novel approach to radio resource allocation in multi-cell wireless networks using a fully scalable multi-agent reinforcement learning (MARL) framework. A distributed method is developed where agents control…

Multiagent Systems · Computer Science 2024-09-19 Yiming Zhang , Dongning Guo

Restless multi-armed bandits (RMAB) have been widely used to model sequential decision making problems with constraints. The decision maker (DM) aims to maximize the expected total reward over an infinite horizon under an "instantaneous…

Machine Learning · Computer Science 2023-12-25 Shufan Wang , Guojun Xiong , Jian Li

We study the problem of collaborative best-arm identification in stochastic linear bandits under a fixed-budget scenario. In our learning model, we first consider multiple agents connected through a star network, interacting with a linear…

Machine Learning · Computer Science 2025-05-27 Sanjana Agrawal , Saúl A. Blanco

In this study, we explore a collaborative multi-agent stochastic linear bandit setting involving a network of $N$ agents that communicate locally to minimize their collective regret while keeping their expected cost under a specified…

Machine Learning · Computer Science 2024-10-24 Amirhossein Afsharrad , Parisa Oftadeh , Ahmadreza Moradipari , Sanjay Lall

In mixed-autonomy traffic networks, autonomous vehicles (AVs) are required to make sequential routing decisions under uncertainty caused by dynamic and heterogeneous interactions with human-driven vehicles (HDVs). Early-stage greedy…

Optimization and Control · Mathematics 2025-05-12 Yu Bai , Yiming Li , Xi Xiong

Automatic Modulation Recognition (AMR) is critical in identifying various modulation types in wireless communication systems. Recent advancements in deep learning have facilitated the integration of algorithms into AMR techniques. However,…

Signal Processing · Electrical Eng. & Systems 2025-10-30 Narges Rashvand , Kenneth Witham , Gabriel Maldonado , Vinit Katariya , Aly Sultan , Gunar Schirner , Hamed Tabkhi

In this paper, we initiate the study of rate-splitting multiple access (RSMA) for a mono-static integrated sensing and communication (ISAC) system, where the dual-functional base station (BS) simultaneously communicates with multiple users…

Information Theory · Computer Science 2024-03-05 Kexin Chen , Yijie Mao , Longfei Yin , Chengcheng Xu , Yang Huang

In this paper we argue that contextual multi-armed bandit algorithms could open avenues for designing self-learning security modules for computer networks and related tasks. The paper has two contributions: a conceptual one and an…

Networking and Internet Architecture · Computer Science 2012-07-13 Tobias Jung , Sylvain Martin , Damien Ernst , Guy Leduc

This letter investigates the problem of energy efficient collaborative strategy for mobile embodied artificial intelligence network (MEAN) over wireless communication. In the considered model, the agents execute the tasks through…

Signal Processing · Electrical Eng. & Systems 2026-05-15 Chenliang Wu , Zhouxiang Zhao , Jiaxiang Wang , Ruopeng Xu , Chen Zhu , Zhaohui Yang , Zhaoyang Zhang

Recently, significant research attention has been devoted to the study of reconfigurable intelligent surfaces (RISs), which are capable of reconfiguring the wireless propagation environment by exploiting the unique properties of…

Networking and Internet Architecture · Computer Science 2021-05-04 Xuelin Cao , Bo Yang , Chongwen Huang , Chau Yuen , Marco Di Renzo , Zhu Han , Dusit Niyato , H. Vincent Poor , Lajos Hanzo

The integration of satellite communication networks with next-generation (NG) technologies is a promising approach towards global connectivity. However, the quality of services is highly dependant on the availability of accurate channel…

Information Theory · Computer Science 2026-03-18 Marios Aristodemou , Yasaman Omid , Sangarapillai Lambotharan , Mahsa Derakhshan , Lajos Hanzo

E-commerce sites strive to provide users the most timely relevant information in order to reduce shopping frictions and increase customer satisfaction. Multi armed bandit models (MAB) as a type of adaptive optimization algorithms provide…

Information Retrieval · Computer Science 2021-08-23 Ding Xiang , Becky West , Jiaqi Wang , Xiquan Cui , Jinzhou Huang

This paper studies a wireless networked control system with multiple base stations (BSs) cooperatively coordinating the wireless control of a number of subsystems each consisting of a plant, a sensor, and an actuator. In this system, each…

Information Theory · Computer Science 2025-01-22 Zhilin Liu , Yiyang Li , Huijun Xing , Ye Zhang , Jie Xu , Shuguang Cui

Wi-Fi plays a crucial role in connecting electronic devices and providing communication services in everyday life. Recently, there has been a growing demand for services that require low-latency communication, such as real-time…

Information Theory · Computer Science 2025-08-29 Seungmin Lee , Changmin Lee , Si-Chan Noh , Joonsoo Lee

Movable antenna (MA) has demonstrated great potential in enhancing wireless communication performance. In this paper, we investigate an MA-enabled multiple-input multiple-output (MIMO) communication system with spatial modulation (SM),…

Signal Processing · Electrical Eng. & Systems 2026-01-21 Kaihe Wang , Ran Yang , Lipeng Zhu , Rongyan Xi , Yue Xiu , Zhongpei Zhang