English
Related papers

Related papers: Coordinated Multi-Armed Bandits for Improved Spati…

200 papers

Multi-armed bandit (MAB) problems are widely applied to online optimization tasks that require balancing exploration and exploitation. In practical scenarios, these tasks often involve multiple conflicting objectives, giving rise to…

Machine Learning · Computer Science 2025-06-17 Mansoor Davoodi , Setareh Maghsudi

This article addresses the challenge of optimizing handover (HO) in next-generation wireless networks by integrating Reconfigurable Intelligent Surfaces (RIS), predicting received signal power, and utilizing learning-based decision-making.…

Signal Processing · Electrical Eng. & Systems 2025-12-10 Ainna Yue Moreno-Locubiche , Josep Vidal , Olga Muñoz-Medina , Margarita Cabrera-Bean

In this paper, we introduce the COmbinatorial Multi-Objective Multi-Armed Bandit (COMO-MAB) problem that captures the challenges of combinatorial and multi-objective online learning simultaneously. In this setting, the goal of the learner…

Machine Learning · Computer Science 2018-03-13 Doruk Öner , Altuğ Karakurt , Atilla Eryılmaz , Cem Tekin

This paper considers a resource allocation problem where several Internet-of-Things (IoT) devices send data to a base station (BS) with or without the help of the reconfigurable intelligent surface (RIS) assisted cellular network. The…

Signal Processing · Electrical Eng. & Systems 2024-06-11 Jingwen Tong , Hongliang Zhang , Liqun Fu , Amir Leshem , Zhu Han

The innovation of Wi-Fi 6, IEEE 802.11ax, was be approved as the next sixth-generation (6G) technology of wireless local area networks (WLANs) by improving the fundamental performance of latency, throughput, and so on. The main technical…

Networking and Internet Architecture · Computer Science 2023-04-05 Ting-Hui Wang , Li-Hsiang Shen , Kai-Ten Feng

This paper proposes a Time Division Multiple Access (TDMA) MAC slot allocation protocol with efficient bandwidth usage in wireless sensor networks and Internet of Things (IoTs). The developed protocol has two primary components: a…

Networking and Internet Architecture · Computer Science 2023-02-13 Hrishikesh Dutta , Amit Kumar Bhuyan , Subir Biswas

Multi-armed Bandit (MAB) algorithms identify the best arm among multiple arms via exploration-exploitation trade-off without prior knowledge of arm statistics. Their usefulness in wireless radio, IoT, and robotics demand deployment on edge…

Systems and Control · Electrical Eng. & Systems 2021-06-08 S. V. Sai Santosh , Sumit J. Darak

Underwater Acoustic (UWA) networks are vital for remote sensing and ocean exploration but face inherent challenges such as limited bandwidth, long propagation delays, and highly dynamic channels. These constraints hinder real-time…

Networking and Internet Architecture · Computer Science 2026-03-24 Fabio Busacca , Andrea Panebianco , Yin Sun

Applying Reinforcement Learning (RL) to Restless Multi-Arm Bandits (RMABs) offers a promising avenue for addressing allocation problems with resource constraints and temporal dynamics. However, classic RMAB models largely overlook the…

Machine Learning · Computer Science 2025-03-20 Yunfan Zhao , Tonghan Wang , Dheeraj Nagaraj , Aparna Taneja , Milind Tambe

This paper proposes a robust adversarial reinforcement learning (RARL)-based multi-access point (AP) coordination method that is robust even against unexpected decentralized operations of uncoordinated APs. Multi-AP coordination is a…

Networking and Internet Architecture · Computer Science 2020-04-03 Yuto Kihira , Yusuke Koda , Koji Yamamoto , Takayuki Nishio , Masahiro Morikura

This paper investigates the use of multi-agent reinforcement learning (MARL) to address distributed channel access in wireless local area networks. In particular, we consider the challenging yet more practical case where the agents…

Machine Learning · Computer Science 2025-06-13 Jiaming Yu , Le Liang , Chongtao Guo , Ziyang Guo , Shi Jin , Geoffrey Ye Li

MmWaves have been envisioned as a promising direction to provide Gbps wireless access. However, they are susceptible to high path losses and blockages, which directional antennas can only partially mitigate. That makes mmWave networks…

Networking and Internet Architecture · Computer Science 2024-04-24 Bibo Zhang , Ilario Filippini

Multi-Armed Bandit (MAB) systems are witnessing an upswing in applications within multi-agent distributed environments, leading to the advancement of collaborative MAB algorithms. In such settings, communication between agents executing…

Machine Learning · Computer Science 2024-04-30 Osama A. Hanna , Merve Karakas , Lin F. Yang , Christina Fragouli

MIMO technology has enabled spatial multiple access and has provided a higher system spectral efficiency (SE). However, this technology has some drawbacks, such as the high number of RF chains that increases complexity in the system. One of…

Signal Processing · Electrical Eng. & Systems 2022-11-28 Yasaman Abdollahian , Ehsan Tohidi , Martin Kasparick , Li Wang , Ahmet Hasim Gokceoglu , Slawomir Stanczak

Recent advances in 3D fabrication have allowed handling the memory bottlenecks for modern data-intensive applications by bringing the computation closer to the memory, enabling Near Memory Processing (NMP). Memory Centric Networks (MCN) are…

Hardware Architecture · Computer Science 2023-12-14 Shubhang Pandey , T G Venkatesh

Multi-agent reinforcement learning (MARL) studies crucial principles that are applicable to a variety of fields, including wireless networking and autonomous driving. We propose a photonic-based decision-making algorithm to address one of…

Machine Learning · Computer Science 2024-07-15 Shun Kotoku , Takatomo Mihana , André Röhm , Ryoichi Horisaki

Multi-player multi-armed bandits (MMAB) study how decentralized players cooperatively play the same multi-armed bandit so as to maximize their total cumulative rewards. Existing MMAB models mostly assume when more than one player pulls the…

Machine Learning · Computer Science 2022-04-29 Xuchuang Wang , Hong Xie , John C. S. Lui

This study investigates a downlink rate-splitting multiple access (RSMA) scenario in which multiple base stations (BSs), employing a coordinated multi-point (CoMP) transmission scheme, serve users equipped with movable antenna (MA)…

Signal Processing · Electrical Eng. & Systems 2025-02-25 Ali Amhaz , Shreya Khisa , Mohamed Elhattab , Chadi Assi , Sanaa Sharafeddine

For a wireless avionics communication system, a Multi-arm bandit game is mathematically formulated, which includes channel states, strategies, and rewards. The simple case includes only two agents sharing the spectrum which is fully studied…

Signal Processing · Electrical Eng. & Systems 2017-11-15 Jingyang Lu , Lun Li , Dan Shen , Genshe Chen , Bin Jia , Erik Blasch , Khanh Pham

The multi-armed bandit (MAB) problem is an active learning framework that aims to select the best among a set of actions by sequentially observing rewards. Recently, it has become popular for a number of applications over wireless networks,…

Machine Learning · Computer Science 2021-11-12 Osama A. Hanna , Lin F. Yang , Christina Fragouli