Related papers: Multi-armed Bandits for Link Configuration in Mill…
Fifth generation (5G) wireless networks are expected to utilize wide bandwidths available at millimeter wave (mmWave) frequencies for enhancing system throughput. However, the unfavorable channel conditions of mmWave links, e.g., higher…
The problem of beam alignment (BA) in a cell-free massive multiple-input multiple-output (CF-mMIMO) system operating at millimeter wave (mmWaves) carrier frequencies is considered in this paper. Two estimation algorithms are proposed, in…
Communication systems at millimeter-wave (mmW) and sub-terahertz frequencies are of increasing interest for future high-data rate networks. One critical challenge faced by phased array systems at these high frequencies is the efficiency of…
We formulate a multi-armed bandit (MAB) approach to choosing expert policies online in Markov decision processes (MDPs). Given a set of expert policies trained on a state and action space, the goal is to maximize the cumulative reward of…
Communication in Millimeter wave (mmWave) band relies on narrow beams due to directionality, high path loss, and shadowing. One can use beam alignment (BA) techniques to find and adjust the direction of these narrow beams. In this paper, BA…
Millimeter wave communications rely on narrow-beam transmissions to cope with the strong signal attenuation at these frequencies, thus demanding precise beam alignment between transmitter and receiver. The communication overhead incurred to…
Recommendation systems are a vital component of many online marketplaces, where there are often millions of items to potentially present to users who have a wide variety of wants or needs. Evaluating recommender system algorithms is a hard…
The use of millimeter wave (mmWave) spectrum for commercial wireless communications is expected to offer data rates in the order of Gigabits-per-second, thus able to support future applications such as Vehicle-to-Vehicle or…
There is much interest in integrating millimeter wave radios (mmWave) into wireless LANs and 5G cellular networks to benefit from their multiple GHz of available spectrum. Yet unlike existing technologies, e.g., WiFi, mmWave radios require…
Millimeter wave (mmW) communication is a promising solution for providing high-capacity wireless network access. However, the benefits of mmW are limited by the fact that the channel between a mmW access point and the user equipment can…
The multi-armed bandit(MAB) problem is a simple yet powerful framework that has been extensively studied in the context of decision-making under uncertainty. In many real-world applications, such as robotic applications, selecting an arm…
This paper studies initial beam acquisition in a millimeter wave network consisting of multiple access points (APs) and mobile devices. A training protocol for joint estimation of transmit and receive beams is presented with a general frame…
Traditional multi-armed bandit (MAB) formulations usually make certain assumptions about the underlying arms' distributions, such as bounds on the support or their tail behaviour. Moreover, such parametric information is usually 'baked'…
Millimeter-wave (mmWave) systems use directional beams to support high-rate data communications. Small misalignment between the transmit and receive beams (e.g., due to the mobility) can result in significant drop of the received signal…
Millimeter wave (mmWave) multiple-input multiple-output (MIMO) systems capable of integrated sensing and communication (ISAC) constitute a key technology for connected autonomous vehicles (CAVs). In this context, we propose a multi-beam…
A multi-user multi-armed bandit (MAB) framework is used to develop algorithms for uncoordinated spectrum access. The number of users is assumed to be unknown to each user. A stochastic setting is first considered, where the rewards on a…
Ultra-reliable and low-latency connectivity is required for real-time and latency-sensitive applications, like wireless augmented and virtual reality streaming. Millimeter-wave (mmW) networks have enabled extremely high data rates through…
Multi-armed bandit (MAB) is a class of online learning problems where a learning agent aims to maximize its expected cumulative reward while repeatedly selecting to pull arms with unknown reward distributions. We consider a scenario where…
In the beyond fifth-generation (B5G) and upcoming sixth-generation (6G) wireless communication systems, millimeter (mmWave) wave technology is a promising solution for offering additional bandwidth resources and mitigating spectrum…
Configuring the antenna arrays is the main source of overhead in millimeter wave (mmWave) communication systems. In high mobility scenarios, the problem is exacerbated, as achieving the highest rates requires frequent link reconfiguration.…