English
Related papers

Related papers: Deep Reinforcement Learning for mmWave Initial Bea…

200 papers

Using RF signals for wireless sensing has gained increasing attention. However, due to the unwanted multi-path fading in uncontrollable radio environments, the accuracy of RF sensing is limited. Instead of passively adapting to the…

Signal Processing · Electrical Eng. & Systems 2020-11-26 Jingzhi Hu , Hongliang Zhang , Kaigui Bian , Marco Di Renzo , Zhu Han , Lingyang Song

In this paper, we develop a deep learning (DL)-guided hybrid beam and power allocation approach for multiuser millimeter-wave (mmWave) networks, which facilitates swift beamforming at the base station (BS). The following persisting…

Signal Processing · Electrical Eng. & Systems 2023-05-24 Yuwen Cao , Tomoaki Ohtsuki , Setareh Maghsudi , Tony Q. S. Quek

Embodied agents, such as robots and virtual characters, must continuously select actions to execute tasks effectively, solving complex sequential decision-making problems. Given the difficulty of designing such controllers manually,…

Robotics · Computer Science 2026-05-18 Pedro Santana

Predicting the millimeter wave (mmWave) beams and blockages using sub-6GHz channels has the potential of enabling mobility and reliability in scalable mmWave systems. These gains attracted increasing interest in the last few years. Prior…

Information Theory · Computer Science 2019-11-05 Muhammad Alrabeiah , Ahmed Alkhateeb

This work contributes to developing an agent based on deep reinforcement learning capable of acting in a beyond visual range (BVR) air combat simulation environment. The paper presents an overview of building an agent representing a…

Robotics · Computer Science 2023-04-20 Joao P. A. Dantas , Marcos R. O. A. Maximo , Takashi Yoneyama

Meeting the high data rate demands of modern applications necessitates the utilization of high-frequency spectrum bands, including millimeter-wave and sub-terahertz bands. However, these frequencies require precise alignment of narrow…

Information Theory · Computer Science 2024-12-05 Sachira Karunasena , Erfan Khordad , Thomas Drummond , Rajitha Senanayake

An effective way to achieve intelligence is to simulate various intelligent behaviors in the human brain. In recent years, bio-inspired learning methods have emerged, and they are different from the classical mathematical programming…

Artificial Intelligence · Computer Science 2019-04-01 Jieneng Chen , Jingye Chen , Ruiming Zhang , Xiaobin Hu

The problem of reinforcement learning is considered where the environment or the model undergoes a change. An algorithm is proposed that an agent can apply in such a problem to achieve the optimal long-time discounted reward. The algorithm…

Systems and Control · Electrical Eng. & Systems 2023-04-25 Wuxia Chen , Taposh Banerjee , Jemin George , Carl Busart

Deep learning has provided new ways of manipulating, processing and analyzing data. It sometimes may achieve results comparable to, or surpassing human expert performance, and has become a source of inspiration in the era of artificial…

Deep learning has enabled traditional reinforcement learning methods to deal with high-dimensional problems. However, one of the disadvantages of deep reinforcement learning methods is the limited exploration capacity of learning agents. In…

Machine Learning · Computer Science 2019-07-30 Thanh Nguyen , Ngoc Duy Nguyen , Saeid Nahavandi

Objective: Intensity-modulated radiation therapy (IMRT) beam angle optimization (BAO) is a challenging combinatorial optimization problem that is NP-hard. In this study, we aim to develop a personalized BAO algorithm for IMRT that improves…

Medical Physics · Physics 2023-03-08 Peng Bao , Gong Wang , Ruijie Yang , Bin Dong

Access points (APs) in millimeter-wave (mmWave) and sub-THz-based user-centric (UC) networks will have sleep mode functionality. As a result of this, it becomes challenging to solve the initial access (IA) problem when the sleeping APs are…

Signal Processing · Electrical Eng. & Systems 2021-10-20 Insaf Ismath , Samad Ali , Nandana Rajatheva , Matti Latva-aho

Reinforcement learning is about learning agent models that make the best sequential decisions in unknown environments. In an unknown environment, the agent needs to explore the environment while exploiting the collected information, which…

Machine Learning · Computer Science 2021-02-12 Hong Qian , Yang Yu

We tackle the problem of joint frequency and power allocation while emphasizing the generalization capability of a deep reinforcement learning model. Most of the existing methods solve reinforcement learning-based wireless problems for a…

Networking and Internet Architecture · Computer Science 2023-05-09 Swatantra Kafle , Jithin Jagannath , Zackary Kane , Noor Biswas , Prem Sagar Vasanth Kumar , Anu Jagannath

A deep reinforcement learning approach is applied, for the first time, to solve the routing, modulation, spectrum and core allocation (RMSCA) problem in dynamic multicore fiber elastic optical networks (MCF-EONs). To do so, a new…

We propose an approach to learning agents for active robotic mapping, where the goal is to map the environment as quickly as possible. The agent learns to map efficiently in simulated environments by receiving rewards corresponding to how…

Robotics · Computer Science 2018-01-01 Shane Barratt

This paper surveys the field of deep multiagent reinforcement learning. The combination of deep neural networks with reinforcement learning has gained increased traction in recent years and is slowly shifting the focus from single-agent to…

Machine Learning · Computer Science 2022-10-14 Annie Wong , Thomas Bäck , Anna V. Kononova , Aske Plaat

Employing large antenna arrays is a key characteristic of millimeter wave (mmWave) and terahertz communication systems. However, due to the adoption of fully analog or hybrid analog/digital architectures, as well as non-ideal hardware or…

Signal Processing · Electrical Eng. & Systems 2021-02-19 Yu Zhang , Muhammad Alrabeiah , Ahmed Alkhateeb

To fully utilize the abundant spectrum resources in millimeter wave (mmWave), Beam Alignment (BA) is necessary for large antenna arrays to achieve large array gains. In practical dynamic wireless environments, channel modeling is…

Networking and Internet Architecture · Computer Science 2022-07-05 Yuntian Deng , Xingyu Zhou , Arnob Ghosh , Abhishek Gupta , Ness B. Shroff

Autonomous navigation is challenging for mobile robots, especially in an unknown environment. Commonly, the robot requires multiple sensors to map the environment, locate itself, and make a plan to reach the target. However, reinforcement…

Robotics · Computer Science 2023-03-08 Miguel Quinones-Ramirez , Jorge Rios-Martinez , Victor Uc-Cetina