English
Related papers

Related papers: Deep Reinforcement Learning-Based Beam Tracking fo…

200 papers

With the advent of 5G and the research into beyond 5G (B5G) networks, a novel and very relevant research issue is how to manage the coexistence of different types of traffic, each with very stringent but completely different requirements.…

Signal Processing · Electrical Eng. & Systems 2026-03-16 Fabio Saggese , Luca Pasqualini , Marco Moretti , Andrea Abrardo

In the era of 5G mobile communication, there has been a significant surge in research focused on unmanned aerial vehicles (UAVs) and mobile edge computing technology. UAVs can serve as intelligent servers in edge computing environments,…

Multiagent Systems · Computer Science 2023-09-06 Zhengrong Song , Chuan Ma , Ming Ding , Howard H. Yang , Yuwen Qian , Xiangwei Zhou

As more and more people choose high-speed rail (HSR) as a means of transportation for short trips, there is ever growing demand of high quality of multimedia services. With its rich spectrum resources, millimeter wave (mm-wave)…

Information Theory · Computer Science 2022-05-24 Xutao Zhou , Xiangfei Zhang , Chen Chen , Yong Niu , Zhu Han , He Wang , Chengjun Sun , Bo Ai , Ning Wang

Conventional Congestion Control (CC) algorithms,such as TCP Cubic, struggle in tactical environments as they misinterpret packet loss and fluctuating network performance as congestion symptoms. Recent efforts, including our own MARLIN, have…

Unmanned aerial base stations (UABSs) can be deployed in vehicular wireless networks to support applications such as extended sensing via vehicle-to-everything (V2X) services. A key problem in such systems is designing algorithms that can…

Machine Learning · Computer Science 2022-10-06 Riccardo Marini , Sangwoo Park , Osvaldo Simeone , Chiara Buratti

In vehicular networks of the future, sensing and communication functionalities will be intertwined. In this paper, we investigate a radar-assisted predictive beamforming design for vehicle-to-infrastructure (V2I) communication by exploiting…

Signal Processing · Electrical Eng. & Systems 2020-01-28 Fan Liu , Weijie Yuan , Christos Masouros , Jinhong Yuan

Deep reinforcement learning (DRL) provides a promising way for learning navigation in complex autonomous driving scenarios. However, identifying the subtle cues that can indicate drastically different outcomes remains an open problem with…

Machine Learning · Computer Science 2021-03-25 Xiaobai Ma , Jiachen Li , Mykel J. Kochenderfer , David Isele , Kikuo Fujimura

With the rapid deployment of the Internet of Things (IoT), fifth-generation (5G) and beyond 5G networks are required to support massive access of a huge number of devices over limited radio spectrum radio. In wireless networks, different…

Signal Processing · Electrical Eng. & Systems 2020-12-18 Helin Yang , Zehui Xiong , Jun Zhao , Dusit Niyato , Chau Yuen , Ruilong Deng

Inefficient traffic signal control methods may cause numerous problems, such as traffic congestion and waste of energy. Reinforcement learning (RL) is a trending data-driven approach for adaptive traffic signal control in complex urban…

Signal Processing · Electrical Eng. & Systems 2021-07-14 Zhenning Li , Chengzhong Xu , Guohui Zhang

We introduce a reinforcement learning (RL) environment to design and benchmark control strategies aimed at reducing drag in turbulent fluid flows enclosed in a channel. The environment provides a framework for computationally-efficient,…

Fluid Dynamics · Physics 2023-02-09 L. Guastoni , J. Rabault , P. Schlatter , H. Azizpour , R. Vinuesa

Deep reinforcement learning (deep RL) has achieved superior performance in complex sequential tasks by learning directly from image input. A deep neural network is used as a function approximator and requires no specific state information.…

Machine Learning · Computer Science 2018-12-27 Xi Chen , Caylin Hickey

Bearing faults in rotating machinery can lead to significant operational disruptions and maintenance costs. Modern methods for bearing fault diagnosis rely heavily on vibration analysis and machine learning techniques, which often require…

Machine Learning · Computer Science 2025-09-03 Efe Çakır , Patrick Dumond

Deep Reinforcement Learning (DRL) is gaining attention as a potential approach to design trajectories for autonomous unmanned aerial vehicles (UAV) used as flying access points in the context of cellular or Internet of Things (IoT)…

Information Theory · Computer Science 2022-02-07 Omid Esrafilian , Harald Bayerlein , David Gesbert

Reinforcement learning (RL) has attracted increasing interest for adaptive traffic signal control due to its model-free ability to learn control policies directly from interaction with the traffic environment. However, several challenges…

Machine Learning · Computer Science 2026-03-17 Dickens Kwesiga , Angshuman Guin , Khaled Abdelghany , Michael Hunter

The advent of Ultra-Reliable Low Latency Communication (URLLC) alongside the emergence of Open RAN (ORAN) architectures presents unprecedented challenges and opportunities in Radio Resource Management (RRM) for next-generation communication…

Signal Processing · Electrical Eng. & Systems 2025-01-29 Rana Muhammad Sohaib , Syed Tariq Shah , Oluwakayode Onireti , Muhammad Ali Imran

The imminent rise of autonomous vehicles (AVs) is revolutionizing the future of transport. The Vehicular Fog Computing (VFC) paradigm has emerged to alleviate the load of compute-intensive and delay-sensitive AV programs via task offloading…

Networking and Internet Architecture · Computer Science 2024-10-10 Mohammad Parsa Toopchinezhad , Mahmood Ahmadi

In this paper, dynamic non-cooperative coexistence between a cognitive pulsed radar and a nearby communications system is addressed by applying nonlinear value function approximation via deep reinforcement learning (Deep RL) to develop a…

Signal Processing · Electrical Eng. & Systems 2020-08-28 Charles E. Thornton , Mark A. Kozy , R. Michael Buehrer , Anthony F. Martone , Kelly D. Sherbondy

Millimeter-wave (mmWave) communication is a promising technology to meet the ever-growing data traffic of vehicular communications. Unfortunately, more frequent channel estimations are required in this spectrum due to the narrow beams…

Signal Processing · Electrical Eng. & Systems 2019-11-06 Sina Shaham , Matthew Kokshoorn , Ming Ding , Zihuai Lin , Mahyar Shirvanimoghaddam

Reinforcement learning (RL)-based driver assistance systems seek to improve fuel consumption via continual improvement of powertrain control actions considering experiential data from the field. However, the need to explore diverse…

Robotics · Computer Science 2023-01-04 Habtamu Hailemichael , Beshah Ayalew , Lindsey Kerbel , Andrej Ivanco , Keith Loiselle

Mobile users are prone to experience beam failure due to beam drifting in millimeter wave (mmWave) communications. Sensing can help alleviate beam drifting with timely beam changes and low overhead since it does not need user feedback. This…

Signal Processing · Electrical Eng. & Systems 2025-05-12 Xiyu Wang , Gilberto Berardinelli , Hei Victor Cheng , Petar Popovski , Ramoni Adeogun