English
Related papers

Related papers: Using Deep Reinforcement Learning for mmWave Real-…

200 papers

The growing performance demands and higher deployment densities of next-generation wireless systems emphasize the importance of adopting strategies to manage the energy efficiency of mobile networks. In this demo, we showcase a framework…

Networking and Internet Architecture · Computer Science 2026-01-07 Matteo Bordin , Andrea Lacava , Michele Polese , Francesca Cuomo , Tommaso Melodia

In this paper, we focus on a wireless-powered sensor network coordinated by a multi-antenna access point (AP). Each node can generate sensing information and report the latest information to the AP using the energy harvested from the AP's…

Systems and Control · Electrical Eng. & Systems 2022-12-29 Shimin Gong , Leiyang Cui , Bo Gu , Bin Lyu , Dinh Thai Hoang , Dusit Niyato

Can an agent learn efficiently in a noisy and self adapting environment with sequential, non-stationary and non-homogeneous observations? Through trading bots, we illustrate how Deep Reinforcement Learning (DRL) can tackle this challenge.…

Machine Learning · Computer Science 2020-10-19 Eric Benhamou , David Saltiel , Sandrine Ungari , Abhishek Mukhopadhyay , Jamal Atif

In modern biomedical and econometric studies, longitudinal processes are often characterized by complex time-varying associations and abrupt regime shifts that are shared across correlated outcomes. Standard functional data analysis (FDA)…

Methodology · Statistics 2026-01-28 Baolin Chen , Mengfei Ran

Automating network processes without human intervention is crucial for the complex Sixth Generation (6G) environment. Thus, 6G networks must advance beyond basic automation, relying on Artificial Intelligence (AI) and Machine Learning (ML)…

6G networks are composed of subnetworks expected to meet ultra-reliable low-latency communication (URLLC) requirements for mission-critical applications such as industrial control and automation. An often-ignored aspect in URLLC is…

Systems and Control · Electrical Eng. & Systems 2025-07-17 Fateme Salehi , Aamir Mahmood , Sarder Fakhrul Abedin , Kyi Thar , Mikael Gidlund

This paper investigates a deep reinforcement learning (DRL)-based approach for managing channel access in wireless networks. Specifically, we consider a scenario in which an intelligent user device (iUD) shares a time-varying uplink…

Signal Processing · Electrical Eng. & Systems 2024-09-04 Abdul Basit , Muddasir Rahim , Georges Kaddoum , Tri Nhu Do , Nadir Adam

The teleoperated driving (TD) scenario comes with stringent Quality of Service (QoS) communication constraints, especially in terms of end-to-end (E2E) latency and reliability. In this context, Predictive Quality of Service (PQoS), possibly…

Networking and Internet Architecture · Computer Science 2025-05-07 Giacomo Avanzi , Marco Giordani , Michele Zorzi

State-of-the-art cloud-native applications require intelligent schedulers that can effectively balance system stability, resource utilisation, and associated costs. While Kubernetes provides feasibility-based placement by default, recent…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-08 Hamed Hamzeh

Millimeter-wave (mmWave) is a key enabler for next-generation transportation systems. However, in an urban city scenario, mmWave is highly susceptible to blockages and shadowing. Therefore, base station (BS) placement is a crucial task in…

Signal Processing · Electrical Eng. & Systems 2024-04-24 Ahmed Al-Tahmeesschi , Jukka Talvitie , Miguel López-Benítez , Hamed Ahmadi , Laura Ruotsalainen

Recent advances in parallel computing and GPU acceleration have created new opportunities for computation-intensive learning problems such as Active SLAM -- where actions are selected to reduce uncertainty and improve joint mapping and…

Robotics · Computer Science 2026-03-30 Martín Arce Llobera , Julio A. Placed , Mariano De Paula , Pablo De Cristóforis

Time Slotted Channel Hopping (TSCH) is a widely adopted Media Access Control (MAC) protocol within the IEEE 802.15.4e standard, designed to provide reliable and energy-efficient communication in Industrial Internet of Things (IIoT)…

Networking and Internet Architecture · Computer Science 2026-04-28 F. Fernando Jurado-Lasso , J. F. Jurado

With the increasing penetration of distributed energy resources, distributed optimization algorithms have attracted significant attention for power systems applications due to their potential for superior scalability, privacy, and…

Systems and Control · Electrical Eng. & Systems 2022-05-09 Sihan Zeng , Alyssa Kody , Youngdae Kim , Kibaek Kim , Daniel K. Molzahn

Traditional anti-jamming techniques like spread spectrum, adaptive power/rate control, and cognitive radio, have demonstrated effectiveness in mitigating jamming attacks. However, their robustness against the growing complexity of…

Signal Processing · Electrical Eng. & Systems 2023-07-14 Abubakar Sani Ali , Shimaa Naser , Sami Muhaidat

Millimeter-wave (mmWave) communication is a promising technology to cope with the exponential increase in 5G data traffic. Such networks typically require a very dense deployment of base stations. A subset of those, so-called macro base…

Networking and Internet Architecture · Computer Science 2020-07-07 Dingwen Yuan , Hsuan-Yin Lin , Jörg Widmer , Matthias Hollick

Renewable energy resources (RERs) have been increasingly integrated into distribution networks (DNs) for decarbonization. However, the variable nature of RERs introduces uncertainties to DNs, frequently resulting in voltage fluctuations…

Systems and Control · Electrical Eng. & Systems 2024-01-30 Jinhao Li , Ruichang Zhang , Hao Wang , Zhi Liu , Hongyang Lai , Yanru Zhang

In this paper, we for the first time investigate the random access problem for a delay-constrained heterogeneous wireless network. We begin with a simple two-device problem where two devices deliver delay-constrained traffic to an access…

Networking and Internet Architecture · Computer Science 2022-05-05 Lei Deng , Danzhou Wu , Zilong Liu , Yijin Zhang , Yunghsiang S. Han

The Open Radio Access Network (Open RAN) paradigm, and its reference architecture proposed by the O-RAN Alliance, is paving the way toward open, interoperable, observable and truly intelligent cellular networks. Crucial to this evolution is…

Networking and Internet Architecture · Computer Science 2025-10-08 Raoul Raftopoulos , Salvatore D'Oro , Tommaso Melodia , Giovanni Schembra

In this paper, we address the channel access problem in a dynamic wireless environment via meta-reinforcement learning. Spectrum is a scarce resource in wireless communications, especially with the dramatic increase in the number of devices…

Networking and Internet Architecture · Computer Science 2022-01-25 Ziyang Lu , M. Cenk Gursoy

Multi-Agent Reinforcement Learning (MARL) has become a powerful framework for numerous real-world applications, modeling distributed decision-making and learning from interactions with complex environments. Resource Allocation Optimization…

Multiagent Systems · Computer Science 2025-05-01 Mohamad A. Hady , Siyi Hu , Mahardhika Pratama , Jimmy Cao , Ryszard Kowalczyk