English
Related papers

Related papers: Reinforcement-Learning-Enabled Beam Alignment for …

200 papers

Deep reinforcement learning (DRL) has recently been used to perform efficient resource allocation in wireless communications. In this paper, the vulnerabilities of such DRL agents to adversarial attacks is studied. In particular, we…

Machine Learning · Computer Science 2021-05-13 Feng Wang , M. Cenk Gursoy , Senem Velipasalar

Heave compensation is an essential part in various offshore operations. It is used in various applications, which include on-loading or off-loading systems, offshore drilling, landing helicopter on oscillating structures, and deploying and…

Systems and Control · Electrical Eng. & Systems 2021-07-26 Shrenik Zinage , Abhilash Somayajula

The stochastic and dynamic nature of renewable energy sources and power electronic devices are creating unique challenges for modern power systems. One such challenge is that the conventional mathematical systems models-based optimal active…

Optimization and Control · Mathematics 2019-09-02 Jiajun Duan , Haifeng Li , Xiaohu Zhang , Ruisheng Diao , Bei Zhang , Di Shi , Xiao Lu , Zhiwei Wang , Siqi Wang

Hybrid reconfigurable intelligent surfaces (HRIS) enhance wireless systems by combining passive reflection with active signal amplification. However, jointly optimizing the transmit beamforming with the HRIS reflection and amplification…

Signal Processing · Electrical Eng. & Systems 2026-04-13 Phuong Nam Tran , Nhan Thanh Nguyen , Markku Juntti

As the applications of deep reinforcement learning (DRL) in wireless communications grow, sensitivity of DRL based wireless communication strategies against adversarial attacks has started to draw increasing attention. In order to address…

Signal Processing · Electrical Eng. & Systems 2022-09-13 Feng Wang , Chen Zhong , M. Cenk Gursoy , Senem Velipasalar

A resource-constrained unmanned aerial vehicle (UAV) can be used as a flying LoRa gateway (GW) to move inside the target area for efficient data collection and LoRa resource management. In this work, we propose deep reinforcement learning…

Networking and Internet Architecture · Computer Science 2023-12-05 Mohammed Jouhari , Khalil Ibrahimi , Jalel Ben Othman , El Mehdi Amhoud

Millimeter Wave (mmWave) is an important part of 5G new radio (NR), in which highly directional beams are adapted to compensate for the substantial propagation loss based on UE locations. However, the location information may have some…

Systems and Control · Electrical Eng. & Systems 2022-04-26 Yujie Yao , Hao Zhou , Melike Erol-Kantarci

In this work, deep reinforcement learning (DRL) is applied to active flow control (AFC) over a threedimensional SD7003 wing at a Reynolds number of Re = 60,000 and angle of attack of AoA = 14 degrees. In the uncontrolled baseline case, the…

Computational Engineering, Finance, and Science · Computer Science 2025-09-15 R. Montalà , B. Font , P. Suárez , J. Rabault , O. Lehmkuhl , R. Vinuesa , I. Rodriguez

Unmanned aerial vehicles (UAVs) are playing an increasingly pivotal role in modern communication networks,offering flexibility and enhanced coverage for a variety of applica-tions. However, UAV networks pose significant challenges due to…

Networking and Internet Architecture · Computer Science 2025-02-19 Wei Zhao , Shaoxin Cui , Wen Qiu , Zhiqiang He , Zhi Liu , Xiao Zheng , Bomin Mao , Nei Kato

Development of autonomous cyber system defense strategies and action recommendations in the real-world is challenging, and includes characterizing system state uncertainties and attack-defense dynamics. We propose a data-driven deep…

Machine Learning · Computer Science 2023-02-06 Ashutosh Dutta , Samrat Chatterjee , Arnab Bhattacharya , Mahantesh Halappanavar

Next-generation wireless systems, already widely deployed, are expected to become even more prevalent in the future, representing challenges in both environmental and economic terms. This paper focuses on improving the energy efficiency of…

Networking and Internet Architecture · Computer Science 2024-10-21 Matteo Bordin , Andrea Lacava , Michele Polese , Sai Satish , Manoj AnanthaSwamy Nittoor , Rajarajan Sivaraj , Francesca Cuomo , Tommaso Melodia

Millimeter-wave (mmWave) is a key enabler for next-generation transportation systems. However, in an urban city scenario, mmWave is highly susceptible to blockages and shadowing. Therefore, base station (BS) placement is a crucial task in…

Signal Processing · Electrical Eng. & Systems 2024-04-24 Ahmed Al-Tahmeesschi , Jukka Talvitie , Miguel López-Benítez , Hamed Ahmadi , Laura Ruotsalainen

The increasing demand for autonomous systems in complex and dynamic environments has driven significant research into intelligent path planning methodologies. For decades, graph-based search algorithms, linear programming techniques, and…

This study explores the use of deep reinforcement learning (DRL) for active flow control (AFC) to reduce flow separation on wings at high angles of attack. Concretely, here the DRL agent controls the flow over the three-dimensional NACA0012…

Computational Engineering, Finance, and Science · Computer Science 2025-09-15 R. Montalà , B. Font , P. Suárez , J. Rabault , O. Lehmkuhl , R. Vinuesa , I. Rodriguez

As the next generation of mobile systems evolves, artificial intelligence (AI) is expected to deeply integrate with wireless communications for resource management in variable environments. In particular, deep reinforcement learning (DRL)…

Signal Processing · Electrical Eng. & Systems 2024-10-15 Jie Zhang , Jun Li , Long Shi , Zhe Wang , Shi Jin , Wen Chen , H. Vincent Poor

User location is a piece of critical information for network management and control. However, location uncertainty is unavoidable in certain settings leading to localization errors. In this paper, we consider the user location uncertainty…

Systems and Control · Electrical Eng. & Systems 2022-08-04 Yujie Yao , Hao Zhou , Melike Erol-Kantarci

Wireless sensor networks consist of randomly distributed sensor nodes for monitoring targets or areas of interest. Maintaining the network for continuous surveillance is a challenge due to the limited battery capacity in each sensor.…

Machine Learning · Computer Science 2023-10-03 Ngoc Bui , Phi Le Nguyen , Viet Anh Nguyen , Phan Thuan Do

Deep reinforcement learning (DRL) has been applied to a variety of problems during the past decade, and has provided effective control strategies in high-dimensional and non-linear situations that are challenging to traditional methods.…

Fluid Dynamics · Physics 2023-04-07 Colin Vignon , Jean Rabault , Ricardo Vinuesa

In this paper, the design of an optimal trajectory for an energy-constrained drone operating in dynamic network environments is studied. In the considered model, a drone base station (DBS) is dispatched to provide uplink connectivity to…

Machine Learning · Computer Science 2020-05-27 Ye Hu , Mingzhe Chen , Walid Saad , H. Vincent Poor , Shuguang Cui

Urban railway systems increasingly rely on communication based train control (CBTC) systems, where optimal deployment of access points (APs) in tunnels is critical for robust wireless coverage. Traditional methods, such as empirical…

Signal Processing · Electrical Eng. & Systems 2025-09-30 Kunyu Wu , Qiushi Zhao , Zihan Feng , Yunxi Mu , Hao Qin , Xinyu Zhang , Xingqi Zhang