English
Related papers

Related papers: Q-NAV: NAV Setting Method based on Reinforcement L…

200 papers

Wireless support of virtual reality (VR) has challenges when a network has multiple users, particularly for 3D VR gaming, digital AI avatars, and remote team collaboration. This work addresses these challenges through investigation of the…

Networking and Internet Architecture · Computer Science 2025-07-28 Muhammad Ahmed Mohsin , Sagnik Bhattacharya , Abhiram Gorle , Muhammad Ali Jamshed , John M. Cioffi

This letter investigates a channel assignment problem in uplink wireless communication systems. Our goal is to maximize the sum rate of all users subject to integer channel assignment constraints. A convex optimization based algorithm is…

Signal Processing · Electrical Eng. & Systems 2020-01-14 Guangyu Jia , Zhaohui Yang , Hak-Keung Lam , Jianfeng Shi , Mohammad Shikh-Bahaei

We introduce a novel family of adaptive robust equalizers for highly challenging underwater acoustic (UWA) channel equalization. Since the underwater environment is highly non-stationary and subjected to impulsive noise, we use adaptive…

Sound · Computer Science 2015-12-22 Dariush Kari , Muhammed Omer Sayin , Suleyman Serdar Kozat

We study the problem of adaptive contention window (CW) design for random-access wireless networks. More precisely, our goal is to design an intelligent node that can dynamically adapt its minimum CW (MCW) parameter to maximize a…

Signal Processing · Electrical Eng. & Systems 2020-11-19 Abhishek Kumar , Gunjan Verma , Chirag Rao , Ananthram Swami , Santiago Segarra

In this paper, we study the underwater acoustic localization in the presence of environmental mismatch. Especially, we exploit a pre-trained neural network for the acoustic wave propagation in a gradient-based optimization framework to…

Sound · Computer Science 2025-04-01 Dariush Kari , Yongjie Zhuang , Andrew C. Singer

Reward design remains a critical bottleneck in visual reinforcement learning (RL) for robotic manipulation. In simulated environments, rewards are conventionally designed based on the distance to a target position. However, such precise…

Machine Learning · Computer Science 2025-09-29 Nan Tang , Jing-Cheng Pang , Guanlin Li , Chao Qian , Yang Yu

In this paper, the problem of unmanned aerial vehicle (UAV) deployment, power allocation, and bandwidth allocation is investigated for a UAV-assisted wireless system operating at terahertz (THz) frequencies. In the studied model, one UAV…

Information Theory · Computer Science 2021-03-16 Luyao Xu , Ming Chen , Mingzhe Chen , Zhaohui Yang , Christina Chaccour , Walid Saad , Choong Seon Hong

This study presents a novel computer system performance optimization and adaptive workload management scheduling algorithm based on Q-learning. In modern computing environments, characterized by increasing data volumes, task complexity, and…

Machine Learning · Computer Science 2024-11-11 Pochun Li , Yuyang Xiao , Jinghua Yan , Xuan Li , Xiaoye Wang

Statistical spoken dialogue systems have the attractive property of being able to be optimised from data via interactions with real users. However in the reinforcement learning paradigm the dialogue manager (agent) often requires…

Machine Learning · Computer Science 2015-08-19 Pei-Hao Su , David Vandyke , Milica Gasic , Nikola Mrksic , Tsung-Hsien Wen , Steve Young

We study deep reinforcement learning (RL) algorithms with delayed rewards. In many real-world tasks, instant rewards are often not readily accessible or even defined immediately after the agent performs actions. In this work, we first…

Machine Learning · Computer Science 2021-06-23 Beining Han , Zhizhou Ren , Zuofan Wu , Yuan Zhou , Jian Peng

Data packet routing in aeronautical ad-hoc networks (AANETs) is challenging due to their high-dynamic topology. In this paper, we invoke deep reinforcement learning for routing in AANETs aiming at minimizing the end-to-end (E2E) delay.…

Networking and Internet Architecture · Computer Science 2021-10-29 Dong Liu , Jingjing Cui , Jiankang Zhang , Chenyang Yang , Lajos Hanzo

With the rapid development of future wireless communication, the combination of NOMA technology and millimeter-wave(mmWave) technology has become a research hotspot. The application of NOMA in mmWave heterogeneous networks can meet the…

Information Theory · Computer Science 2020-06-23 Haijun Zhang , Haisen Zhang , Keping Long , George K. Karagiannidis

We study reinforcement learning (RL) problems in which agents observe the reward or transition realizations at their current state before deciding which action to take. Such observations are available in many applications, including…

Machine Learning · Computer Science 2024-10-22 Nadav Merlis

Unpredictable sensor-to-estimator delays fundamentally distort what matters for wireless remote state estimation: not just freshness, but how delay interacts with sensor informativeness and energy efficiency. In this paper, we present a…

Information Theory · Computer Science 2026-01-30 Nho-Duc Tran , Aamir Mahmood , Mikael Gidlund

In wireless sensor networks (WSNs), utilizing the unmanned aerial vehicle (UAV) as a mobile data collector for the ground sensor nodes (SNs) is an energy-efficient technique to prolong the network lifetime. Specifically, since the UAV can…

Information Theory · Computer Science 2017-08-02 Cheng Zhan , Yong Zeng , Rui Zhang

The rapid development of Wi-Fi technologies in recent years has caused a significant increase in the traffic usage. Hence, knowledge obtained from Wi-Fi network measurements can be helpful for a more efficient network management. In this…

Networking and Internet Architecture · Computer Science 2024-08-20 Seyedeh Soheila Shaabanzadeh , Juan Sánchez-González

Unmanned aerial vehicles (UAVs) technique has been recognized as a promising solution in future wireless connectivity from the sky, and UAV navigation is one of the most significant open research problems, which has attracted wide interest…

Signal Processing · Electrical Eng. & Systems 2019-11-28 Hongji Huang , Yuchun Yang , Hong Wang , Zhiguo Ding , Hikmet Sari , Fumiyuki Adachi

Unmanned aerial vehicles (UAVs) are expected to be an integral part of wireless networks, and determining collision-free trajectories for multiple UAVs while satisfying requirements of connectivity with ground base stations (GBSs) is a…

Robotics · Computer Science 2021-04-19 Xueyuan Wang , M. Cenk Gursoy

Scaling reinforcement learning (RL) to recommender systems (RS) is promising since maximizing the expected cumulative rewards for RL agents meets the objective of RS, i.e., improving customers' long-term satisfaction. A key approach to this…

Machine Learning · Computer Science 2022-09-27 Chengqian Gao , Ke Xu , Kuangqi Zhou , Lanqing Li , Xueqian Wang , Bo Yuan , Peilin Zhao

Reinforcement learning tasks in real-world scenarios often involve large, high-dimensional action spaces, leading to challenges such as convergence difficulties, instability, and high computational complexity. It is widely acknowledged that…

Machine Learning · Computer Science 2024-12-18 Hai Lin , Cheng Huang , Zhihong Chen