English
Related papers

Related papers: Q-NAV: NAV Setting Method based on Reinforcement L…

200 papers

This paper investigates the fair-effective communication and robustness in imperfect and energy-constrained underwater acoustic sensor networks (IC-UASNs). Specifically, we investigate the impact of unexpected node malfunctions on the…

Networking and Internet Architecture · Computer Science 2025-08-12 Yu Gou , Tong Zhang , Jun Liu , Tingting Yang , Shanshan Song , Jun-Hong Cui

Questions remain on the robustness of data-driven learning methods when crossing the gap from simulation to reality. We utilize weight anchoring, a method known from continual learning, to cultivate and fixate desired behavior in Neural…

Machine Learning · Computer Science 2023-04-21 Steffen Gracla , Edgar Beck , Carsten Bockelmann , Armin Dekorsy

In this paper, the problem of data correlation-aware resource management is studied for a network of wireless virtual reality (VR) users communicating over cloud-based small cell networks (SCNs). In the studied model, small base stations…

Information Theory · Computer Science 2017-11-28 Mingzhe Chen , Walid Saad , Changchuan Yin , Merouane Debbah

We present a method that addresses the pain point of long lead-time required to deploy cell-level parameter optimisation policies to new wireless network sites. Given a sequence of action spaces represented by overlapping subsets of…

Machine Learning · Computer Science 2024-05-01 Cengis Hasan , Alexandros Agapitos , David Lynch , Alberto Castagna , Giorgio Cruciata , Hao Wang , Aleksandar Milenovic

Ultra-wideband technology has become increasingly popular for indoor localization and location-based services. This has led recent advances to be focused on reducing the ranging errors, whilst research focusing on enabling more reliable and…

Networking and Internet Architecture · Computer Science 2022-10-28 Dieter Coppens , Adnan Shahid , Eli De Poorter

Monitoring Wireless Sensor Networks (WSNs) are composed of sensor nodes that report temperature, relative humidity, and other environmental parameters. The time between two successive measurements is a critical parameter to set during the…

Networking and Internet Architecture · Computer Science 2016-07-13 Gabriel Martins Dias , Maddalena Nurchis , Boris Bellalta

For the goal of automated design of high-performance deep convolutional neural networks (CNNs), Neural Architecture Search (NAS) methodology is becoming increasingly important for both academia and industries.Due to the costly stochastic…

Machine Learning · Computer Science 2021-10-12 Shengran Hu , Ran Cheng , Cheng He , Zhichao Lu , Jing Wang , Miao Zhang

In this paper, a deep reinforcement learning (DRL) method is proposed to address the problem of UAV navigation in an unknown environment. However, DRL algorithms are limited by the data efficiency problem as they typically require a huge…

Robotics · Computer Science 2020-08-07 Lei He , Nabil Aouf , James F. Whidborne , Bifeng Song

Using Unmanned Aerial Vehicles (UAVs) in Search and rescue operations (SAR) to navigate challenging terrain while maintaining reliable communication with the cellular network is a promising approach. This paper suggests a novel technique…

Routing in multi-hop wireless networks is a complex problem, especially in heterogeneous networks where multiple wireless communication technologies coexist. Reinforcement learning (RL) methods, such as Q-learning, have been introduced for…

Signal Processing · Electrical Eng. & Systems 2025-08-21 Brian Kim , Justin H. Kong , Terrence J. Moore , Fikadu T. Dagefu

For real-world deployments, it is critical to allow robots to navigate in complex environments autonomously. Traditional methods usually maintain an internal map of the environment, and then design several simple rules, in conjunction with…

Robotics · Computer Science 2021-04-16 Yuanyang Zhu , Zhi Wang , Chunlin Chen , Daoyi Dong

There is a significant need for precise and reliable forecasting of the far-field noise emanating from shipping vessels. Conventional full-order models based on the Navier-Stokes equations are unsuitable, and sophisticated model reduction…

Machine Learning · Computer Science 2024-04-15 Indu Kant Deo , Akash Venkateshwaran , Rajeev K. Jaiman

Underwater Wireless Sensor Networks (UWSNs) represent a promising technology that enables diverse underwater applications through acoustic communication. However, it encounters significant challenges including harsh communication…

Networking and Internet Architecture · Computer Science 2025-08-13 Tong Zhang , Yu Gou , Jun Liu , Jun-Hong Cui

This paper studies an unmanned aerial vehicle (UAV)-enabled wireless sensor network, in which one UAV flies in the sky to collect the data transmitted from a set of ground nodes (GNs) via distributed beamforming. We consider two scenarios…

Information Theory · Computer Science 2021-08-10 Tianxin Feng , Lifeng Xie , Jianping Yao , Jie Xu

Reinforcement learning in sparse-reward navigation environments with expensive and limited interactions is challenging and poses a need for effective exploration. Motivated by complex navigation tasks that require real-world training (when…

Optimization and Control · Mathematics 2023-10-13 Yijia Wang , Matthias Poloczek , Daniel R. Jiang

This paper proposes an Improved Noisy Deep Q-Network (Noisy DQN) to enhance the exploration and stability of Unmanned Aerial Vehicle (UAV) when applying deep reinforcement learning in simulated environments. This method enhances the…

Systems and Control · Electrical Eng. & Systems 2026-02-06 Zhang Hengyu , Maryam Cheraghy , Liu Wei , Armin Farhadi , Meysam Soltanpour , Zhong Zhuoqing

Link adaptation (LA) is an essential function in modern wireless communication systems that dynamically adjusts the transmission rate of a communication link to match time- and frequency-varying radio link conditions. However, factors such…

Machine Learning · Computer Science 2024-12-02 Samuele Peri , Alessio Russo , Gabor Fodor , Pablo Soldati

In this paper, we study how to solve resource allocation problems in ultra-reliable and low-latency communications by unsupervised deep learning, which often yield functional optimization problems with quality-of-service (QoS) constraints.…

Networking and Internet Architecture · Computer Science 2019-06-06 Chengjian Sun , Chenyang Yang

Wireless sensor networks monitor dynamic environments that change rapidly over time. This dynamic behavior is either caused by external factors or initiated by the system designers themselves. To adapt to such conditions, sensor networks…

Networking and Internet Architecture · Computer Science 2016-08-16 Mohammad Abu Alsheikh , Shaowei Lin , Dusit Niyato , Hwee-Pink Tan

The next-generation wireless technologies, including beyond 5G and 6G networks, are paving the way for transformative applications such as vehicle platooning, smart cities, and remote surgery. These innovations are driven by a vast array of…

Multiagent Systems · Computer Science 2026-01-05 Eslam Eldeeb , Hirley Alves