English
Related papers

Related papers: Self-Sustaining Multiple Access with Continual Dee…

200 papers

We consider a dynamic multichannel access problem, where multiple correlated channels follow an unknown joint Markov model. A user at each time slot selects a channel to transmit data and receives a reward based on the success or failure of…

Networking and Internet Architecture · Computer Science 2018-02-21 Shangxing Wang , Hanpeng Liu , Pedro Henrique Gomes , Bhaskar Krishnamachari

A continual learning agent builds on previous experiences to develop increasingly complex behaviors by adapting to non-stationary and dynamic environments while preserving previously acquired knowledge. However, scaling these systems…

Machine Learning · Computer Science 2025-03-06 Achref Jaziri , Etienne Künzel , Visvanathan Ramesh

This work proposes a novel framework to dynamically and effectively manage and allocate different types of resources for Metaverse applications, which are forecasted to demand massive resources of various types that have never been seen…

Networking and Internet Architecture · Computer Science 2023-02-28 Nam H. Chu , Diep N. Nguyen , Dinh Thai Hoang , Khoa T. Phan , Eryk Dutkiewicz , Dusit Niyato , Tao Shu

A key challenge of continual reinforcement learning (CRL) in dynamic environments is to promptly adapt the RL agent's behavior as the environment changes over its lifetime, while minimizing the catastrophic forgetting of the learned…

Machine Learning · Computer Science 2023-05-25 Tiantian Zhang , Zichuan Lin , Yuxing Wang , Deheng Ye , Qiang Fu , Wei Yang , Xueqian Wang , Bin Liang , Bo Yuan , Xiu Li

Improving the interactivity and interconnectivity between people is one of the highlights of the Metaverse. The Metaverse relies on a core approach, digital twinning, which is a means to replicate physical world objects, people, actions and…

Networking and Internet Architecture · Computer Science 2022-09-28 Terence Jie Chua , Wenhan Yu , Jun Zhao

Deep reinforcement learning (DRL) has become a powerful tool for complex decision-making in machine learning and AI. However, traditional methods often assume perfect action execution, overlooking the uncertainties and deviations between an…

Robotics · Computer Science 2025-07-02 Oren Fivel , Matan Rudman , Kobi Cohen

6G networks are composed of subnetworks expected to meet ultra-reliable low-latency communication (URLLC) requirements for mission-critical applications such as industrial control and automation. An often-ignored aspect in URLLC is…

Systems and Control · Electrical Eng. & Systems 2025-07-17 Fateme Salehi , Aamir Mahmood , Sarder Fakhrul Abedin , Kyi Thar , Mikael Gidlund

Deep reinforcement learning for high dimensional, hierarchical control tasks usually requires the use of complex neural networks as functional approximators, which can lead to inefficiency, instability and even divergence in the training…

Machine Learning · Computer Science 2019-11-26 Yuguang Yang

We develop a framework based on deep reinforce-ment learning (DRL) to solve the spectrum allocation problem inthe emerging integrated access and backhaul (IAB) architecturewith large scale deployment and dynamic environment. The avail-able…

Information Theory · Computer Science 2020-04-29 Wanlu Lei , Yu Ye , Ming Xiao

With the rapidly growing expansion in the use of UAVs, the ability to autonomously navigate in varying environments and weather conditions remains a highly desirable but as-of-yet unsolved challenge. In this work, we use Deep Reinforcement…

Computer Vision and Pattern Recognition · Computer Science 2019-12-13 Bruna G. Maciel-Pearson , Letizia Marchegiani , Samet Akcay , Amir Atapour-Abarghouei , James Garforth , Toby P. Breckon

Dynamic spectrum access (DSA) is regarded as an effective and efficient technology to share radio spectrum among different networks. As a secondary user (SU), a DSA device will face two critical problems: avoiding causing harmful…

Machine Learning · Computer Science 2018-10-30 Hao-Hsuan Chang , Hao Song , Yang Yi , Jianzhong Zhang , Haibo He , Lingjia Liu

Deep reinforcement learning (DRL) has been shown to be successful in many application domains. Combining recurrent neural networks (RNNs) and DRL further enables DRL to be applicable in non-Markovian environments by capturing temporal…

Machine Learning · Computer Science 2020-10-13 Hao-Hsuan Chang , Lingjia Liu , Yang Yi

Deep Reinforcement Learning (DRL) has become a powerful methodology to solve complex decision-making problems. However, DRL has several limitations when used in real-world problems (e.g., robotics applications). For instance, long training…

Robotics · Computer Science 2019-08-15 Rodrigo Pérez-Dattari , Carlos Celemin , Javier Ruiz-del-Solar , Jens Kober

The increasing device heterogeneity and decentralization requirements in the computing continuum (i.e., spanning edge, fog, and cloud) introduce new challenges in resource orchestration. In such environments, agents are often responsible…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-23 Vlad Popescu-Vifor , Ilir Murturi , Praveen Kumar Donta , Schahram Dustdar

Deep Reinforcement Learning (DRL) is a subfield of machine learning for training autonomous agents that take sequential actions across complex environments. Despite its significant performance in well-known environments, it remains…

The deployment of unmanned aerial vehicles (UAVs) in many different settings has provided various solutions and strategies for networking paradigms. Therefore, it reduces the complexity of the developments for the existing problems, which…

Networking and Internet Architecture · Computer Science 2025-02-25 Baris Yamansavascilar , Atay Ozgovde , Cem Ersoy

Deep Reinforcement Learning (DRL) has recently witnessed significant advances that have led to multiple successes in solving sequential decision-making problems in various domains, particularly in wireless communications. The future…

Machine Learning · Computer Science 2020-11-10 Amal Feriani , Ekram Hossain

Effective patient monitoring is vital for timely interventions and improved healthcare outcomes. Traditional monitoring systems often struggle to handle complex, dynamic environments with fluctuating vital signs, leading to delays in…

Machine Learning · Computer Science 2024-10-30 Thanveer Shaik , Xiaohui Tao , Lin Li , Haoran Xie , Hong-Ning Dai , Feng Zhao , Jianming Yong

Increasingly complex, non-linear World-Earth system models are used for describing the dynamics of the biophysical Earth system and the socio-economic and socio-cultural World of human societies and their interactions. Identifying pathways…

Physics and Society · Physics 2020-09-16 Felix M. Strnad , Wolfram Barfuss , Jonathan F. Donges , Jobst Heitzig

In the context of advancing 6G, a substantial paradigm shift is anticipated, highlighting comprehensive everything-to-everything interactions characterized by numerous connections and stringent adherence to Quality of Service/Experience…

Networking and Internet Architecture · Computer Science 2024-12-19 Masoud Shokrnezhad , Hao Yu , Tarik Taleb , Richard Li , Kyunghan Lee , Jaeseung Song , Cedric Westphal