English
Related papers

Related papers: Deep Reinforcement Learning for Digital Twin-Orien…

200 papers

The evolution and growing automation of collaborative robots introduce more complexity and unpredictability to systems, highlighting the crucial need for robot's adaptability and flexibility to address the increasing complexities of their…

Robotics · Computer Science 2024-03-21 Yuzhu Sun , Mien Van , Stephen McIlvanna , Nguyen Minh Nhat , Kabirat Olayemi , Jack Close , Seán McLoone

We present a modelling framework for the spreading of epidemics on temporal networks from which both the individual-based and pair-based models can be recovered. The proposed temporal pair-based model that is systematically derived from…

Physics and Society · Physics 2020-11-17 Rory Humphries , Kieran Mulchrone , Jamie Tratalos , Simon More , Philipp Hövel

Safe and efficient navigation through human crowds is an essential capability for mobile robots. Previous work on robot crowd navigation assumes that the dynamics of all agents are known and well-defined. In addition, the performance of…

Robotics · Computer Science 2025-01-28 Shuijing Liu , Peixin Chang , Weihang Liang , Neeloy Chakraborty , Katherine Driggs-Campbell

This article presents a digital twin (DT)-enhanced reinforcement learning (RL) framework aimed at optimizing performance and reliability in network resource management, since the traditional RL methods face several unified challenges when…

Systems and Control · Electrical Eng. & Systems 2024-06-18 Nan Cheng , Xiucheng Wang , Zan Li , Zhisheng Yin , Tom Luan , Xuemin Shen

Digital twins (DTs) constitute a critical link between the real-world and the metaverse. To guarantee a robust connection between these two worlds, DTs should maintain accurate representations of the physical applications, while preserving…

Machine Learning · Computer Science 2022-04-12 Omar Hashash , Christina Chaccour , Walid Saad

Many real-world systems can be expressed in temporal networks with nodes playing far different roles in structure and function and edges representing the relationships between nodes. Identifying critical nodes can help us control the spread…

Social and Information Networks · Computer Science 2021-07-07 En-Yu Yu , Yan Fu , Jun-Lin Zhou , Hong-Liang Sun , Duan-Bing Chen

Solar sensor-based monitoring systems have become a crucial agricultural innovation, advancing farm management and animal welfare through integrating sensor technology, Internet-of-Things, and edge and cloud computing. However, the…

Machine Learning · Computer Science 2025-05-07 Dian Chen , Zelin Wan , Dong Sam Ha , Jin-Hee Cho

Digital twins (DTs) are envisioned as a key enabler of the cyber-physical continuum in future wireless networks. However, efficient deployment and synchronization of DTs in dynamic multi-access edge computing (MEC) environments remains…

Systems and Control · Electrical Eng. & Systems 2026-04-02 Hossam Farag , Cedomir Stefanovic

Reinforcement Learning (RL) or Deep Reinforcement Learning (DRL) is a powerful approach to solving Markov Decision Processes (MDPs) when the model of the environment is not known a priori. However, RL models are still faced with challenges…

Systems and Control · Electrical Eng. & Systems 2024-06-04 Kabirat Olayemi , Mien Van , Luke Maguire , Sean McLoone

In this paper, we introduce a decentralized digital twin (DDT) framework for dynamical systems and discuss the prospects of the DDT modeling paradigm in computational science and engineering applications. The DDT approach is built on a…

Machine Learning · Computer Science 2022-07-26 Omer San , Suraj Pawar , Adil Rasheed

Complementary Learning Systems (CLS) theory suggests that the brain uses a 'neocortical' and a 'hippocampal' learning system to achieve complex behavior. These two systems are complementary in that the 'neocortical' system relies on slow…

Neurons and Cognition · Quantitative Biology 2019-05-08 Sam Blakeman , Denis Mareschal

The growing demand for services and the rapid deployment of virtualized network functions (VNFs) pose significant challenges for achieving low-latency and energy-efficient orchestration in modern edge-core network infrastructures. To…

Networking and Internet Architecture · Computer Science 2026-01-22 Faisal Ahmed , Suresh Subramaniam , Motoharu Matsuura , Hiroshi Hasegawa , Shih-Chun Lin

This paper focuses on jointly inferring network and community structures from the dynamics of complex systems. Although many approaches have been designed to solve these two problems solely, none of them consider explicit shareable…

Social and Information Networks · Computer Science 2024-10-28 Kai Wu , Chao Wang , Junyuan Chen , Jing Liu

We investigate the effects of modular and temporal connectivity patterns on epidemic spreading. To this end, we introduce and analytically characterise a model of time-varying networks with tunable modularity. Within this framework, we…

Physics and Society · Physics 2017-10-05 Matthieu Nadini , Kaiyuan Sun , Enrico Ubaldi , Michele Starnini , Alessandro Rizzo , Nicola Perra

The duration, type and structure of connections between individuals in real-world populations play a crucial role in how diseases invade and spread. Here, we incorporate the aforementioned heterogeneities into a model by considering a…

Physics and Society · Physics 2018-04-05 Rosanna C Barnard , Istvan Z Kiss , Luc Berthouze , Joel C Miller

The Network Slicing (NS) paradigm enables the partition of physical and virtual resources among multiple logical networks, possibly managed by different tenants. In such a scenario, network resources need to be dynamically allocated…

Multiagent Systems · Computer Science 2024-08-22 Federico Mason , Gianfranco Nencioni , Andrea Zanella

Control Co-Design (CCD) integrates physical and control system design to improve the performance of dynamic and autonomous systems. Despite advances in uncertainty-aware CCD methods, real-world uncertainties remain highly unpredictable.…

Machine Learning · Computer Science 2025-10-14 Ying-Kuan Tsai , Vispi Karkaria , Yi-Ping Chen , Wei Chen

A permanently increasing number of on-board automotive control systems requires new approaches to their digital mapping that improves functionality in terms of adaptability and robustness as well as enables their easier on-line software…

Systems and Control · Electrical Eng. & Systems 2022-07-20 Moritz Zink , Martin Schiele , Valentin Ivanov

Digital network twin (DNT) is a promising paradigm to replicate real-world cellular networks toward continual assessment, proactive management, and what-if analysis. Existing discussions have been focusing on using only deep learning…

Networking and Internet Architecture · Computer Science 2023-11-22 Yuru Zhang , Ming Zhao , Qiang Liu

Network slicing-based communication systems can dynamically and efficiently allocate resources for diversified services. However, due to the limitation of the network interface on channel access and the complexity of the resource…

Networking and Internet Architecture · Computer Science 2023-11-29 Zhengming Zhang , Yongming Huang , Cheng Zhang , Qingbi Zheng , Luxi Yang , Xiaohu You