English
Related papers

Related papers: Reinforcement Twinning: from digital twins to mode…

200 papers

While the digital twin has become an intrinsic part of the product creation process, its true power lies in the connectivity of the digital representation with its physical counterpart. Data acquired on the physical asset can validate,…

Other Computer Science · Computer Science 2023-04-17 Herman Van der Auweraer , Dirk Hartmann

Digital twin (DT) is one of the most promising enabling technologies for realizing smart grids. Characterized by seamless and active---data-driven, real-time, and closed-loop---integration between digital and physical spaces, a DT is much…

Signal Processing · Electrical Eng. & Systems 2019-09-17 Xing He , Qian Ai , Robert C. Qiu , Dongxia Zhang

In many practical control applications, the performance level of a closed-loop system degrades over time due to the change of plant characteristics. Thus, there is a strong need for redesigning a controller without going through the system…

Systems and Control · Electrical Eng. & Systems 2023-12-01 Mei Minami , Yuka Masumoto , Yoshihiro Okawa , Tomotake Sasaki , Yutaka Hori

The urgent energy transition requirements towards a sustainable future stretch across various industries and are a significant challenge facing humanity. Hydrogen promises a clean, carbon-free future, with the opportunity to integrate with…

Systems and Control · Electrical Eng. & Systems 2025-02-17 Vasu Sharma , Alexander Winkler , Armin Norouzi , Jakob Andert , David Gordon , Hongsheng Guo

Despite their effectiveness and popularity in offline or model-based reinforcement learning (RL), transformers remain underexplored in online model-free RL due to their sensitivity to training setups and model design decisions such as how…

Machine Learning · Computer Science 2025-10-16 Nikita Kachaev , Daniil Zelezetsky , Egor Cherepanov , Alexey K. Kovelev , Aleksandr I. Panov

Recently, empowered with the powerful capabilities of neural networks, reinforcement learning (RL) has successfully tackled numerous challenging tasks. However, while these models demonstrate enhanced decision-making abilities, they are…

Machine Learning · Computer Science 2025-10-09 Zhengpeng Xie , Yulong Zhang

Reinforcement learning (RL) is a framework to optimize a control policy using rewards that are revealed by the system as a response to a control action. In its standard form, RL involves a single agent that uses its policy to accomplish a…

Systems and Control · Electrical Eng. & Systems 2021-11-24 Juan Cervino , Juan Andres Bazerque , Miguel Calvo-Fullana , Alejandro Ribeiro

Digital Twins (DTs) are gaining prominence in cybersecurity for their ability to replicate complex IT (Information Technology), OT (Operational Technology), and IoT (Internet of Things) infrastructures, allowing for real time monitoring,…

Cryptography and Security · Computer Science 2025-07-24 Vita Santa Barletta , Vito Bavaro , Miriana Calvano , Antonio Curci , Antonio Piccinno , Davide Pio Posa

Reinforcement learning has been established over the past decade as an effective tool to find optimal control policies for dynamical systems, with recent focus on approaches that guarantee safety during the learning and/or execution phases.…

Systems and Control · Electrical Eng. & Systems 2021-10-06 S M Nahid Mahmud , Scott A Nivison , Zachary I. Bell , Rushikesh Kamalapurkar

Deep reinforcement learning is becoming increasingly popular for robot control algorithms, with the aim for a robot to self-learn useful feature representations from unstructured sensory input leading to the optimal actuation policy. In…

Robotics · Computer Science 2017-03-16 Steven Bohez , Tim Verbelen , Elias De Coninck , Bert Vankeirsbilck , Pieter Simoens , Bart Dhoedt

Digital twins are evolving into self-learning, autonomous systems that link models, data, and human interaction. Realizing their full potential depends on interoperability, standardization, and the integration of artificial intelligence and…

Computational Engineering, Finance, and Science · Computer Science 2026-05-26 Omer San , Adil Rasheed , Eda Bozdemir , Jun Deng

Air-ground integrated networks can relieve communication pressure on ground transportation networks and provide 6G-enabled vehicular Metaverses services offloading in remote areas with sparse RoadSide Units (RSUs) coverage and downtown…

Artificial Intelligence · Computer Science 2024-06-11 Yongju Tong , Jiawen Kang , Junlong Chen , Minrui Xu , Gaolei Li , Weiting Zhang , Xincheng Yan

As language models continue to rapidly improve, we can expect their actions and reasoning to become difficult or impossible for weaker agents and humans to follow, undermining interpretability and oversight. With an eye on long-term…

Artificial Intelligence · Computer Science 2026-01-27 Robert West , Ashton Anderson , Ece Kamar , Eric Horvitz

Learning a risk-aware policy is essential but rather challenging in unstructured robotic tasks. Safe reinforcement learning methods open up new possibilities to tackle this problem. However, the conservative policy updates make it…

Machine Learning · Computer Science 2022-12-15 Linrui Zhang , Zichen Yan , Li Shen , Shoujie Li , Xueqian Wang , Dacheng Tao

The accurate and efficient modeling of nuclear reactor transients is crucial for ensuring safe and optimal reactor operation. Traditional physics-based models, while valuable, can be computationally intensive and may not fully capture the…

Applications · Statistics 2024-11-28 James Daniell , Kazuma Kobayashi , Ayodeji Alajo , Syed Bahauddin Alam

Recent technological developments and advances in Artificial Intelligence (AI) have enabled sophisticated capabilities to be a part of Digital Twin (DT), virtually making it possible to introduce automation into all aspects of work…

Software Engineering · Computer Science 2022-01-19 Ashwin Agrawal , Martin Fischer , Vishal Singh

Reinforcement learning suffers from limitations in real practices primarily due to the number of required interactions with virtual environments. It results in a challenging problem because we are implausible to obtain a local optimal…

Machine Learning · Computer Science 2024-10-28 Qizhen Wu , Kexin Liu , Lei Chen

Deep learning (DL) techniques have demonstrated strong performance in compressing and reconstructing channel state information (CSI) while reducing feedback overhead in massive MIMO systems. A key challenge, however, is their reliance on…

Signal Processing · Electrical Eng. & Systems 2025-10-01 Hao Luo , Shuaifeng Jiang , Saeed R. Khosravirad , Ahmed Alkhateeb

Reinforcement learning (RL) has emerged as a powerful paradigm for solving decision-making problems in dynamic environments. In this research, we explore the application of Double DQN (DDQN) and Dueling Network Architectures, to financial…

Machine Learning · Computer Science 2025-04-17 Bruno Giorgio

This paper has proposed an easily replicable and novel approach for developing a Digital Twin (DT) system for industrial robots in intelligent manufacturing applications. Our framework enables effective communication via Robot Web Service…

Robotics · Computer Science 2024-10-22 Tianyi Xiang , Borui Li , Xin Pan , Quan Zhang