English
Related papers

Related papers: Developing Robust Digital Twins and Reinforcement …

200 papers

Multiple automakers have in development or in production automated driving systems (ADS) that offer freeway-pilot functions. This type of ADS is typically limited to restricted-access freeways only, that is, the transition from manual to…

Machine Learning · Computer Science 2019-02-05 Pin Wang , Ching-Yao Chan

This paper proposes an adaptive energy management strategy for hybrid electric vehicles by combining deep reinforcement learning (DRL) and transfer learning (TL). This work aims to address the defect of DRL in tedious training time. First,…

Signal Processing · Electrical Eng. & Systems 2020-07-20 Xiaowei Guo , Teng Liu , Bangbei Tang , Xiaolin Tang , Jinwei Zhang , Wenhao Tan , Shufeng Jin

Gradient Boosting Machine (GBM) is an extremely powerful supervised learning algorithm that is widely used in practice. GBM routinely features as a leading algorithm in machine learning competitions such as Kaggle and the KDDCup. In this…

Machine Learning · Computer Science 2020-08-28 Haihao Lu , Sai Praneeth Karimireddy , Natalia Ponomareva , Vahab Mirrokni

In this paper, we investigate a novel digital network twin (DNT) assisted deep learning (DL) model training framework. In particular, we consider a physical network where a base station (BS) uses several antennas to serve multiple mobile…

Networking and Internet Architecture · Computer Science 2026-03-11 Hanzhi Yu , Hasan Farooq , Julien Forgeat , Shruti Bothe , Kristijonas Cyras , Md Moin Uddin Chowdhury , Mingzhe Chen

The growing scale and complexity of modern data centers present major challenges in balancing energy efficiency with outage risk. Although Deep Reinforcement Learning (DRL) shows strong potential for intelligent control, its deployment in…

Artificial Intelligence · Computer Science 2026-04-10 Qingang Zhang , Yuejun Yan , Guangyu Wu , Siew-Chien Wong , Jimin Jia , Zhaoyang Wang , Yonggang Wen

This paper presents a supervised multi-agent safe policy learning (SMAS-PL) method for optimal power management of networked microgrids (MGs) in distribution systems. While conventional reinforcement learning (RL) algorithms are black-box…

Systems and Control · Electrical Eng. & Systems 2020-10-28 Qianzhi Zhang , Kaveh Dehghanpour , Zhaoyu Wang , Feng Qiu , Dongbo Zhao

This paper is a technical overview of DeepMind and Google's recent work on reinforcement learning for controlling commercial cooling systems. Building on expertise that began with cooling Google's data centers more efficiently, we recently…

In the era of Industry 4.0 and smart manufacturing, process systems engineering must adapt to digital transformation. While reinforcement learning offers a model-free approach to process control, its applications are limited by the…

Systems and Control · Electrical Eng. & Systems 2025-05-28 Runze Lin , Junghui Chen , Biao Huang , Lei Xie , Hongye Su

The use of machine learning (ML) model as digital-twins for reduced-order-modeling (ROM) in lieu of system codes has grown traction over the past few years. However, due to the complex and non-linear nature of nuclear reactor transients as…

Machine Learning · Computer Science 2022-05-24 Edward Chen , Linyu Lin , Nam T. Dinh

Emerging reinforcement learning techniques using deep neural networks have shown great promise in control optimization. They harness non-local regularities of noisy control trajectories and facilitate transfer learning between tasks. To…

Quantum Physics · Physics 2018-04-17 Murphy Yuezhen Niu , Sergio Boixo , Vadim Smelyanskiy , Hartmut Neven

In the context of communication networks, digital twin technology provides a means to replicate the radio frequency (RF) propagation environment as well as the system behaviour, allowing for a way to optimize the performance of a deployed…

Signal Processing · Electrical Eng. & Systems 2024-02-01 Maximilian Arnold , Bence Major , Fabio Valerio Massoli , Joseph B. Soriaga , Arash Behboodi

Modern distribution grids are currently being challenged by frequent and sizable voltage fluctuations, due mainly to the increasing deployment of electric vehicles and renewable generators. Existing approaches to maintaining bus voltage…

Systems and Control · Computer Science 2019-12-05 Qiuling Yang , Gang Wang , Alireza Sadeghi , Georgios B. Giannakis , Jian Sun

Digital Twins (DTs) are set to become a key enabling technology in future wireless networks, with their use in network management increasing significantly. We developed a DT framework that leverages the heterogeneity of network access…

Networking and Internet Architecture · Computer Science 2024-08-07 Roberto Morabito , Bivek Pandey , Paulius Daubaris , Yasith R Wanigarathna , Sasu Tarkoma

This work focuses on the main challenges and problems in developing a virtual oceanic environment reproducing real experiments using Unmanned Surface Vehicles (USV) digital twins. We introduce the key features for building virtual worlds,…

This paper has proposed an easily replicable and novel approach for developing a Digital Twin (DT) system for industrial robots in intelligent manufacturing applications. Our framework enables effective communication via Robot Web Service…

Robotics · Computer Science 2024-10-22 Tianyi Xiang , Borui Li , Xin Pan , Quan Zhang

Robust machine learning for regulatory genomics is studied under biologically and technically induced distribution shifts. Deep convolutional and attention based models achieve strong in distribution performance on DNA regulatory sequence…

Genomics · Quantitative Biology 2026-02-20 Yiyao Yang

The urgent energy transition requirements towards a sustainable future stretch across various industries and are a significant challenge facing humanity. Hydrogen promises a clean, carbon-free future, with the opportunity to integrate with…

Systems and Control · Electrical Eng. & Systems 2025-02-17 Vasu Sharma , Alexander Winkler , Armin Norouzi , Jakob Andert , David Gordon , Hongsheng Guo

We investigate the effectiveness of reinforcement learning methods for finetuning large language models when transitioning from offline to semi-online to fully online regimes for both verifiable and non-verifiable tasks. Our experiments…

Digital Twins (DTs) are computational models that simulate the states and temporal dynamics of real-world systems, playing a crucial role in prediction, understanding, and decision-making across diverse domains. However, existing approaches…

Machine Learning · Computer Science 2024-11-01 Samuel Holt , Tennison Liu , Mihaela van der Schaar

While deep learning has had significant successes in computer vision thanks to the abundance of visual data, collecting sufficiently large real-world datasets for robot learning can be costly. To increase the practicality of these…

Robotics · Computer Science 2017-12-20 Fangyi Zhang , Jürgen Leitner , Michael Milford , Peter Corke