English
Related papers

Related papers: Value-Based Reinforcement Learning for Digital Twi…

200 papers

Real-time control of pumps can be an infeasible task in water distribution systems (WDSs) because the calculation to find the optimal pump speeds is resource-intensive. The computational need cannot be lowered even with the capabilities of…

Artificial Intelligence · Computer Science 2020-10-14 Gergely Hajgató , György Paál , Bálint Gyires-Tóth

In this paper, we propose a novel method for enhancing security in privacy-preserving federated learning using the Vision Transformer. In federated learning, learning is performed by collecting updated information without collecting raw…

Cryptography and Security · Computer Science 2024-10-01 Hiroto Sawada , Shoko Imaizumi , Hitoshi Kiya

Constrained reinforcement learning is to maximize the expected reward subject to constraints on utilities/costs. However, the training environment may not be the same as the test one, due to, e.g., modeling error, adversarial attack,…

Machine Learning · Computer Science 2022-09-16 Yue Wang , Fei Miao , Shaofeng Zou

Digital Twins have gained attention in various industries for simulation, monitoring, and decision-making, relying on ever-improving machine learning models. However, agricultural Digital Twin implementations are limited compared to other…

Machine Learning · Computer Science 2024-06-14 Georg Goldenits , Kevin Mallinger , Sebastian Raubitzek , Thomas Neubauer

Wireless digital twins can be leveraged to provide site-specific synthetic channel information through precise physical modeling and signal propagation simulations. This can help reduce the overhead of channel state information (CSI)…

Signal Processing · Electrical Eng. & Systems 2026-04-21 Hao Luo , Saeed R. Khosravirad , Ahmed Alkhateeb

Obtaining reliable state preparation protocols is a key step towards practical implementation of many quantum technologies, and one of the main tasks in quantum control. In this work, different reinforcement learning approaches are used to…

Quantum Physics · Physics 2024-09-04 Manuel Guatto , Gian Antonio Susto , Francesco Ticozzi

A critical and challenging problem in reinforcement learning is how to learn the state-action value function from the experience replay buffer and simultaneously keep sample efficiency and faster convergence to a high quality solution. In…

Machine Learning · Computer Science 2018-04-25 Weichao Li , Fuxian Huang , Xi Li , Gang Pan , Fei Wu

Generation IV (Gen-IV) nuclear power plants are envisioned to replace the current reactor fleet, bringing improvements in performance, safety, reliability, and sustainability. However, large cost investments currently inhibit the deployment…

Systems and Control · Electrical Eng. & Systems 2025-12-02 Jasmin Y. Lim , Dimitrios Pylorof , Humberto E. Garcia , Karthik Duraisamy

Central to the digital transformation of the process industry are Digital Twins (DTs), virtual replicas of physical manufacturing systems that combine sensor data with sophisticated data-based or physics-based models, or a combination…

Machine Learning · Computer Science 2024-07-03 Michael Mayr , Georgios C. Chasparis , Josef Küng

Digital Twin technology creates virtual replicas of physical objects, processes, or systems by replicating their properties, data, and behaviors. This advanced technology offers a range of intelligent functionalities, such as modeling,…

Machine Learning · Computer Science 2024-08-26 Sagar Srinivas Sakhinana , Krishna Sai Sudhir Aripirala , Shivam Gupta , Venkataramana Runkana

Image-based Reinforcement Learning is a practical yet challenging task. A major hurdle lies in extracting control-centric representations while disregarding irrelevant information. While approaches that follow the bisimulation principle…

Machine Learning · Computer Science 2023-10-30 Chen Liu , Hongyu Zang , Xin Li , Yong Heng , Yifei Wang , Zhen Fang , Yisen Wang , Mingzhong Wang

Large language models (LLMs) are increasingly deployed in decision-making tasks, where not only accuracy but also reliable confidence estimates are essential. Well-calibrated confidence enables downstream systems to decide when to trust a…

Machine Learning · Computer Science 2026-01-21 Duygu Nur Yaldiz , Evangelia Spiliopoulou , Zheng Qi , Siddharth Varia , Srikanth Doss , Nikolaos Pappas

Deep reinforcement learning (DRL) is a machine learning-based method suited for complex and high-dimensional control problems. In this study, a real-time control system based on DRL is developed for long-term voltage stability events. The…

Systems and Control · Electrical Eng. & Systems 2022-07-12 Hannes Hagmar , Le Anh Tuan , Robert Eriksson

In order to collaborate efficiently with unknown partners in cooperative control settings, adaptation of the partners based on online experience is required. The rather general and widely applicable control setting, where each cooperation…

Multiagent Systems · Computer Science 2019-10-30 Florian Köpf , Samuel Tesfazgi , Michael Flad , Sören Hohmann

Nowadays, fast delivery services have created the need for high-density warehouses. The puzzle-based storage system is a practical way to enhance the storage density, however, facing difficulties in the retrieval process. In this work, a…

Machine Learning · Computer Science 2022-02-09 Jing He , Xinglu Liu , Qiyao Duan , Wai Kin Victor Chan , Mingyao Qi

The emerging data-driven methods based on artificial intelligence (AI) have paved the way for intelligent, flexible, and adaptive network management in vehicular applications. To enhance network management towards network automation, this…

Networking and Internet Architecture · Computer Science 2024-03-26 Kaige Qu , Weihua Zhuang

Interactive adaptive systems powered by Reinforcement Learning (RL) have many potential applications, such as intelligent tutoring systems. In such systems there is typically an external human system designer that is creating, monitoring…

Artificial Intelligence · Computer Science 2020-04-06 Ramtin Keramati , Emma Brunskill

Temporal information is essential to learning effective policies with Reinforcement Learning (RL). However, current state-of-the-art RL algorithms either assume that such information is given as part of the state space or, when learning…

Machine Learning · Computer Science 2021-01-07 Wenling Shang , Xiaofei Wang , Aravind Srinivas , Aravind Rajeswaran , Yang Gao , Pieter Abbeel , Michael Laskin

Deep Neural Networks (DNNs) have been widely applied in Internet of Things (IoT) systems for various tasks such as image classification and object detection. However, heavyweight DNN models can hardly be deployed on edge devices due to…

Machine Learning · Computer Science 2022-10-12 Tinghao Zhang , Zhijun Li , Yongrui Chen , Kwok-Yan Lam , Jun Zhao

The increasing penetration of renewable energy resources in distribution systems necessitates high-speed monitoring and control of voltage for ensuring reliable system operation. However, existing voltage control algorithms often make…

Systems and Control · Electrical Eng. & Systems 2024-10-03 Mohammad Golgol , Anamitra Pal