An Architecture for Deploying Reinforcement Learning in Industrial Environments
Abstract
Industry 4.0 is driven by demands like shorter time-to-market, mass customization of products, and batch size one production. Reinforcement Learning (RL), a machine learning paradigm shown to possess a great potential in improving and surpassing human level performance in numerous complex tasks, allows coping with the mentioned demands. In this paper, we present an OPC UA based Operational Technology (OT)-aware RL architecture, which extends the standard RL setting, combining it with the setting of digital twins. Moreover, we define an OPC UA information model allowing for a generalized plug-and-play like approach for exchanging the RL agent used. In conclusion, we demonstrate and evaluate the architecture, by creating a proof of concept. By means of solving a toy example, we show that this architecture can be used to determine the optimal policy using a real control system.
Keywords
Cite
@article{arxiv.2306.01420,
title = {An Architecture for Deploying Reinforcement Learning in Industrial Environments},
author = {Georg Schäfer and Reuf Kozlica and Stefan Wegenkittl and Stefan Huber},
journal= {arXiv preprint arXiv:2306.01420},
year = {2023}
}
Comments
This preprint has not undergone peer review or any post-submission improvements or corrections. The Version of Record of this contribution is published in Computer Aided Systems Theory - EUROCAST 2022 and is available online at https://doi.org/10.1007/978-3-031-25312-6_67