English
Related papers

Related papers: Digital Twin Calibration with Model-Based Reinforc…

200 papers

This paper proposes a robust control design method using reinforcement-learning for controlling partially-unknown dynamical systems under uncertain conditions. The method extends the optimal reinforcement-learning algorithm with a new…

Systems and Control · Electrical Eng. & Systems 2020-04-17 Phuong D. Ngo , Fred Godtliebsen

Reinforcement learning (RL) is a promising solution for autonomous vehicles to deal with complex and uncertain traffic environments. The RL training process is however expensive, unsafe, and time consuming. Algorithms are often developed…

Robotics · Computer Science 2022-11-29 Kevin Voogd , Jean Pierre Allamaa , Javier Alonso-Mora , Tong Duy Son

Modern control theories such as systems engineering approaches try to solve nonlinear system problems by revelation of causal relationship or co-relationship among the components; most of those approaches focus on control of sophisticatedly…

Machine Learning · Computer Science 2021-01-07 Byunghyun Ban , Soobin Kim

Animal behavior reflects interactions between the nervous system, body, and environment. Therefore, biomechanics and environmental context must be considered to understand algorithms for behavioral control. Neuromechanical digital twins,…

Neurons and Cognition · Quantitative Biology 2026-04-14 Sibo Wang-Chen , Pavan Ramdya

Task scheduling is a critical problem when one user offloads multiple different tasks to the edge server. When a user has multiple tasks to offload and only one task can be transmitted to server at a time, while server processes tasks…

Machine Learning · Computer Science 2022-08-05 Xiucheng Wang , Longfei Ma , Haocheng Li , Zhisheng Yin , Tom. Luan , Nan Cheng

As the manufacturing industry shifts from mass production to mass customization, there is a growing emphasis on adopting agile, resilient, and human-centric methodologies in line with the directives of Industry 5.0. Central to this…

Model-based reinforcement learning (MBRL) agents typically learn world models by minimizing predictive loss. However, powerful RL optimizers inevitably exploit minor model inaccuracies, leading to simulator exploitation and a reality gap…

Machine Learning · Computer Science 2026-05-29 Christoph Dann , Yishay Mansour , Mehryar Mohri

Feedback-based control is the de-facto standard when it comes to controlling classical stochastic systems and processes. However, standard feedback-based control methods are challenged by quantum systems due to measurement induced…

Quantum Physics · Physics 2024-05-14 Kai Meinerz , Simon Trebst , Mark Rudner , Evert van Nieuwenburg

We address the conflicting requirements of a multi-agent assignment problem through constrained reinforcement learning, emphasizing the inadequacy of standard regularization techniques for this purpose. Instead, we recur to a state…

Systems and Control · Electrical Eng. & Systems 2025-03-03 Leopoldo Agorio , Sean Van Alen , Miguel Calvo-Fullana , Santiago Paternain , Juan Andres Bazerque

The application of learning-based control methods in robotics presents significant challenges. One is that model-free reinforcement learning algorithms use observation data with low sample efficiency. To address this challenge, a prevalent…

Machine Learning · Computer Science 2024-07-19 Andrey Gorodetskiy , Konstantin Mironov , Aleksandr Panov

Reinforcement learning is an emerging approach to control dynamical systems for which classical approaches are difficult to apply. However, trained agents may not generalize against the variations of system parameters. This paper presents…

Systems and Control · Electrical Eng. & Systems 2023-11-10 Abdel Gafoor Haddad , Igor Boiko , Yahya Zweiri

Model-Based Reinforcement Learning involves learning a \textit{dynamics model} from data, and then using this model to optimise behaviour, most often with an online \textit{planner}. Much of the recent research along these lines presents a…

The challenge in controlling stochastic systems in which low-probability events can set the system on catastrophic trajectories is to develop a robust ability to respond to such events without significantly compromising the optimality of…

Populations and Evolution · Quantitative Biology 2020-10-28 Dalit Engelhardt

Biopharmaceutical manufacturing is a rapidly growing industry with impact in virtually all branches of medicines. Biomanufacturing processes require close monitoring and control, in the presence of complex bioprocess dynamics with many…

Artificial Intelligence · Computer Science 2022-07-26 Hua Zheng , Wei Xie , Ilya O. Ryzhov , Dongming Xie

Model-based reinforcement learning (RL) has proven to be a data efficient approach for learning control tasks but is difficult to utilize in domains with complex observations such as images. In this paper, we present a method for learning…

Machine Learning · Computer Science 2019-06-25 Marvin Zhang , Sharad Vikram , Laura Smith , Pieter Abbeel , Matthew J. Johnson , Sergey Levine

This work investigates the formal policy synthesis of continuous-state stochastic dynamic systems given high-level specifications in linear temporal logic. To learn an optimal policy that maximizes the satisfaction probability, we take a…

Artificial Intelligence · Computer Science 2023-04-21 Lening Li , Zhentian Qian

Model-based reinforcement learning approaches carry the promise of being data efficient. However, due to challenges in learning dynamics models that sufficiently match the real-world dynamics, they struggle to achieve the same asymptotic…

Machine Learning · Computer Science 2018-09-17 Ignasi Clavera , Jonas Rothfuss , John Schulman , Yasuhiro Fujita , Tamim Asfour , Pieter Abbeel

This paper proposes a novel robust reinforcement learning framework for discrete-time linear systems with model mismatch that may arise from the sim-to-real gap. A key strategy is to invoke advanced techniques from control theory. Using the…

Systems and Control · Electrical Eng. & Systems 2023-12-07 Leilei Cui , Tamer Başar , Zhong-Ping Jiang

The development of Digital Twins (DTs) represents a transformative advance for simulating and optimizing complex systems in a controlled digital space. Despite their potential, the challenge of constructing DTs that accurately replicate and…

Systems and Control · Electrical Eng. & Systems 2024-06-21 Longfei Ma , Nan Cheng , Xiucheng Wang , Jiong Chen , Yinjun Gao , Dongxiao Zhang , Jun-Jie Zhang

A model among many may only be best under certain states of the world. Switching from a model to another can also be costly. Finding a procedure to dynamically choose a model in these circumstances requires to solve a complex estimation…

Machine Learning · Computer Science 2023-10-10 Francesco Cordoni , Alessio Sancetta