English
Related papers

Related papers: Closed-Loop CO2 Storage Control With History-Based…

200 papers

We develop a probabilistic framework for analysing model-based reinforcement learning in the episodic setting. We then apply it to study finite-time horizon stochastic control problems with linear dynamics but unknown coefficients and…

Machine Learning · Computer Science 2021-12-22 Lukasz Szpruch , Tanut Treetanthiploet , Yufei Zhang

Imitation learning (IL) enables efficient skill acquisition from demonstrations but often struggles with long-horizon tasks and high-precision control due to compounding errors. Residual policy learning offers a promising, model-agnostic…

Robotics · Computer Science 2025-09-17 Zhefei Gong , Shangke Lyu , Pengxiang Ding , Wei Xiao , Donglin Wang

A data-based policy for iterative control task is presented. The proposed strategy is model-free and can be applied whenever safe input and state trajectories of a system performing an iterative task are available. These trajectories,…

Systems and Control · Computer Science 2019-03-22 Ugo Rosolia , Xiaojing Zhang , Francesco Borrelli

Control of non-condensing non-ideal-gas power cycles is challenging because their output power dynamics depend on complex system interactions, non-ideal-gas effects complicate turbomachinery behavior, and state constraints must be…

Systems and Control · Electrical Eng. & Systems 2021-08-30 Viv Bone , Michael Kearney , Ingo Jahn

Imitation learning has emerged as an effective approach for bootstrapping sequential decision-making in robotics, achieving strong performance even in high-dimensional dexterous manipulation tasks. Recent behavior cloning methods further…

Robotics · Computer Science 2026-02-06 Entong Su , Tyler Westenbroek , Anusha Nagabandi , Abhishek Gupta

This paper explores the development of learning-based tunable control gains using EMT-in-the-loop simulation framework (e.g., PSCAD interfaced with Python-based learning modules) to address critical sub-synchronous oscillations. Since…

Systems and Control · Electrical Eng. & Systems 2025-11-11 Sayak Mukherjee , Ramij R. Hossain , Kaustav Chatterjee , Sameer Nekkalapu , Marcelo Elizondo

Autonomous learning of robotic skills can allow general-purpose robots to learn wide behavioral repertoires without requiring extensive manual engineering. However, robotic skill learning methods typically make one of several trade-offs to…

Machine Learning · Computer Science 2016-10-07 William Montgomery , Anurag Ajay , Chelsea Finn , Pieter Abbeel , Sergey Levine

Model-based reinforcement learning is an effective approach for controlling an unknown system. It is based on a longstanding pipeline familiar to the control community in which one performs experiments on the environment to collect a…

Systems and Control · Electrical Eng. & Systems 2024-08-14 Bruce D. Lee , Ingvar Ziemann , George J. Pappas , Nikolai Matni

The applicability of reinforcement learning (RL) algorithms in real-world domains often requires adherence to safety constraints, a need difficult to address given the asymptotic nature of the classic RL optimization objective. In contrast…

Machine Learning · Computer Science 2021-04-15 Moritz A. Zanger , Karam Daaboul , J. Marius Zöllner

Underwater vehicles are employed in the exploration of dynamic environments where tuning of a specific controller for each task would be time-consuming and unreliable as the controller depends on calculated mathematical coefficients in…

Systems and Control · Electrical Eng. & Systems 2021-01-14 Wilmer Ariza Ramirez , Zhi Q. Leong , Hung D. Nguyen , S. G. Jayasinghe

Systems and machines undergo various failure modes that result in machine health degradation, so maintenance actions are required to restore them back to a state where they can perform their expected functions. Since maintenance tasks are…

Machine Learning · Computer Science 2023-07-11 Oluwaseyi Ogunfowora , Homayoun Najjaran

Physical reservoir computing is a computational framework that offers an energy- and computation-efficient alternative to conventional training of neural networks. In reservoir computing, input signals are mapped into the high-dimensional…

Soft Condensed Matter · Physics 2026-01-12 Veit-Lorenz Heuthe , Lukas Seemann , Samuel Tovey , Clemens Bechinger

An important question in data-driven control is how to obtain an informative dataset. In this work, we consider the problem of effective data acquisition of an unknown linear system with bounded disturbance for both open-loop and…

Systems and Control · Electrical Eng. & Systems 2025-12-01 Shilun Feng , Dawei Shi , Yang Shi , Kaikai Zheng

Model predictive control can optimally deal with nonlinear systems under consideration of constraints. The control performance depends on the model accuracy and the prediction horizon. Recent advances propose to use reinforcement learning…

Machine Learning · Computer Science 2024-11-01 Dean Brandner , Sergio Lucia

While deep learning models often achieve high predictive accuracy, their predictions typically do not come with any provable guarantees on risk or reliability, which are critical for deployment in high-stakes applications. The framework of…

Machine Learning · Computer Science 2025-10-13 Christopher Yeh , Nicolas Christianson , Adam Wierman , Yisong Yue

A deep-learning-based surrogate model capable of predicting flow and geomechanical responses in CO2 storage operations is presented and applied. The 3D recurrent R-U-Net model combines deep convolutional and recurrent neural networks to…

Machine Learning · Computer Science 2021-05-05 Meng Tang , Xin Ju , Louis J. Durlofsky

Most reinforcement-learning (RL) controllers used in continuous control are architecturally centralized: observations are compressed into a single latent state from which both value estimates and actions are produced. Biological control…

Machine Learning · Computer Science 2026-04-27 Anne E. Staples

This paper presents a closed-loop controller for wind farms to provide active power control services using a high-fidelity computational fluid dynamics based wind plant simulator. The proposed design enhances power tracking stability and…

Systems and Control · Electrical Eng. & Systems 2022-06-15 Jean Gonzalez Silva , Bart Matthijs Doekemeijer , Riccardo Ferrari , Jan-Willem van Wingerden

We investigate congestion-aware control of quantum repeater nodes operating under stochastic traffic and finite memory coherence. Entanglement generation is modeled as a probabilistic process producing Werner states subject to depolarizing…

Quantum Physics · Physics 2026-03-27 Nicolò Lo Piparo , William J. Munro , Kae Nemoto

This paper integrates prior knowledge into direct learning of safe controllers for linear uncertain systems under disturbances. To this end, we characterize the set of all closed-loop systems that can be explained by available prior…

Systems and Control · Electrical Eng. & Systems 2025-03-04 Amir Modares , Bahare Kiumarsi , Hamidreza Modares