English
Related papers

Related papers: Hybrid ML-RL Approach for Smart Grid Stability Pre…

200 papers

Driven by the key challenges of cell therapy manufacturing, including high complexity, high uncertainty, and very limited process observations, we propose a hybrid model-based reinforcement learning (RL) to efficiently guide process…

Systems and Control · Electrical Eng. & Systems 2022-01-27 Hua Zheng , Wei Xie , Keqi Wang , Zheng Li

Smart grids are designed to efficiently handle variable power demands, especially for large loads, by real-time monitoring, distributed generation and distribution of electricity. However, the grid's distributed nature and the internet…

Systems and Control · Electrical Eng. & Systems 2024-11-26 Anjana B. , Suman Maiti , Sunandan Adhikary , Soumyajit Dey , Ashish R. Hota

We propose a Reinforcement Learning (RL) based control design framework for handling complex tasks. The approach extends the concept of Reward Machines (RM) with Signal Temporal Logic (STL) formulas that can be used for event generation.…

Artificial Intelligence · Computer Science 2026-04-17 Ana María Gómez Ruiz , Thao Dang , Alexandre Donzé

This paper introduces a potential learning scheme that can dynamically predict the stability of the reconnection of sub-networks to a main grid. As the future electrical power systems tend towards smarter and greener technology, the…

Machine Learning · Computer Science 2017-04-19 Carter Lassetter , Eduardo Cotilla-Sanchez , Jinsub Kim

The building energy (BE) management has an essential role in urban sustainability and smart cities. Recently, the novel data science and data-driven technologies have shown significant progress in analyzing the energy consumption and energy…

Machine Learning · Computer Science 2022-02-25 Ardabili Sina , Leila Abdolalizadeh , Csaba Mako , Bernat Torok , Mosavi Amir

This paper introduces a hybrid algorithm of deep reinforcement learning (RL) and Force-based motion planning (FMP) to solve distributed motion planning problem in dense and dynamic environments. Individually, RL and FMP algorithms each have…

Machine Learning · Computer Science 2020-04-01 Samaneh Hosseini Semnani , Hugh Liu , Michael Everett , Anton de Ruiter , Jonathan P. How

Deep Reinforcement Learning (DRL) is applied to control a nonlinear, chaotic system governed by the one-dimensional Kuramoto-Sivashinsky (KS) equation. DRL uses reinforcement learning principles for the determination of optimal control…

In dynamic programming (DP) and reinforcement learning (RL), an agent learns to act optimally in terms of expected long-term return by sequentially interacting with its environment modeled by a Markov decision process (MDP). More generally…

Machine Learning · Computer Science 2022-01-03 Mastane Achab , Gergely Neu

An efficient urban bus control system has the potential to significantly reduce travel delays and streamline the allocation of transportation resources, thereby offering enhanced and user-friendly transit services to passengers. However,…

Systems and Control · Electrical Eng. & Systems 2023-08-17 Qinghui Nie , Jishun Ou , Haiyang Zhang , Jiawei Lu , Shen Li , Haotian Shi

Traditional bulk load flexibility options, such as load shifting and load curtailment, for managing uncertainty in power markets limit the diversity of options and ignore the preferences of the individual loads, thus reducing efficiency and…

Systems and Control · Electrical Eng. & Systems 2021-12-20 Majid Majidi , Deepan Muthirayan , Masood Parvania , Pramod P. Khargonekar

Integration of machine learning (ML) models of unresolved dynamics into numerical simulations of fluid dynamics has been demonstrated to improve the accuracy of coarse resolution simulations. However, when trained in a purely offline mode,…

Fluid Dynamics · Physics 2023-07-26 Christian Pedersen , Laure Zanna , Joan Bruna , Pavel Perezhogin

Signal temporal logic (STL) is a powerful tool for describing complex behaviors for dynamical systems. Among many approaches, the control problem for systems under STL task constraints is well suited for learning-based solutions, because…

Systems and Control · Electrical Eng. & Systems 2020-03-16 Peter Varnai , Dimos V. Dimarogonas

We present a framework to synthesize control policies for nonlinear dynamical systems from complex temporal constraints specified in a rich temporal logic called Signal Temporal Logic (STL). We propose a novel smooth and differentiable STL…

Systems and Control · Computer Science 2019-04-29 Iman Haghighi , Noushin Mehdipour , Ezio Bartocci , Calin Belta

Model predictive control (MPC) is a method to formulate the optimal scheduling problem for grid flexibilities in a mathematical manner. The resulting time-constrained optimization problem can be re-solved in each optimization time step…

Systems and Control · Electrical Eng. & Systems 2021-08-20 Steven de Jongh , Sina Steinle , Anna Hlawatsch , Felicitas Mueller , Michael Suriyah , Thomas Leibfried

Ensuring safety and meeting temporal specifications are critical challenges for long-term robotic tasks. Signal temporal logic (STL) has been widely used to systematically and rigorously specify these requirements. However, traditional…

Machine Learning · Computer Science 2023-09-12 Yue Meng , Chuchu Fan

Reinforcement learning (RL) has been successfully applied to autoregressive (AR) and diffusion models. However, extending RL to hybrid AR-diffusion frameworks remains challenging due to interleaved inference and noisy log-probability…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Xiaoxiao Ma , Jiachen Lei , Tianfei Ren , Jie Huang , Siming Fu , Aiming Hao , Jiahong Wu , Xiangxiang Chu , Feng Zhao

Decision-making in military aviation Prognostics and Health Management (PHM) faces significant challenges due to the "curse of dimensionality" in large-scale fleet operations, combined with sparse feedback and stochastic mission profiles.…

Machine Learning · Computer Science 2026-04-09 Yong Si , Mingfei Lu , Jing Li , Yang Hu , Guijiang Li , Yueheng Song , Zhaokui Wang

Model-based reinforcement learning (RL) has shown great potential in various control tasks in terms of both sample-efficiency and final performance. However, learning a generalizable dynamics model robust to changes in dynamics remains a…

Machine Learning · Computer Science 2020-10-27 Younggyo Seo , Kimin Lee , Ignasi Clavera , Thanard Kurutach , Jinwoo Shin , Pieter Abbeel

The increasing integration of renewable energy sources (RESs) is transforming traditional power grid networks, which require new approaches for managing decentralized energy production and consumption. Microgrids (MGs) provide a promising…

Machine Learning · Computer Science 2025-11-19 Davide Salaorni , Federico Bianchi , Francesco Trovò , Marcello Restelli

Control synthesis from temporal logic specifications has gained popularity in recent years. In this paper, we use a model predictive approach to control discrete time linear systems with additive bounded disturbances subject to constraints…

Systems and Control · Computer Science 2016-05-24 Sadra Sadraddini , Calin Belta