English
Related papers

Related papers: Optimal-PhiBE: A PDE-based Model-free framework fo…

200 papers

Design of process control scheme is critical for quality assurance to reduce variations in manufacturing systems. Taking semiconductor manufacturing as an example, extensive literature focuses on control optimization based on certain…

Machine Learning · Computer Science 2023-09-19 Yanrong Li , Juan Du , Wei Jiang

We propose a learning-based robust predictive control algorithm that compensates for significant uncertainty in the dynamics for a class of discrete-time systems that are nominally linear with an additive nonlinear component. Such systems…

Systems and Control · Electrical Eng. & Systems 2022-12-05 Rohan Sinha , James Harrison , Spencer M. Richards , Marco Pavone

We present a general framework for optimizing the Conditional Value-at-Risk for dynamical systems using stochastic search. The framework is capable of handling the uncertainty from the initial condition, stochastic dynamics, and uncertain…

Optimization and Control · Mathematics 2021-02-16 Ziyi Wang , Oswin So , Keuntaek Lee , Camilo A. Duarte , Evangelos A. Theodorou

This work presents a physics-informed deep learning-based super-resolution framework to enhance the spatio-temporal resolution of the solution of time-dependent partial differential equations (PDE). Prior works on deep learning-based…

Machine Learning · Computer Science 2022-12-09 Rajat Arora , Ankit Shrivastava

Reinforcement learning (RL) is a class of artificial intelligence algorithms being used to design adaptive optimal controllers through online learning. This paper presents a model-free, real-time, data-efficient Q-learning-based algorithm…

Systems and Control · Electrical Eng. & Systems 2023-10-11 Ali Aalipour , Alireza Khani

Offline reinforcement learning (RL) aims to optimize a policy using collected data without online interactions. Model-based approaches are particularly appealing for addressing offline RL challenges because of their capability to mitigate…

Machine Learning · Computer Science 2026-04-14 Hao Li , Xiao-Hu Zhou , Shu-Hai Li , Mei-Jiang Gui , Xiao-Liang Xie , Shi-Qi Liu , Shuang-Yi Wang , Zhen-Qiu Feng , Zeng-Guang Hou

We develop an approach for solving time-consistent risk-sensitive stochastic optimization problems using model-free reinforcement learning (RL). Specifically, we assume agents assess the risk of a sequence of random variables using dynamic…

Machine Learning · Computer Science 2022-12-01 Anthony Coache , Sebastian Jaimungal

Optimal control strategies are often combined with safety certificates to ensure both performance and safety in safety-critical systems. A prominent example is combining Model Predictive Control (MPC) with Control Barrier Functions (CBF).…

Systems and Control · Electrical Eng. & Systems 2025-12-05 Kerim Dzhumageldyev , Filippo Airaldi , Azita Dabiri

Social goods, such as healthcare, smart city, and information networks, often produce ordered event data in continuous time. The generative processes of these event data can be very complex, requiring flexible models to capture their…

Machine Learning · Computer Science 2020-12-29 Shuang Li , Shuai Xiao , Shixiang Zhu , Nan Du , Yao Xie , Le Song

LCRL is a software tool that implements model-free Reinforcement Learning (RL) algorithms over unknown Markov Decision Processes (MDPs), synthesising policies that satisfy a given linear temporal specification with maximal probability. LCRL…

Machine Learning · Computer Science 2022-09-22 Hosein Hasanbeig , Daniel Kroening , Alessandro Abate

In this paper, we present a robotic model-based reinforcement learning method that combines ideas from model identification and model predictive control. We use a feature-based representation of the dynamics that allows the dynamics model…

Machine Learning · Computer Science 2016-03-16 Christopher Xie , Sachin Patil , Teodor Moldovan , Sergey Levine , Pieter Abbeel

In recent years, deep learning has proven to be a viable methodology for surrogate modeling and uncertainty quantification for a vast number of physical systems. However, in their traditional form, such models can require a large amount of…

Computational Physics · Physics 2019-12-04 Nicholas Geneva , Nicholas Zabaras

Reward shaping has been applied widely to accelerate Reinforcement Learning (RL) agents' training. However, a principled way of designing effective reward shaping functions, especially for complex continuous control problems, remains…

Machine Learning · Computer Science 2026-02-12 Mateo Juliani , Mingxuan Li , Elias Bareinboim

The massive integration of renewable-based distributed energy resources (DERs) inherently increases the energy system's complexity, especially when it comes to defining its operational schedule. Deep reinforcement learning (DRL) algorithms…

Systems and Control · Electrical Eng. & Systems 2023-05-10 Hou Shengren , Pedro P. Vergara , Edgar Mauricio Salazar Duque , Peter Palensky

Reinforcement learning (RL) is a promising approach. However, success is limited to real-world applications, because ensuring safe exploration and facilitating adequate exploitation is a challenge for controlling robotic systems with…

Robotics · Computer Science 2022-08-29 Mingyu Cai , Cristian-Ioan Vasile

Standard reinforcement learning (RL) optimizes policies for reward but imposes few constraints on how decisions evolve over time. As a result, policies may achieve high performance while exhibiting temporally incoherent behavior such as…

Machine Learning · Computer Science 2026-04-24 Sukesh Subaharan

Constrained Reinforcement Learning (CRL) is a subset of machine learning that introduces constraints into the traditional reinforcement learning (RL) framework. Unlike conventional RL which aims solely to maximize cumulative rewards, CRL…

Artificial Intelligence · Computer Science 2024-12-02 Xiaoshan Lin , Sadık Bera Yüksel , Yasin Yazıcıoğlu , Derya Aksaray

A self-learning optimal control algorithm for episodic fixed-horizon manufacturing processes with time-discrete control actions is proposed and evaluated on a simulated deep drawing process. The control model is built during consecutive…

Systems and Control · Computer Science 2020-01-07 Johannes Dornheim , Norbert Link , Peter Gumbsch

This paper introduces a simple efficient learning algorithms for general sequential decision making. The algorithm combines Optimism for exploration with Maximum Likelihood Estimation for model estimation, which is thus named OMLE. We prove…

Machine Learning · Computer Science 2022-11-24 Qinghua Liu , Praneeth Netrapalli , Csaba Szepesvári , Chi Jin

Constrained Reinforcement Learning (CRL) addresses sequential decision-making problems where agents are required to achieve goals by maximizing the expected return while meeting domain-specific constraints. In this setting, policy-based…

Machine Learning · Computer Science 2025-06-09 Alessandro Montenegro , Leonardo Cesani , Marco Mussi , Matteo Papini , Alberto Maria Metelli