English
Related papers

Related papers: Model-free optimal controller for discrete-time Ma…

200 papers

Recently, policy optimization for control purposes has received renewed attention due to the increasing interest in reinforcement learning. In this paper, we investigate the convergence of policy optimization for quadratic control of…

Optimization and Control · Mathematics 2020-02-12 Joao Paulo Jansch-Porto , Bin Hu , Geir Dullerud

Markovian jump linear systems (MJLS) are an important class of dynamical systems that arise in many control applications. In this paper, we introduce the problem of controlling unknown (discrete-time) MJLS as a new benchmark for…

Optimization and Control · Mathematics 2020-07-16 Joao Paulo Jansch-Porto , Bin Hu , Geir Dullerud

Recently, policy optimization for control purposes has received renewed attention due to the increasing interest in reinforcement learning. In this paper, we investigate the global convergence of gradient-based policy optimization methods…

Optimization and Control · Mathematics 2020-11-25 Joao Paulo Jansch-Porto , Bin Hu , Geir Dullerud

In this paper, a novel Q-learning scheduling method for the current controller of switched reluctance motor (SRM) drive is investigated. Q-learning algorithm is a class of reinforcement learning approaches that can find the best…

Systems and Control · Electrical Eng. & Systems 2020-06-16 Hamad A. Alharkan , Sepehr Saadatmand , Mehdi Ferdowsi , Pourya Shamsi

Owing to the growth of interest in Reinforcement Learning in the last few years, gradient based policy control methods have been gaining popularity for Control problems as well. And rightly so, since gradient policy methods have the…

Machine Learning · Computer Science 2021-12-01 Santanu Rathod , Manoj Bhadu , Abir De

Model-free Reinforcement Learning (RL) algorithms such as Q-learning [Watkins, Dayan 92] have been widely used in practice and can achieve human level performance in applications such as video games [Mnih et al. 15]. Recently, equipped with…

Machine Learning · Computer Science 2019-05-03 Zhao Song , Wen Sun

This paper introduces and analyzes an improved Q-learning algorithm for discrete-time linear time-invariant systems. The proposed method does not require any knowledge of the system dynamics, and it enjoys significant efficiency advantages…

Systems and Control · Electrical Eng. & Systems 2023-04-03 Victor G. Lopez , Mohammad Alsalti , Matthias A. Müller

Incorporating pattern-learning for prediction (PLP) in many discrete-time or discrete-event systems allows for computation-efficient controller design by memorizing patterns to schedule control policies based on their future occurrences. In…

Systems and Control · Electrical Eng. & Systems 2023-05-10 SooJean Han , Soon-Jo Chung , John C. Doyle

Reinforcement learning (RL) is a classical tool to solve network control or policy optimization problems in unknown environments. The original Q-learning suffers from performance and complexity challenges across very large networks. Herein,…

Machine Learning · Computer Science 2024-09-02 Talha Bozkus , Urbashi Mitra

This paper is concerned with the linear quadratic optimal control of discrete-time time-varying system with terminal state constraint. The main contribution is to propose a Q-learning algorithm for the optimal controller when the…

Optimization and Control · Mathematics 2023-07-20 Juanjuan Xu , Jingmei Liu , Zhaorong Zhang , Wei Wang

Reinforcement learning (RL) is an effective approach for solving optimal control problems without knowing the exact information of the system model. However, the classical Q-learning method, a model-free RL algorithm, has its limitations,…

Optimization and Control · Mathematics 2025-06-04 Xiushan Jiang , Weihai Zhang

This paper investigates a model-free solution to the stochastic linear quadratic regulation (LQR) problem for linear discrete-time systems with both multiplicative and additive noises. We formulate the stochastic LQR problem as a nonconvex…

Optimization and Control · Mathematics 2025-12-25 Jing Guo , Xiushan Jiang , Weihai Zhang

Reinforcement learning (RL) is a class of artificial intelligence algorithms being used to design adaptive optimal controllers through online learning. This paper presents a model-free, real-time, data-efficient Q-learning-based algorithm…

Systems and Control · Electrical Eng. & Systems 2023-10-11 Ali Aalipour , Alireza Khani

This paper presents a discrete-time option pricing model that is rooted in Reinforcement Learning (RL), and more specifically in the famous Q-Learning method of RL. We construct a risk-adjusted Markov Decision Process for a discrete-time…

Computational Finance · Quantitative Finance 2019-09-04 Igor Halperin

Q-learning is a promising method for solving optimal control problems for uncertain systems without the explicit need for system identification. However, approaches for continuous-time Q-learning have limited provable safety guarantees,…

Systems and Control · Electrical Eng. & Systems 2024-01-30 Soutrik Bandyopadhyay , Shubhendu Bhasin

Reinforcement Learning (RL) techniques have been increasingly applied in optimizing control systems. However, their application in quantum systems is hampered by the challenge of performing closed-loop control due to the difficulty in…

Quantum Physics · Physics 2024-02-08 Tanmay Neema , Susmit Jha , Tuhin Sahai

Autonomous unpowered flight is a challenge for control and guidance systems: all the energy the aircraft might use during flight has to be harvested directly from the atmosphere. We investigate the design of an algorithm that optimizes the…

Machine Learning · Computer Science 2017-07-19 Erwan Lecarpentier , Sebastian Rapp , Marc Melo , Emmanuel Rachelson

Learning how to effectively control unknown dynamical systems is crucial for intelligent autonomous systems. This task becomes a significant challenge when the underlying dynamics are changing with time. Motivated by this challenge, this…

Machine Learning · Computer Science 2025-10-21 Yahya Sattar , Zhe Du , Davoud Ataee Tarzanagh , Laura Balzano , Necmiye Ozay , Samet Oymak

Jump Markov linear systems (JMLS) are a useful class which can be used to model processes which exhibit random changes in behavior during operation. This paper presents a numerically stable method for learning the parameters of jump Markov…

Applications · Statistics 2020-04-21 Mark P. Balenzuela , Adrian G. Wills , Christopher Renton , Brett Ninness

Regularized Markov Decision Processes serve as models of sequential decision making under uncertainty wherein the decision maker has limited information processing capacity and/or aversion to model ambiguity. With functional approximation,…

Artificial Intelligence · Computer Science 2025-02-11 Jiachen Xi , Alfredo Garcia , Petar Momcilovic
‹ Prev 1 2 3 10 Next ›