English
Related papers

Related papers: Enhanced Q-Learning Approach to Finite-Time Reacha…

200 papers

One of the major challenges in Deep Reinforcement Learning for control is the need for extensive training to learn the policy. Motivated by this, we present the design of the Control-Tutored Deep Q-Networks (CT-DQN) algorithm, a Deep…

Machine Learning · Computer Science 2022-12-05 Francesco De Lellis , Marco Coraggio , Giovanni Russo , Mirco Musolesi , Mario di Bernardo

In this paper, we introduce Hamilton-Jacobi-Bellman (HJB) equations for Q-functions in continuous time optimal control problems with Lipschitz continuous controls. The standard Q-function used in reinforcement learning is shown to be the…

Optimization and Control · Mathematics 2020-05-05 Jeongho Kim , Insoon Yang

We propose an innovative Parallel Quantum Local Search (PQLS) methodology that leverages the capabilities of small-scale quantum computers to efficiently address complex combinatorial optimization problems. Traditional Quantum Local Search…

Quantum Physics · Physics 2024-06-11 Chen-Yu Liu , Kuan-Cheng Chen

We study the Non-Stationary Reinforcement Learning (RL) under distribution shifts in both finite-horizon episodic and infinite-horizon discounted Markov Decision Processes (MDPs). In the finite-horizon case, the transition functions may…

Machine Learning · Computer Science 2026-03-31 Ha Manh Bui , Felix Parker , Kimia Ghobadi , Anqi Liu

Reinforcement learning has shown great promise in the training of robot behavior due to the sequential decision making characteristics. However, the required enormous amount of interactive and informative training data provides the major…

Artificial Intelligence · Computer Science 2020-12-22 Sha Luo , Hamidreza Kasaei , Lambert Schomaker

We present an approach to approximate reachable sets for linear systems with bounded L-infinity controls in finite time. Our first approach investigates the boundaries of these sets and reveals an exact characterization for single-input,…

Optimization and Control · Mathematics 2026-03-18 Steven Nguyen , Jorge Cortés , Boris Kramer

This paper introduces Meta-Q-Learning (MQL), a new off-policy algorithm for meta-Reinforcement Learning (meta-RL). MQL builds upon three simple ideas. First, we show that Q-learning is competitive with state-of-the-art meta-RL algorithms if…

Machine Learning · Computer Science 2020-04-07 Rasool Fakoor , Pratik Chaudhari , Stefano Soatto , Alexander J. Smola

Optimal control theory and machine learning techniques are combined to formulate and solve in closed form an optimal control formulation of online learning from supervised examples with regularization of the updates. The connections with…

Optimization and Control · Mathematics 2016-12-15 Giorgio Gnecco , Alberto Bemporad , Marco Gori , Marcello Sanguineti

We consider a dynamic multichannel access problem, where multiple correlated channels follow an unknown joint Markov model. A user at each time slot selects a channel to transmit data and receives a reward based on the success or failure of…

Networking and Internet Architecture · Computer Science 2018-02-21 Shangxing Wang , Hanpeng Liu , Pedro Henrique Gomes , Bhaskar Krishnamachari

We seek for the optimal strategy to infer the width $a$ of an infinite potential wells by performing measurements on the particle(s) contained in the well. In particular, we address quantum estimation theory as the proper framework to…

Quantum Physics · Physics 2019-07-10 Ilaria Pizio , Shivani Singh , C. M. Chandrashekar , Matteo G. A. Paris

The expansion in automation of increasingly fast applications and low-power edge devices poses a particular challenge for optimization based control algorithms, like model predictive control. Our proposed machine-learning supported approach…

Systems and Control · Electrical Eng. & Systems 2025-01-08 Hendrik Alsmeier , Anton Savchenko , Rolf Findeisen

Precision medicine aims to tailor therapeutic decisions to individual patient characteristics. This objective is commonly formalized through dynamic treatment regimes, which use statistical and machine learning methods to derive sequential…

Machine Learning · Statistics 2026-03-23 Sophia Yazzourh , Erica E. M. Moodie

Ensuring quality of service (QoS) guarantees in service systems is a challenging task, particularly when the system is composed of more fine-grained services, such as service function chains. An important QoS metric in service systems is…

Performance · Computer Science 2020-08-24 Majid Raeis , Ali Tizghadam , Alberto Leon-Garcia

Learning-based predictive control is a promising alternative to optimization-based MPC. However, efficiently learning the optimal control policy, the optimal value function, or the Q-function requires suitable function approximators. Often,…

Systems and Control · Electrical Eng. & Systems 2023-04-14 Dieter Teichrib , Moritz Schulze Darup

Given a set of trajectories demonstrating the execution of a task safely in a constrained MDP with observable rewards but with unknown constraints and non-observable costs, we aim to find a policy that maximizes the likelihood of…

Machine Learning · Computer Science 2026-03-02 George Papadopoulos , George A. Vouros

Optimal control problems with constraints ensuring safety and convergence to desired states can be mapped onto a sequence of real time optimization problems through the use of Control Barrier Functions (CBFs) and Control Lyapunov Functions…

Systems and Control · Electrical Eng. & Systems 2019-12-10 Wei Xiao , Calin A. Belta , Christos G. Cassandras

We propose the use of Bayesian networks, which provide both a mean value and an uncertainty estimate as output, to enhance the safety of learned control policies under circumstances in which a test-time input differs significantly from the…

Machine Learning · Computer Science 2019-02-18 Keuntaek Lee , Kamil Saigol , Evangelos A. Theodorou

Despite recent advances in improving the sample-efficiency of reinforcement learning (RL) algorithms, designing an RL algorithm that can be practically deployed in real-world environments remains a challenge. In this paper, we present…

Robotics · Computer Science 2024-07-11 Younggyo Seo , Jafar Uruç , Stephen James

This paper addresses the challenges of power flow calculation in large scale power systems with high renewable penetration, focusing on computational efficiency and generalization. Traditional methods, while accurate, struggle with…

Systems and Control · Electrical Eng. & Systems 2024-10-30 Ziqing Zhu , Shuyang Zhu , Siqi Bu

Quantum control is a ubiquitous research field that has enabled physicists to delve into the dynamics and features of quantum systems, delivering powerful applications for various atomic, optical, mechanical, and solid-state systems. In…

Quantum Physics · Physics 2023-12-11 Ariel Norambuena , Marios Mattheakis , Francisco J. González , Raúl Coto