English
Related papers

Related papers: Reinforcement Learning for Intensity Control: An A…

200 papers

Optimized control of quantum networks is essential for enabling distributed quantum applications with strict performance requirements. In near-term architectures with constrained hardware, effective control may determine the feasibility of…

We study data-driven learning of robust stochastic control for infinite-horizon systems with potentially continuous state and action spaces. In many managerial settings--supply chains, finance, manufacturing, services, and dynamic…

Machine Learning · Statistics 2025-11-18 Shengbo Wang , Jason Meng , Nian Si , Jose Blanchet , Zhengyuan Zhou

Model-based reinforcement learning techniques accelerate the learning task by employing a transition model to make predictions. In this paper, a model-based learning approach is presented that iteratively computes the optimal value function…

Optimization and Control · Mathematics 2020-10-22 Milad Farsi , Jun Liu

This work presents a technique for learning systems, where the learning process is guided by knowledge of the physics of the system. In particular, we solve the problem of the two-point boundary optimal control problem of linear…

Systems and Control · Electrical Eng. & Systems 2021-05-03 Vasanth Reddy , Hoda Eldardiry , Almuatazbellah Boker

Optimal execution is an important problem faced by any trader. Most solutions are based on the assumption of constant market impact, while liquidity is known to be dynamic. Moreover, models with time-varying liquidity typically assume that…

Trading and Market Microstructure · Quantitative Finance 2024-02-21 Andrea Macrì , Fabrizio Lillo

This paper considers a class of reinforcement learning problems, which involve systems with two types of states: stochastic and pseudo-stochastic. In such systems, stochastic states follow a stochastic transition kernel while the…

Machine Learning · Computer Science 2023-11-09 Honghao Wei , Xin Liu , Weina Wang , Lei Ying

This paper considers a demand response agent that must find a near-optimal sequence of decisions based on sparse observations of its environment. Extracting a relevant set of features from these observations is a challenging task and may…

Machine Learning · Computer Science 2020-01-28 Frederik Ruelens , Bert J. Claessens , Peter Vrancx , Fred Spiessens , Geert Deconinck

Despite technological advancements, the significance of interdisciplinary subjects like complex networks has grown. Exploring communication within these networks is crucial, with traffic becoming a key concern due to the expanding…

Networking and Internet Architecture · Computer Science 2024-01-02 Seyed Hassan Yajadda , Farshad Safaei

Vehicular crowdsensing is anticipated to become a key catalyst for data-driven optimization in the Intelligent Transportation System (ITS) domain. Yet, the expected growth in massive Machine-type Communication (mMTC) caused by…

Networking and Internet Architecture · Computer Science 2020-01-16 Benjamin Sliwa , Christian Wietfeld

Reinforcement learning often uses neural networks to solve complex control tasks. However, neural networks are sensitive to input perturbations, which makes their deployment in safety-critical environments challenging. This work lifts…

Machine Learning · Computer Science 2024-08-20 Manuel Wendl , Lukas Koller , Tobias Ladner , Matthias Althoff

Stochastic control problems with delay are challenging due to the path-dependent feature of the system and thus its intrinsic high dimensions. In this paper, we propose and systematically study deep neural networks-based algorithms to solve…

Optimization and Control · Mathematics 2021-06-18 Jiequn Han , Ruimeng Hu

Due to the highly variable execution context in which edge services run, adapting their behavior to the execution context is crucial to comply with their requirements. However, adapting service behavior is a challenging task because it is…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-04-30 M. Fadel Argerich , B. Cheng , J. Fürst

In this paper, we explore a multi-agent reinforcement learning approach to address the design problem of communication and control strategies for multi-agent cooperative transport. Typical end-to-end deep neural network policies may be…

Machine Learning · Computer Science 2021-03-30 Kazuki Shibata , Tomohiko Jimbo , Takamitsu Matsubara

In this paper, we study the use of robust model independent bounded extremum seeking (ES) feedback control to improve the robustness of deep reinforcement learning (DRL) controllers for a class of nonlinear time-varying systems. DRL has the…

Machine Learning · Computer Science 2026-03-11 Shaifalee Saxena , Alan Williams , Rafael Fierro , Alexander Scheinker

We present an efficient algorithm for model-free episodic reinforcement learning on large (potentially continuous) state-action spaces. Our algorithm is based on a novel $Q$-learning policy with adaptive data-driven discretization. The…

Machine Learning · Computer Science 2019-12-20 Sean R. Sinclair , Siddhartha Banerjee , Christina Lee Yu

In this paper, we present an online reinforcement learning algorithm for constrained Markov decision processes with a safety constraint. Despite the necessary attention of the scientific community, considering stochastic stopping time, the…

Machine Learning · Computer Science 2024-03-26 Abhijit Mazumdar , Rafal Wisniewski , Manuela L. Bujorianu

Partially observed control problems are a challenging aspect of reinforcement learning. We extend two related, model-free algorithms for continuous control -- deterministic policy gradient and stochastic value gradient -- to solve partially…

Machine Learning · Computer Science 2015-12-15 Nicolas Heess , Jonathan J Hunt , Timothy P Lillicrap , David Silver

This paper proposes a model predictive controller for discrete-time linear systems with additive, possibly unbounded, stochastic disturbances and subject to chance constraints. By computing a polytopic probabilistic positively invariant set…

Optimization and Control · Mathematics 2024-09-23 Kai Wang , Kiet Tuan Hoang , Sébastien Gros

This paper develops algorithms for high-dimensional stochastic control problems based on deep learning and dynamic programming. Unlike classical approximate dynamic programming approaches, we first approximate the optimal policy by means of…

Probability · Mathematics 2021-09-21 Côme Huré , Huyên Pham , Achref Bachouch , Nicolas Langrené

Constrained reinforcement learning is to maximize the expected reward subject to constraints on utilities/costs. However, the training environment may not be the same as the test one, due to, e.g., modeling error, adversarial attack,…

Machine Learning · Computer Science 2022-09-16 Yue Wang , Fei Miao , Shaofeng Zou