English
Related papers

Related papers: Revised Progressive-Hedging-Algorithm Based Two-la…

200 papers

In this paper, we consider the linear programming (LP) formulation for deep reinforcement learning. The number of the constraints depends on the size of state and action spaces, which makes the problem intractable in large or continuous…

Optimization and Control · Mathematics 2021-05-21 Yongfeng Li , Mingming Zhao , Weijie Chen , Zaiwen Wen

Dynamic hedging is a financial strategy that consists in periodically transacting one or multiple financial assets to offset the risk associated with a correlated liability. Deep Reinforcement Learning (DRL) algorithms have been used to…

Computational Finance · Quantitative Finance 2025-04-18 Andrei Neagu , Frédéric Godin , Leila Kosseim

This paper considers a stochastic linear quadratic problem for discrete-time systems with multiplicative noises over an infinite horizon. To obtain the optimal solution, we propose an online iterative algorithm of reinforcement learning…

Optimization and Control · Mathematics 2023-11-22 Hongdan Li , Lucky Qiaofeng Li , Xun Li , Zhaorong Zhang

We present an algorithm for model-based reinforcement learning that combines Bayesian neural networks (BNNs) with random roll-outs and stochastic optimization for policy learning. The BNNs are trained by minimizing $\alpha$-divergences,…

Machine Learning · Statistics 2017-03-09 Stefan Depeweg , José Miguel Hernández-Lobato , Finale Doshi-Velez , Steffen Udluft

We present a reinforcement-learning (RL) framework for dynamic hedging of equity index option exposures under realistic transaction costs and position limits. We hedge a normalized option-implied equity exposure (one unit of underlying…

Portfolio Management · Quantitative Finance 2025-12-16 Travon Lucius , Christian Koch , Jacob Starling , Julia Zhu , Miguel Urena , Carrie Hu

We present a method for finding optimal hedging policies for arbitrary initial portfolios and market states. We develop a novel actor-critic algorithm for solving general risk-averse stochastic control problems and use it to learn hedging…

Computational Finance · Quantitative Finance 2022-07-18 Phillip Murray , Ben Wood , Hans Buehler , Magnus Wiese , Mikko S. Pakkanen

This paper proposes a receding horizon active learning and control problem for dynamical systems in which Gaussian Processes (GPs) are utilized to model the system dynamics. The active learning objective in the optimization problem is…

Systems and Control · Electrical Eng. & Systems 2021-05-13 Viet-Anh Le , Truong X. Nghiem

This paper presents a new approach and algorithm for solving a class of constrained Bi-Level Optimization (BLO) problems in which the lower-level problem involves constraints coupling both upper-level and lower-level variables. Such…

Machine Learning · Computer Science 2024-01-30 Wei Yao , Chengming Yu , Shangzhi Zeng , Jin Zhang

A common problem in Machine Learning and statistics consists in detecting whether the current sample in a stream of data belongs to the same distribution as previous ones, is an isolated outlier or inaugurates a new distribution of data. We…

Machine Learning · Statistics 2018-05-16 Vincent Moens

We study a new two-time-scale stochastic gradient method for solving optimization problems, where the gradients are computed with the aid of an auxiliary variable under samples generated by time-varying MDPs controlled by the underlying…

Optimization and Control · Mathematics 2024-08-27 Sihan Zeng , Thinh T. Doan , Justin Romberg

This paper introduces a reinforcement learning (RL) approach to address the challenges associated with configuring and optimizing genetic algorithms (GAs) for solving difficult combinatorial or non-linear problems. The proposed RL+GA method…

This paper investigates the so-called reward-balancing methods, a novel class of algorithms for solving discounted-return reinforcement learning (RL) problems. These methods consist of iteratively adjusting the reward function to transform…

Optimization and Control · Mathematics 2026-04-23 Simone Baroncini , Bahman Gharesifard , Giuseppe Notarstefano

Reinforcement Learning (RL) has demonstrated state-of-the-art results in a number of autonomous system applications, however many of the underlying algorithms rely on black-box predictions. This results in poor explainability of the…

Machine Learning · Computer Science 2019-11-27 Matt Benatan , Edward O. Pyzer-Knapp

The nuclear fuel loading pattern optimization problem belongs to the class of large-scale combinatorial optimization. It is also characterized by multiple objectives and constraints, which makes it impossible to solve explicitly. Stochastic…

Machine Learning · Computer Science 2023-07-18 Paul Seurin , Koroush Shirvan

This paper studies the adaptive optimal stationary control of continuous-time linear stochastic systems with both additive and multiplicative noises, using reinforcement learning techniques. Based on policy iteration, a novel off-policy…

Systems and Control · Electrical Eng. & Systems 2021-12-07 Bo Pang , Zhong-Ping Jiang

The endeavor of artificial intelligence (AI) is to design autonomous agents capable of achieving complex tasks. Namely, reinforcement learning (RL) proposes a theoretical background to learn optimal behaviors. In practice, RL algorithms…

Machine Learning · Computer Science 2022-09-27 Firas Jarboui , Ahmed Akakzia

Reinforcement learning (RL) is a powerful framework for optimal decision-making and control but often lacks provable guarantees for safety-critical applications. In this paper, we introduce a novel recovery-based shielding framework that…

Machine Learning · Computer Science 2026-02-18 Alexander W. Goodall , Francesco Belardinelli

Hierarchical learning algorithms that gradually approximate a solution to a data-driven optimization problem are essential to decision-making systems, especially under limitations on time and computational resources. In this study, we…

Machine Learning · Computer Science 2023-03-22 Christos Mavridis , John Baras

We consider reinforcement learning (RL) methods for finding optimal policies in linear quadratic (LQ) mean field control (MFC) problems over an infinite horizon in continuous time, with common noise and entropy regularization. We study…

Optimization and Control · Mathematics 2024-08-06 Noufel Frikha , Huyên Pham , Xuanye Song

We consider a task of surveillance-evading path-planning in a continuous setting. An Evader strives to escape from a 2D domain while minimizing the risk of detection (and immediate capture). The probability of detection is path-dependent…

Machine Learning · Computer Science 2023-02-24 Dongping Qi , David Bindel , Alexander Vladimirsky