English
Related papers

Related papers: Exploratory Mean-Variance Portfolio Optimization w…

200 papers

In this paper, a unified framework for exploration in reinforcement learning (RL) is proposed based on an option-critic model. The proposed framework learns to integrate a set of diverse exploration strategies so that the agent can…

Machine Learning · Computer Science 2024-09-10 Woojun Kim , Jeonghye Kim , Youngchul Sung

We present an online approach to portfolio selection. The motivation is within the context of algorithmic trading, which demands fast and recursive updates of portfolio allocations, as new data arrives. In particular, we look at two online…

Portfolio Management · Quantitative Finance 2010-05-20 Theodoros Tsagaris , Ajay Jasra , Niall Adams

In this work we deal with the funding costs rising from hedging the risky securities underlying a target volatility strategy (TVS), a portfolio of risky assets and a risk-free one dynamically rebalanced in order to keep the realized…

Pricing of Securities · Quantitative Finance 2021-12-06 Roberto Daluiso , Emanuele Nastasi , Andrea Pallavicini , Stefano Polo

Patch foraging involves the deliberate and planned process of determining the optimal time to depart from a resource-rich region and investigate potentially more beneficial alternatives. The Marginal Value Theorem (MVT) is frequently used…

Artificial Intelligence · Computer Science 2025-12-30 Yesid Fonseca , Manuel S. Ríos , Nicanor Quijano , Luis F. Giraldo

Offline reinforcement learning (RL) shows promise of applying RL to real-world problems by effectively utilizing previously collected data. Most existing offline RL algorithms use regularization or constraints to suppress extrapolation…

Machine Learning · Computer Science 2021-10-20 Xiaoteng Ma , Yiqin Yang , Hao Hu , Qihan Liu , Jun Yang , Chongjie Zhang , Qianchuan Zhao , Bin Liang

With the rapid development of artificial intelligence, data-driven methods effectively overcome limitations in traditional portfolio optimization. Conventional models primarily employ long-only mechanisms, excluding highly correlated assets…

Computational Finance · Quantitative Finance 2025-03-18 Gang Huang , Xiaohua Zhou , Qingyang Song

We study model-free reinforcement learning (RL) algorithms in episodic non-stationary constrained Markov Decision Processes (CMDPs), in which an agent aims to maximize the expected cumulative reward subject to a cumulative constraint on the…

Machine Learning · Computer Science 2023-03-13 Honghao Wei , Arnob Ghosh , Ness Shroff , Lei Ying , Xingyu Zhou

Portfolio optimization requires dynamic allocation of funds by balancing the risk and return tradeoff under dynamic market conditions. With the recent advancements in AI, Deep Reinforcement Learning (DRL) has gained prominence in providing…

Portfolio Management · Quantitative Finance 2025-05-08 Arishi Orra , Aryan Bhambu , Himanshu Choudhary , Manoj Thakur , Selvaraju Natarajan

Multi-task learning (MTL) has achieved great success in various research domains, such as CV, NLP and IR etc. Due to the complex and competing task correlation, naive training all tasks may lead to inequitable learning, i.e. some tasks are…

Machine Learning · Computer Science 2023-06-21 Jun Yuan , Rui Zhang

Traditional reinforcement learning (RL) aims to maximize the expected total reward, while the risk of uncertain outcomes needs to be controlled to ensure reliable performance in a risk-averse setting. In this paper, we consider the problem…

Machine Learning · Computer Science 2023-01-18 Xian Yu , Siqian Shen

Standard model-based reinforcement learning (MBRL) approaches fit a transition model of the environment to all past experience, but this wastes model capacity on data that is irrelevant for policy improvement. We instead propose a new…

Machine Learning · Computer Science 2023-05-23 Yecheng Jason Ma , Kausik Sivakumar , Jason Yan , Osbert Bastani , Dinesh Jayaraman

Dynamic Portfolio optimization is the process of distribution and rebalancing of a fund into different financial assets such as stocks, cryptocurrencies, etc, in consecutive trading periods to maximize accumulated profits or minimize risks…

Portfolio Management · Quantitative Finance 2021-02-15 Kumar Yashaswi

Risk-sensitive reinforcement learning (RL) has garnered significant attention in recent years due to the growing interest in deploying RL agents in real-world scenarios. A critical aspect of risk awareness involves modeling highly rare risk…

Machine Learning · Computer Science 2023-08-30 Karthik Somayaji NS , Yu Wang , Malachi Schram , Jan Drgona , Mahantesh Halappanavar , Frank Liu , Peng Li

Optimizing risk-averse objectives in discounted MDPs is challenging because most models do not admit direct dynamic programming equations and require complex history-dependent policies. In this paper, we show that the risk-averse {\em total…

Machine Learning · Computer Science 2025-07-15 Xihong Su , Julien Grand-Clément , Marek Petrik

Ensuring safety is a critical challenge in applying Reinforcement Learning (RL) to real-world scenarios. Constrained Reinforcement Learning (CRL) addresses this by maximizing returns under predefined constraints, typically formulated as the…

Machine Learning · Computer Science 2026-01-21 Shiqing Gao , Yihang Zhou , Shuai Shao , Haoyu Luo , Yiheng Bing , Jiaxin Ding , Luoyi Fu , Xinbing Wang

Offline reinforcement learning (RL) looks at learning how to optimally solve tasks using a fixed dataset of interactions from the environment. Many off-policy algorithms developed for online learning struggle in the offline setting as they…

Machine Learning · Computer Science 2025-03-18 Natinael Solomon Neggatu , Jeremie Houssineau , Giovanni Montana

Execution algorithms are vital to modern trading, they enable market participants to execute large orders while minimising market impact and transaction costs. As these algorithms grow more sophisticated, optimising them becomes…

Computational Finance · Quantitative Finance 2025-10-28 Ollie Olby , Andreea Bacalum , Rory Baggott , Namid Stillman

Multi-Objective Reinforcement Learning (MORL) is a generalization of traditional Reinforcement Learning (RL) that aims to optimize multiple, often conflicting objectives simultaneously rather than focusing on a single reward. This approach…

Machine Learning · Computer Science 2025-08-15 Davide Guidobene , Lorenzo Benedetti , Diego Arapovic

This paper presents a safe learning-based eco-driving framework tailored for mixed traffic flows, which aims to optimize energy efficiency while guaranteeing safety during real-system operations. Even though reinforcement learning (RL) is…

Systems and Control · Electrical Eng. & Systems 2024-02-01 Ke Lu , Dongjun Li , Qun Wang , Kaidi Yang , Lin Zhao , Ziyou Song

The monotone mean-variance (MMV) preference proposed by Maccheroni, et al. (Math. Finance 19(3): 487-521, 2009) fails to differentiate strictly dominant payoffs, which may cause inconsistency in portfolio decision-making. This paper…

Mathematical Finance · Quantitative Finance 2026-04-03 Yike Wang , Yusha Chen , Jingzhen Liu , Zhenyu Cui