English
Related papers

Related papers: Reinforcement Learning for Stock Transactions

200 papers

We study the use of inverse reinforcement learning (IRL) as a tool for the recognition of agents' behavior on the basis of observation of their sequential decision behavior interacting with the environment. We model the problem faced by the…

Machine Learning · Computer Science 2013-03-22 Qifeng Qiao , Peter A. Beling

Model-based reinforcement learning (RL) is appealing because (i) it enables planning and thus more strategic exploration, and (ii) by decoupling dynamics from rewards, it enables fast transfer to new reward functions. However, learning an…

Machine Learning · Computer Science 2020-07-14 Evan Zheran Liu , Ramtin Keramati , Sudarshan Seshadri , Kelvin Guu , Panupong Pasupat , Emma Brunskill , Percy Liang

A wide variety of deep reinforcement learning (DRL) models have recently been proposed to learn profitable investment strategies. The rules learned by these models outperform the previous strategies specially in high frequency trading…

Statistical Finance · Quantitative Finance 2021-01-12 Mehran Taghian , Ahmad Asadi , Reza Safabakhsh

An in-depth understanding of the particular environment is crucial in reinforcement learning (RL). To address this challenge, the decision-making process of a mobile collaborative robotic assistant modeled by the Markov decision process…

Machine Learning · Computer Science 2021-06-29 Mónika Farsang , Luca Szegletes

Reinforcement Learning (RL) based methods have seen their paramount successes in solving serial decision-making and control problems in recent years. For conventional RL formulations, Markov Decision Process (MDP) and state-action-value…

Machine Learning · Computer Science 2020-06-09 Ziyao Zhang , Liang Ma , Kin K. Leung , Konstantinos Poularakis , Mudhakar Srivatsa

No real-world reward function is perfect. Sensory errors and software bugs may result in RL agents observing higher (or lower) rewards than they should. For example, a reinforcement learning agent may prefer states where a sensory error…

Artificial Intelligence · Computer Science 2017-08-22 Tom Everitt , Victoria Krakovna , Laurent Orseau , Marcus Hutter , Shane Legg

Prosumer operators are dealing with extensive challenges to participate in short-term electricity markets while taking uncertainties into account. Challenges such as variation in demand, solar energy, wind power, and electricity prices as…

Machine Learning · Computer Science 2022-03-14 Saeed Mohammadi , Mohammad Reza Hesamzadeh

In this chapter, we will give comprehensive examples of applying RL in optimizing the physical layer of wireless communications by defining different class of problems and the possible solutions to handle them. In Section 9.2, we present…

Artificial Intelligence · Computer Science 2021-07-02 Philippe Mary , Visa Koivunen , Christophe Moy

Reinforcement learning (RL) has been widely applied in recommendation systems due to its potential in optimizing the long-term engagement of users. From the perspective of RL, recommendation can be formulated as a Markov decision process…

Information Retrieval · Computer Science 2023-10-26 Chengpeng Li , Zhengyi Yang , Jizhi Zhang , Jiancan Wu , Dingxian Wang , Xiangnan He , Xiang Wang

Offline reinforcement learning (RL) aims to find optimal policies in dynamic environments in order to maximize the expected total rewards by leveraging pre-collected data. Learning from heterogeneous data is one of the fundamental…

Machine Learning · Statistics 2026-03-10 Rui Miao , Babak Shahbaba , Annie Qu

As intelligent trading agents based on reinforcement learning (RL) gain prevalence, it becomes more important to ensure that RL agents obey laws, regulations, and human behavioral expectations. There is substantial literature concerning the…

Machine Learning · Computer Science 2023-06-12 David Byrd

Reactive synthesis algorithms allow automatic construction of policies to control an environment modeled as a Markov Decision Process (MDP) that are optimal with respect to high-level temporal logic specifications. However, they assume that…

Formal Languages and Automata Theory · Computer Science 2022-05-31 Rajeev Alur , Suguman Bansal , Osbert Bastani , Kishor Jothimurugan

Can an asset manager plan the optimal timing for her/his hedging strategies given market conditions? The standard approach based on Markowitz or other more or less sophisticated financial rules aims to find the best portfolio allocation…

Portfolio Management · Quantitative Finance 2020-11-10 Eric Benhamou , David Saltiel , Sandrine Ungari , Abhishek Mukhopadhyay

We consider reinforcement learning (RL) in Markov Decision Processes in which an agent repeatedly interacts with an environment that is modeled by a controlled Markov process. At each time step $t$, it earns a reward, and also incurs a…

Machine Learning · Computer Science 2023-03-16 Rahul Singh , Abhishek Gupta , Ness B. Shroff

Advances in Reinforcement Learning (RL) span a wide variety of applications which motivate development in this area. While application tasks serve as suitable benchmarks for real world problems, RL is seldomly used in practical scenarios…

Trading and Market Microstructure · Quantitative Finance 2021-04-02 Karush Suri , Xiao Qi Shi , Konstantinos Plataniotis , Yuri Lawryshyn

Reinforcement learning (RL) in Markov decision processes (MDPs) with large state spaces is a challenging problem. The performance of standard RL algorithms degrades drastically with the dimensionality of state space. However, in practice,…

Artificial Intelligence · Computer Science 2018-06-21 Kamyar Azizzadenesheli , Alessandro Lazaric , Animashree Anandkumar

In the world of advice and financial planning, there is seldom one right answer. While traditional algorithms have been successful in solving linear problems, its success often depends on choosing the right features from a dataset, which…

Statistical Finance · Quantitative Finance 2021-10-26 Shareefuddin Mohammed , Rusty Bealer , Jason Cohen

Reinforcement Learning (RL) is a learning paradigm concerned with learning to control a system so as to maximize an objective over the long term. This approach to learning has received immense interest in recent times and success manifests…

Artificial Intelligence · Computer Science 2018-07-26 Sanyam Kapoor

We propose a formulation of the stochastic cutting stock problem as a discounted infinite-horizon Markov decision process. At each decision epoch, given current inventory of items, an agent chooses in which patterns to cut objects in stock…

Optimization and Control · Mathematics 2022-06-29 Anselmo R. Pitombeira-Neto , Arthur H. Fonseca Murta

In many practical applications of RL, it is expensive to observe state transitions from the environment. For example, in the problem of plasma control for nuclear fusion, computing the next state for a given state-action pair requires…

Machine Learning · Computer Science 2022-03-16 Viraj Mehta , Biswajit Paria , Jeff Schneider , Stefano Ermon , Willie Neiswanger