English
Related papers

Related papers: A Deep Reinforcement Learning Trader without Offli…

200 papers

Offline reinforcement learning, which aims at optimizing sequential decision-making strategies with historical data, has been extensively applied in real-life applications. State-Of-The-Art algorithms usually leverage powerful function…

Machine Learning · Computer Science 2022-11-28 Ming Yin , Mengdi Wang , Yu-Xiang Wang

We consider the problem of offline reinforcement learning with model-based control, whose goal is to learn a dynamics model from the experience replay and obtain a pessimism-oriented agent under the learned model. Current model-based…

Machine Learning · Computer Science 2021-09-16 Ruizhen Liu , Dazhi Zhong , Zhicong Chen

We investigate the effectiveness of reinforcement learning methods for finetuning large language models when transitioning from offline to semi-online to fully online regimes for both verifiable and non-verifiable tasks. Our experiments…

With the development of artificial intelligence technology, quantitative trading systems represented by reinforcement learning have emerged in the stock trading market. The authors combined the deep Q network in reinforcement learning with…

Statistical Finance · Quantitative Finance 2021-12-01 Yizhuo Li , Peng Zhou , Fangyi Li , Xiao Yang

We present the use of the fitted Q iteration in algorithmic trading. We show that the fitted Q iteration helps alleviate the dimension problem that the basic Q-learning algorithm faces in application to trading. Furthermore, we introduce a…

Trading and Market Microstructure · Quantitative Finance 2018-05-22 Son Le

Deep learning methods achieve state-of-the-art performance in many application scenarios. Yet, these methods require a significant amount of hyperparameters tuning in order to achieve the best results. In particular, tuning the learning…

Machine Learning · Computer Science 2017-11-07 Francesco Orabona , Tatiana Tommasi

The ability of an AI agent to assist other agents, such as humans, is an important and challenging goal, which requires the assisting agent to reason about the behavior and infer the goals of the assisted agent. Training such an ability by…

Artificial Intelligence · Computer Science 2021-10-05 Antti Keurulainen , Isak Westerlund , Samuel Kaski , Alexander Ilin

Quantum machine learning has the potential for a transformative impact across industry sectors and in particular in finance. In our work we look at the problem of hedging where deep reinforcement learning offers a powerful framework for…

The emerging cryptocurrency market has lately received great attention for asset allocation due to its decentralization uniqueness. However, its volatility and brand new trading mode have made it challenging to devising an acceptable…

Machine Learning · Computer Science 2021-10-19 Fengrui Liu , Yang Li , Baitong Li , Jiaxin Li , Huiyang Xie

This paper sets forth a framework for deep reinforcement learning as applied to market making (DRLMM) for cryptocurrencies. Two advanced policy gradient-based algorithms were selected as agents to interact with an environment that…

Trading and Market Microstructure · Quantitative Finance 2019-11-21 Jonathan Sadighian

Reinforcement learning (RL) algorithms have made huge progress in recent years by leveraging the power of deep neural networks (DNN). Despite the success, deep RL algorithms are known to be sample inefficient, often requiring many rounds of…

Machine Learning · Computer Science 2018-05-22 Zichuan Lin , Tianqi Zhao , Guangwen Yang , Lintao Zhang

We consider the problem of optimal bidding for virtual trading in two-settlement electricity markets. A virtual trader aims to arbitrage on the differences between day-ahead and real-time market prices; both prices, however, are random and…

Computer Science and Game Theory · Computer Science 2018-08-02 Sevi Baltaoglu , Lang Tong , Qing Zhao

This paper presents a controlled study of adversarial reinforcement learning in network security through a custom OpenAI Gym environment that models brute-force attacks and reactive defenses on multi-port services. The environment captures…

Machine Learning · Computer Science 2025-10-08 Abrar Shahid , Ibteeker Mahir Ishum , AKM Tahmidul Haque , M Sohel Rahman , A. B. M. Alim Al Islam

We introduce a novel and highly tractable supervised learning approach based on neural networks that can be applied for the computation of model-free price bounds of, potentially high-dimensional, financial derivatives and for the…

Computational Finance · Quantitative Finance 2022-12-15 Ariel Neufeld , Julian Sester

In this paper, we propose a principled deep reinforcement learning (RL) approach that is able to accelerate the convergence rate of general deep neural networks (DNNs). With our approach, a deep RL agent (synonym for optimizer in this work)…

Machine Learning · Computer Science 2017-07-14 Jie Fu

Studying how to fine-tune offline reinforcement learning (RL) pre-trained policy is profoundly significant for enhancing the sample efficiency of RL algorithms. However, directly fine-tuning pre-trained policies often results in sub-optimal…

Machine Learning · Computer Science 2024-05-29 Ziqi Zhang , Xiao Xiong , Zifeng Zhuang , Jinxin Liu , Donglin Wang

This paper presents a Pre-Training Deep Reinforcement Learning(DRL) for avoidance navigation without map for mobile robots which map raw sensor data to control variable and navigate in an unknown environment. The efficient offline training…

Robotics · Computer Science 2023-08-04 Yang Wenkai Ji Ruihang Zhang Yuxiang Lei Hao , Zhao Zijie

Deep Q-Learning is an important reinforcement learning algorithm, which involves training a deep neural network, called Deep Q-Network (DQN), to approximate the well-known Q-function. Although wildly successful under laboratory conditions,…

Machine Learning · Computer Science 2021-04-13 Arunselvan Ramaswamy , Eyke Hüllermeier

The recent success of supervised learning methods on ever larger offline datasets has spurred interest in the reinforcement learning (RL) field to investigate whether the same paradigms can be translated to RL algorithms. This research…

Machine Learning · Computer Science 2021-02-12 Mengjiao Yang , Ofir Nachum

We apply Reinforcement Learning algorithms to solve the classic quantitative finance Market Making problem, in which an agent provides liquidity to the market by placing buy and sell orders while maximizing a utility function. The optimal…

Machine Learning · Computer Science 2021-04-12 Matias Selser , Javier Kreiner , Manuel Maurette