English
Related papers

Related papers: Model-based gym environments for limit order book …

200 papers

This work describes a new version of a previously published Python package - gym-saturation: a collection of OpenAI Gym environments for guiding saturation-style provers based on the given clause algorithm with reinforcement learning. We…

Machine Learning · Computer Science 2023-09-19 Boris Shminke

With Reinforcement Learning (RL) for inventory management (IM) being a nascent field of research, approaches tend to be limited to simple, linear environments with implementations that are minor modifications of off-the-shelf RL algorithms.…

Machine Learning · Computer Science 2023-04-19 Madhav Khirwar , Karthik S. Gurumoorthy , Ankit Ajit Jain , Shantala Manchenahally

Algorithmic trading relies on extracting meaningful signals from diverse financial data sources, including candlestick charts, order statistics on put and canceled orders, traded volume data, limit order books, and news flow. While deep…

Machine Learning · Computer Science 2025-04-22 Kasymkhan Khubiev , Mikhail Semenov

This paper presents ModelicaGym toolbox that was developed to employ Reinforcement Learning (RL) for solving optimization and control tasks in Modelica models. The developed tool allows connecting models using Functional Mock-up Interface…

Software Engineering · Computer Science 2019-10-29 Oleh Lukianykhin , Tetiana Bogodorova

Financial exchanges across the world use limit order books (LOBs) to process orders and match trades. For research purposes it is important to have large scale efficient simulators of LOB dynamics. LOB simulators have previously been…

Trading and Market Microstructure · Quantitative Finance 2023-08-28 Sascha Frey , Kang Li , Peer Nagy , Silvia Sapora , Chris Lu , Stefan Zohren , Jakob Foerster , Anisoara Calinescu

Success stories of applied machine learning can be traced back to the datasets and environments that were put forward as challenges for the community. The challenge that the community sets as a benchmark is usually the challenge that the…

Machine Learning · Computer Science 2020-12-16 Ashish Kumar , Toby Buckley , John B. Lanier , Qiaozhi Wang , Alicia Kavelaars , Ilya Kuzovkin

Reinforcement learning (RL) has recently shown impressive performance in complex game AI and robotics tasks. To a large extent, this is thanks to the availability of simulated environments such as OpenAI Gym, Atari Learning Environment, or…

Computation and Language · Computer Science 2020-11-18 Rajkumar Ramamurthy , Rafet Sifa , Christian Bauckhage

While reinforcement learning (RL) has achieved notable success in various domains, training effective policies for complex tasks remains challenging. Agents often converge to local optima and fail to maximize long-term rewards. Existing…

Artificial Intelligence · Computer Science 2025-05-28 Heng Tan , Hua Yan , Yu Yang

Model-free Reinforcement Learning (RL) requires the ability to sample trajectories by taking actions in the original problem environment or a simulated version of it. Breakthroughs in the field of RL have been largely facilitated by the…

Multiagent Systems · Computer Science 2021-11-03 Selim Amrouni , Aymeric Moulin , Jared Vann , Svitlana Vyetrenko , Tucker Balch , Manuela Veloso

Model-based Reinforcement Learning (MBRL) aims to make agents more sample-efficient, adaptive, and explainable by learning an explicit model of the environment. While the capabilities of MBRL agents have significantly improved in recent…

Machine Learning · Computer Science 2024-04-09 Ran Wei , Nathan Lambert , Anthony McDonald , Alfredo Garcia , Roberto Calandra

Recent advances in reinforcement learning (RL) have increased the promise of introducing cognitive assistance and automation to robot-assisted laparoscopic surgery (RALS). However, progress in algorithms and methods depends on the…

The development of Large Language Models (LLMs) has created transformative opportunities for the financial industry, especially in the area of financial trading. However, how to integrate LLMs with trading systems has become a challenge. To…

Computational Engineering, Finance, and Science · Computer Science 2024-12-09 Yu Kang , Ge Wang , Xin Yang , Yuda Wang , Mingwen Liu

Understanding the long-term impact of algorithmic interventions on society is vital to achieving responsible AI. Traditional evaluation strategies often fall short due to the complex, adaptive and dynamic nature of society. While…

Machine Learning · Computer Science 2024-08-26 Emmanuel Klu , Sameer Sethi , DJ Passey , Donald Martin

Reinforcement learning (RL) has gained popularity in the realm of recommender systems due to its ability to optimize long-term rewards and guide users in discovering relevant content. However, the successful implementation of RL in…

Information Retrieval · Computer Science 2024-08-21 Nathan Corecco , Giorgio Piatti , Luca A. Lanzendörfer , Flint Xiaofeng Fan , Roger Wattenhofer

Finance is a particularly difficult playground for deep reinforcement learning. However, establishing high-quality market environments and benchmarks for financial reinforcement learning is challenging due to three major factors, namely,…

Trading and Market Microstructure · Quantitative Finance 2022-11-08 Xiao-Yang Liu , Ziyi Xia , Jingyang Rui , Jiechao Gao , Hongyang Yang , Ming Zhu , Christina Dan Wang , Zhaoran Wang , Jian Guo

Reinforcement learning (RL) agents need to explore their environments in order to learn optimal policies. In many environments and tasks, safety is of critical importance. The widespread use of simulators offers a number of advantages,…

Robotics · Computer Science 2024-03-01 Luka Kovač , Igor Farkaš

Inventory-policy comparisons are often difficult to interpret because performance depends on the evaluation contract as much as on the policy itself. Differences in topology, demand regime, information access, feasibility constraints,…

Machine Learning · Computer Science 2026-05-13 Reza Barati , Qinmin Vivian Hu

Financial domain tasks, such as trading in market exchanges, are challenging and have long attracted researchers. The recent achievements and the consequent notoriety of Reinforcement Learning (RL) have also increased its adoption in…

Pretraining reinforcement learning (RL) models on offline datasets is a promising way to improve their training efficiency in online tasks, but challenging due to the inherent mismatch in dynamics and behaviors across various tasks. We…

Machine Learning · Computer Science 2024-06-06 Minting Pan , Yitao Zheng , Yunbo Wang , Xiaokang Yang

This paper studies the constrained/safe reinforcement learning (RL) problem with sparse indicator signals for constraint violations. We propose a model-based approach to enable RL agents to effectively explore the environment with unknown…

Artificial Intelligence · Computer Science 2021-03-09 Zuxin Liu , Hongyi Zhou , Baiming Chen , Sicheng Zhong , Martial Hebert , Ding Zhao