English
Related papers

Related papers: FR-LUX: Friction-Aware, Regime-Conditioned Policy …

200 papers

Research in quantitative finance has demonstrated that reinforcement learning (RL) methods have delivered promising outcomes in the context of hedging financial portfolios. For example, hedging a portfolio of European options using RL…

Computational Engineering, Finance, and Science · Computer Science 2024-07-16 Anil Sharma , Freeman Chen , Jaesun Noh , Julio DeJesus , Mario Schlener

We analyze the efficiency of markets with friction, particularly power markets. We model the market as a dynamic system with $(d_t;\,t\geq 0)$ the demand process and $(s_t;\,t\geq 0)$ the supply process. Using stochastic differential…

Systems and Control · Computer Science 2011-09-19 Arman C. Kizilkale , Shie Mannor

With the increasing power of computers and the rapid development of self-learning methodologies such as machine learning and artificial intelligence, the problem of constructing an automatic Financial Trading Systems (FTFs) becomes an…

Trading and Market Microstructure · Quantitative Finance 2019-08-29 Haoqian Li , Thomas Lau

Finance is a particularly difficult playground for deep reinforcement learning. However, establishing high-quality market environments and benchmarks for financial reinforcement learning is challenging due to three major factors, namely,…

Trading and Market Microstructure · Quantitative Finance 2022-11-08 Xiao-Yang Liu , Ziyi Xia , Jingyang Rui , Jiechao Gao , Hongyang Yang , Ming Zhu , Christina Dan Wang , Zhaoran Wang , Jian Guo

The realm of High-Frequency Trading (HFT) is characterized by rapid decision-making processes that capitalize on fleeting market inefficiencies. As the financial markets become increasingly competitive, there is a pressing need for…

Trading and Market Microstructure · Quantitative Finance 2023-11-21 Soumyadip Sarkar

Reinforcement learning (RL) has emerged as a promising paradigm for Internet congestion control, achieving higher link utilization than classical heuristics. However, RL-based controllers trained in single-flow environments are not…

Networking and Internet Architecture · Computer Science 2026-05-20 Thomas Mbrice , Yuyu Liu

Safety is a critical hurdle that limits the application of deep reinforcement learning (RL) to real-world control tasks. To this end, constrained reinforcement learning leverages cost functions to improve safety in constrained Markov…

Machine Learning · Computer Science 2023-01-26 Tairan He , Weiye Zhao , Changliu Liu

Many applications in Reinforcement Learning (RL) usually have noise or stochasticity present in the environment. Beyond their impact on learning, these uncertainties lead the exact same policy to perform differently, i.e. yield different…

Machine Learning · Computer Science 2024-01-23 Manon Flageat , Bryan Lim , Antoine Cully

Balancing safety, efficiency, and operational costs in highway driving poses a challenging decision-making problem for heavy-duty vehicles. A central difficulty is that conventional scalar reward formulations, obtained by aggregating these…

Machine Learning · Computer Science 2026-01-27 Deepthi Pathare , Leo Laine , Morteza Haghir Chehreghani

A standing assumption in the literature on proportional transaction costs is efficient friction. Together with robust no free lunch with vanishing risk, it rules out strategies of infinite variation, as they usually appear in frictionless…

Mathematical Finance · Quantitative Finance 2023-06-21 Christoph Kühn , Alexander Molitor

Financial markets are of much interest to researchers due to their dynamic and stochastic nature. With their relations to world populations, global economies and asset valuations, understanding, identifying and forecasting trends and…

Statistical Finance · Quantitative Finance 2021-08-13 Peter Akioyamen , Yi Zhou Tang , Hussien Hussien

In a fixed time horizon, appropriately executing a large amount of a particular asset -- meaning a considerable portion of the volume traded within this frame -- is challenging. Especially for illiquid or even highly liquid but also highly…

Mathematical Finance · Quantitative Finance 2023-08-15 David Evangelista , Yuri Thamsten

Reinforcement learning (RL) can refine Vision-Language-Action (VLA) policies beyond behavior cloning, but real-world RL remains expensive due to extensive rollouts, resets, supervision, and safety risks. Action-conditioned video world…

Robotics · Computer Science 2026-05-26 Xiaokang Liu , Zechen Bai , Hai Ci , Kevin Yuchen Ma , Mike Zheng Shou

Existing quadrupedal locomotion learning paradigms usually rely on extensive domain randomization to alleviate the sim2real gap and enhance robustness. It trains policies with a wide range of environment parameters and sensor noises to…

Robotics · Computer Science 2025-09-23 Wei Xiao , Shangke Lyu , Zhefei Gong , Renjie Wang , Donglin Wang

Can large language models (LLMs) generate continuous numerical features that improve reinforcement learning (RL) trading agents? We build a modular pipeline where a frozen LLM serves as a stateless feature extractor, transforming…

Computation and Language · Computer Science 2026-04-14 Zhengzhe Yang

We propose a framework to study optimal trading policies in a one-tick pro-rata limit order book, as typically arises in short-term interest rate futures contracts. The high-frequency trader has the choice to trade via market orders or…

Trading and Market Microstructure · Quantitative Finance 2012-05-15 Fabien Guilbaud , Huyên Pham

Ensuring safety for black-box hybrid dynamical systems presents significant challenges due to their instantaneous state jumps and unknown explicit nonlinear dynamics. Existing solutions for strict safety constraint satisfaction, like…

Robotics · Computer Science 2026-04-27 Aayushi Shrivastava , Kartik Nagpal , Sairam Jinkala , Jean-Baptiste Bouvier , Negar Mehr

Language Models (LMs) struggle with complex, interdependent instructions, particularly in high-stakes domains like finance where precision is critical. We introduce FIFE, a novel, high-difficulty benchmark designed to assess LM…

Machine Learning · Computer Science 2025-12-11 Glenn Matlin , Siddharth , Anirudh JM , Aditya Shukla , Yahya Hassan , Sudheer Chava

Typical deep reinforcement learning (DRL) agents for dynamic portfolio optimization learn the factors influencing portfolio return and risk by analyzing the output values of the reward function while adjusting portfolio weights within the…

Machine Learning · Computer Science 2025-04-17 Ruoyu Sun , Angelos Stefanidis , Zhengyong Jiang , Jionglong Su

Model-free or learning-based control, in particular, reinforcement learning (RL), is expected to be applied for complex robotic tasks. Traditional RL requires a policy to be optimized is state-dependent, that means, the policy is a kind of…

Machine Learning · Computer Science 2022-08-09 Taisuke Kobayashi , Kenta Yoshizawa