English
Related papers

Related papers: Synergistic Formulaic Alpha Generation for Quantit…

200 papers

The majority of language model training builds on imitation learning. It covers pretraining, supervised fine-tuning, and affects the starting conditions for reinforcement learning from human feedback (RLHF). The simplicity and scalability…

Deep Reinforcement learning is a branch of unsupervised learning in which an agent learns to act based on environment state in order to maximize its total reward. Deep reinforcement learning provides good opportunity to model the complexity…

Statistical Finance · Quantitative Finance 2021-08-05 Zhaolu Dong , Shan Huang , Simiao Ma , Yining Qian

This paper studies tabular reinforcement learning (RL) in the hybrid setting, which assumes access to both an offline dataset and online interactions with the unknown environment. A central question boils down to how to efficiently utilize…

Machine Learning · Computer Science 2023-05-18 Gen Li , Wenhao Zhan , Jason D. Lee , Yuejie Chi , Yuxin Chen

Many reinforcement learning (RL) applications have combinatorial action spaces, where each action is a composition of sub-actions. A standard RL approach ignores this inherent factorization structure, resulting in a potential failure to…

Machine Learning · Computer Science 2023-05-04 Shengpu Tang , Maggie Makar , Michael W. Sjoding , Finale Doshi-Velez , Jenna Wiens

In quantitative investing, return prediction supports various tasks, including stock selection, portfolio optimization, and risk management. Quantitative factors, such as valuation, quality, and growth, capture various characteristics of…

Computational Finance · Quantitative Finance 2025-11-26 Tian Guo , Emmanuel Hauptmann

Following a recent surge in using history-based methods for resolving perceptual aliasing in reinforcement learning, we introduce an algorithm based on the feature reinforcement learning framework called PhiMDP. To create a practical…

Artificial Intelligence · Computer Science 2011-08-19 Phuong Nguyen , Peter Sunehag , Marcus Hutter

Effective feature selection, representation and transformation are principal steps in machine learning to improve prediction accuracy, model generalization and computational efficiency. Reinforcement learning provides a new perspective…

Machine Learning · Computer Science 2025-03-18 Sumana Sanyasipura Nagaraju

Recommender systems need to optimize various types of user feedback, e.g., clicks, likes, and shares. A typical recommender system handling multiple types of feedback has two components: a multi-task learning (MTL) module, predicting…

Information Retrieval · Computer Science 2025-04-09 Yang Cao , Changhao Zhang , Xiaoshuang Chen , Kaiqiao Zhan , Ben Wang

Reinforcement learning (RL) is a promising approach for solving robotic manipulation tasks. However, it is challenging to apply the RL algorithms directly in the real world. For one thing, RL is data-intensive and typically requires…

In this paper, we present a novel trading strategy that integrates reinforcement learning methods with clustering techniques for portfolio management in multi-period trading. Specifically, we leverage the clustering method to categorize…

Portfolio Management · Quantitative Finance 2023-10-03 Zhengyong Jiang , Jeyan Thiayagalingam , Jionglong Su , Jinjun Liang

This article explores the use of machine learning models to build a market generator. The underlying idea is to simulate artificial multi-dimensional financial time series, whose statistical properties are the same as those observed in the…

Machine Learning · Computer Science 2020-07-10 Edmond Lezmi , Jules Roche , Thierry Roncalli , Jiali Xu

This paper proposes a novel reinforcement learning (RL) framework for credit underwriting that tackles ungeneralizable contextual challenges. We adapt RL principles for credit scoring, incorporating action space renewal and multi-choice…

It is known that reinforcement learning (RL) is data-hungry. To improve sample-efficiency of RL, it has been proposed that the learning algorithm utilize data from 'approximately similar' processes. However, since the process models are…

Machine Learning · Computer Science 2025-11-24 Vinay Kanakeri , Shivam Bajaj , Ashwin Verma , Vijay Gupta , Aritra Mitra

Classical portfolio optimization often requires forecasting asset returns and their corresponding variances in spite of the low signal-to-noise ratio provided in the financial markets. Modern deep reinforcement learning (DRL) offers a…

Portfolio Management · Quantitative Finance 2023-05-19 Alessio Brini , Daniele Tantari

Reinforcement Learning (RL) is a promising approach for solving various control, optimization, and sequential decision making tasks. However, designing reward functions for complex tasks (e.g., with multiple objectives and safety…

Artificial Intelligence · Computer Science 2021-07-23 Xuan Zhao , Marcos Campos

Feedback Alignment (FA) methods are biologically inspired local learning rules for training neural networks with reduced communication between layers. While FA has potential applications in distributed and privacy-aware ML, limitations in…

Machine Learning · Computer Science 2024-06-05 Zachary Robertson , Oluwasanmi Koyejo

Despite the promise of RLHF in aligning LLMs with human preferences, it often leads to superficial alignment, prioritizing stylistic changes over improving downstream performance of LLMs. Underspecified preferences could obscure directions…

Computation and Language · Computer Science 2024-03-22 Kyungjae Lee , Dasol Hwang , Sunghyun Park , Youngsoo Jang , Moontae Lee

Cryptocurrency is a cryptography-based digital asset with extremely volatile prices. Around USD 70 billion worth of cryptocurrency is traded daily on exchanges. Trading cryptocurrency is difficult due to the inherent volatility of the…

Computational Finance · Quantitative Finance 2024-12-12 Hongshen Yang , Avinash Malik

Column generation (CG) is one of the most successful approaches for solving large-scale linear programming (LP) problems. Given an LP with a prohibitively large number of variables (i.e., columns), the idea of CG is to explicitly consider…

Optimization and Control · Mathematics 2024-04-09 Haofeng Yuan , Lichang Fang , Shiji Song

As a paradigm for sequential decision making in unknown environments, reinforcement learning (RL) has received a flurry of attention in recent years. However, the explosion of model complexity in emerging applications and the presence of…

Machine Learning · Statistics 2025-07-22 Yuejie Chi , Yuxin Chen , Yuting Wei