English
Related papers

Related papers: ARM: Advantage Reward Modeling for Long-Horizon Ma…

200 papers

This study proposes a regime-aware reinforcement learning framework for long-horizon portfolio optimization. Moving beyond traditional feedforward and GARCH-based models, we design realistic environments where agents dynamically reallocate…

Portfolio Management · Quantitative Finance 2025-09-19 Gabriel Nixon Raj

Aligning human preference and value is an important requirement for building contemporary foundation models and embodied AI. However, popular approaches such as reinforcement learning with human feedback (RLHF) break down the task into…

Artificial Intelligence · Computer Science 2024-12-03 Chenliang Li , Siliang Zeng , Zeyi Liao , Jiaxiang Li , Dongyeop Kang , Alfredo Garcia , Mingyi Hong

Process Reward Models (PRMs) have achieved remarkable success in augmenting the reasoning capabilities of Large Language Models (LLMs) within static domains such as mathematics. However, their potential in dynamic data analysis tasks…

Computation and Language · Computer Science 2026-04-28 Zhisong Qiu , Shuofei Qiao , Kewei Xu , Yuqi Zhu , Lun Du , Ningyu Zhang , Huajun Chen

Reinforcement Learning from Human Feedback (RLHF) has been credited as the key advance that has allowed Large Language Models (LLMs) to effectively follow instructions and produce useful assistance. Classically, this involves generating…

Machine Learning · Computer Science 2024-02-02 Alex J. Chan , Hao Sun , Samuel Holt , Mihaela van der Schaar

This paper proposes a novel approach for Asset-Liability Management (ALM) by employing continuous-time Reinforcement Learning (RL) with a linear-quadratic (LQ) formulation that incorporates both interim and terminal objectives. We develop a…

Machine Learning · Computer Science 2025-09-30 Yilie Huang

We propose a multi-agent distributed reinforcement learning algorithm that balances between potentially conflicting short-term reward and sparse, delayed long-term reward, and learns with partial information in a dynamic environment. We…

Machine Learning · Computer Science 2022-04-06 Jing Tan , Ramin Khalili , Holger Karl

Effective training-time guidance is central to multi-agent reinforcement learning (MARL), yet remains difficult in sparse-reward settings where weak supervision limits coordination and policy improvement, and existing methods often require…

Multiagent Systems · Computer Science 2026-05-29 Xiaoguang Wu , Zhi Zheng , Hui Xiong

Multi-agent reinforcement learning (MARL) faces two critical bottlenecks distinct from single-agent RL: credit assignment in cooperative tasks and partial observability of environmental states. We propose LERO, a framework integrating Large…

Machine Learning · Computer Science 2025-03-31 Yuan Wei , Xiaohan Shan , Jianmin Li

Reward machines (RMs) are a recent formalism for representing the reward function of a reinforcement learning task through a finite-state machine whose edges encode subgoals of the task using high-level events. The structure of RMs enables…

Machine Learning · Computer Science 2023-06-06 Daniel Furelos-Blanco , Mark Law , Anders Jonsson , Krysia Broda , Alessandra Russo

Reinforcement learning (RL) has re-emerged as a natural approach for training interactive LLM agents in real-world environments. However, directly applying the widely used Group Relative Policy Optimization (GRPO) algorithm to multi-turn…

Machine Learning · Computer Science 2026-01-27 Junbo Li , Peng Zhou , Rui Meng , Meet P. Vadera , Lihong Li , Yang Li

The past decade has seen the rapid development of Reinforcement Learning, which acquires impressive performance with numerous training resources. However, one of the greatest challenges in RL is generalization efficiency (i.e.,…

Machine Learning · Computer Science 2021-08-18 Qi Yang , Peng Yang , Ke Tang

Reward modeling is central to alignment pipelines such as RLHF, RLAIF, and PPO-based policy optimization, yet its reliability is constrained by limited and heterogeneous human preference data that are expensive to collect at scale. While…

Machine Learning · Computer Science 2026-05-26 Payel Bhattacharjee , Osvaldo Simeone , Ravi Tandon

Reinforcement learning (RL) with rule-based reward functions has recently shown great promise in enhancing the reasoning depth and generalization ability of vision-language models (VLMs), while maintaining computational efficiency. In spite…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Yizhou Liu , Dingkang Yang , Zizhi Chen , Minghao Han , Xukun Zhang , Keliang Liu , Jingwei Wei , Lihua Zhang

Model-based reinforcement learning (RL) has proven to be a data efficient approach for learning control tasks but is difficult to utilize in domains with complex observations such as images. In this paper, we present a method for learning…

Machine Learning · Computer Science 2019-06-25 Marvin Zhang , Sharad Vikram , Laura Smith , Pieter Abbeel , Matthew J. Johnson , Sergey Levine

Standard reward models typically predict scalar scores that fail to capture the multifaceted nature of response quality in non-verifiable domains, such as creative writing or open-ended instruction following. To address this limitation, we…

Computation and Language · Computer Science 2026-02-13 Ran Xu , Tianci Liu , Zihan Dong , Tony Yu , Ilgee Hong , Carl Yang , Linjun Zhang , Tao Zhao , Haoyu Wang

Reinforcement Learning (RL) algorithms can suffer from poor sample efficiency when rewards are delayed and sparse. We introduce a solution that enables agents to learn temporally extended actions at multiple levels of abstraction in a…

Machine Learning · Computer Science 2019-03-11 Andrew Levy , Robert Platt , Kate Saenko

Transfer of recent advances in deep reinforcement learning to real-world applications is hindered by high data demands and thus low efficiency and scalability. Through independent improvements of components such as replay buffers or more…

Machine Learning · Computer Science 2022-11-28 André Eberhard , Houssam Metni , Georg Fahland , Alexander Stroh , Pascal Friederich

Recent years have witnessed an emerging paradigm shift toward embodied artificial intelligence, in which an agent must learn to solve challenging tasks by interacting with its environment. There are several challenges in solving embodied…

Robotics · Computer Science 2022-10-26 Zhiwei Jia , Kaixiang Lin , Yizhou Zhao , Qiaozi Gao , Govind Thattai , Gaurav Sukhatme

Despite the success of single-agent reinforcement learning, multi-agent reinforcement learning (MARL) remains challenging due to complex interactions between agents. Motivated by decentralized applications such as sensor networks, swarm…

Machine Learning · Computer Science 2019-01-10 Hoi-To Wai , Zhuoran Yang , Zhaoran Wang , Mingyi Hong

In this paper, a new reinforcement learning approach is proposed which is based on a powerful concept named Active Learning Method (ALM) in modeling. ALM expresses any multi-input-single-output system as a fuzzy combination of some…

Artificial Intelligence · Computer Science 2010-11-09 Hesam Sagha , Saeed Bagheri Shouraki , Hosein Khasteh , Ali Akbar Kiaei