English
Related papers

Related papers: Dual Alignment Maximin Optimization for Offline Mo…

200 papers

Large language models (LLMs) increasingly rely on multi-turn tool-integrated planning for knowledge-intensive and complex reasoning tasks. Existing implementations typically rely on a single agent, but they suffer from limited context…

Computation and Language · Computer Science 2025-10-07 Zhanfeng Mo , Xingxuan Li , Yuntao Chen , Lidong Bing

Policy optimization methods with function approximation are widely used in multi-agent reinforcement learning. However, it remains elusive how to design such algorithms with statistical guarantees. Leveraging a multi-agent performance…

Machine Learning · Computer Science 2023-05-09 Yulai Zhao , Zhuoran Yang , Zhaoran Wang , Jason D. Lee

Existing batch size selection approaches in distributed machine learning rely on static allocation or simplistic heuristics that fail to adapt to heterogeneous, dynamic computing environments. We present DYNAMIX, a reinforcement learning…

Machine Learning · Computer Science 2025-10-10 Yuanjun Dai , Keqiang He , An Wang

Model-based offline reinforcement learning (RL), which builds a supervised transition model with logging dataset to avoid costly interactions with the online environment, has been a promising approach for offline policy optimization. As the…

Machine Learning · Computer Science 2023-09-06 Junming Yang , Xingguo Chen , Shengyuan Wang , Bolei Zhang

Large Language Models (LLMs) are increasingly aligned with human preferences through Reinforcement Learning from Human Feedback (RLHF). Among RLHF methods, Group Relative Policy Optimization (GRPO) has gained attention for its simplicity…

Computation and Language · Computer Science 2025-09-25 Yuhang Zhou , Jing Zhu , Shengyi Qian , Zhuokai Zhao , Xiyao Wang , Xiaoyu Liu , Ming Li , Paiheng Xu , Wei Ai , Furong Huang

Offline policy learning is aimed at learning decision-making policies using existing datasets of trajectories without collecting additional data. The primary motivation for using reinforcement learning (RL) instead of supervised learning…

Demonstrations are an effective alternative to task specification for learning agents in settings where designing a reward function is difficult. However, demonstrating expert behavior in the action space of the agent becomes unwieldy when…

Machine Learning · Computer Science 2024-09-23 Harshit Sikchi , Caleb Chuck , Amy Zhang , Scott Niekum

Large language models (LLMs) have recently advanced in reasoning when optimized with reinforcement learning (RL) under verifiable rewards. Existing methods primarily rely on outcome-based supervision to strengthen internal LLM reasoning,…

Artificial Intelligence · Computer Science 2026-05-29 Siyao Song , Cong Ma , Zhihao Cheng , Shiye Lei , Minghao Li , Ying Zeng , Huaixiao Tou , Kai Jia

Large Language Models (LLMs) suffer from order bias, where their performance is affected by the arrangement order of input elements. This unfairness limits the model's applications in scenarios such as in-context learning and…

Machine Learning · Computer Science 2026-05-13 Xu Chu , Guanyu Wang , Zhijie Tan , Xinrong Chen , Ziyu Li , Tong Mo , Weiping Li

This paper presents a novel methodological framework, called the Actor-Simulator, that incorporates the calibration of digital twins into model-based reinforcement learning for more effective control of stochastic systems with complex…

Machine Learning · Computer Science 2025-01-07 Hua Zheng , Wei Xie , Ilya O. Ryzhov , Keilung Choy

Deep Reinforcement Learning (DRL) is a powerful tool used for addressing complex challenges in mobile networks. This paper investigates the application of two DRL models, on-policy and off-policy, in the field of resource allocation for…

Networking and Internet Architecture · Computer Science 2024-12-04 Manal Mehdaoui , Amine Abouaomar

Reinforcement Learning has emerged as a promising framework for developing adaptive and data-driven strategies, enabling market makers to optimize decision-making policies based on interactions with the limit order book environment. This…

Trading and Market Microstructure · Quantitative Finance 2026-02-17 Rafael Zimmer , Oswaldo Luiz do Valle Costa

Finding different solutions to the same problem is a key aspect of intelligence associated with creativity and adaptation to novel situations. In reinforcement learning, a set of diverse policies can be useful for exploration, transfer,…

Artificial Intelligence · Computer Science 2023-02-06 Tom Zahavy , Yannick Schroecker , Feryal Behbahani , Kate Baumli , Sebastian Flennerhag , Shaobo Hou , Satinder Singh

Aligning large language models (LLMs) on domain-specific data remains a fundamental challenge. Supervised fine-tuning (SFT) offers a straightforward way to inject domain knowledge but often degrades the model's generality. In contrast,…

Machine Learning · Computer Science 2026-02-12 Linxuan Xia , Xiaolong Yang , Yongyuan Chen , Enyue Zhao , Deng Cai , Yasheng Wang , Boxi Wu

Off-policy reinforcement learning (RL) has achieved notable success in tackling many complex real-world tasks, by leveraging previously collected data for policy learning. However, most existing off-policy RL algorithms fail to maximally…

Machine Learning · Computer Science 2024-05-30 Yu Luo , Tianying Ji , Fuchun Sun , Jianwei Zhang , Huazhe Xu , Xianyuan Zhan

In offline reinforcement learning, deriving an effective policy from a pre-collected set of experiences is challenging due to the distribution mismatch between the target policy and the behavioral policy used to collect the data, as well as…

Machine Learning · Computer Science 2024-12-10 Catalin E. Brita , Stephan Bongers , Frans A. Oliehoek

Diffusion policies have achieved superior performance in imitation learning and offline reinforcement learning (RL) due to their rich expressiveness. However, the conventional diffusion training procedure requires samples from target…

Machine Learning · Computer Science 2025-07-01 Haitong Ma , Tianyi Chen , Kai Wang , Na Li , Bo Dai

Offline reinforcement learning (RL), also known as batch RL, aims to optimize policy from a large pre-recorded dataset without interaction with the environment. This setting offers the promise of utilizing diverse, pre-collected datasets to…

Machine Learning · Computer Science 2021-01-05 Qiang He , Xinwen Hou

Learning a risk-aware policy is essential but rather challenging in unstructured robotic tasks. Safe reinforcement learning methods open up new possibilities to tackle this problem. However, the conservative policy updates make it…

Machine Learning · Computer Science 2022-12-15 Linrui Zhang , Zichen Yan , Li Shen , Shoujie Li , Xueqian Wang , Dacheng Tao

The application of Reinforcement Learning (RL) in real world environments can be expensive or risky due to sub-optimal policies during training. In Offline RL, this problem is avoided since interactions with an environment are prohibited.…