English
Related papers

Related papers: DFPO: Scaling Value Modeling via Distributional Fl…

200 papers

Diffusion models have emerged as powerful tools for 3D medical image generation, yet bridging the gap between standard training objectives and clinical relevance remains a challenge. This paper presents a method to enhance 3D diffusion…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Yueying Tian , Xudong Han , Meng Zhou , Rodrigo Aviles-Espinosa , Rupert Young , Philip Birch

Diffusion-based models have achieved notable empirical successes in reinforcement learning (RL) due to their expressiveness in modeling complex distributions. Despite existing methods being promising, the key challenge of extending existing…

Machine Learning · Computer Science 2024-11-04 Dmitry Shribak , Chen-Xiao Gao , Yitong Li , Chenjun Xiao , Bo Dai

Large language models (LLMs) are increasingly applied to complex reasoning tasks that require executing several complex steps before receiving any reward. Properly assigning credit to these steps is essential for enhancing model…

Reinforcement learning (RL) is effective in enhancing the accuracy of large language models in complex reasoning tasks. Existing RL policy optimization frameworks rely on final-answer correctness as feedback signals and rarely capture the…

Artificial Intelligence · Computer Science 2026-04-13 Jinghan Zhang , Fengran Mo , Tharindu Cyril Weerasooriya , Ruimin Dai , Xiaoyan Han , Yanjie Fu , Dakuo Wang , Kunpeng Liu

Reinforcement Learning with Verifiable Rewards (RLVR) offers a promising framework for optimizing large language models in reasoning tasks. However, existing RLVR algorithms focus on different granularities, and each has complementary…

Machine Learning · Computer Science 2026-01-12 Zijun Min , Bingshuai Liu , Ante Wang , Long Zhang , Anxiang Zeng , Haibo Zhang , Jinsong Su

The incorporation of online reinforcement learning (RL) into diffusion and flow-based generative models has recently gained attention as a powerful paradigm for aligning model behavior with human preferences. By leveraging stochastic…

Machine Learning · Computer Science 2025-11-25 Yujie Zhou , Pengyang Ling , Jiazi Bu , Yibin Wang , Yuhang Zang , Jiaqi Wang , Li Niu , Guangtao Zhai

Recent advancements adopt online reinforcement learning (RL) from LLMs to text-to-image rectified flow diffusion models for reward alignment. The use of group-level rewards successfully aligns the model with the targeted reward. However, it…

Machine Learning · Computer Science 2026-01-06 Yiyang Wang , Xi Chen , Xiaogang Xu , Yu Liu , Hengshuang Zhao

Recently, online Reinforcement Learning with Verifiable Rewards (RLVR) has become a key paradigm for enhancing the reasoning capabilities of Large Language Models (LLMs). However, existing methods typically treat all training samples…

Artificial Intelligence · Computer Science 2025-09-30 Shijie Zhang , Guohao Sun , Kevin Zhang , Xiang Guo , Rujun Guo

Reinforcement Learning (RL) algorithms for safety alignment of Large Language Models (LLMs), such as Direct Preference Optimization (DPO), encounter the challenge of distribution shift. Current approaches typically address this issue…

Computation and Language · Computer Science 2025-06-17 Qiyuan Deng , Xuefeng Bai , Kehai Chen , Yaowei Wang , Liqiang Nie , Min Zhang

Large Vision-Language Models (LVLMs) or multimodal large language models represent a significant advancement in artificial intelligence, enabling systems to understand and generate content across both visual and textual modalities. While…

Machine Learning · Computer Science 2025-09-09 Thanh Thi Nguyen , Campbell Wilson , Janis Dalins

Reinforcement learning (RL) has become central to enhancing reasoning in large language models (LLMs). Yet on-policy algorithms such as Group Relative Policy Optimization (GRPO) often suffer in early training: noisy gradients from…

Machine Learning · Computer Science 2026-03-19 Ziyan Wang , Zheng Wang , Xingwei Qu , Qi Cheng , Jie Fu , Shengpu Tang , Minjia Zhang , Xiaoming Huo

Reinforcement learning (RL) policies often fail under dynamics that differ from training, a gap not fully addressed by domain randomization or existing adversarial RL methods. Distributionally robust RL provides a formal remedy but still…

Machine Learning · Computer Science 2026-04-16 Mintae Kim , Koushil Sreenath

Reinforcement Learning (RL) has recently received significant attention from the process systems engineering and control communities. Recent works have investigated the application of RL to identify optimal scheduling decision in the…

Systems and Control · Electrical Eng. & Systems 2022-03-11 Max Mowbray , Dongda Zhang , Ehecatl Antonio Del Rio Chanona

Offline-to-online reinforcement learning (O2O-RL) has emerged as a promising paradigm for safe and efficient robotic policy deployment but suffers from two fundamental challenges: limited coverage of multimodal behaviors and distributional…

Robotics · Computer Science 2025-11-14 Haidong Huang , Haiyue Zhu. Jiayu Song , Xixin Zhao , Yaohua Zhou , Jiayi Zhang , Yuze Zhai , Xiaocong Li

Distributional reinforcement learning (RL) is a powerful framework increasingly adopted in safety-critical domains for its ability to optimize risk-sensitive objectives. However, the role of the discount factor is often overlooked, as it is…

Machine Learning · Computer Science 2026-02-05 Mehrdad Moghimi , Anthony Coache , Hyejin Ku

The success of deep reinforcement learning (DRL) hinges on the availability of training data, which is typically obtained via a large number of environment interactions. In many real-world scenarios, costs and risks are associated with…

Machine Learning · Computer Science 2022-05-20 Amir Abolfazli , Gregory Palmer , Daniel Kudenko

Group Relative Policy Optimization (GRPO) has emerged as the de facto Reinforcement Learning (RL) objective driving recent advancements in Multimodal Large Language Models. However, extending this success to open-source multimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Wenbo Hu , Xin Chen , Yan Gao-Tian , Yihe Deng , Nanyun Peng , Kai-Wei Chang

Reinforcement learning algorithms are fundamental to align large language models with human preferences and to enhance their reasoning capabilities. However, current reinforcement learning algorithms often suffer from training instability…

Machine Learning · Computer Science 2025-06-05 Yaru Hao , Li Dong , Xun Wu , Shaohan Huang , Zewen Chi , Furu Wei

Resource allocation in High Performance Computing (HPC) environments presents a complex and multifaceted challenge for job scheduling algorithms. Beyond the efficient allocation of system resources, schedulers must account for and optimize…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-08 Matthew Sgambati , Aleksandar Vakanski , Matthew Anderson

Reinforcement learning has been central to recent advances in large language model reasoning, but most algorithms rely on on-policy training that demands fresh rollouts at every update, limiting efficiency and scalability. Asynchronous RL…

Machine Learning · Computer Science 2025-10-29 Haizhong Zheng , Jiawei Zhao , Beidi Chen