English
Related papers

Related papers: MixGRPO: Unlocking Flow-based GRPO Efficiency with…

200 papers

Existing Reinforcement Learning with Verifiable Rewards (RLVR) algorithms, such as GRPO, rely on rigid, uniform, and symmetric trust region mechanisms that are fundamentally misaligned with the complex optimization dynamics of Large…

Machine Learning · Computer Science 2026-04-21 Xiaoliang Fu , Jiaye Lin , Yangyi Fang , Binbin Zheng , Chaowen Hu , Zekai Shao , Cong Qin , Lu Pan , Ke Zeng , Xunliang Cai

Recent advancements in Large Reasoning Models (LRMs), exemplified by DeepSeek-R1, have underscored the potential of scaling inference-time compute through Group Relative Policy Optimization (GRPO). However, GRPO frequently suffers from…

Artificial Intelligence · Computer Science 2026-02-09 Yu Zhao , Fan Jiang , Tianle Liu , Bo Zeng , Yu Liu , Longyue Wang , Weihua Luo

Reinforcement learning from human feedback (RLHF) shows promise for aligning diffusion and flow models, yet policy optimization methods such as GRPO suffer from inefficient and static sampling strategies. These methods treat all prompts and…

Machine Learning · Computer Science 2026-02-09 Yuming Li , Qingyu Li , Chengyu Bai , Xiangyang Luo , Zeyue Xue , Wenyu Qin , Meng Wang , Yikai Wang , Shanghang Zhang

DPO (Direct Preference Optimization) has become a widely used offline preference optimization algorithm due to its simplicity and training stability. However, DPO is prone to overfitting and collapse. To address these challenges, we propose…

Machine Learning · Computer Science 2025-08-26 Rui Wang , Qianguo Sun , Chao Song , Junlong Wu , Tianrong Chen , Zhiyun Zeng , Yu Li

Reinforcement learning (RL) has become an effective way to improve prompt alignment and perceptual quality in diffusion and flow-matching generators. A critical step for applying online RL to flow matching is turning the deterministic…

Machine Learning · Computer Science 2026-05-25 Jade Zou , Tao Huang , Weijie Kong , Junzhe Li , Yue Wu , Qi Tian , Jiangfeng Xiong , Jianwei Zhang , Liefeng Bo , Zhao Zhong

Uniform Discrete Diffusion Model (UDM) has recently emerged as a promising paradigm for discrete generative modeling; however, its integration with reinforcement learning remains largely unexplored. We observe that naively applying GRPO to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Jiaqi Wang , Haoge Deng , Ting Pan , Yang Liu , Chengyuan Wang , Fan Zhang , Yonggang Qi , Xinlong Wang

High-level penetration of intermittent renewable energy sources (RESs) has introduced significant uncertainties into modern power systems. In order to rapidly and economically respond to the fluctuations of power system operating state,…

Systems and Control · Electrical Eng. & Systems 2023-08-08 Pengfei Wu , Chen Chen , Dexiang Lai , Jian Zhong

The integration of Reinforcement Learning (RL) into flow matching models for text-to-image (T2I) generation has driven substantial advances in generation quality. However, these gains often come at the cost of exhaustive exploration and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Xiaolong Fu , Lichen Ma , Zipeng Guo , ShiPing Dong , Lan Yang , Tan Lit Sin , Gaojing Zhou , Yu He , Jingling Fu , Shizhe Zhou , Junshi Huang , Jason Li

In the field of 3D dynamic scene reconstruction, how to balance model convergence rate and rendering quality has long been a critical challenge that urgently needs to be addressed, particularly in high-precision modeling of scenes with…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Nengbo Lu , Minghua Pan , Shaohua Sun , Yizhou Liang

In this paper we provide new randomized algorithms with improved runtimes for solving linear programs with two-sided constraints. In the special case of the minimum cost flow problem on $n$-vertex $m$-edge graphs with integer…

Data Structures and Algorithms · Computer Science 2021-08-24 Jan van den Brand , Yin Tat Lee , Yang P. Liu , Thatchaphol Saranurak , Aaron Sidford , Zhao Song , Di Wang

Flow matching has emerged as a simulation-free alternative to diffusion-based generative modeling, producing samples by solving an ODE whose time-dependent velocity field is learned along an interpolation between a simple source…

Machine Learning · Statistics 2026-04-10 Shivam Kumar , Yixin Wang , Lizhen Lin

The optimal selection, sizing, and location of small-scale technologies within a grid-connected distributed energy system (DES) can contribute to reducing carbon emissions, consumer costs, and network imbalances. This is the first study to…

Optimization and Control · Mathematics 2022-09-30 Ishanki De Mel , Oleksiy V. Klymenko , Michael Short

Momentum-Aided Prompt Optimization (MAPO) enhances the efficiency and efficacy of prompt optimization for Large Language Models (LLMs). Building on ProTeGi, MAPO uses positive natural language "gradients" and a momentum-based extension to…

Computation and Language · Computer Science 2025-06-30 Anthony Cui , Pranav Nandyalam , Andrew Rufail , Ethan Cheung , Aiden Lei , Kevin Zhu , Sean O'Brien

Improving sample efficiency has been a longstanding goal in reinforcement learning. This paper proposes $\mathtt{VRMPO}$ algorithm: a sample efficient policy gradient method with stochastic mirror descent. In $\mathtt{VRMPO}$, a novel…

Machine Learning · Computer Science 2022-02-10 Long Yang , Yu Zhang , Gang Zheng , Qian Zheng , Pengfei Li , Jianhang Huang , Jun Wen , Gang Pan

Distributed training using multiple devices (e.g., GPUs) has been widely adopted for learning DNN models over large datasets. However, the performance of large-scale distributed training tends to be far from linear speed-up in practice.…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-19 Hanpeng Hu , Chenyu Jiang , Yuchen Zhong , Yanghua Peng , Chuan Wu , Yibo Zhu , Haibin Lin , Chuanxiong Guo

Fluid antenna system (FAS) becomes a promising paradigm for next-generation wireless networks, which enables position-flexible antenna elements that can dynamically adjust to more favorable channel conditions. However, the optimization of…

Information Theory · Computer Science 2026-05-04 Wanzhe Wang , Tong Zhang , Hao Xu , Shuai Wang , Rui Wang , Kai-Kit Wong

Denoising Diffusion Probabilistic Models (DDPMs) have established a new state-of-the-art in generative image synthesis, yet their deployment is hindered by significant computational overhead during inference, often requiring up to 1,000…

Machine Learning · Computer Science 2025-11-25 Srishti Gupta , Yashasvee Taiwade

Solving partial differential equations (PDEs) by numerical methods meet computational cost challenge for getting the accurate solution since fine grids and small time steps are required. Machine learning can accelerate this process, but…

Numerical Analysis · Mathematics 2025-01-28 Qi Wang , Yuan Mi , Haoyun Wang , Yi Zhang , Ruizhi Chengze , Hongsheng Liu , Ji-Rong Wen , Hao Sun

Mixture-of-Experts (MoE) has emerged as an effective approach to reduce the computational overhead of Transformer architectures by sparsely activating a subset of parameters for each token while preserving high model capacity. This paradigm…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Dohwan Ko , Jinyoung Park , Seoung Choi , Sanghyeok Lee , Seohyun Lee , Hyunwoo J. Kim

This study presents a novel training algorithm depending upon the recently proposed Fitness Dependent Optimizer (FDO). The stability of this algorithm has been verified and performance-proofed in both the exploration and exploitation stages…

Neural and Evolutionary Computing · Computer Science 2022-01-04 Dosti Kh. Abbas , Tarik A. Rashid , Karmand H. Abdallaand Nebojsa Bacanin , Abeer Alsadoon