中文
相关论文

相关论文: MixGRPO: Unlocking Flow-based GRPO Efficiency with…

200 篇论文

Existing Reinforcement Learning with Verifiable Rewards (RLVR) algorithms, such as GRPO, rely on rigid, uniform, and symmetric trust region mechanisms that are fundamentally misaligned with the complex optimization dynamics of Large…

机器学习 · 计算机科学 2026-04-21 Xiaoliang Fu , Jiaye Lin , Yangyi Fang , Binbin Zheng , Chaowen Hu , Zekai Shao , Cong Qin , Lu Pan , Ke Zeng , Xunliang Cai

Recent advancements in Large Reasoning Models (LRMs), exemplified by DeepSeek-R1, have underscored the potential of scaling inference-time compute through Group Relative Policy Optimization (GRPO). However, GRPO frequently suffers from…

人工智能 · 计算机科学 2026-02-09 Yu Zhao , Fan Jiang , Tianle Liu , Bo Zeng , Yu Liu , Longyue Wang , Weihua Luo

Reinforcement learning from human feedback (RLHF) shows promise for aligning diffusion and flow models, yet policy optimization methods such as GRPO suffer from inefficient and static sampling strategies. These methods treat all prompts and…

机器学习 · 计算机科学 2026-02-09 Yuming Li , Qingyu Li , Chengyu Bai , Xiangyang Luo , Zeyue Xue , Wenyu Qin , Meng Wang , Yikai Wang , Shanghang Zhang

DPO (Direct Preference Optimization) has become a widely used offline preference optimization algorithm due to its simplicity and training stability. However, DPO is prone to overfitting and collapse. To address these challenges, we propose…

机器学习 · 计算机科学 2025-08-26 Rui Wang , Qianguo Sun , Chao Song , Junlong Wu , Tianrong Chen , Zhiyun Zeng , Yu Li

Reinforcement learning (RL) has become an effective way to improve prompt alignment and perceptual quality in diffusion and flow-matching generators. A critical step for applying online RL to flow matching is turning the deterministic…

机器学习 · 计算机科学 2026-05-25 Jade Zou , Tao Huang , Weijie Kong , Junzhe Li , Yue Wu , Qi Tian , Jiangfeng Xiong , Jianwei Zhang , Liefeng Bo , Zhao Zhong

Uniform Discrete Diffusion Model (UDM) has recently emerged as a promising paradigm for discrete generative modeling; however, its integration with reinforcement learning remains largely unexplored. We observe that naively applying GRPO to…

计算机视觉与模式识别 · 计算机科学 2026-05-29 Jiaqi Wang , Haoge Deng , Ting Pan , Yang Liu , Chengyuan Wang , Fan Zhang , Yonggang Qi , Xinlong Wang

High-level penetration of intermittent renewable energy sources (RESs) has introduced significant uncertainties into modern power systems. In order to rapidly and economically respond to the fluctuations of power system operating state,…

系统与控制 · 电气工程与系统科学 2023-08-08 Pengfei Wu , Chen Chen , Dexiang Lai , Jian Zhong

The integration of Reinforcement Learning (RL) into flow matching models for text-to-image (T2I) generation has driven substantial advances in generation quality. However, these gains often come at the cost of exhaustive exploration and…

计算机视觉与模式识别 · 计算机科学 2026-05-18 Xiaolong Fu , Lichen Ma , Zipeng Guo , ShiPing Dong , Lan Yang , Tan Lit Sin , Gaojing Zhou , Yu He , Jingling Fu , Shizhe Zhou , Junshi Huang , Jason Li

In the field of 3D dynamic scene reconstruction, how to balance model convergence rate and rendering quality has long been a critical challenge that urgently needs to be addressed, particularly in high-precision modeling of scenes with…

计算机视觉与模式识别 · 计算机科学 2026-01-12 Nengbo Lu , Minghua Pan , Shaohua Sun , Yizhou Liang

In this paper we provide new randomized algorithms with improved runtimes for solving linear programs with two-sided constraints. In the special case of the minimum cost flow problem on $n$-vertex $m$-edge graphs with integer…

数据结构与算法 · 计算机科学 2021-08-24 Jan van den Brand , Yin Tat Lee , Yang P. Liu , Thatchaphol Saranurak , Aaron Sidford , Zhao Song , Di Wang

Flow matching has emerged as a simulation-free alternative to diffusion-based generative modeling, producing samples by solving an ODE whose time-dependent velocity field is learned along an interpolation between a simple source…

机器学习 · 统计学 2026-04-10 Shivam Kumar , Yixin Wang , Lizhen Lin

The optimal selection, sizing, and location of small-scale technologies within a grid-connected distributed energy system (DES) can contribute to reducing carbon emissions, consumer costs, and network imbalances. This is the first study to…

最优化与控制 · 数学 2022-09-30 Ishanki De Mel , Oleksiy V. Klymenko , Michael Short

Momentum-Aided Prompt Optimization (MAPO) enhances the efficiency and efficacy of prompt optimization for Large Language Models (LLMs). Building on ProTeGi, MAPO uses positive natural language "gradients" and a momentum-based extension to…

计算与语言 · 计算机科学 2025-06-30 Anthony Cui , Pranav Nandyalam , Andrew Rufail , Ethan Cheung , Aiden Lei , Kevin Zhu , Sean O'Brien

Improving sample efficiency has been a longstanding goal in reinforcement learning. This paper proposes $\mathtt{VRMPO}$ algorithm: a sample efficient policy gradient method with stochastic mirror descent. In $\mathtt{VRMPO}$, a novel…

机器学习 · 计算机科学 2022-02-10 Long Yang , Yu Zhang , Gang Zheng , Qian Zheng , Pengfei Li , Jianhang Huang , Jun Wen , Gang Pan

Distributed training using multiple devices (e.g., GPUs) has been widely adopted for learning DNN models over large datasets. However, the performance of large-scale distributed training tends to be far from linear speed-up in practice.…

分布式、并行与集群计算 · 计算机科学 2022-05-19 Hanpeng Hu , Chenyu Jiang , Yuchen Zhong , Yanghua Peng , Chuan Wu , Yibo Zhu , Haibin Lin , Chuanxiong Guo

Fluid antenna system (FAS) becomes a promising paradigm for next-generation wireless networks, which enables position-flexible antenna elements that can dynamically adjust to more favorable channel conditions. However, the optimization of…

信息论 · 计算机科学 2026-05-04 Wanzhe Wang , Tong Zhang , Hao Xu , Shuai Wang , Rui Wang , Kai-Kit Wong

Denoising Diffusion Probabilistic Models (DDPMs) have established a new state-of-the-art in generative image synthesis, yet their deployment is hindered by significant computational overhead during inference, often requiring up to 1,000…

机器学习 · 计算机科学 2025-11-25 Srishti Gupta , Yashasvee Taiwade

Solving partial differential equations (PDEs) by numerical methods meet computational cost challenge for getting the accurate solution since fine grids and small time steps are required. Machine learning can accelerate this process, but…

数值分析 · 数学 2025-01-28 Qi Wang , Yuan Mi , Haoyun Wang , Yi Zhang , Ruizhi Chengze , Hongsheng Liu , Ji-Rong Wen , Hao Sun

Mixture-of-Experts (MoE) has emerged as an effective approach to reduce the computational overhead of Transformer architectures by sparsely activating a subset of parameters for each token while preserving high model capacity. This paradigm…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Dohwan Ko , Jinyoung Park , Seoung Choi , Sanghyeok Lee , Seohyun Lee , Hyunwoo J. Kim

This study presents a novel training algorithm depending upon the recently proposed Fitness Dependent Optimizer (FDO). The stability of this algorithm has been verified and performance-proofed in both the exploration and exploitation stages…

神经与进化计算 · 计算机科学 2022-01-04 Dosti Kh. Abbas , Tarik A. Rashid , Karmand H. Abdallaand Nebojsa Bacanin , Abeer Alsadoon