English
Related papers

Related papers: TempFlow-GRPO: When Timing Matters for GRPO in Flo…

200 papers

Many data-driven decision problems are formulated using a nominal distribution estimated from historical data, while performance is ultimately determined by a deployment distribution that may be shifted, context-dependent, partially…

Machine Learning · Computer Science 2026-04-07 Xiuyuan Cheng , Yunqin Zhu , Yao Xie

Reinforcement learning improves LLM reasoning, yet sparse delayed reward over long sequences makes token-level credit assignment the key bottleneck. We study the verifiable-reward setting, where the final answer is checkable and multiple…

Computation and Language · Computer Science 2025-10-06 Hieu Tran , Zonghai Yao , Hong Yu

While recent text-to-video (T2V) diffusion models have achieved impressive quality and prompt alignment, they often produce low-diversity outputs when sampling multiple videos from a single text prompt. We tackle this challenge by…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Tahira Kazimi , Connor Dunlop , Pinar Yanardag

Generating high-quality time-series data is challenging because real-world signals often exhibit multimodal patterns and multiscale dynamics, including oscillations and high-frequency variations. Flow Matching (FM) offers an efficient…

Machine Learning · Computer Science 2026-05-29 Junru Zhang , Lang Feng , Jinbo Wang , Xu Guo , Yucheng Wang , Han Yu , Min Wu , Yabo Dong , Duanqing Xu

Reconstructing near-wall turbulence from wall-based measurements is a critical yet inherently ill-posed problem in wall-bounded flows, where limited sensing and spatially heterogeneous flow-wall coupling challenge deterministic estimation…

Fluid Dynamics · Physics 2025-04-22 Meet Hemant Parikh , Xiantao Fan , Jian-Xun Wang

Continuous-time event sequences, in which events occur at irregular intervals, are ubiquitous across a wide range of industrial and scientific domains. The contemporary modeling paradigm is to treat such data as realizations of a temporal…

Machine Learning · Computer Science 2026-04-07 Gavin Kerrigan , Kai Nelson , Padhraic Smyth

Multi-turn human-AI collaboration is fundamental to deploying interactive services such as adaptive tutoring, conversational recommendation, and professional consultation. However, optimizing these interactions via reinforcement learning is…

Machine Learning · Computer Science 2026-03-26 Haoyu Wang , Yuxin Chen , Liang Luo , Buyun Zhang , Ellie Dingqiao Wen , Pan Li

Recent advancements in diffusion models (DMs) have been propelled by alignment methods that post-train models to better conform to human preferences. However, these approaches typically require computation-intensive training of a base model…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Zejian Li , Yize Li , Chenye Meng , Zhongni Liu , Yang Ling , Shengyuan Zhang , Guang Yang , Changyuan Yang , Zhiyuan Yang , Lingyun Sun

Group Relative Policy Optimization (GRPO) methods for video generation like FlowGRPO remain far less reliable than their counterparts for language models and images. This gap arises because video generation has a complex solution space, and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Mingzhe Zheng , Weijie Kong , Yue Wu , Dengyang Jiang , Yue Ma , Xuanhua He , Bin Lin , Kaixiong Gong , Zhao Zhong , Liefeng Bo , Qifeng Chen , Harry Yang

Recent advancements in video-audio joint generation have achieved remarkable success in semantic correspondence. However, achieving precise temporal synchronization, which requires fine-grained alignment between audio events and their…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Xin Cheng , Xihua Wang , Ying Ba , Yuyue Wang , Kaisi Guan , Yinbo Wang , Wenpu Li , Ruihua Song

Reward-based fine-tuning steers a pretrained diffusion or flow-based generative model toward higher-reward samples while remaining close to the pretrained model. Although existing methods are derived from different perspectives, we show…

Machine Learning · Computer Science 2026-05-08 Jeongjae Lee , Jinho Chang , Jeongsol Kim , Jong Chul Ye

Reinforcement Learning with Verifiable Rewards (RLVR) has become a standard recipe for post-training LLMs on reasoning tasks, with Group Relative Policy Optimization (GRPO) emerging as a leading approach. However, GRPO and its variants are…

Machine Learning · Computer Science 2026-05-12 Chanakya Ekbote , Vijay Lingam , Sujay Sanghavi , Jun Huan , Behrooz Omidvar-Tehrani , Anoop Deoras , Stefano Soatto

This paper introduces Completion Pruning Policy Optimization (CPPO) to accelerate the training of reasoning models based on Group Relative Policy Optimization (GRPO). GRPO, while effective, incurs high training costs due to the need to…

Artificial Intelligence · Computer Science 2025-11-11 Zhihang Lin , Mingbao Lin , Yuan Xie , Rongrong Ji

Recent advancements in reinforcement learning (RL) have achieved great success in fine-tuning diffusion-based generative models. However, fine-tuning continuous flow-based generative models to align with arbitrary user-defined reward…

Machine Learning · Computer Science 2025-02-11 Jiajun Fan , Shuaike Shen , Chaoran Cheng , Yuxin Chen , Chumeng Liang , Ge Liu

Diffusion and flow-based generative models have achieved remarkable success in domains such as image synthesis, video generation, and natural language modeling. In this work, we extend these advances to weight space learning by leveraging…

Machine Learning · Computer Science 2025-10-17 Daniel Saragih , Deyu Cao , Tejas Balaji

Post-training LLMs with Reinforcement Learning, specifically Group Relative Policy Optimization (GRPO), has emerged as a paradigm for enhancing mathematical reasoning. However, standard GRPO relies on scalar correctness rewards that are…

Computation and Language · Computer Science 2026-03-03 Xiwen Chen , Wenhui Zhu , Peijie Qiu , Xuanzhao Dong , Hao Wang , Haiyu Wu , Huayu Li , Aristeidis Sotiras , Yalin Wang , Abolfazl Razi

Diffusion Multi-Modal Large Language Models (dMLLMs) are powerful for image generation, but optimizing them through reinforcement learning (RL) remains a major challenge. One primary difficulty is that a single image can be generated…

Artificial Intelligence · Computer Science 2026-05-19 Siqi Luo , Jianghan Shen , Yi Xin , Huayu Zheng , Haoxing Chen , Yan Tai , Yue Li , Junjun He , Yihao Liu , Guangtao Zhai , Yuewen Cao , Xiaohong Liu

Large language models frequently exhibit suboptimal performance on low resource languages, primarily due to inefficient subword segmentation and systemic training data imbalances. In this paper, we propose Variable Entropy Policy…

Computation and Language · Computer Science 2026-03-20 Chonghan Liu , Yimin Du , Qi An , Xin He , Cunqi Zhai , Fei Tan , Weijia Lin , Xiaochun Gong , Yongchao Deng , Shousheng Jia , Xiangzheng Zhang

Recent progress in large-scale flow and diffusion models raised two fundamental algorithmic challenges: (i) control-based reward adaptation of pre-trained flows, and (ii) integration of multiple models, i.e., flow merging. While current…

Machine Learning · Computer Science 2026-02-10 Riccardo De Santi , Malte Franke , Ya-Ping Hsieh , Andreas Krause

Contemporary reinforcement learning with verifiable reward methods post-train language models on multi-step reasoning by assigning a single outcome reward uniformly across all tokens in a trajectory. Such uniform assignment ignores which…

Artificial Intelligence · Computer Science 2026-05-27 Ankur Samanta , Akshayaa Magesh , Ayush Jain , Youliang Yu , Daniel Jiang , Kavosh Asadi , Kaveh Hassani , Paul Sajda , Jalaj Bhandari , Yonathan Efroni
‹ Prev 1 8 9 10 Next ›