English
Related papers

Related papers: Know Your Step: Faster and Better Alignment for Fl…

200 papers

While behavior cloning with flow/diffusion policies excels at learning complex skills from demonstrations, it remains vulnerable to distributional shift, and standard RL methods struggle to fine-tune these models due to their iterative…

Machine Learning · Computer Science 2025-10-20 Mingyang Sun , Pengxiang Ding , Weinan Zhang , Donglin Wang

Recent studies generally enhance MLLMs' reasoning capabilities via supervised fine-tuning on high-quality chain-of-thought reasoning data, which often leads models to merely imitate successful reasoning paths without understanding what the…

Artificial Intelligence · Computer Science 2025-08-05 Jingyi Zhang , Jiaxing Huang , Huanjin Yao , Shunyu Liu , Xikun Zhang , Shijian Lu , Dacheng Tao

Flow matching is a powerful framework for generating high-quality samples in various applications, especially image synthesis. However, the intensive computational demands of these models, especially during the finetuning process and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Bao Nguyen , Binh Nguyen , Viet Anh Nguyen

Adapting large language models (LLMs) for specific tasks usually involves fine-tuning through reinforcement learning with human feedback (RLHF) on preference data. While these data often come from diverse labelers' groups (e.g., different…

Computation and Language · Computer Science 2024-05-31 Shyam Sundhar Ramesh , Yifan Hu , Iason Chaimalas , Viraj Mehta , Pier Giuseppe Sessa , Haitham Bou Ammar , Ilija Bogunovic

Diffusion policies are expressive yet incur high inference latency. Flow Matching (FM) enables one-step generation, but integrating it into Maximum Entropy Reinforcement Learning (MaxEnt RL) is challenging: the optimal policy is an…

Machine Learning · Computer Science 2026-02-03 Zeqiao Li , Yijing Wang , Haoyu Wang , Zheng Li , Zhiqiang Zuo

Generative foundation models are susceptible to implicit biases that can arise from extensive unsupervised training data. Such biases can produce suboptimal samples, skewed outcomes, and unfairness, with potentially serious consequences.…

Machine Learning · Computer Science 2023-12-04 Hanze Dong , Wei Xiong , Deepanshu Goyal , Yihan Zhang , Winnie Chow , Rui Pan , Shizhe Diao , Jipeng Zhang , Kashun Shum , Tong Zhang

Reinforcement learning methods such as GRPO have seen great popularity in LLM post-training. In GRPO, models produce completions to a set of prompts, which are rewarded, and the policy is updated towards the relatively high reward…

Machine Learning · Computer Science 2026-05-22 Nikolay Blagoev , Oğuzhan Ersoy , Wendelin Boehmer , Lydia Yiyu Chen

Unified models capable of interleaved generation have emerged as a promising paradigm, with the community increasingly converging on autoregressive modeling for text and flow matching for image generation. To advance this direction, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Jie Liu , Zilyu Ye , Linxiao Yuan , Shenhan Zhu , Yu Gao , Jie Wu , Kunchang Li , Xionghui Wang , Xiaonan Nie , Weilin Huang , Wanli Ouyang

Reinforcement Learning with Human Feedback (RLHF) has been the dominant approach for improving the reasoning capabilities of Large Language Models (LLMs). Recently, Reinforcement Learning with Verifiable Rewards (RLVR) has simplified this…

Computation and Language · Computer Science 2025-10-10 Yining Wang , Jinman Zhao , Chuangxin Zhao , Shuhao Guan , Gerald Penn , Shinan Liu

Group Relative Policy Optimization (GRPO) has emerged as an effective and lightweight framework for post-training visual generative models. However, its performance is fundamentally limited by the ambiguity of textual visual correspondence:…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Ruiying Liu , Yuanzhi Liang , Haibin Huang , Tianshu Yu , Chi Zhang

Most of the traditional Applicant Tracking Systems (ATS) depend on strict matching using keywords, where candidates that are highly qualified are many times disqualified because of minor semantic differences. In this article, the two-stage…

Machine Learning · Computer Science 2026-01-21 Shreyansh Jain , Madhav Singhvi , Shreya Rahul Jain , Pranav S , Dishaa Lokesh , Naren Chittibabu , Akash Anandhan

Group Relative Policy Optimization(GRPO) has become a cornerstone of modern reinforcement learning alignment, prized for its efficacy in foregoing an explicit value-critic by leveraging reward normalization across sampled trajectory…

Computation and Language · Computer Science 2026-05-29 Redacted by arXiv

Flow-based generative models have shown remarkable success in text-to-image generation, yet fine-tuning them with intermediate feedback remains challenging, especially for continuous-time flow matching models. Most existing approaches…

Machine Learning · Computer Science 2025-10-22 Jiajun Fan , Chaoran Cheng , Shuaike Shen , Xiangxin Zhou , Ge Liu

Forecasting high-dimensional, PDE-governed dynamics remains a core challenge for generative modeling. Existing autoregressive and diffusion-based approaches often suffer cumulative errors and discretisation artifacts that limit long,…

Machine Learning · Computer Science 2025-10-20 Yolanne Yi Ran Lee , Kyriakos Flouris

Video action models are an appealing foundation for Vision--Language--Action systems because they can learn visual dynamics from large-scale video data and transfer this knowledge to downstream robot control. Yet current diffusion-based…

Direct preference optimization (DPO) has shown success in aligning diffusion models with human preference. Previous approaches typically assume a consistent preference label between final generations and noisy samples at intermediate steps,…

Machine Learning · Computer Science 2025-02-05 Jie Ren , Yuhang Zhang , Dongrui Liu , Xiaopeng Zhang , Qi Tian

Instruction-guided image editing requires balancing target modification with non-target preservation. Recently, flow-based models have emerged as a strong and increasingly adopted backbone for instruction-guided image editing, thanks to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Zhuohan Ouyang , Zhe Qian , Wenhuo Cui , Chaoqun Wang

Preference optimization for diffusion models aims to align them with human preferences for images. Previous methods typically use Vision-Language Models (VLMs) as pixel-level reward models to approximate human preferences. However, when…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Tao Zhang , Cheng Da , Kun Ding , Huan Yang , Kun Jin , Yan Li , Tingting Gao , Di Zhang , Shiming Xiang , Chunhong Pan

Imitation learning is a promising approach for enabling generalist capabilities in humanoid robots, but its scaling is fundamentally constrained by the scarcity of high-quality expert demonstrations. This limitation can be mitigated by…

Robotics · Computer Science 2025-08-21 Quentin Rouxel , Clemente Donoso , Fei Chen , Serena Ivaldi , Jean-Baptiste Mouret

Fine-tuning flow matching models is a central challenge in settings with limited data, evolving distributions, or strict efficiency demands, where unconstrained fine-tuning can erode the accuracy and efficiency gains learned during…

Machine Learning · Computer Science 2026-02-02 Gudrun Thorkelsdottir , Arindam Banerjee
‹ Prev 1 4 5 6 7 8 10 Next ›