English
Related papers

Related papers: HuViDPO:Enhancing Video Generation through Direct …

200 papers

The practical applications of diffusion models have been limited by the misalignment between generated images and corresponding text prompts. Recent studies have introduced direct preference optimization (DPO) to enhance the alignment of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Zijing Hu , Fengda Zhang , Kun Kuang

Direct Preference Optimization (DPO) has gained attention as an efficient alternative to reinforcement learning from human feedback (RLHF) for aligning large language models (LLMs) with human preferences. Despite its advantages, DPO suffers…

Computation and Language · Computer Science 2025-02-21 Ruichen Shao , Bei Li , Gangao Liu , Yang Chen , Xiang Zhou , Jingang Wang , Xunliang Cai , Peng Li

Video generation has achieved significant advances through rectified flow techniques, but issues like unsmooth motion and misalignment between videos and prompts persist. In this work, we develop a systematic pipeline that harnesses human…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Jie Liu , Gongye Liu , Jiajun Liang , Ziyang Yuan , Xiaokun Liu , Mingwu Zheng , Xiele Wu , Qiulin Wang , Menghan Xia , Xintao Wang , Xiaohong Liu , Fei Yang , Pengfei Wan , Di Zhang , Kun Gai , Yujiu Yang , Wanli Ouyang

Direct Preference Optimization (DPO) is an effective framework for aligning large language models with human preferences, but it struggles with complex reasoning tasks. DPO optimizes for the likelihood of generating preferred over…

Artificial Intelligence · Computer Science 2026-04-23 Darsh Kachroo , Adriana Caraeni , Arjun Prasaath Anbazhagan , Brennan Lagasse , Kevin Zhu

Direct Preference Optimization (DPO) is a powerful paradigm for aligning Large Language Models (LLMs) to human preferences in Machine Translation (MT), but current methods are hindered by two fundamental challenges: (1) flawed reward…

Computation and Language · Computer Science 2025-10-16 Hao Wang , Linlong Xu , Heng Liu , Yangyang Liu , Xiaohu Zhao , Bo Zeng , Liangying Shao , Longyue Wang , Weihua Luo , Kaifu Zhang

RLHF techniques like DPO can significantly improve the generation quality of text-to-image diffusion models. However, these methods optimize for a single reward that aligns model generation with population-level preferences, neglecting the…

Machine Learning · Computer Science 2025-01-14 Meihua Dang , Anikait Singh , Linqi Zhou , Stefano Ermon , Jiaming Song

Preferences within a group of people are not uniform but follow a distribution. While existing alignment methods like Direct Preference Optimization (DPO) attempt to steer models to reflect human preferences, they struggle to capture the…

Computation and Language · Computer Science 2025-05-14 Binwei Yao , Zefan Cai , Yun-Shiuan Chuang , Shanglin Yang , Ming Jiang , Diyi Yang , Junjie Hu

Direct preference optimization (DPO) is an effective technique to train language models to generate preferred over dispreferred responses. However, this binary "winner-takes-all" approach is suboptimal for vision-language models whose…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Ansel Blume , Burak Uzkent , Shalini Chaudhuri , Garin Kessler

Radiography Report Generation (RRG) has gained significant attention in medical image analysis as a promising tool for alleviating the growing workload of radiologists. However, despite numerous advancements, existing methods have yet to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Valentin Samokhin , Boris Shirokikh , Mikhail Goncharov , Dmitriy Umerenkov , Maksim Bobrin , Ivan Oseledets , Dmitry Dylov , Mikhail Belyaev

Existing methods for preference tuning of text-to-image (T2I) diffusion models often rely on computationally expensive generation steps to create positive and negative pairs of images. These approaches frequently yield training pairs that…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Sanjana Reddy , Ishaan Malhi , Sally Ma , Praneet Dutta

Efficiently aligning large-scale video diffusion models with human intent requires a scalable and trajectory-aware pathway that bridges the inherent discrepancy between training noise distributions and practical inference trajectories.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Jingyuan Zhu , Biaolong Chen , Le Zhang , Aixi Zhang , Hao Jiang , Pipei Huang

We present LongVPO, a novel two-stage Direct Preference Optimization framework that enables short-context vision-language models to robustly understand ultra-long videos without any long-video annotations. In Stage 1, we synthesize…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Zhenpeng Huang , Jiaqi Li , Zihan Jia , Xinhao Li , Desen Meng , Lingxue Song , Xi Chen , Liang Li , Limin Wang

Large vision-language models (LVLMs) suffer from hallucination, resulting in misalignment between the output textual response and the input visual content. Recent research indicates that the over-reliance on the Large Language Model (LLM)…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Yuxi Xie , Guanzhen Li , Xiao Xu , Min-Yen Kan

Direct Preference Optimization (DPO) has emerged as a simple and effective method for aligning large language models. However, its reliance on a fixed temperature parameter leads to suboptimal training on diverse preference data, causing…

Machine Learning · Computer Science 2025-10-08 Hyung Gyu Rho

Modern preference alignment methods, such as DPO, rely on divergence regularization to a reference model for training stability-but this creates a fundamental problem we call "reference mismatch." In this paper, we investigate the negative…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Jiwoo Hong , Sayak Paul , Noah Lee , Kashif Rasul , James Thorne , Jongheon Jeong

While preference optimization is crucial for improving visual generative models, how to effectively scale this paradigm remains largely unexplored. Current open-source preference datasets contain conflicting preference patterns, where…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Ming Li , Jie Wu , Justin Cui , Xiaojie Li , Rui Wang , Chen Chen

Direct Preference Optimization (DPO) is an effective technique that leverages pairwise preference data (usually one chosen and rejected response pair per user prompt) to align LLMs to human preferences. In practice, multiple responses can…

Computation and Language · Computer Science 2024-11-11 Pulkit Pattnaik , Rishabh Maheshwary , Kelechi Ogueji , Vikas Yadav , Sathwik Tejaswi Madhusudhan

Direct Preference Optimization (DPO) has emerged as a de-facto approach for aligning language models with human preferences. Recent work has shown DPO's effectiveness relies on training data quality. In particular, clear quality differences…

Machine Learning · Computer Science 2025-01-28 Nirav Diwan , Tolga Ergen , Dongsub Shim , Honglak Lee

Large Video Models (LVMs) built upon Large Language Models (LLMs) have shown promise in video understanding but often suffer from misalignment with human intuition and video hallucination issues. To address these challenges, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Haojian Huang , Haodong Chen , Shengqiong Wu , Meng Luo , Jinlan Fu , Xinya Du , Hanwang Zhang , Hao Fei

Text-to-video (T2V) generation has achieved remarkable progress in producing high-quality videos aligned with textual prompts. However, aligning synthesized videos with nuanced human preference remains challenging due to the subjective and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Qiushi Yang , Yingjie Chen , Yuan Yao , Yifang Men , Huaizhuo Liu , Miaomiao Cui