English
Related papers

Related papers: BalancedDPO: Adaptive Multi-Metric Alignment

200 papers

At the forefront of state-of-the-art human alignment methods are preference optimization methods (*PO). Prior research has often concentrated on identifying the best-performing method, typically involving a grid search over hyperparameters,…

Computation and Language · Computer Science 2025-04-30 Kian Ahrabian , Xihui Lin , Barun Patra , Vishrav Chaudhary , Alon Benhaim , Jay Pujara , Xia Song

Direct preference optimization (DPO), a widely adopted offline preference optimization algorithm, aims to align large language models (LLMs) with human-desired behaviors using pairwise preference data. However, the generation of the winning…

Computation and Language · Computer Science 2025-02-19 Yuxin Jiang , Bo Huang , Yufei Wang , Xingshan Zeng , Liangyou Li , Yasheng Wang , Xin Jiang , Lifeng Shang , Ruiming Tang , Wei Wang

DPO has become a widely adopted alternative to RLHF for aligning LLMs with human preferences, eliminating the need for a separate reward model or RL loop. Recent theoretical analysis uncovers an asymmetric gradient behavior in DPO: the loss…

Computation and Language · Computer Science 2026-05-28 Shaolong Chen , Madalina Ciobanu , Qingqing Mao , Ritankar Das

Direct Preference Optimization (DPO) has emerged as a powerful approach to align text-to-image (T2I) models with human feedback. Unfortunately, successful application of DPO to T2I models requires a huge amount of resources to collect and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Shyamgopal Karthik , Huseyin Coskun , Zeynep Akata , Sergey Tulyakov , Jian Ren , Anil Kag

In the field of large language models (LLMs), aligning models with the diverse preferences of users is a critical challenge. Direct Preference Optimization (DPO) has played a key role in this area. It works by using pairs of preferences…

Computation and Language · Computer Science 2024-05-29 Yueqin Yin , Zhendong Wang , Yi Gu , Hai Huang , Weizhu Chen , Mingyuan Zhou

A major challenge in aligning large language models (LLMs) with human preferences is the issue of distribution shift. LLM alignment algorithms rely on static preference datasets, assuming that they accurately represent real-world user…

Machine Learning · Computer Science 2026-01-16 Zaiyan Xu , Sushil Vemuri , Kishan Panaganti , Dileep Kalathil , Rahul Jain , Deepak Ramachandran

A key challenge in music generation models is their lack of direct alignment with human preferences, as music evaluation is inherently subjective and varies widely across individuals. We introduce MR-FlowDPO, a novel approach that enhances…

Sound · Computer Science 2025-12-16 Alon Ziv , Sanyuan Chen , Andros Tjandra , Yossi Adi , Wei-Ning Hsu , Bowen Shi

Efficiently aligning large-scale video diffusion models with human intent requires a scalable and trajectory-aware pathway that bridges the inherent discrepancy between training noise distributions and practical inference trajectories.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Jingyuan Zhu , Biaolong Chen , Le Zhang , Aixi Zhang , Hao Jiang , Pipei Huang

Aligning large language models (LLMs) with human values and intentions is crucial for their utility, honesty, and safety. Reinforcement learning from human feedback (RLHF) is a popular approach to achieve this alignment, but it faces…

Machine Learning · Computer Science 2025-07-22 Junkang Wu , Xue Wang , Zhengyi Yang , Jiancan Wu , Jinyang Gao , Bolin Ding , Xiang Wang , Xiangnan He

Direct Preference Optimization (DPO) has recently been applied as a post-training technique for text-to-video diffusion models. To obtain training data, annotators are asked to provide preferences between two videos generated from…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Ziyi Wu , Anil Kag , Ivan Skorokhodov , Willi Menapace , Ashkan Mirzaei , Igor Gilitschenski , Sergey Tulyakov , Aliaksandr Siarohin

Conditional image generation enhances text-to-image synthesis with structural, spatial, or stylistic priors, but current methods face challenges in handling conflicts between sources. These include 1) input-level conflicts, where the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Dewei Zhou , Mingwei Li , Zongxin Yang , Yu Lu , Yunqiu Xu , Zhizhong Wang , Zeyi Huang , Yi Yang

Diffusion models have become a central paradigm for image and multimodal generation, yet their deployment raises persistent questions about alignment, safety, preference satisfaction, and robustness to misuse. This survey reviews recent…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Preeti Lamba , Kiran Ravish , Ankita Kushwaha , Pawan Kumar

Direct Preference Optimization (DPO) has been proposed as a promising alternative to Proximal Policy Optimization (PPO) based Reinforcement Learning with Human Feedback (RLHF). However, empirical evaluations consistently reveal suboptimal…

Machine Learning · Computer Science 2025-03-03 Qinwei Ma , Jingzhe Shi , Can Jin , Jenq-Neng Hwang , Serge Belongie , Lei Li

Direct preference optimization (DPO) methods have shown strong potential in aligning text-to-image diffusion models with human preferences by training on paired comparisons. These methods improve training stability by avoiding the REINFORCE…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Yi-Lun Wu , Bo-Kai Ruan , Chiang Tseng , Hong-Han Shuai

Direct Preference Optimization (DPO) is successful for alignment in LLMs but still faces challenges in text-to-image generation. Existing studies are confined to denoising diffusion models while overlooking flow-matching, and suffer from an…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Kesong Li , Yixuan Xu , Kuo-kun Tseng , Weiyi Lu , Kan Liu , Tao Lan

The rapid development of large language model (LLM) alignment algorithms has resulted in a complex and fragmented landscape, with limited clarity on the effectiveness of different methods and their inter-connections. This paper introduces…

Traditional RLHF-based LLM alignment methods explicitly maximize the expected rewards from a separate reward model. More recent supervised alignment methods like Direct Preference Optimization (DPO) circumvent this phase to avoid problems…

Machine Learning · Computer Science 2025-02-03 Abhijnan Nath , Changsoo Jung , Ethan Seefried , Nikhil Krishnaswamy

Direct Preference Optimization (DPO) has become a standard framework for safety alignment, but its reliance on pairwise preference updates makes training sensitive to imperfect supervision. Existing robust DPO methods often address this…

Machine Learning · Computer Science 2026-05-27 Jilong Liu , Yonghui Yang , Pengyang Shao , Wenjian Tao , Hao Zhan , Haokai Ma , Wei Qin , Richang Hong

Generating visually appealing images is fundamental to modern text-to-image generation models. A potential solution to better aesthetics is direct preference optimization (DPO), which has been applied to diffusion models to improve general…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Zhanhao Liang , Yuhui Yuan , Shuyang Gu , Bohan Chen , Tiankai Hang , Mingxi Cheng , Ji Li , Liang Zheng

Direct preference optimization (DPO) has shown to be an effective method for large language model (LLM) alignment. Recent works have attempted to apply DPO to multimodal scenarios but have found it challenging to achieve consistent…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Fei Wang , Wenxuan Zhou , James Y. Huang , Nan Xu , Sheng Zhang , Hoifung Poon , Muhao Chen