English
Related papers

Related papers: Calibrated Multi-Preference Optimization for Align…

200 papers

The application of diffusion models in 3D LiDAR scene completion is limited due to diffusion's slow sampling speed. Score distillation accelerates diffusion sampling but with performance degradation, while post-training with direct policy…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 An Zhao , Shengyuan Zhang , Ling Yang , Zejian Li , Jiale Wu , Haoran Xu , AnYang Wei , Perry Pengyun GU , Lingyun Sun

Preference alignment in diffusion models has primarily focused on benign human preferences (e.g., aesthetic). In this paper, we propose a novel perspective: framing unrestricted adversarial example generation as a problem of aligning with…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Kaixun Jiang , Zhaoyu Chen , Haijing Guo , Jinglun Li , Jiyuan Fu , Pinxue Guo , Hao Tang , Bo Li , Wenqiang Zhang

Few-step diffusion models enable efficient high-resolution image synthesis but struggle to align with specific downstream objectives due to limitations of existing reinforcement learning (RL) methods in low-step regimes with limited state…

Machine Learning · Computer Science 2026-03-02 Ziyi Zhang , Li Shen , Sen Zhang , Deheng Ye , Yong Luo , Miaojing Shi , Dongjing Shan , Bo Du , Dacheng Tao

Direct Preference Optimization (DPO) optimizes language models to align with human preferences. Utilizing on-policy samples, generated directly by the policy model, typically results in better performance due to its distribution consistency…

Machine Learning · Computer Science 2025-03-21 Yunan Wang , Jijie Li , Bo-Wen Zhang , Liangdong Wang , Guang Liu

Fine-tuning pre-trained Large Language Models (LLMs) is essential to align them with human values and intentions. This process often utilizes methods like pairwise comparisons and KL divergence against a reference LLM, focusing on the…

Computation and Language · Computer Science 2024-09-02 Yongcheng Zeng , Guoqing Liu , Weiyu Ma , Ning Yang , Haifeng Zhang , Jun Wang

Text-to-image (T2I) generation has greatly enhanced creative expression, yet achieving preference-aligned generation in a real-time and training-free manner remains challenging. Previous methods often rely on static, pre-collected…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Yang Li , Songlin Yang , Xiaoxuan Han , Wei Wang , Jing Dong , Yueming Lyu , Ziyu Xue

Direct Preference Optimisation (DPO) has emerged as a powerful method for aligning Large Language Models (LLMs) with human preferences, offering a stable and efficient alternative to approaches that use Reinforcement learning via Human…

Artificial Intelligence · Computer Science 2025-05-06 Sarvesh Shashidhar , Ritik , Nachiketa Patil , Suraj Racha , Ganesh Ramakrishnan

Human preference alignment is essential to improve the interaction quality of large language models (LLMs). Existing alignment methods depend on manually annotated preference data to guide the LLM optimization directions. However,…

Computation and Language · Computer Science 2024-06-04 Pengyu Cheng , Yifan Yang , Jian Li , Yong Dai , Tianhao Hu , Peixin Cao , Nan Du , Xiaolong Li

Diffusion models are a class of flexible generative models trained with an approximation to the log-likelihood objective. However, most use cases of diffusion models are not concerned with likelihoods, but instead with downstream objectives…

Machine Learning · Computer Science 2024-01-08 Kevin Black , Michael Janner , Yilun Du , Ilya Kostrikov , Sergey Levine

Iterative data generation and model retraining are widely used to align large language models (LLMs). It typically involves a policy model to generate on-policy responses and a reward model to guide training data selection. Direct…

Computation and Language · Computer Science 2025-07-01 Yao Xiao , Hai Ye , Linyao Chen , Hwee Tou Ng , Lidong Bing , Xiaoli Li , Roy Ka-wei Lee

Existing preference datasets for text-to-image models typically store only the final winner/loser images. This representation is insufficient for rectified flow (RF) models, whose generation is naturally indexed by a specific prior noise…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yunhong Lu , Qichao Wang , Hengyuan Cao , Xiaoyin Xu , Min Zhang

While fusing heterogeneous open-source LLMs with varying architectures and sizes can potentially integrate the strengths of different models, existing fusion methods face significant challenges, such as vocabulary alignment and merging…

Computation and Language · Computer Science 2025-02-27 Ziyi Yang , Fanqi Wan , Longguang Zhong , Tianyuan Shi , Xiaojun Quan

Contrastive learning models have demonstrated impressive abilities to capture semantic similarities by aligning representations in the embedding space. However, their performance can be limited by the quality of the training data and its…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Amirabbas Afzali , Borna Khodabandeh , Ali Rasekh , Mahyar JafariNodeh , Sepehr kazemi , Simon Gottschalk

DPO is an effective preference optimization algorithm. However, the DPO-tuned models tend to overfit on the dispreferred samples, manifested as overly long generations lacking diversity. While recent regularization approaches have…

Computation and Language · Computer Science 2025-08-26 Chenxu Yang , Ruipeng Jia , Naibin Gu , Zheng Lin , Siyuan Chen , Chao Pang , Weichong Yin , Yu Sun , Hua Wu , Weiping Wang

Offline preference optimization methods are efficient for large language models (LLMs) alignment. Direct Preference optimization (DPO)-like learning, one of the most popular approaches, stands out for its efficiency in reward modeling.…

Machine Learning · Computer Science 2026-05-26 Xiaobo Wang , Zixia Jia , Jiaqi Li , Qi Liu , Zilong Zheng

Despite the efficacy of Direct Preference Optimization (DPO) in aligning Large Language Models (LLMs), reward hacking remains a pivotal challenge. This issue emerges when LLMs excessively reduce the probability of rejected completions to…

Computation and Language · Computer Science 2025-08-26 Chenxu Yang , Ruipeng Jia , Mingyu Zheng , Naibin Gu , Zheng Lin , Siyuan Chen , Weichong Yin , Hua Wu , Weiping Wang

To enhance controllability in text-to-image generation, ControlNet introduces image-based control signals, while ControlNet++ improves pixel-level cycle consistency between generated images and the input control signal. To avoid the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-10 Zonglin Lyu , Ming Li , Xinxin Liu , Chen Chen

Direct Preference Optimization (DPO) has recently emerged as a popular approach to improve reinforcement learning with human feedback (RLHF), leading to better techniques to fine-tune large language models (LLM). A weakness of DPO, however,…

Machine Learning · Computer Science 2025-04-21 Haoxian Chen , Hanyang Zhao , Henry Lam , David Yao , Wenpin Tang

Traditional RLHF-based LLM alignment methods explicitly maximize the expected rewards from a separate reward model. More recent supervised alignment methods like Direct Preference Optimization (DPO) circumvent this phase to avoid problems…

Machine Learning · Computer Science 2025-02-03 Abhijnan Nath , Changsoo Jung , Ethan Seefried , Nikhil Krishnaswamy

The default paradigm of post-training text-to-image generators includes post-hoc selection of generated images, and subsequent training with one reward model to align the generator to the reward, typically user preference. This discards…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Nicolas Dufour , Lucas Degeorge , Arijit Ghosh , Vicky Kalogeiton , David Picard