English
Related papers

Related papers: Enhancing Multilingual Counterfactual Generation t…

200 papers

As large language models (LLMs) are rapidly advancing and achieving near-human capabilities on specific tasks, aligning them with human values is becoming more urgent. In scenarios where LLMs outperform humans, we face a weak-to-strong…

Computation and Language · Computer Science 2025-03-04 Yougang Lyu , Lingyong Yan , Zihan Wang , Dawei Yin , Pengjie Ren , Maarten de Rijke , Zhaochun Ren

We propose Soft Preference Optimization (SPO), a method for aligning generative models, such as Large Language Models (LLMs), with human preferences, without the need for a reward model. SPO optimizes model outputs directly over a…

Machine Learning · Computer Science 2024-10-07 Arsalan Sharifnassab , Saber Salehkaleybar , Sina Ghiassian , Surya Kanoria , Dale Schuurmans

Large language models (LLMs) fine-tuned with alignment techniques, such as reinforcement learning from human feedback, have been instrumental in developing some of the most capable AI systems to date. Despite their success, existing methods…

Computation and Language · Computer Science 2025-07-01 Kyuyoung Kim , Ah Jeong Seo , Hao Liu , Jinwoo Shin , Kimin Lee

Generative AI can now synthesize strikingly realistic images from text, yet output quality remains highly sensitive to how prompts are phrased. Direct Preference Optimization (DPO) offers a lightweight, off-policy alternative to RL for…

Computation and Language · Computer Science 2025-07-30 Anas Mohamed , Azal Ahmad Khan , Xinran Wang , Ahmad Faraz Khan , Shuwen Ge , Saman Bahzad Khan , Ayaan Ahmad , Ali Anwar

The alignment of language models with human preferences is vital for their application in real-world tasks. The problem is formulated as optimizing the model's policy to maximize the expected reward that reflects human preferences with…

Computation and Language · Computer Science 2024-06-06 Haozhe Ji , Cheng Lu , Yilin Niu , Pei Ke , Hongning Wang , Jun Zhu , Jie Tang , Minlie Huang

In this work, we introduce a methodology for alignment designed to enhance the ability of large language models (LLMs) to articulate their reasoning (self-explanation) even in the absence of annotated rationale explanations. Our alignment…

Artificial Intelligence · Computer Science 2024-10-18 Luis Felipe Villa-Arenas , Ata Nizamoglu , Qianli Wang , Sebastian Möller , Vera Schmitt

In this study, we delve into the realm of counterfactual reasoning capabilities of large language models (LLMs). Our primary objective is to cultivate the counterfactual thought processes within LLMs and rigorously assess these processes…

Computation and Language · Computer Science 2024-06-10 Yinya Huang , Ruixin Hong , Hongming Zhang , Wei Shao , Zhicheng Yang , Dong Yu , Changshui Zhang , Xiaodan Liang , Linqi Song

We study the problem of aligning large language models (LLMs) with human preference data. Contrastive preference optimization has shown promising results in aligning LLMs with available preference data by optimizing the implicit reward…

Machine Learning · Computer Science 2024-12-20 Teng Xiao , Yige Yuan , Huaisheng Zhu , Mingxiao Li , Vasant G Honavar

Direct Preference Optimization (DPO) has emerged as a promising approach for aligning large language models with human preferences. While prior work mainly extends DPO from the aspect of the objective function, we instead improve DPO from…

Machine Learning · Computer Science 2026-02-17 Xun Deng , Han Zhong , Rui Ai , Fuli Feng , Zheng Wang , Xiangnan He

Test-time scaling has proven effective in further enhancing the performance of pretrained Large Language Models (LLMs). However, mainstream post-training methods (i.e., reinforcement learning (RL) with chain-of-thought (CoT) reasoning)…

Machine Learning · Computer Science 2025-08-19 Yuyang Xu , Yi Cheng , Haochao Ying , Zhuoyun Du , Renjun Hu , Xing Shi , Wei Lin , Jian Wu

Large language models (LLMs) have attracted significant attention in recommendation systems. Current work primarily applies supervised fine-tuning (SFT) to adapt the model for recommendation tasks. However, SFT on positive examples only…

Information Retrieval · Computer Science 2025-02-07 Chongming Gao , Ruijun Chen , Shuai Yuan , Kexin Huang , Yuanqing Yu , Xiangnan He

Neural retrieval models excel in Web search, but their training requires substantial amounts of labeled query-document pairs, which are costly to obtain. With the widespread availability of Web document collections like ClueWeb22, synthetic…

Information Retrieval · Computer Science 2025-05-27 João Coelho , Bruno Martins , João Magalhães , Chenyan Xiong

Conversational Recommender Systems (CRSs) aim to elicit user preferences via natural dialogue to provide suitable item recommendations. However, current CRSs often deviate from realistic human interactions by rapidly recommending items in…

Information Retrieval · Computer Science 2025-09-01 Manato Tajiri , Michimasa Inaba

Human preference alignment is critical in building powerful and reliable large language models (LLMs). However, current methods either ignore the multi-dimensionality of human preferences (e.g. helpfulness and harmlessness) or struggle with…

Machine Learning · Computer Science 2024-10-14 Xingzhou Lou , Junge Zhang , Jian Xie , Lifeng Liu , Dong Yan , Kaiqi Huang

Large language models (LLMs) have shown promising abilities as cost-effective and reference-free evaluators for assessing language generation quality. In particular, pairwise LLM evaluators, which compare two generated texts and determine…

Computation and Language · Computer Science 2024-10-15 Han Zhou , Xingchen Wan , Yinhong Liu , Nigel Collier , Ivan Vulić , Anna Korhonen

Direct Preference Optimization (DPO) has become a popular approach for aligning language models using pairwise preferences. However, in practical post-training pipelines, on-policy generation typically yields multiple candidate responses…

Machine Learning · Computer Science 2025-06-23 Taneesh Gupta , Rahul Madhavan , Xuchao Zhang , Nagarajan Natarajan , Chetan Bansal , Saravan Rajmohan

The ability of LLMs to represent diverse perspectives is critical as they increasingly impact society. However, recent studies reveal that alignment algorithms such as RLHF and DPO significantly reduce the diversity of LLM outputs. Not only…

Computation and Language · Computer Science 2025-11-13 Stewart Slocum , Asher Parker-Sartori , Dylan Hadfield-Menell

Human preference alignment is essential to improve the interaction quality of large language models (LLMs). Existing alignment methods depend on manually annotated preference data to guide the LLM optimization directions. However,…

Computation and Language · Computer Science 2024-06-04 Pengyu Cheng , Yifan Yang , Jian Li , Yong Dai , Tianhao Hu , Peixin Cao , Nan Du , Xiaolong Li

Recent developments in Direct Preference Optimization (DPO) allow large language models (LLMs) to function as implicit ranking models by maximizing the margin between preferred and non-preferred responses. In practice, user feedback on such…

Machine Learning · Computer Science 2025-09-09 Junda Wu , Rohan Surana , Zhouhang Xie , Yiran Shen , Yu Xia , Tong Yu , Ryan A. Rossi , Prithviraj Ammanabrolu , Julian McAuley

Recent advances in Emotional Support Conversation (ESC) have improved emotional support generation by fine-tuning Large Language Models (LLMs) via Supervised Fine-Tuning (SFT). However, common psychological errors still persist. While…

Computation and Language · Computer Science 2026-01-19 Chao Zhang , Xin Shi , Xueqiao Zhang , Yifan Zhu , Yi Yang , Yawei Luo