English
Related papers

Related papers: Alignment with Preference Optimization Is All You …

200 papers

Post-training alignment of large language models (LLMs) is a critical challenge, as not all tokens contribute equally to model performance. This paper introduces a selective alignment strategy that prioritizes high-impact tokens within…

Computation and Language · Computer Science 2025-07-11 Zhijin Dong

Preference-based alignment like Reinforcement Learning from Human Feedback (RLHF) learns from pairwise preferences, yet the labels are often noisy and inconsistent. Existing uncertainty-aware approaches weight preferences, but ignore a more…

Machine Learning · Computer Science 2026-01-27 Tiejin Chen , Xiaoou Liu , Vishnu Nandam , Kuan-Ru Liou , Hua Wei

Large language models (LLMs) have emerged as powerful tools for addressing a wide range of general inquiries and tasks. Despite this, fine-tuning aligned LLMs on smaller, domain-specific datasets, critical to adapting them to specialized…

Artificial Intelligence · Computer Science 2025-02-04 Guanlin Li , Kangjie Chen , Shangwei Guo , Jie Zhang , Han Qiu , Chao Zhang , Guoyin Wang , Tianwei Zhang , Jiwei Li

Large language models (LLMs) require careful alignment to balance competing objectives - factuality, safety, conciseness, proactivity, and diversity. Existing studies focus on individual techniques or specific dimensions, lacking a holistic…

Machine Learning · Computer Science 2025-09-17 Denis Janiak , Julia Moska , Dawid Motyka , Karolina Seweryn , Paweł Walkowiak , Bartosz Żuk , Arkadiusz Janz

Large language models (LLMs) demonstrate impressive performance but lack the flexibility to adapt to human preferences quickly without retraining. In this work, we introduce Test-time Preference Optimization (TPO), a framework that aligns…

Computation and Language · Computer Science 2025-01-23 Yafu Li , Xuyang Hu , Xiaoye Qu , Linjie Li , Yu Cheng

The success of the reward model in distinguishing between responses with subtle safety differences depends critically on the high-quality preference dataset, which should capture the fine-grained nuances of harmful and harmless responses.…

Computation and Language · Computer Science 2024-12-19 Duanyu Feng , Bowen Qin , Chen Huang , Youcheng Huang , Zheng Zhang , Wenqiang Lei

The widespread application of large language models (LLMs) raises increasing demands on ensuring safety or imposing constraints, such as reducing harmful content and adhering to predefined rules. While there have been several works studying…

Machine Learning · Computer Science 2026-02-13 Yihan Du , Seo Taek Kong , R. Srikant

Safety post-training can improve the harmfulness and policy compliance of Large Language Models (LLMs), but it may also reduce general utility, a phenomenon often described as the \emph{alignment tax}. We study this trade-off through the…

Machine Learning · Computer Science 2026-05-13 Guanglong Sun , Siyuan Zhang , Liyuan Wang , Jun Zhu , Hang Su , Yi Zhong

Alignment in artificial intelligence pursues the consistency between model responses and human preferences as well as values. In practice, the multifaceted nature of human preferences inadvertently introduces what is known as the "alignment…

Computation and Language · Computer Science 2024-10-14 Yiju Guo , Ganqu Cui , Lifan Yuan , Ning Ding , Zexu Sun , Bowen Sun , Huimin Chen , Ruobing Xie , Jie Zhou , Yankai Lin , Zhiyuan Liu , Maosong Sun

Recent studies on the safety alignment of large language models (LLMs) have revealed that existing approaches often operate superficially, leaving models vulnerable to various adversarial attacks. Despite their significance, these studies…

Cryptography and Security · Computer Science 2025-06-02 Jianwei Li , Jung-Eun Kim

While reasoning models have achieved remarkable success in complex reasoning tasks, their increasing power necessitates stringent safety measures. For safety alignment, the core challenge lies in the inherent trade-off between safety and…

Cryptography and Security · Computer Science 2026-02-17 Yanbo Wang , Minzheng Wang , Jian Liang , Lu Wang , Yongcan Yu , Ran He

Although humans inherently have diverse values, current large language model (LLM) alignment methods often assume that aligning LLMs with the general public's preferences is optimal. A major challenge in adopting a more individualized…

Computation and Language · Computer Science 2024-11-06 Seongyun Lee , Sue Hyun Park , Seungone Kim , Minjoon Seo

As large language models (LLMs) are deployed in high-stakes domains like healthcare, understanding how well their decision-making aligns with human preferences and values becomes crucial, especially when we recognize that there is no single…

Computation and Language · Computer Science 2024-10-01 Isaac Kohane

Large language models (LLMs) have achieved remarkable success across many applications, but their ability to generate harmful content raises serious safety concerns. Although safety alignment techniques are often applied during pre-training…

Machine Learning · Computer Science 2026-04-24 Chengcan Wu , Zhixin Zhang , Zeming Wei , Yihao Zhang , Xiaokun Luan , Meng Sun

Fine-tuning on task-specific data to boost downstream performance is a crucial step for leveraging Large Language Models (LLMs). However, previous studies have demonstrated that fine-tuning the models on several adversarial samples or even…

Machine Learning · Computer Science 2024-10-14 Han Shen , Pin-Yu Chen , Payel Das , Tianyi Chen

Large language models (LLMs) have become increasingly central to AI applications worldwide, necessitating robust multilingual safety alignment to ensure secure deployment across diverse linguistic contexts. Existing preference learning…

Computation and Language · Computer Science 2025-05-23 Weixiang Zhao , Yulin Hu , Yang Deng , Tongtong Wu , Wenxuan Zhang , Jiahe Guo , An Zhang , Yanyan Zhao , Bing Qin , Tat-Seng Chua , Ting Liu

Fine-tuning large language models (LLMs) for downstream tasks often leads to catastrophic forgetting, notably degrading the safety of originally aligned models. While some existing methods attempt to restore safety by incorporating…

Computation and Language · Computer Science 2025-08-29 Hua Farn , Hsuan Su , Shachi H Kumar , Saurav Sahay , Shang-Tse Chen , Hung-yi Lee

Current adversarial robustness methods for large language models require extensive datasets of harmful prompts (thousands to hundreds of thousands of examples), yet remain vulnerable to novel attack vectors and distributional shifts. We…

Artificial Intelligence · Computer Science 2026-05-12 Linh Le , David Williams-King , Mohamed Amine Merzouk , Aton Kamanda , Adam Oberman

Recent advancements in large language models (LLMs) have accelerated progress toward artificial general intelligence, yet their potential to generate harmful content poses critical safety challenges. Existing alignment methods often…

Computation and Language · Computer Science 2025-10-08 Kehua Feng , Keyan Ding , Yuhao Wang , Menghan Li , Fanjunduo Wei , Xinda Wang , Qiang Zhang , Huajun Chen

Large Language Models (LLMs) are increasingly integrated into high-stakes applications, making robust safety guarantees a central practical and commercial concern. Existing safety evaluations predominantly rely on fixed collections of…

Computation and Language · Computer Science 2026-03-23 Zafir Shamsi , Nikhil Chekuru , Zachary Guzman , Shivank Garg