English
Related papers

Related papers: Leveraging Robust Optimization for LLM Alignment u…

200 papers

Reinforcement learning from human feedback (RLHF) has evolved to be one of the main methods for fine-tuning large language models (LLMs). However, existing RLHF methods are non-robust, and their performance deteriorates if the downstream…

Machine Learning · Computer Science 2025-03-04 Debmalya Mandal , Paulius Sasnauskas , Goran Radanovic

A key challenge in training Large Language Models (LLMs) is properly aligning them with human preferences. Reinforcement Learning with Human Feedback (RLHF) uses pairwise comparisons from human annotators to train reward functions and has…

Machine Learning · Computer Science 2025-01-17 Ariel D. Procaccia , Benjamin Schiffer , Shirley Zhang

This paper addresses the challenge of aligning large language models (LLMs) with diverse human preferences within federated learning (FL) environments, where standard methods often fail to adequately represent diverse viewpoints. We…

Computation and Language · Computer Science 2025-12-17 Mahmoud Srewa , Tianyu Zhao , Salma Elmalaki

Large language models (LLMs) have become integral to a wide range of applications worldwide, driving an unprecedented global demand for effective multilingual capabilities. Central to achieving robust multilingual performance is the…

Computation and Language · Computer Science 2025-09-22 Ping Guo , Yubing Ren , Binbin Liu , Fengze Liu , Haobin Lin , Yifan Zhang , Bingni Zhang , Taifeng Wang , Yin Zheng

Can modifying the training data distribution guide optimizers toward solutions with improved generalization when training large language models (LLMs)? In this work, we theoretically analyze an in-context linear regression model with…

Machine Learning · Computer Science 2026-02-03 Tushaar Gangavarapu , Jiping Li , Christopher Vattheuer , Zhangyang Wang , Baharan Mirzasoleiman

Inference-time alignment provides an efficient alternative for aligning LLMs with humans. However, these approaches still face challenges, such as limited scalability due to policy-specific value functions and latency during the inference…

Computation and Language · Computer Science 2025-05-27 Ruizhe Chen , Wenhao Chai , Zhifei Yang , Xiaotian Zhang , Joey Tianyi Zhou , Tony Quek , Soujanya Poria , Zuozhu Liu

Aligning Large Language Models (LLMs) with human preferences is crucial, but standard methods like Reinforcement Learning from Human Feedback (RLHF) are often complex and unstable. In this work, we propose a new, simpler approach that…

Machine Learning · Computer Science 2026-01-27 Saeed Najafi , Alona Fyshe

Preference-based feedback is important for many applications in machine learning where evaluation of a reward function is not feasible. Notable recent examples arise in preference alignment for large language models, including in…

In various work contexts, such as meeting scheduling, collaborating, and project planning, collective decision-making is essential but often challenging due to diverse individual preferences, varying work focuses, and power dynamics among…

Computation and Language · Computer Science 2025-08-13 Marios Papachristou , Longqi Yang , Chin-Chia Hsu

Language models (LMs) trained on vast quantities of text data can acquire sophisticated skills such as generating summaries, answering questions or generating code. However, they also manifest behaviors that violate human preferences, e.g.,…

Machine Learning · Computer Science 2024-04-19 Tomasz Korbak

Aligning large language models (LLMs) with human values is a vital task for LLM practitioners. Current alignment techniques have several limitations: (1) requiring a large amount of annotated data; (2) demanding heavy human involvement; (3)…

Computation and Language · Computer Science 2024-01-17 Hongyi Guo , Yuanshun Yao , Wei Shen , Jiaheng Wei , Xiaoying Zhang , Zhaoran Wang , Yang Liu

The dominating NLP paradigm of training a strong neural predictor to perform one task on a specific dataset has led to state-of-the-art performance in a variety of applications (eg. sentiment classification, span-prediction based question…

Computation and Language · Computer Science 2021-09-06 Paul Michel

While Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse natural language processing tasks, aligning these models with varying human preferences across multiple objectives remains a significant challenge…

Computation and Language · Computer Science 2025-11-17 Biao Liu , Ning Xu , Junming Yang , Xin Geng

Recent advances in Multi-modal Large Language Models (MLLMs), such as LLaVA-series models, are driven by massive machine-generated instruction-following data tuning. Such automatic instruction collection pipelines, however, inadvertently…

Artificial Intelligence · Computer Science 2025-12-05 Hongzhe Huang , Jiang Liu , Zhewen Yu , Li Cai , Dian Jiao , Wenqiao Zhang , Siliang Tang , Juncheng Li , Hao Jiang , Haoyuan Li , Yueting Zhuang

While recent advancements in aligning Large Language Models (LLMs) with recommendation tasks have shown great potential and promising performance overall, these aligned recommendation LLMs still face challenges in complex scenarios. This is…

Information Retrieval · Computer Science 2025-02-18 Yi Fang , Wenjie Wang , Yang Zhang , Fengbin Zhu , Qifan Wang , Fuli Feng , Xiangnan He

As large language models (LLMs) advance their capabilities, aligning these models with human preferences has become crucial. Preference optimization, which trains models to distinguish between preferred and non-preferred responses based on…

Machine Learning · Computer Science 2026-02-02 Shawn Im , Sharon Li

Pre-trained large-scale language models (LLMs) excel at producing coherent articles, yet their outputs may be untruthful, toxic, or fail to align with user expectations. Current approaches focus on using reinforcement learning with human…

Computation and Language · Computer Science 2024-06-06 Dehong Xu , Liang Qiu , Minseok Kim , Faisal Ladhak , Jaeyoung Do

Large language models (LLMs) are increasingly being used as decision aids. However, users have diverse values and preferences that can affect their decision-making, which requires novel methods for LLM alignment and personalization.…

Computation and Language · Computer Science 2025-07-15 Bharadwaj Ravichandran , David Joy , Paul Elliott , Brian Hu , Jadie Adams , Christopher Funk , Emily Veenhuis , Anthony Hoogs , Arslan Basharat

Personalizing large language models (LLMs) to accommodate diverse user preferences is essential for enhancing alignment and user satisfaction. Traditional reinforcement learning from human feedback (RLHF) approaches often rely on monolithic…

Machine Learning · Computer Science 2025-04-22 Avinandan Bose , Zhihan Xiong , Yuejie Chi , Simon Shaolei Du , Lin Xiao , Maryam Fazel

Large language models (LLMs) have achieved remarkable success, yet aligning their generations with human preferences remains a critical challenge. Existing approaches to preference modeling often rely on an explicit or implicit reward…

Computation and Language · Computer Science 2025-05-09 Zhuocheng Gong , Jian Guan , Wei Wu , Huishuai Zhang , Dongyan Zhao