English
Related papers

Related papers: Aligning LLMs with Individual Preferences via Inte…

200 papers

Sequential recommendation systems predict the next interaction item based on users' past interactions, aligning recommendations with individual preferences. Leveraging the strengths of Large Language Models (LLMs) in knowledge comprehension…

Information Retrieval · Computer Science 2025-01-22 Xiaoyu Kong , Jiancan Wu , An Zhang , Leheng Sheng , Hui Lin , Xiang Wang , Xiangnan He

This paper explores the advancements in making large language models (LLMs) more human-like. We focus on techniques that enhance natural language understanding, conversational coherence, and emotional intelligence in AI systems. The study…

Computation and Language · Computer Science 2026-02-03 Ethem Yağız Çalık , Talha Rüzgar Akkuş

The wide exploration of large language models (LLMs) raises the awareness of alignment between healthcare stakeholder preferences and model outputs. This alignment becomes a crucial foundation to empower the healthcare workflow effectively,…

Computers and Society · Computer Science 2025-05-07 Kexin Ding , Mu Zhou , Akshay Chaudhari , Shaoting Zhang , Dimitris N. Metaxas

This paper presents a system for diversity-aware autonomous conversation leveraging the capabilities of large language models (LLMs). The system adapts to diverse populations and individuals, considering factors like background,…

Robotics · Computer Science 2024-06-26 Lucrezia Grassi , Carmine Tommaso Recchiuto , Antonio Sgorbissa

Ensuring Large Language Models (LLMs) align with diverse human preferences while preserving privacy and fairness remains a challenge. Existing methods, such as Reinforcement Learning from Human Feedback (RLHF), rely on centralized data…

Machine Learning · Computer Science 2025-03-14 Mahmoud Srewa , Tianyu Zhao , Salma Elmalaki

Recent advances in large language models have highlighted their potential for personalized recommendation, where accurately capturing user preferences remains a key challenge. Leveraging their strong reasoning and generalization…

The advent of large language models (LLMs) has significantly advanced various fields, including natural language processing and automated dialogue systems. This paper explores the application of LLMs in psychological counseling, addressing…

Computation and Language · Computer Science 2024-06-21 Wenjie Li , Tianyu Sun , Kun Qian , Wenhong Wang

Aligning large language models (LLMs) to human preferences is a crucial step in building helpful and safe AI tools, which usually involve training on supervised datasets. Popular algorithms such as Direct Preference Optimization (DPO) rely…

Computation and Language · Computer Science 2025-06-05 Honggen Zhang , Xufeng Zhao , Igor Molybog , June Zhang

Aligning large language models (LLMs) with human preferences is essential for safe and useful LLMs. Previous works mainly adopt reinforcement learning (RLHF) and direct preference optimization (DPO) with human feedback for alignment.…

Computation and Language · Computer Science 2023-10-03 Tianci Xue , Ziqi Wang , Heng Ji

Alignment with human preference prevents large language models (LLMs) from generating misleading or toxic content while requiring high-cost human feedback. Assuming resources of human annotation are limited, there are two different ways of…

Computation and Language · Computer Science 2024-04-02 Feifan Song , Bowen Yu , Hao Lang , Haiyang Yu , Fei Huang , Houfeng Wang , Yongbin Li

Large language models (LLMs) are increasingly used to simulate human decision-making, but their intrinsic biases often diverge from real human behavior--limiting their ability to reflect population-level diversity. We address this challenge…

Computer Science and Game Theory · Computer Science 2025-08-27 Ayato Kitadai , Yusuke Fukasawa , Nariaki Nishino

Large Language Models (LLMs) are increasingly deployed in socially complex, interaction-driven tasks, yet their ability to mirror human behavior in emotionally and strategically complex contexts remains underexplored. This study assesses…

Computation and Language · Computer Science 2025-09-23 Deuksin Kwon , Kaleen Shrestha , Bin Han , Elena Hayoung Lee , Gale Lucas

Large Language Models (LLMs) are typically aligned with human values using preference data or predefined principles such as helpfulness, honesty, and harmlessness. However, as AI systems progress toward Artificial General Intelligence (AGI)…

Computation and Language · Computer Science 2025-12-08 Panatchakorn Anantaprayoon , Nataliia Babina , Jad Tarifi , Nima Asgharbeygi

Language models (LMs) trained on vast quantities of text data can acquire sophisticated skills such as generating summaries, answering questions or generating code. However, they also manifest behaviors that violate human preferences, e.g.,…

Machine Learning · Computer Science 2024-04-19 Tomasz Korbak

As Large Language Models (LLMs) evolve into lifelong AI assistants, LLM personalization has become a critical frontier. However, progress is currently bottlenecked by the absence of a gold-standard evaluation benchmark. Existing benchmarks…

Computation and Language · Computer Science 2026-05-12 Jianfei Xiao , Xiang Yu , Chengbing Wang , Wuqiang Zheng , Xinyu Lin , Kaining Liu , Hongxun Ding , Yang Zhang , Wenjie Wang , Fuli Feng , Xiangnan He

Search-augmented large language models (LLMs) have advanced information-seeking tasks by integrating retrieval into generation, reducing users' cognitive burden compared to traditional search systems. Yet they remain insufficient for fully…

Computation and Language · Computer Science 2026-05-27 Hyunseo Kim , Sangam Lee , Kwangwook Seo , Dongha Lee

Recent advancements in AI alignment techniques have significantly improved the alignment of large language models (LLMs) with static human preferences. However, the dynamic nature of human preferences can render some prior training data…

Machine Learning · Computer Science 2024-12-24 Han Zhang , Zhuo Zhang , Yi Zhang , Yuanzhao Zhai , Hanyang Peng , Yu Lei , Yue Yu , Hui Wang , Bin Liang , Lin Gui , Ruifeng Xu

In the rapidly evolving landscape of large language models (LLMs), most research has primarily viewed them as independent individuals, focusing on assessing their capabilities through standardized benchmarks and enhancing their general…

Human-Computer Interaction · Computer Science 2024-01-17 Jiayin Wang , Weizhi Ma , Peijie Sun , Min Zhang , Jian-Yun Nie

Humans shift between different personas depending on social context. Large Language Models (LLMs) demonstrate a similar flexibility in adopting different personas and behaviors. Existing approaches, however, typically adapt such behavior…

Computation and Language · Computer Science 2026-02-10 Ruimeng Ye , Zihan Wang , Zinan Ling , Yang Xiao , Manling Li , Xiaolong Ma , Bo Hui

While Reinforcement Learning from Human Feedback (RLHF) is widely used to align Large Language Models (LLMs) with human preferences, it typically assumes homogeneous preferences across users, overlooking diverse human values and minority…

Computation and Language · Computer Science 2025-10-28 Yijiang River Dong , Tiancheng Hu , Yinhong Liu , Ahmet Üstün , Nigel Collier