English
Related papers

Related papers: DPRF: A Generalizable Dynamic Persona Refinement F…

200 papers

Deep Research agents driven by LLMs have automated the scholarly discovery pipeline, from planning and query formulation to iterative web exploration. Yet they remain constrained by a static, ``one-size-fits-all'' retrieval paradigm.…

Information Retrieval · Computer Science 2026-05-12 Xiaopeng Li , Wenlin Zhang , Yingyi Zhang , Pengyue Jia , Yejing Wang , Yichao Wang , Yong Liu , Huifeng Guo , Xiangyu Zhao

Large Language Models (LLMs) struggle with generating reliable outputs due to outdated knowledge and hallucinations. Retrieval-Augmented Generation (RAG) models address this by enhancing LLMs with external knowledge, but often fail to…

Information Retrieval · Computer Science 2026-01-16 Saber Zerhoudi , Michael Granitzer

While large language models (LLMs) afford new possibilities for user modeling and approximation of human behaviors, they often fail to capture the multidimensional nuances of individual users. In this work, we introduce PersonaTwin, a…

Computation and Language · Computer Science 2025-08-18 Sihan Chen , John P. Lalor , Yi Yang , Ahmed Abbasi

While Reinforcement Learning from Human Feedback (RLHF) is widely used to align Large Language Models (LLMs) with human preferences, it typically assumes homogeneous preferences across users, overlooking diverse human values and minority…

Computation and Language · Computer Science 2025-10-28 Yijiang River Dong , Tiancheng Hu , Yinhong Liu , Ahmet Üstün , Nigel Collier

Model alignment with human preferences is an essential step in making Large Language Models (LLMs) helpful and consistent with human values. It typically consists of supervised fine-tuning (SFT) and reinforcement learning from human…

Computation and Language · Computer Science 2023-10-10 Yi Dong , Zhilin Wang , Makesh Narsimhan Sreedhar , Xianchao Wu , Oleksii Kuchaiev

This paper delves into the dynamic landscape of artificial intelligence, specifically focusing on the burgeoning prominence of large language models (LLMs). We underscore the pivotal role of Reinforcement Learning from Human Feedback (RLHF)…

Computers and Society · Computer Science 2024-03-18 Dana Alsagheer , Rabimba Karanjai , Nour Diallo , Weidong Shi , Yang Lu , Suha Beydoun , Qiaoning Zhang

In this paper, we introduce \emph{refined Direct Preference Optimization} (rDPO), a method for improving the behavioral alignment of Large Language Models (LLMs) without the need for human-annotated data. The method involves creating…

Computation and Language · Computer Science 2024-02-14 Víctor Gallego

AI alignment in the shape of Reinforcement Learning from Human Feedback (RLHF) is increasingly treated as a crucial ingredient for high performance large language models. Proximal Policy Optimization (PPO) has been positioned by recent…

Aligning large language models (LLMs) with human preferences is crucial for enhancing their utility in terms of helpfulness, truthfulness, safety, harmlessness, and interestingness. Existing methods for achieving this alignment often…

Computation and Language · Computer Science 2024-07-04 Wenhao Liu , Xiaohua Wang , Muling Wu , Tianlong Li , Changze Lv , Zixuan Ling , Jianhao Zhu , Cenyuan Zhang , Xiaoqing Zheng , Xuanjing Huang

As users increasingly expect LLMs to align with their preferences, personalized information becomes valuable. However, personalized information can be a double-edged sword: it can improve interaction but may compromise objectivity and…

Artificial Intelligence · Computer Science 2026-05-19 Xiaoyou Liu , Xinyi Mou , Shengbin Yue , Liang Wang , Yuqing Wang , Qiexiang Wang , Tianrui Qin , Zhongyu Wei

Creating human-like large language model (LLM) agents is crucial for faithful social simulation. Having LLMs role-play based on demographic information sometimes improves human likeness but often does not. This study assessed whether LLM…

Computation and Language · Computer Science 2024-10-17 Yun-Shiuan Chuang , Krirk Nirunwiroj , Zach Studdiford , Agam Goyal , Vincent V. Frigo , Sijia Yang , Dhavan Shah , Junjie Hu , Timothy T. Rogers

The rapid advancement of language models (LMs) necessitates robust alignment with diverse user values. However, current preference optimization approaches often fail to capture the plurality of user opinions, instead reinforcing majority…

Computation and Language · Computer Science 2024-07-25 Louis Castricato , Nathan Lile , Rafael Rafailov , Jan-Philipp Fränken , Chelsea Finn

Large language models (LLMs) are increasingly used to simulate human decision-making, but their intrinsic biases often diverge from real human behavior--limiting their ability to reflect population-level diversity. We address this challenge…

Computer Science and Game Theory · Computer Science 2025-08-27 Ayato Kitadai , Yusuke Fukasawa , Nariaki Nishino

Predicting human decision-making in high-stakes environments remains a central challenge for artificial intelligence. While large language models (LLMs) demonstrate strong general reasoning, they often struggle to generate consistent,…

Artificial Intelligence · Computer Science 2026-02-20 Ben Yellin , Ehud Ezra , Mark Foreman , Shula Grinapol

Recent advancements in Large Language Models (LLMs) demonstrate remarkable capabilities across various fields. These developments have led to more direct communication between humans and LLMs in various situations, such as social…

Computation and Language · Computer Science 2025-09-12 Yixuan Tang , Yi Yang , Ahmed Abbasi

Positioned between pre-training and user deployment, aligning large language models (LLMs) through reinforcement learning (RL) has emerged as a prevailing strategy for training instruction following-models such as ChatGPT. In this work, we…

Machine Learning · Computer Science 2024-05-06 Fan Wu , Huseyin A. Inan , Arturs Backurs , Varun Chandrasekaran , Janardhan Kulkarni , Robert Sim

Large Language Models (LLMs) have demonstrated remarkable capabilities in reasoning and generation, serving as the foundation for advanced persona simulation and Role-Playing Language Agents (RPLAs). However, achieving authentic alignment…

Computation and Language · Computer Science 2026-04-20 Xintao Wang , Jian Yang , Weiyuan Li , Rui Xie , Jen-tse Huang , Jun Gao , Shuai Huang , Yueping Kang , Yuanli Gou , Hongwei Feng , Yanghua Xiao

As we consider entrusting Large Language Models (LLMs) with key societal and decision-making roles, measuring their alignment with human cognition becomes critical. This requires methods that can assess how these systems represent…

Artificial Intelligence · Computer Science 2025-10-03 Mattson Ogg , Ritwik Bose , Jamie Scharf , Christopher Ratto , Michael Wolmetz

Large language models (LLMs) exhibit human-like intelligence, enabling them to simulate human behavior and support various applications that require both humanized communication and extensive knowledge reserves. Efforts are made to…

Computation and Language · Computer Science 2025-05-16 Zheni Zeng , Jiayi Chen , Huimin Chen , Yukun Yan , Yuxuan Chen , Zhenghao Liu , Zhiyuan Liu , Maosong Sun

Imbuing Large Language Models (LLMs) with specific personas is prevalent for tailoring interaction styles, yet the impact on underlying cognitive capabilities remains unexplored. We employ the Neuron-based Personality Trait Induction (NPTI)…

Computation and Language · Computer Science 2026-05-13 Jiaqi Chen , Ming Wang , Tingna Xie , Shi Feng , Yongkang Liu