English
Related papers

Related papers: DPRF: A Generalizable Dynamic Persona Refinement F…

200 papers

Personalized alignment is crucial for enabling Large Language Models (LLMs) to engage effectively in user-centric interactions. However, current methods face a dual challenge: they fail to infer users' deep implicit preferences (including…

Artificial Intelligence · Computer Science 2026-04-29 Peiming Li , Zhiyuan Hu , Yang Tang , Shiyu Li , Xi Chen

Many important behavior changes are frictionful; they require individuals to expend effort over a long period with little immediate gratification. Here, an artificial intelligence (AI) agent can provide personalized interventions to help…

Artificial Intelligence · Computer Science 2024-01-29 Eura Nofshin , Siddharth Swaroop , Weiwei Pan , Susan Murphy , Finale Doshi-Velez

The evolution of Large Language Models (LLMs) has introduced a new paradigm for investigating human behavior emulation. Recent research has employed LLM-based Agents to create a sociological research environment, in which agents exhibit…

Multiagent Systems · Computer Science 2024-01-08 Zihong He , Changwang Zhang

Large language models (LLMs) are recognized as systems that closely mimic aspects of human intelligence. This capability has attracted attention from the social science community, who see the potential in leveraging LLMs to replace human…

Computers and Society · Computer Science 2025-03-04 Qiuejie Xie , Qiming Feng , Tianqi Zhang , Qingqiu Li , Linyi Yang , Yuejie Zhang , Rui Feng , Liang He , Shang Gao , Yue Zhang

Ensuring persona fidelity in large language models (LLMs) is essential for maintaining coherent and engaging human-AI interactions. However, LLMs often exhibit Out-of-Character (OOC) behavior, where generated responses deviate from an…

Computation and Language · Computer Science 2025-06-25 Jisu Shin , Juhyun Oh , Eunsu Kim , Hoyun Song , Alice Oh

The standard Reinforcement Learning from Human Feedback (RLHF) framework primarily focuses on optimizing the performance of large language models using pre-collected prompts. However, collecting prompts that provide comprehensive coverage…

Computation and Language · Computer Science 2024-06-18 Rui Zheng , Hongyi Guo , Zhihan Liu , Xiaoying Zhang , Yuanshun Yao , Xiaojun Xu , Zhaoran Wang , Zhiheng Xi , Tao Gui , Qi Zhang , Xuanjing Huang , Hang Li , Yang Liu

As language models continue to scale in size and capability, they display an array of emerging behaviors, both beneficial and concerning. This heightens the need to control model behaviors. We hope to be able to control the personality…

Computation and Language · Computer Science 2024-02-16 Yixuan Weng , Shizhu He , Kang Liu , Shengping Liu , Jun Zhao

Generalizable alignment is a core challenge for deploying Large Language Models (LLMs) safely in real-world NLP applications. Current alignment methods, including Reinforcement Learning from Human Feedback (RLHF), often fail to guarantee…

Computation and Language · Computer Science 2025-04-07 Jaymari Chua , Chen Wang , Lina Yao

Reinforcement Learning from Human Feedback (RLHF) has emerged as a important paradigm for aligning large language models (LLMs) with human preferences during post-training. This framework typically involves two stages: first, training a…

Machine Learning · Computer Science 2025-04-08 Wenyuan Xu , Xiaochen Zuo , Chao Xin , Yu Yue , Lin Yan , Yonghui Wu

Text-based person retrieval aims to identify the specific persons using textual descriptions as queries. Existing ad vanced methods typically depend on vision-language pre trained (VLP) models to facilitate effective cross-modal alignment.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Bin Kang , Bin Chen , Junjie Wang , Yong Xu

Large language models (LLMs) are increasingly used to simulate human behavior in experimental settings, but they systematically diverge from human decisions in complex decision-making environments, where participants must anticipate others'…

Artificial Intelligence · Computer Science 2026-01-06 Letian Kong , Qianran , Jin , Renyu Zhang

Large language models (LLMs) have shown significant potential for robotics applications, particularly task planning, by harnessing their language comprehension and text generation capabilities. However, in applications such as household…

Robotics · Computer Science 2024-12-31 Dongge Han , Trevor McInroe , Adam Jelley , Stefano V. Albrecht , Peter Bell , Amos Storkey

Alignment of Large Language Models (LLMs) aims to align outputs with human preferences, and personalized alignment further adapts models to individual users. This relies on personalized reward models that capture user-specific preferences…

Computation and Language · Computer Science 2026-04-21 Hongru Cai , Yongqi Li , Tiezheng Yu , Fengbin Zhu , Wenjie Wang , Fuli Feng , Wenjie Li

Current RLHF methods such as PPO and DPO typically reduce human preferences to binary labels, which are costly to obtain and too coarse to reflect individual variation. We observe that expressions of satisfaction and dissatisfaction follow…

Computation and Language · Computer Science 2025-10-28 YuXuan Zhang

Aligning large language models (LLMs) with human preferences is critical to recent advances in generative artificial intelligence. Reinforcement learning from human feedback (RLHF) is widely applied to achieve this objective. A key step in…

Machine Learning · Statistics 2025-01-03 Pangpang Liu , Chengchun Shi , Will Wei Sun

Large language models for subjectivity analysis are typically trained with aggregated labels, which compress variations in human judgment into a single supervision signal. This paradigm overlooks the intrinsic uncertainty of low-agreement…

Computation and Language · Computer Science 2026-05-14 Junyu Lu , Deyi Ji , Xuanyi Liu , Lanyun Zhu , Bo Xu , Liang Yang , Xian-Sheng Hua , Hongfei Lin

Role-Playing Agent (RPA) is an increasingly popular type of LLM Agent that simulates human-like behaviors in a variety of tasks. However, evaluating RPAs is challenging due to diverse task requirements and agent designs. This paper proposes…

Human-Computer Interaction · Computer Science 2025-03-28 Chaoran Chen , Bingsheng Yao , Ruishi Zou , Wenyue Hua , Weimin Lyu , Yanfang Ye , Toby Jia-Jun Li , Dakuo Wang

With the widespread adoption of large language models (LLMs), understanding their personality representation mechanisms has become critical. As a novel paradigm in Personality Editing, most existing methods employ neuron-editing to locate…

Computation and Language · Computer Science 2026-05-01 Lifan Zheng , Xue Yang , Jiawei Chen , Chenyan Wu , Jingyuan Zhang , Fanheng Kong , Xinyi Zeng , Xiang Chen , Yu Tian

While recent advancements in aligning Large Language Models (LLMs) with recommendation tasks have shown great potential and promising performance overall, these aligned recommendation LLMs still face challenges in complex scenarios. This is…

Information Retrieval · Computer Science 2025-02-18 Yi Fang , Wenjie Wang , Yang Zhang , Fengbin Zhu , Qifan Wang , Fuli Feng , Xiangnan He

Large language models (LLMs) are fine-tuned using human comparison data with Reinforcement Learning from Human Feedback (RLHF) methods to make them better aligned with users' preferences. In contrast to LLMs, human preference learning has…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Bram Wallace , Meihua Dang , Rafael Rafailov , Linqi Zhou , Aaron Lou , Senthil Purushwalkam , Stefano Ermon , Caiming Xiong , Shafiq Joty , Nikhil Naik