English
Related papers

Related papers: ValueSim: Generating Backstories to Model Individu…

200 papers

AI agents are commonly aligned with "human values" through reinforcement learning from human feedback (RLHF), where a single reward model is learned from aggregated human feedback and used to align an agent's behavior. However, human values…

Artificial Intelligence · Computer Science 2025-06-24 Carter Blair , Kate Larson , Edith Law

A long-standing challenge in developing accurate recommendation models is simulating user behavior, mainly due to the complex and stochastic nature of user interactions. Towards this, one promising line of work has been the use of Large…

Information Retrieval · Computer Science 2025-09-15 Himanshu Thakur , Eshani Agrawal , Smruthi Mukund

Stories about overcoming personal struggles can effectively illustrate the application of psychological theories in real life, yet they may fail to resonate with individuals' experiences. In this work, we employ large language models (LLMs)…

The advancement of large language models (LLMs) has outpaced traditional evaluation methodologies. This progress presents novel challenges, such as measuring human-like psychological constructs, moving beyond static and task-specific…

Computation and Language · Computer Science 2026-03-12 Haoran Ye , Jing Jin , Yuhang Xie , Xin Zhang , Guojie Song

Designing effective reward functions remains a fundamental challenge in reinforcement learning (RL), as it often requires extensive human effort and domain expertise. While RL from human feedback has been successful in aligning agents with…

Machine Learning · Computer Science 2025-06-17 Tung Minh Luu , Younghwan Lee , Donghoon Lee , Sunho Kim , Min Jun Kim , Chang D. Yoo

Recent advancements in explainable recommendation have greatly bolstered user experience by elucidating the decision-making rationale. However, the existing methods actually fail to provide effective feedback signals for potentially better…

Information Retrieval · Computer Science 2025-08-08 Jiakai Tang , Jingsen Zhang , Zihang Tian , Xueyang Feng , Lei Wang , Xu Chen

While integrating external tools into large language models (LLMs) enhances their ability to access real-time information and domain-specific services, existing approaches focus narrowly on functional tool selection following user…

Computation and Language · Computer Science 2025-05-23 Zihao Cheng , Hongru Wang , Zeming Liu , Yuhang Guo , Yuanfang Guo , Yunhong Wang , Haifeng Wang

The rapid rise of Large Language Models (LLMs) has created new disruptive possibilities for persuasive communication, enabling fully-automated, personalized, and interactive content generation at an unprecedented scale. In this paper, we…

Computation and Language · Computer Science 2026-04-22 Sander Noels , Alexander Rogiers , Maarten Buyl , Tijl De Bie

Simulating human profiles by instilling personas into large language models (LLMs) is rapidly transforming research in agentic behavioral simulation, LLM personalization, and human-AI alignment. However, most existing synthetic personas…

Artificial Intelligence · Computer Science 2025-12-02 Zhen Wang , Yufan Zhou , Zhongyan Luo , Lyumanshan Ye , Adam Wood , Man Yao , Saab Mansour , Luoshang Pan

Pluralistic alignment has emerged as a critical frontier in the development of Large Language Models (LLMs), with reward models (RMs) serving as a central mechanism for capturing diverse human values. While benchmarks for general response…

Computation and Language · Computer Science 2026-04-09 Qiyao Ma , Dechen Gao , Rui Cai , Boqi Zhao , Hanchu Zhou , Junshan Zhang , Zhe Zhao

The recent success of large language models (LLMs) has shown great potential to develop more powerful conversational recommender systems (CRSs), which rely on natural language conversations to satisfy user needs. In this paper, we embark on…

Computation and Language · Computer Science 2024-06-21 Xiaolei Wang , Xinyu Tang , Wayne Xin Zhao , Jingyuan Wang , Ji-Rong Wen

Developing effective text summarizers remains a challenge due to issues like hallucinations, key information omissions, and verbosity in LLM-generated summaries. This work explores using LLM-generated feedback to improve summary quality by…

Computation and Language · Computer Science 2025-01-28 Hwanjun Song , Taewon Yun , Yuho Lee , Jihwan Oh , Gihun Lee , Jason Cai , Hang Su

Automatic grading of subjective questions remains a significant challenge in examination assessment due to the diversity in question formats and the open-ended nature of student responses. Existing works primarily focus on a specific type…

Computation and Language · Computer Science 2025-10-10 Fanwei Zhua , Jiaxuan He , Xiaoxiao Chen , Zulong Chen , Quan Lu , Chenrui Mei

Personalized retrieval-augmented generation (RAG) aims to produce user-tailored responses by incorporating retrieved user profiles alongside the input query. Existing methods primarily focus on improving retrieval and rely on large language…

Information Retrieval · Computer Science 2025-08-12 Kepu Zhang , Teng Shi , Weijie Yu , Jun Xu

While black-box large language models are widely deployed, they produce generic outputs that overlook individual user preferences. Current personalization methods are fundamentally limited to response-level personalization; they only match…

Computation and Language · Computer Science 2026-03-03 Jieyong Kim , Tongyoung Kim , Soojin Yoon , Jaehyung Kim , Dongha Lee

Driven by the demand for personalized AI systems, there is growing interest in aligning the behavior of large language models (LLMs) with human traits such as personality. Previous attempts to induce personality in LLMs have shown promising…

Computation and Language · Computer Science 2025-09-25 Seungjong Sun , Seo Yeon Baek , Jang Hyun Kim

Large Language Models (LLMs) have demonstrated exceptional capabilities in solving various tasks, progressively evolving into general-purpose assistants. The increasing integration of LLMs into society has sparked interest in whether they…

Computation and Language · Computer Science 2025-10-20 Yuan Li , Yue Huang , Hongyi Wang , Ying Cheng , Xiangliang Zhang , James Zou , Lichao Sun

While Large Language Models (LLMs) achieve near-human performance on standard benchmarks, their capabilities often fail to generalize to complex, real-world problems. To bridge this gap, we introduce DeepQuestion, a scalable, automated…

Computation and Language · Computer Science 2026-03-02 Ali Khoramfar , Ali Ramezani , Mohammad Mahdi Mohajeri , Mohammad Javad Dousti , Majid Nili Ahmadabadi , Heshaam Faili

User simulation is increasingly vital to develop and evaluate recommender systems (RSs). While Large Language Models (LLMs) offer promising avenues to simulate user behavior, they often struggle with the absence of specific task alignment…

Human-Computer Interaction · Computer Science 2026-04-20 Tianjun Wei , Huizhong Guo , Yingpeng Du , Zhu Sun , Huang Chen , Dongxia Wang , Jie Zhang

Table processing, a key task in natural language processing, has significantly benefited from recent advancements in language models (LMs). However, the capabilities of LMs in table-to-text generation, which transforms structured data into…

Computation and Language · Computer Science 2024-10-18 Sahar Iravani , Tim . O . F Conrad