English
Related papers

Related papers: Aligning Language Models to User Opinions

200 papers

Large Language Models (LLMs) excel in handling general knowledge tasks, yet they struggle with user-specific personalization, such as understanding individual emotions, writing styles, and preferences. Personalized Large Language Models…

Artificial Intelligence · Computer Science 2025-09-23 Jiahong Liu , Zexuan Qiu , Zhongyang Li , Quanyu Dai , Wenhao Yu , Jieming Zhu , Minda Hu , Menglin Yang , Tat-Seng Chua , Irwin King

Accurately simulating human opinion dynamics is crucial for understanding a variety of societal phenomena, including polarization and the spread of misinformation. However, the agent-based models (ABMs) commonly used for such simulations…

Instruction tuning aligns the response of large language models (LLMs) with human preferences. Despite such efforts in human--LLM alignment, we find that instruction tuning does not always make LLMs human-like from a cognitive modeling…

Computation and Language · Computer Science 2024-04-16 Tatsuki Kuribayashi , Yohei Oseki , Timothy Baldwin

Large Language Models (LLMs) are increasingly used in decision-making scenarios that involve risk assessment, yet their alignment with human economic rationality remains unclear. In this study, we investigate whether LLMs exhibit risk…

General Economics · Economics 2025-09-16 Jiaxin Liu , Yixuan Tang , Yi Yang , Kar Yan Tam

We investigate Large Language Models' (LLMs) ability to predict a user's stance on a target given a collection of his/her target-agnostic social media posts (i.e., user-level stance prediction). While we show early evidence that LLMs are…

Computation and Language · Computer Science 2024-09-24 Siyuan Brandon Loh , Liang Ze Wong , Prasanta Bhattacharya , Joseph Simons , Wei Gao , Hong Zhang

Enhancing user engagement through interactions plays an essential role in socially-driven dialogues. While prior works have optimized models to reason over relevant knowledge or plan a dialogue act flow, the relationship between user…

Computation and Language · Computer Science 2025-06-27 Jiashuo Wang , Kaitao Song , Chunpu Xu , Changhe Song , Yang Xiao , Dongsheng Li , Lili Qiu , Wenjie Li

Human judgments are inherently subjective and are actively affected by personal traits such as gender and ethnicity. While Large Language Models (LLMs) are widely used to simulate human responses across diverse contexts, their ability to…

Computation and Language · Computer Science 2025-02-18 Huaman Sun , Jiaxin Pei , Minje Choi , David Jurgens

Being able to predict people's opinions on issues and behaviors in realistic scenarios can be helpful in various domains, such as politics and marketing. However, conducting large-scale surveys like the European Social Survey to solicit…

Computation and Language · Computer Science 2023-10-30 Dongjun Kang , Joonsuk Park , Yohan Jo , JinYeong Bak

The ongoing revolution in language modeling has led to various novel applications, some of which rely on the emerging social abilities of large language models (LLMs). Already, many turn to the new cyber friends for advice during the…

Computers and Society · Computer Science 2025-08-05 Ivan Zakazov , Mikolaj Boronski , Lorenzo Drudi , Robert West

When we read, we make predictions about upcoming words; these predictions influence our reading behavior. The success of large language models (LLMs), which, like humans, make predictions about upcoming words, has motivated their use as…

Computation and Language · Computer Science 2026-05-27 Byung-Doh Oh , Tal Linzen

Recent advances in Large Language Models (LLMs) highlight the need to align their behaviors with human values. A critical, yet understudied, issue is the potential divergence between an LLM's stated preferences (its reported alignment with…

Artificial Intelligence · Computer Science 2025-06-03 Zhuojun Gu , Quan Wang , Shuchu Han

A long-standing challenge in developing accurate recommendation models is simulating user behavior, mainly due to the complex and stochastic nature of user interactions. Towards this, one promising line of work has been the use of Large…

Information Retrieval · Computer Science 2025-09-15 Himanshu Thakur , Eshani Agrawal , Smruthi Mukund

Large Language Models (LLMs) acquire extensive knowledge and remarkable abilities from extensive text corpora, making them powerful tools for various applications. To make LLMs more usable, aligning them with human preferences is essential.…

Computation and Language · Computer Science 2024-10-21 Mozhi Zhang , Pengyu Wang , Chenkun Tan , Mianqiu Huang , Dong Zhang , Yaqian Zhou , Xipeng Qiu

While both agent interaction and personalisation are vibrant topics in research on large language models (LLMs), there has been limited focus on the effect of language interaction on the behaviour of persona-conditioned LLM agents. Such an…

Computation and Language · Computer Science 2024-02-06 Ivar Frisch , Mario Giulianelli

Large language models (LLMs) are supposed to acquire unconscious human knowledge and feelings, such as social common sense and biases, by training models from large amounts of text. However, it is not clear how much the sentiments of…

Computation and Language · Computer Science 2024-08-09 Kunitomo Tanaka , Ryohei Sasano , Koichi Takeda

We discuss how desirable it is that Large Language Models (LLMs) be able to adapt or align their language behavior with users who may be diverse in their language use. User diversity may come about among others due to i) age differences;…

Computation and Language · Computer Science 2025-02-19 Pia Knoeferle , Sebastian Möller , Dorothea Kolossa , Veronika Solopova , Georg Rehm

Large Language Models (LLMs) have demonstrated their capabilities across various tasks, from language translation to complex reasoning. Understanding and predicting human behavior and biases are crucial for artificial intelligence (AI)…

Artificial Intelligence · Computer Science 2024-08-06 Thuy Ngoc Nguyen , Kasturi Jamale , Cleotilde Gonzalez

Reasoning and predicting human opinions with large language models (LLMs) is essential yet challenging. Current methods employ role-playing with personae but face two major issues: LLMs are sensitive to even a single irrelevant persona,…

Computation and Language · Computer Science 2024-12-17 Do Xuan Long , Kenji Kawaguchi , Min-Yen Kan , Nancy F. Chen

Human groups are able to converge on more accurate beliefs through deliberation, even in the presence of polarization and partisan bias -- a phenomenon known as the "wisdom of partisan crowds." Generated agents powered by Large Language…

Computation and Language · Computer Science 2024-02-19 Yun-Shiuan Chuang , Siddharth Suresh , Nikunj Harlalka , Agam Goyal , Robert Hawkins , Sijia Yang , Dhavan Shah , Junjie Hu , Timothy T. Rogers

Effective engagement by large language models (LLMs) requires adapting responses to users' sociodemographic characteristics, such as age, occupation, and education level. While many real-world applications leverage dialogue history for…

Computation and Language · Computer Science 2025-05-28 Qishuai Zhong , Zongmin Li , Siqi Fan , Aixin Sun