English
Related papers

Related papers: Can LLMs Assess Personality? Validating Conversati…

200 papers

This study examines whether LLMs can simulate culturally grounded psychological patterns based on demographic information. Using DeepSeek, we generated 2943 virtual participants matched to demographic distributions from the CFPS2018 and…

Computers and Society · Computer Science 2025-10-01 Ke Luoma , Li Zengyi , Liao Jiangqun , Tong Song , Peng Kaiping

Large Language Models (LLMs) are widely used as conversational agents, exploiting their capabilities in various sectors such as education, law, medicine, and more. However, LLMs are often subjected to context-shifting behaviour, resulting…

Computation and Language · Computer Science 2025-02-18 Pranav Bhandari , Nicolas Fay , Michael Wise , Amitava Datta , Stephanie Meek , Usman Naseem , Mehwish Nasim

This paper introduces an innovative task focused on editing the personality traits of Large Language Models (LLMs). This task seeks to adjust the models' responses to opinion-related questions on specified topics since an individual's…

Computation and Language · Computer Science 2024-09-04 Shengyu Mao , Xiaohan Wang , Mengru Wang , Yong Jiang , Pengjun Xie , Fei Huang , Ningyu Zhang

This study proposes a novel methodology for generating personalized fake news debunking messages by prompting Large Language Models (LLMs) with persona-based inputs aligned to the Big Five personality traits: Extraversion, Agreeableness,…

Artificial Intelligence · Computer Science 2026-03-11 Pietro Dell'Oglio , Alessandro Bondielli , Francesco Marcelloni , Lucia C. Passaro

This research paper delves into the evolving landscape of fine-tuning large language models (LLMs) to align with human users, extending beyond basic alignment to propose "personality alignment" for language models in organizational…

Human-Computer Interaction · Computer Science 2023-12-07 Byunggu Yu , Junwhan Kim

Large Language Models (LLMs) have emerged as personalized assistants for users across a wide range of tasks -- from offering writing support to delivering tailored recommendations or consultations. Over time, the interaction history between…

Computation and Language · Computer Science 2025-10-28 Bowen Jiang , Zhuoqun Hao , Young-Min Cho , Bryan Li , Yuan Yuan , Sihao Chen , Lyle Ungar , Camillo J. Taylor , Dan Roth

This study investigates the efficacy of large language models (LLMs) as tools for grading master-level student essays. Utilizing a sample of 60 essays in political science, the study compares the accuracy of grades suggested by the GPT-4…

General Economics · Economics 2024-06-25 Magnus Lundgren

Motivational interviewing (MI) promotes behavioural change in substance use disorders. Its fidelity is measured using the Motivational Interviewing Treatment Integrity (MITI) framework. While large language models (LLMs) can potentially…

Computation and Language · Computer Science 2026-03-05 Aishwariya Jha , Prakrithi Shivaprakash , Lekhansh Shukla , Animesh Mukherjee , Prabhat Chand , Pratima Murthy

In computational cognitive modeling, capturing the full spectrum of human judgment and decision-making processes, beyond just optimal behaviors, is a significant challenge. This study explores whether Large Language Models (LLMs) can…

Artificial Intelligence · Computer Science 2025-02-24 Animesh Nighojkar , Bekhzodbek Moydinboyev , My Duong , John Licato

In this study, we delve into the validity of conventional personality questionnaires in capturing the human-like personality traits of Large Language Models (LLMs). Our objective is to assess the congruence between the personality traits…

Computation and Language · Computer Science 2024-12-11 Yiming Ai , Zhiwei He , Ziyin Zhang , Wenhong Zhu , Hongkun Hao , Kai Yu , Lingjun Chen , Rui Wang

This study investigates the efficacy of Large Language Models (LLMs) in interactive language therapy for high-functioning autistic adolescents. With the rapid advancement of artificial intelligence, particularly in natural language…

Human-Computer Interaction · Computer Science 2023-11-17 Yujin Cho , Mingeon Kim , Seojin Kim , Oyun Kwon , Ryan Donghan Kwon , Yoonha Lee , Dohyun Lim

People now regularly interface with Large Language Models (LLMs) via speech and text (e.g., Bard) interfaces. However, little is known about the relationship between how users anthropomorphize an LLM system (i.e., ascribe human-like…

Human-Computer Interaction · Computer Science 2024-05-13 Michelle Cohn , Mahima Pushkarna , Gbolahan O. Olanubi , Joseph M. Moran , Daniel Padgett , Zion Mengesha , Courtney Heldreth

Mixed methods research integrates quantitative and qualitative data but faces challenges in aligning their distinct structures, particularly in examining measurement characteristics and individual response patterns. Advances in large…

Computation and Language · Computer Science 2025-05-29 Jihong Zhang , Xinya Liang , Anqi Deng , Nicole Bonge , Lin Tan , Ling Zhang , Nicole Zarrett

Large Language Models (LLMs) are increasingly deployed in roles requiring nuanced psychological understanding, such as emotional support agents, counselors, and decision-making assistants. However, their ability to interpret human…

Computation and Language · Computer Science 2025-09-17 Jianfeng Zhu , Julina Maharjan , Xinyu Li , Karin G. Coifman , Ruoming Jin

The rapid development of large language models (LLMs) has necessitated the creation of benchmarks to evaluate their performance. These benchmarks resemble human tests and surveys, as they consist of sets of questions designed to measure…

Computation and Language · Computer Science 2025-01-30 Denis Federiakin

The versatility of Large Language Models (LLMs) on natural language understanding tasks has made them popular for research in social sciences. To properly understand the properties and innate personas of LLMs, researchers have performed…

Computation and Language · Computer Science 2024-04-03 Bangzhao Shu , Lechen Zhang , Minje Choi , Lavinia Dunagan , Lajanugen Logeswaran , Moontae Lee , Dallas Card , David Jurgens

In this article we explore the application of Large Language Models (LLMs) in assessing the content validity of psychometric instruments, focusing on the Big Five Questionnaire (BFQ) and Big Five Inventory (BFI). Content validity, a…

Human-Computer Interaction · Computer Science 2025-03-18 Nicola Milano , Michela Ponticorvo , Davide Marocco

We test the abilities of specialised deep neural networks like PersonalityMap as well as general LLMs like GPT-4o and Claude 3 Opus in understanding human personality. Specifically, we compare their ability to predict correlations between…

Computers and Society · Computer Science 2024-06-13 Philipp Schoenegger , Spencer Greenberg , Alexander Grishin , Joshua Lewis , Lucius Caviola

Human problem-solving is enriched by a diversity of styles and personality traits, yet the development of Large Language Models (LLMs) has largely prioritized uniform performance benchmarks that favour specific behavioural tendencies such…

Computation and Language · Computer Science 2026-03-09 Xi Wang , Mengdie Zhuang , Jiqun Liu

With the release of ChatGPT and other large language models (LLMs) the discussion about the intelligence, possibilities, and risks, of current and future models have seen large attention. This discussion included much debated scenarios…

Artificial Intelligence · Computer Science 2024-07-31 Nils Körber , Silvan Wehrli , Christopher Irrgang