English
Related papers

Related papers: Evaluating LLM Alignment on Personality Inference …

200 papers

As Large Language Models (LLMs) continue to gain popularity due to their human-like traits and the intimacy they offer to users, their societal impact inevitably expands. This leads to the rising necessity for comprehensive studies to fully…

Artificial Intelligence · Computer Science 2025-01-07 Bojana Bodroza , Bojana M. Dinic , Ljubisa Bojic

People have long hoped for a conversational system that can assist in real-life situations, and recent progress on large language models (LLMs) is bringing this idea closer to reality. While LLMs are often impressive in performance, their…

Computation and Language · Computer Science 2025-02-06 Linkai Peng , Baorian Nuchged , Yingming Gao

Serendipity plays a pivotal role in enhancing user satisfaction within recommender systems, yet its evaluation poses significant challenges due to its inherently subjective nature and conceptual ambiguity. Current algorithmic approaches…

Information Retrieval · Computer Science 2025-07-24 Li Kang , Yuhan Zhao , Li Chen

The ability to translate diverse patterns of inputs into structured patterns of behavior has been thought to rest on both humans' and machines' ability to learn robust representations of relevant concepts. The rapid advancement of…

Artificial Intelligence · Computer Science 2025-10-02 Zach Studdiford , Timothy T. Rogers , Kushin Mukherjee , Siddharth Suresh

As a specific domain of subjective well-being, travel satisfaction has recently attracted much research attention. Previous studies primarily relied on statistical models and, more recently, machine learning models to explore its…

Computers and Society · Computer Science 2025-11-10 Pengfei Xu , Donggen Wang

The advent of large language models (LLMs) has revolutionized natural language processing, enabling the generation of coherent and contextually relevant human-like text. As LLMs increasingly powerconversational agents used by the general…

Large Language Models (LLMs) are increasingly deployed in socially complex, interaction-driven tasks, yet their ability to mirror human behavior in emotionally and strategically complex contexts remains underexplored. This study assesses…

Computation and Language · Computer Science 2025-09-23 Deuksin Kwon , Kaleen Shrestha , Bin Han , Elena Hayoung Lee , Gale Lucas

Large Language Models (LLMs) trained on extensive textual corpora have emerged as leading solutions for a broad array of Natural Language Processing (NLP) tasks. Despite their notable performance, these models are prone to certain…

Computation and Language · Computer Science 2023-07-25 Yufei Wang , Wanjun Zhong , Liangyou Li , Fei Mi , Xingshan Zeng , Wenyong Huang , Lifeng Shang , Xin Jiang , Qun Liu

Large Language Models (LLMs) have demonstrated remarkable abilities in text comprehension and logical reasoning, indicating that the text representations learned by LLMs can facilitate their language processing capabilities. In…

Artificial Intelligence · Computer Science 2025-01-16 Yuqi Ren , Renren Jin , Tongxuan Zhang , Deyi Xiong

Large Language Models (LLMs) have demonstrated impressive capabilities in generating coherent text but often struggle with grounding language and strategic dialogue. To address this gap, we focus on journalistic interviews, a domain rich in…

Computation and Language · Computer Science 2026-02-13 Alexander Spangher , Michael Lu , Sriya Jeslyn Kalyan , Hyundong Justin Cho , Weiyan Shi , Jonathan May

Large Language Model (LLM) personas with explicit specifications of attributes, background, and behavioural tendencies are increasingly used to simulate human conversations for tasks such as user modeling, social reasoning, and behavioural…

Computation and Language · Computer Science 2026-03-04 Eliseo Bao , Anxo Perez , Xi Wang , Javier Parapar

Large Language Models (LLMs) have emerged as personalized assistants for users across a wide range of tasks -- from offering writing support to delivering tailored recommendations or consultations. Over time, the interaction history between…

Computation and Language · Computer Science 2025-10-28 Bowen Jiang , Zhuoqun Hao , Young-Min Cho , Bryan Li , Yuan Yuan , Sihao Chen , Lyle Ungar , Camillo J. Taylor , Dan Roth

Accurate assessment of personality traits is crucial for effective psycho-counseling, yet traditional methods like self-report questionnaires are time-consuming and biased. This study exams whether Large Language Models (LLMs) can predict…

Computation and Language · Computer Science 2024-06-26 Yang Yan , Lizhi Ma , Anqi Li , Jingsong Ma , Zhenzhong Lan

What if large language models could not only infer human mindsets but also expose every blind spot in team dialogue such as discrepancies in the team members' joint understanding? We present a novel, two-step framework that leverages large…

Computation and Language · Computer Science 2025-09-03 Katharine Kowalyshyn , Matthias Scheutz

As the use of Large Language Models (LLMs) becomes more widespread, understanding their self-evaluation of confidence in generated responses becomes increasingly important as it is integral to the reliability of the output of these models.…

Computation and Language · Computer Science 2024-06-18 Abhishek Kumar , Robert Morabito , Sanzhar Umbet , Jad Kabbara , Ali Emami

Large language models (LLMs) increasingly reach real-world applications, necessitating a better understanding of their behaviour. Their size and complexity complicate traditional assessment methods, causing the emergence of alternative…

Artificial Intelligence · Computer Science 2025-05-13 Sanne Peereboom , Inga Schwabe , Bennett Kleinberg

The study explores whether current Large Language Models (LLMs) exhibit Theory of Mind (ToM) capabilities -- specifically, the ability to infer others' beliefs, intentions, and emotions from text. Given that LLMs are trained on language…

Computation and Language · Computer Science 2026-03-20 Anna Babarczy , Andras Lukacs , Peter Vedres , Zeteny Bujka

Due to their architecture and vast pre-training data, large language models (LLMs) demonstrate strong text classification performance. However, LLM output - here, the category assigned to a text - depends heavily on the wording of the…

Computation and Language · Computer Science 2025-12-04 Kylie L. Anglin , Stephanie Milan , Brittney Hernandez , Claudia Ventura

Large Language Models (LLMs) have shown remarkable capabilities in manipulating natural language across multiple applications, but their ability to handle simple reasoning tasks is often questioned. In this work, we aim to provide a…

Computation and Language · Computer Science 2025-05-05 Alessandro Raganato , Rafael Peñaloza , Marco Viviani , Gabriella Pasi

We evaluate large language models (LLMs) for automatic personality prediction from text under the binary Five Factor Model (BIG5). Five models -- including GPT-4 and lightweight open-source alternatives -- are tested across three…

Computation and Language · Computer Science 2025-12-01 Francesco Di Cursi , Chiara Boldrini , Marco Conti , Andrea Passarella