English
Related papers

Related papers: Every(bot) Makes Mistakes: Coding Big Five Persona…

200 papers

Powered by large language models (LLMs), AI agents have become capable of many human tasks. Using the most canonical definitions of the Big Five personality, we measure the ability of LLMs to negotiate within a game-theoretical framework,…

Computation and Language · Computer Science 2024-05-10 Sean Noh , Ho-Chun Herbert Chang

Recent research has focused on examining Large Language Models' (LLMs) characteristics from a psychological standpoint, acknowledging the necessity of understanding their behavioral characteristics. The administration of personality tests…

Computation and Language · Computer Science 2024-10-07 Jen-tse Huang , Wenxiang Jiao , Man Ho Lam , Eric John Li , Wenxuan Wang , Michael R. Lyu

Recent Large Language Model (LLM) based AI can exhibit recognizable and measurable personality traits during conversations to improve user experience. However, as human understandings of their personality traits can be affected by their…

Human-Computer Interaction · Computer Science 2026-01-21 Jingshu Li , Tianqi Song , Nattapat Boonprakong , Zicheng Zhu , Yitian Yang , Yi-Chieh Lee

Fine-tuning large language models (LLMs) with domain-specific instructions has emerged as an effective method to enhance their domain-specific understanding. Yet, there is limited work that examines the core characteristics acquired during…

Computation and Language · Computer Science 2023-12-27 Varun Nathan , Ayush Kumar , Digvijay Ingle , Jithendra Vepa

With the rapid advancement of large language models (LLMs), intelligent conversational assistants have demonstrated remarkable capabilities across various domains. However, they still mainly rely on explicit textual input and do not know…

Human-Computer Interaction · Computer Science 2025-12-29 Ziyan Zhang , Nan Gao , Zhiqiang Nie , Shantanu Pal , Haining Zhang

Generative AI including large language models (LLMs) has recently gained significant interest in the geo-science community through its versatile task-solving capabilities including programming, arithmetic reasoning, generation of sample…

Computers and Society · Computer Science 2024-08-14 Hartwig H. Hochmair , Levente Juhasz , Takoda Kemp

There is a significant gap between patient needs and available mental health support today. In this paper, we aim to thoroughly examine the potential of using Large Language Models (LLMs) to assist professional psychotherapy. To this end,…

Computation and Language · Computer Science 2025-01-28 Mian Zhang , Xianjun Yang , Xinlu Zhang , Travis Labrum , Jamie C. Chiu , Shaun M. Eack , Fei Fang , William Yang Wang , Zhiyu Zoey Chen

In the rapidly evolving field of artificial intelligence, large language models (LLMs) have demonstrated significant capabilities across numerous applications. However, the performance of these models in languages with fewer resources, such…

Computation and Language · Computer Science 2024-05-24 Birger Moell

We evaluate large language models (LLMs) for automatic personality prediction from text under the binary Five Factor Model (BIG5). Five models -- including GPT-4 and lightweight open-source alternatives -- are tested across three…

Computation and Language · Computer Science 2025-12-01 Francesco Di Cursi , Chiara Boldrini , Marco Conti , Andrea Passarella

When making decisions under uncertainty, individuals often deviate from rational behavior, which can be evaluated across three dimensions: risk preference, probability weighting, and loss aversion. Given the widespread use of large language…

Artificial Intelligence · Computer Science 2024-11-04 Jingru Jia , Zehua Yuan , Junhao Pan , Paul E. McNamara , Deming Chen

Large language models (LLMs) are increasingly used to support question answering and decision-making in high-stakes, domain-specific settings such as natural hazard response and infrastructure planning, where effective answers must convey…

Computation and Language · Computer Science 2026-02-11 Homaira Huda Shomee , Rochana Chaturvedi , Yangxinyu Xie , Tanwi Mallick

Large Language Models (LLMs) are increasingly used to simulate human users in interactive settings such as therapy, education, and social role-play. While these simulations enable scalable training and evaluation of AI agents, off-the-shelf…

Computation and Language · Computer Science 2025-11-04 Marwa Abdulhai , Ryan Cheng , Donovan Clay , Tim Althoff , Sergey Levine , Natasha Jaques

Large Language Models (LLMs) are increasingly applied to software engineering (SE), yet their potential for autonomous, role-oriented collaboration remains largely underexplored. Understanding how multiple LLM-based agents coordinate,…

Large Language Models (LLMs) have showcased remarkable capabilities in various Natural Language Processing tasks. For automatic open-domain dialogue evaluation in particular, LLMs have been seamlessly integrated into evaluation frameworks,…

Computation and Language · Computer Science 2024-07-08 John Mendonça , Alon Lavie , Isabel Trancoso

Recent work has questioned whether large language models (LLMs) can perform genuine in-context learning (ICL) for scientific experimental design, with prior studies suggesting that LLM-based agents exhibit no sensitivity to experimental…

Large language models (LLMs) typically generate identical or similar responses for all users given the same prompt, posing serious safety risks in high-stakes applications where user vulnerabilities differ widely. Existing safety…

Computers and Society · Computer Science 2026-01-14 Yuchen Wu , Edward Sun , Kaijie Zhu , Jianxun Lian , Jose Hernandez-Orallo , Aylin Caliskan , Jindong Wang

Predicting human decision-making in high-stakes environments remains a central challenge for artificial intelligence. While large language models (LLMs) demonstrate strong general reasoning, they often struggle to generate consistent,…

Artificial Intelligence · Computer Science 2026-02-20 Ben Yellin , Ehud Ezra , Mark Foreman , Shula Grinapol

Pre-trained code models have emerged as crucial tools in various code intelligence tasks. However, their effectiveness depends on the quality of the pre-training dataset, particularly the human reference comments, which serve as a bridge…

Software Engineering · Computer Science 2023-12-27 Kang Yang , Xinjun Mao , Shangwen Wang , Tanghaoran Zhang , Bo Lin , Yanlin Wang , Yihao Qin , Zhang Zhang , Xiaoguang Mao

Substance use disorders (SUDs) affect millions of people, and relapses are common, requiring multi-session treatments. Access to care is limited, which contributes to the challenge of recovery support. We present \textbf{ChatThero}, an…

Artificial Intelligence · Computer Science 2025-10-15 Junda Wang , Zonghai Yao , Lingxi Li , Junhui Qian , Zhichao Yang , Hong Yu

Learning from human feedback has become a pivot technique in aligning large language models (LLMs) with human preferences. However, acquiring vast and premium human feedback is bottlenecked by time, labor, and human capability, resulting in…

Computation and Language · Computer Science 2024-07-17 Ganqu Cui , Lifan Yuan , Ning Ding , Guanming Yao , Bingxiang He , Wei Zhu , Yuan Ni , Guotong Xie , Ruobing Xie , Yankai Lin , Zhiyuan Liu , Maosong Sun