English
Related papers

Related papers: AIPsychoBench: Understanding the Psychometric Diff…

200 papers

Human-like personality traits have recently been discovered in large language models, raising the hypothesis that their (known and as yet undiscovered) biases conform with human latent psychological constructs. While large conversational…

Computation and Language · Computer Science 2025-01-14 Maor Reuben , Ortal Slobodin , Aviad Elyshar , Idan-Chaim Cohen , Orna Braun-Lewensohn , Odeya Cohen , Rami Puzis

This paper explores the frontiers of large language models (LLMs) in psychology applications. Psychology has undergone several theoretical changes, and the current use of Artificial Intelligence (AI) and Machine Learning, particularly LLMs,…

Machine Learning · Computer Science 2025-07-15 Luoma Ke , Song Tong , Peng Cheng , Kaiping Peng

The advent of Large Language Models (LLMs) offers potential solutions to address problems such as shortage of medical resources and low diagnostic consistency in psychiatric clinical practice. Despite this potential, a robust and…

Computation and Language · Computer Science 2025-06-19 Shuyu Liu , Ruoxi Wang , Ling Zhang , Xuequan Zhu , Rui Yang , Xinzhu Zhou , Fei Wu , Zhi Yang , Cheng Jin , Gang Wang

Large Language Model (LLM) sycophancy is a growing concern. The current literature has largely examined sycophancy in contexts with clear right and wrong answers, like coding. However, AI is increasingly being used for emotional support and…

Human-Computer Interaction · Computer Science 2026-03-17 Jean Rehani , Victoria Oldemburgo de Mello , Dariya Ovsyannikova , Ashton Anderson , Michael Inzlicht

Large Language Models (LLMs) have become instrumental across various applications, with the customization of these models to specific scenarios becoming increasingly critical. System message, a fundamental component of LLMs, is consist of…

Computation and Language · Computer Science 2024-10-23 Yanzhao Qin , Tao Zhang , Tao Zhang , Yanjun Shen , Wenjing Luo , Haoze Sun , Yan Zhang , Yujing Qiao , Weipeng Chen , Zenan Zhou , Wentao Zhang , Bin Cui

Large language models (LLMs) are the foundation of the current successes of artificial intelligence (AI), however, they are unavoidably biased. To effectively communicate the risks and encourage mitigation efforts these models need adequate…

Computation and Language · Computer Science 2025-01-14 Carolin M. Schuster , Maria-Alexandra Dinisor , Shashwat Ghatiwala , Georg Groh

Large language models (LLMs) have achieved remarkable breakthroughs in new dialogue capabilities by leveraging instruction tuning, which refreshes human impressions of dialogue systems. The long-standing goal of dialogue systems is to be…

Computation and Language · Computer Science 2024-04-01 Jiao Ou , Junda Lu , Che Liu , Yihong Tang , Fuzheng Zhang , Di Zhang , Kun Gai

Large language models (LLMs) increasingly reach real-world applications, necessitating a better understanding of their behaviour. Their size and complexity complicate traditional assessment methods, causing the emergence of alternative…

Artificial Intelligence · Computer Science 2025-05-13 Sanne Peereboom , Inga Schwabe , Bennett Kleinberg

Large language models (LLMs) like ChatGPT have revealed amazing intelligence. How to evaluate the question-solving abilities of LLMs and their degrees of intelligence is a hot-spot but challenging issue. First, the question-solving…

Computation and Language · Computer Science 2023-09-14 Fei Tang , Wanling Gao , Luzhou Peng , Jianfeng Zhan

Instruction tuning aligns the response of large language models (LLMs) with human preferences. Despite such efforts in human--LLM alignment, we find that instruction tuning does not always make LLMs human-like from a cognitive modeling…

Computation and Language · Computer Science 2024-04-16 Tatsuki Kuribayashi , Yohei Oseki , Timothy Baldwin

Large Language Models (LLMs) are increasingly used in everyday life and research. One of the most common use cases is conversational interactions, enabled by the language generation capabilities of LLMs. Just as between two humans, a…

Computation and Language · Computer Science 2024-11-12 Jingyao Zheng , Xian Wang , Simo Hosio , Xiaoxian Xu , Lik-Hang Lee

While Large Language Models (LLMs) have achieved remarkable success in cognitive and reasoning benchmarks, they exhibit a persistent deficit in anthropomorphic intelligence-the capacity to navigate complex social, emotional, and ethical…

Computation and Language · Computer Science 2025-12-29 Jiaxin Liu , Peiyi Tu , Wenyu Chen , Yihong Zhuang , Xinxia Ling , Anji Zhou , Chenxi Wang , Zhuo Han , Zhengkai Yang , Junbo Zhao , Zenan Huang , Yuanyuan Wang

In recent years, AI has demonstrated remarkable capabilities in simulating human behaviors, particularly those implemented with large language models (LLMs). However, due to the lack of systematic evaluation of LLMs' simulated behaviors,…

Computation and Language · Computer Science 2024-06-18 Yang Xiao , Yi Cheng , Jinlan Fu , Jiashuo Wang , Wenjie Li , Pengfei Liu

This paper explores the potential of large language models (LLMs) as reliable analytical tools in linguistic research, focusing on the emergence of affective meanings in temporal expressions involving manner-of-motion verbs. While LLMs like…

Computation and Language · Computer Science 2025-07-15 Rosa Illan Castillo , Javier Valenzuela

Large Language Models (LLMs),such as ChatGPT, are increasingly used in research, ranging from simple writing assistance to complex data annotation tasks. Recently, some research has suggested that LLMs may even be able to simulate human…

Artificial Intelligence · Computer Science 2025-08-14 Sarah Schröder , Thekla Morgenroth , Ulrike Kuhl , Valerie Vaquet , Benjamin Paaßen

Large language models (LLMs) can pass explicit social bias tests but still harbor implicit biases, similar to humans who endorse egalitarian beliefs yet exhibit subtle biases. Measuring such implicit biases can be a challenge: as LLMs…

Computers and Society · Computer Science 2024-05-24 Xuechunzi Bai , Angelina Wang , Ilia Sucholutsky , Thomas L. Griffiths

Large Language Models (LLMs) have recently been shown to produce estimates of psycholinguistic norms, such as valence, arousal, or concreteness, for words and multiword expressions, that correlate with human judgments. These estimates are…

Computation and Language · Computer Science 2026-03-13 Thomas Hikaru Clark , Carlos Arriaga , Javier Conde , Gonzalo Martínez , Pedro Reviriego

Large language models (LLMs) have brought breakthroughs in tasks including translation, summarization, information retrieval, and language generation, gaining growing interest in the CHI community. Meanwhile, the literature shows…

Human-Computer Interaction · Computer Science 2024-03-05 Lu Wang , Max Song , Rezvaneh Rezapour , Bum Chul Kwon , Jina Huh-Yoo

While large language models (LLMs) excel at many domain-specific tasks, their ability to deeply comprehend and reason about full-length academic papers remains underexplored. Existing benchmarks often fall short of capturing such depth,…

Artificial Intelligence · Computer Science 2026-01-08 Xinbang Dai , Huikang Hu , Yongrui Chen , Jiaqi Li , Rihui Jin , Yuyang Zhang , Xiaoguang Li , Lifeng Shang , Guilin Qi

Recently developed large language models (LLMs) have been shown to perform remarkably well on a wide range of language understanding tasks. But, can they really "reason" over the natural language? This question has been receiving…

Computation and Language · Computer Science 2024-06-07 Mihir Parmar , Nisarg Patel , Neeraj Varshney , Mutsumi Nakamura , Man Luo , Santosh Mashetty , Arindam Mitra , Chitta Baral