English
Related papers

Related papers: Improving LLM Leaderboards with Psychometrical Met…

200 papers

Large Language Models (LLMs) have significantly advanced natural language processing, demonstrating exceptional reasoning, tool usage, and memory capabilities. As their applications expand into multi-agent environments, there arises a need…

Computation and Language · Computer Science 2024-11-28 Lin Xu , Zhiyuan Hu , Daquan Zhou , Hongyu Ren , Zhen Dong , Kurt Keutzer , See Kiong Ng , Jiashi Feng

We employ a Large Language Model (LLM) to convert unstructured psychological interviews into structured questionnaires spanning various psychiatric and personality domains. The LLM is prompted to answer these questionnaires by impersonating…

Computation and Language · Computer Science 2024-06-12 Gony Rosenman , Lior Wolf , Talma Hendler

This study investigates the linguistic understanding of Large Language Models (LLMs) regarding signifier (form) and signified (meaning) by distinguishing two LLM assessment paradigms: psycholinguistic and neurolinguistic. Traditional…

Computation and Language · Computer Science 2025-07-15 Linyang He , Ercong Nie , Helmut Schmid , Hinrich Schütze , Nima Mesgarani , Jonathan Brennan

Mixed methods research integrates quantitative and qualitative data but faces challenges in aligning their distinct structures, particularly in examining measurement characteristics and individual response patterns. Advances in large…

Computation and Language · Computer Science 2025-05-29 Jihong Zhang , Xinya Liang , Anqi Deng , Nicole Bonge , Lin Tan , Ling Zhang , Nicole Zarrett

The field of large language models (LLMs) has made significant progress, and their knowledge storage capacity is approaching that of human beings. Furthermore, advanced techniques, such as prompt learning and reinforcement learning, are…

Computation and Language · Computer Science 2023-08-01 Keyu Pan , Yawen Zeng

Psychological assessment tools have long helped humans understand behavioural patterns. While Large Language Models (LLMs) can generate content comparable to that of humans, we explore whether they exhibit personality traits. To this end,…

Computation and Language · Computer Science 2025-02-11 Pranav Bhandari , Usman Naseem , Amitava Datta , Nicolas Fay , Mehwish Nasim

Large language models (LLMs) are a class of language models that have demonstrated outstanding performance across a range of natural language processing (NLP) tasks and have become a highly sought-after research area, because of their…

Digital Libraries · Computer Science 2023-04-06 Lizhou Fan , Lingyao Li , Zihui Ma , Sanggyu Lee , Huizi Yu , Libby Hemphill

Language models serve as a cornerstone in natural language processing (NLP), utilizing mathematical methods to generalize language laws and knowledge for prediction and generation. Over extensive research spanning decades, language modeling…

Computation and Language · Computer Science 2024-09-24 Zichong Wang , Zhibo Chu , Thang Viet Doan , Shiwen Ni , Min Yang , Wenbin Zhang

Chatbots have shown promise as tools to scale qualitative data collection. Recent advances in Large Language Models (LLMs) could accelerate this process by allowing researchers to easily deploy sophisticated interviewing chatbots. We test…

Human-Computer Interaction · Computer Science 2024-12-05 Alejandro Cuevas , Jennifer V. Scurrell , Eva M. Brown , Jason Entenmann , Madeleine I. G. Daepp

This research paper discusses the advances made in the past decade in biomedicine and Large Language Models. To understand how the advances have been made hand-in-hand with one another, the paper also discusses the integration of Natural…

Computation and Language · Computer Science 2024-06-26 Michael Ackerman

Large Language Models (LLMs) have emerged as powerful tools in various research domains. This article examines their potential through a literature review and firsthand experimentation. While LLMs offer benefits like cost-effectiveness and…

Human-Computer Interaction · Computer Science 2024-04-10 M. Namvarpour , A. Razi

The integration of Large Language Models (LLMs) into the healthcare domain has the potential to significantly enhance patient care and support through the development of empathetic, patient-facing chatbots. This study investigates an…

Computation and Language · Computer Science 2024-05-28 Man Luo , Christopher J. Warren , Lu Cheng , Haidar M. Abdul-Muhsin , Imon Banerjee

Recommendation systems aim to provide users with relevant suggestions, but often lack interpretability and fail to capture higher-level semantic relationships between user behaviors and profiles. In this paper, we propose a novel approach…

Information Retrieval · Computer Science 2024-01-26 Yan Wang , Zhixuan Chu , Xin Ouyang , Simeng Wang , Hongyan Hao , Yue Shen , Jinjie Gu , Siqiao Xue , James Y Zhang , Qing Cui , Longfei Li , Jun Zhou , Sheng Li

The evaluation of large language model (LLM) outputs is increasingly performed by other LLMs, a setup commonly known as "LLM-as-a-judge", or autograders. While autograders offer a scalable alternative to human evaluation, they have shown…

Machine Learning · Computer Science 2026-02-27 Magda Dubois , Harry Coppock , Mario Giulianelli , Timo Flesch , Lennart Luettgau , Cozmin Ududec

Large Language Models (LLMs) have transformed the Natural Language Processing (NLP) landscape with their remarkable ability to understand and generate human-like text. However, these models are prone to ``hallucinations'' -- outputs that do…

Machine psychology aims to reconstruct the mindset of Large Language Models (LLMs), i.e. how these artificial intelligences perceive and associate ideas. This work introduces PhDGPT, a prompting framework and synthetic dataset that…

Human-Computer Interaction · Computer Science 2024-11-19 Edoardo Sebastiano De Duro , Enrique Taietta , Riccardo Improta , Massimo Stella

Emotion cognition in large language models (LLMs) is crucial for enhancing performance across various applications, such as social media, human-computer interaction, and mental health assessment. We explore the current landscape of…

Computation and Language · Computer Science 2024-09-23 Yuyan Chen , Yanghua Xiao

Large language models (LLMs) have showcased remarkable reasoning capabilities, yet they remain susceptible to errors, particularly in temporal reasoning tasks involving complex temporal logic. Existing research has explored LLM performance…

Computation and Language · Computer Science 2024-06-14 Bahare Fatemi , Mehran Kazemi , Anton Tsitsulin , Karishma Malkan , Jinyeong Yim , John Palowitch , Sungyong Seo , Jonathan Halcrow , Bryan Perozzi

Large language models (LLMs) have shown potential in recommendation systems (RecSys) by using them as either knowledge enhancer or zero-shot ranker. A key challenge lies in the large semantic gap between LLMs and RecSys where the former…

Information Retrieval · Computer Science 2025-12-22 Guangneng Hu

Large language models (LLMs) like ChatGPT are increasingly used in academic writing, yet issues such as incorrect or fabricated references raise ethical concerns. Moreover, current content quality evaluations often rely on subjective human…

Computation and Language · Computer Science 2025-09-15 Jing Ren , Weiqi Wang