中文
相关论文

相关论文: Improving LLM Leaderboards with Psychometrical Met…

200 篇论文

Large Language Models (LLMs) have significantly advanced natural language processing, demonstrating exceptional reasoning, tool usage, and memory capabilities. As their applications expand into multi-agent environments, there arises a need…

计算与语言 · 计算机科学 2024-11-28 Lin Xu , Zhiyuan Hu , Daquan Zhou , Hongyu Ren , Zhen Dong , Kurt Keutzer , See Kiong Ng , Jiashi Feng

We employ a Large Language Model (LLM) to convert unstructured psychological interviews into structured questionnaires spanning various psychiatric and personality domains. The LLM is prompted to answer these questionnaires by impersonating…

计算与语言 · 计算机科学 2024-06-12 Gony Rosenman , Lior Wolf , Talma Hendler

This study investigates the linguistic understanding of Large Language Models (LLMs) regarding signifier (form) and signified (meaning) by distinguishing two LLM assessment paradigms: psycholinguistic and neurolinguistic. Traditional…

计算与语言 · 计算机科学 2025-07-15 Linyang He , Ercong Nie , Helmut Schmid , Hinrich Schütze , Nima Mesgarani , Jonathan Brennan

Mixed methods research integrates quantitative and qualitative data but faces challenges in aligning their distinct structures, particularly in examining measurement characteristics and individual response patterns. Advances in large…

计算与语言 · 计算机科学 2025-05-29 Jihong Zhang , Xinya Liang , Anqi Deng , Nicole Bonge , Lin Tan , Ling Zhang , Nicole Zarrett

The field of large language models (LLMs) has made significant progress, and their knowledge storage capacity is approaching that of human beings. Furthermore, advanced techniques, such as prompt learning and reinforcement learning, are…

计算与语言 · 计算机科学 2023-08-01 Keyu Pan , Yawen Zeng

Psychological assessment tools have long helped humans understand behavioural patterns. While Large Language Models (LLMs) can generate content comparable to that of humans, we explore whether they exhibit personality traits. To this end,…

计算与语言 · 计算机科学 2025-02-11 Pranav Bhandari , Usman Naseem , Amitava Datta , Nicolas Fay , Mehwish Nasim

Large language models (LLMs) are a class of language models that have demonstrated outstanding performance across a range of natural language processing (NLP) tasks and have become a highly sought-after research area, because of their…

数字图书馆 · 计算机科学 2023-04-06 Lizhou Fan , Lingyao Li , Zihui Ma , Sanggyu Lee , Huizi Yu , Libby Hemphill

Language models serve as a cornerstone in natural language processing (NLP), utilizing mathematical methods to generalize language laws and knowledge for prediction and generation. Over extensive research spanning decades, language modeling…

计算与语言 · 计算机科学 2024-09-24 Zichong Wang , Zhibo Chu , Thang Viet Doan , Shiwen Ni , Min Yang , Wenbin Zhang

Chatbots have shown promise as tools to scale qualitative data collection. Recent advances in Large Language Models (LLMs) could accelerate this process by allowing researchers to easily deploy sophisticated interviewing chatbots. We test…

人机交互 · 计算机科学 2024-12-05 Alejandro Cuevas , Jennifer V. Scurrell , Eva M. Brown , Jason Entenmann , Madeleine I. G. Daepp

This research paper discusses the advances made in the past decade in biomedicine and Large Language Models. To understand how the advances have been made hand-in-hand with one another, the paper also discusses the integration of Natural…

计算与语言 · 计算机科学 2024-06-26 Michael Ackerman

Large Language Models (LLMs) have emerged as powerful tools in various research domains. This article examines their potential through a literature review and firsthand experimentation. While LLMs offer benefits like cost-effectiveness and…

人机交互 · 计算机科学 2024-04-10 M. Namvarpour , A. Razi

The integration of Large Language Models (LLMs) into the healthcare domain has the potential to significantly enhance patient care and support through the development of empathetic, patient-facing chatbots. This study investigates an…

计算与语言 · 计算机科学 2024-05-28 Man Luo , Christopher J. Warren , Lu Cheng , Haidar M. Abdul-Muhsin , Imon Banerjee

Recommendation systems aim to provide users with relevant suggestions, but often lack interpretability and fail to capture higher-level semantic relationships between user behaviors and profiles. In this paper, we propose a novel approach…

The evaluation of large language model (LLM) outputs is increasingly performed by other LLMs, a setup commonly known as "LLM-as-a-judge", or autograders. While autograders offer a scalable alternative to human evaluation, they have shown…

机器学习 · 计算机科学 2026-02-27 Magda Dubois , Harry Coppock , Mario Giulianelli , Timo Flesch , Lennart Luettgau , Cozmin Ududec

Large Language Models (LLMs) have transformed the Natural Language Processing (NLP) landscape with their remarkable ability to understand and generate human-like text. However, these models are prone to ``hallucinations'' -- outputs that do…

Machine psychology aims to reconstruct the mindset of Large Language Models (LLMs), i.e. how these artificial intelligences perceive and associate ideas. This work introduces PhDGPT, a prompting framework and synthetic dataset that…

人机交互 · 计算机科学 2024-11-19 Edoardo Sebastiano De Duro , Enrique Taietta , Riccardo Improta , Massimo Stella

Emotion cognition in large language models (LLMs) is crucial for enhancing performance across various applications, such as social media, human-computer interaction, and mental health assessment. We explore the current landscape of…

计算与语言 · 计算机科学 2024-09-23 Yuyan Chen , Yanghua Xiao

Large language models (LLMs) have showcased remarkable reasoning capabilities, yet they remain susceptible to errors, particularly in temporal reasoning tasks involving complex temporal logic. Existing research has explored LLM performance…

Large language models (LLMs) have shown potential in recommendation systems (RecSys) by using them as either knowledge enhancer or zero-shot ranker. A key challenge lies in the large semantic gap between LLMs and RecSys where the former…

信息检索 · 计算机科学 2025-12-22 Guangneng Hu

Large language models (LLMs) like ChatGPT are increasingly used in academic writing, yet issues such as incorrect or fabricated references raise ethical concerns. Moreover, current content quality evaluations often rely on subjective human…

计算与语言 · 计算机科学 2025-09-15 Jing Ren , Weiqi Wang