中文
相关论文

相关论文: Evaluating Large Language Models in Theory of Mind…

200 篇论文

Following the widespread adoption of ChatGPT in early 2023, numerous studies reported that large language models (LLMs) can match or even surpass human performance in creative tasks. However, it remains unclear whether LLMs have become more…

计算与语言 · 计算机科学 2025-04-18 Jennifer Haase , Paul H. P. Hanel , Sebastian Pokutta

Human interactions are deeply rooted in the interplay of thoughts, beliefs, and desires made possible by Theory of Mind (ToM): our cognitive ability to understand the mental states of ourselves and others. Although ToM may come naturally to…

人工智能 · 计算机科学 2023-11-20 Alex Wilf , Sihyun Shawn Lee , Paul Pu Liang , Louis-Philippe Morency

Understanding and attributing mental states, known as Theory of Mind (ToM), emerges as a fundamental capability for human social reasoning. While Large Language Models (LLMs) appear to possess certain ToM abilities, the mechanisms…

人工智能 · 计算机科学 2024-05-31 Wentao Zhu , Zhining Zhang , Yizhou Wang

Large Language Models (LLMs),such as ChatGPT, are increasingly used in research, ranging from simple writing assistance to complex data annotation tasks. Recently, some research has suggested that LLMs may even be able to simulate human…

人工智能 · 计算机科学 2025-08-14 Sarah Schröder , Thekla Morgenroth , Ulrike Kuhl , Valerie Vaquet , Benjamin Paaßen

IMPORTANCE The response effectiveness of different large language models (LLMs) and various individuals, including medical students, graduate students, and practicing physicians, in pediatric ophthalmology consultations, has not been…

计算与语言 · 计算机科学 2023-11-09 Jason Holmes , Rui Peng , Yiwei Li , Jinyu Hu , Zhengliang Liu , Zihao Wu , Huan Zhao , Xi Jiang , Wei Liu , Hong Wei , Jie Zou , Tianming Liu , Yi Shao

Large Language Models (LLMs) are able to provide assistance on a wide range of information-seeking tasks. However, model outputs may be misleading, whether unintentionally or in cases of intentional deception. We investigate the ability of…

计算与语言 · 计算机科学 2024-07-17 Betty Li Hou , Kejian Shi , Jason Phang , James Aung , Steven Adler , Rosie Campbell

Large language models (LLMs) have exhibited impressive zero-shot performance on inference tasks. However, LLMs may suffer from spurious correlations between input texts and output labels, which limits LLMs' ability to reason based purely on…

计算与语言 · 计算机科学 2024-10-25 Yingjie Li , Yun Luo , Xiaotian Xie , Yue Zhang

This study investigates the efficacy of large language models (LLMs) as tools for grading master-level student essays. Utilizing a sample of 60 essays in political science, the study compares the accuracy of grades suggested by the GPT-4…

综合经济学 · 经济学 2024-06-25 Magnus Lundgren

Understanding the limits of language is a prerequisite for Large Language Models (LLMs) to act as theories of natural language. LLM performance in some language tasks presents both quantitative and qualitative differences from that of…

计算与语言 · 计算机科学 2025-06-30 Vittoria Dentella , Fritz Guenther , Evelina Leivada

Although large language models (LLMs) often produce impressive outputs, it remains unclear how they perform in real-world scenarios requiring strong reasoning skills and expert domain knowledge. We set out to investigate whether close- and…

计算与语言 · 计算机科学 2023-12-27 Valentin Liévin , Christoffer Egeberg Hother , Andreas Geert Motzfeldt , Ole Winther

Theory of Mind (ToM) reasoning entails recognizing that other individuals possess their own intentions, emotions, and thoughts, which is vital for guiding one's own thought processes. Although large language models (LLMs) excel in tasks…

计算与语言 · 计算机科学 2024-06-11 Maryam Amirizaniani , Elias Martin , Maryna Sivachenko , Afra Mashhadi , Chirag Shah

The rapid advancement of Large Language Models (LLMs) has introduced new possibilities and challenges in physics education, necessitating rigorous evaluation of their capabilities as both problem solvers and automated assessors. This paper…

物理教育 · 物理学 2026-05-25 Jonah R. Donaldson , Aliya Navaz , Konstantinos Doran , Alysta Lim , Mario Campanelli

Large Language Models (LLMs) hold promise as dynamic instructional aids. Yet, it remains unclear whether LLMs can replicate the adaptivity of intelligent tutoring systems (ITS)--where student knowledge and pedagogical strategies are…

计算与语言 · 计算机科学 2025-04-09 Conrad Borchers , Tianze Shou

Large language models (LLMs) are currently at the forefront of intertwining AI systems with human communication and everyday life. Therefore, it is of great importance to evaluate their emerging abilities. In this study, we show that LLMs,…

计算与语言 · 计算机科学 2023-10-10 Thilo Hagendorff , Sarah Fabi

This study consists of qualitative empirical research, conducted through exploratory tests with two different Large Language Models (LLMs) chatbots: ChatGPT and Gemini. The methodological procedure involved exploratory tests based on…

计算与语言 · 计算机科学 2024-07-19 Melise Peruchini , Julio Monteiro Teixeira

As Large-Scale Language Models (LLMs) continue to evolve, they demonstrate significant enhancements in performance and an expansion of functionalities, impacting various domains, including education. In this study, we conducted interviews…

人机交互 · 计算机科学 2024-07-18 He Zhang , Jingyi Xie , Chuhao Wu , Jie Cai , ChanMin Kim , John M. Carroll

As large language models (LLMs) become more common in educational tools and programming environments, questions arise about how these systems should interact with users. This study investigates how different interaction styles with…

人机交互 · 计算机科学 2025-07-08 Kai Deng

Theory of Mind (ToM) refers to the ability of individuals to attribute mental states to others. While Large Language Models (LLMs) have shown some promise with ToM ability, they still struggle with complex ToM reasoning. Our approach…

计算与语言 · 计算机科学 2024-06-27 Weizhi Tang , Vaishak Belle

Artificial Intelligence (AI) is increasingly being integrated into scientific research, particularly in the social sciences, where understanding human behavior is critical. Large Language Models (LLMs) have shown promise in replicating…

计算与语言 · 计算机科学 2025-06-23 Ziyan Cui , Ning Li , Huaikang Zhou

Research suggests that tutors should adopt a strategic approach when addressing math errors made by low-efficacy students. Rather than drawing direct attention to the error, tutors should guide the students to identify and correct their…

人机交互 · 计算机科学 2024-01-09 Sanjit Kakarla , Danielle Thomas , Jionghao Lin , Shivang Gupta , Kenneth R. Koedinger