English
Related papers

Related papers: Re-evaluating Theory of Mind evaluation in large l…

200 papers

This paper explores the potential of large language models (LLMs) as reliable analytical tools in linguistic research, focusing on the emergence of affective meanings in temporal expressions involving manner-of-motion verbs. While LLMs like…

Computation and Language · Computer Science 2025-07-15 Rosa Illan Castillo , Javier Valenzuela

Can a machine understand the meanings of natural language? Recent developments in the generative large language models (LLMs) of artificial intelligence have led to the belief that traditional philosophical assumptions about machine…

Computation and Language · Computer Science 2023-10-27 Vladimír Havlík

Large language models (LLMs) are advanced artificial intelligence (AI) systems that can perform a variety of tasks commonly found in human intelligence tests, such as defining words, performing calculations, and engaging in verbal…

Computation and Language · Computer Science 2024-09-12 David Ilić , Gilles E. Gignac

In human society, trust is an essential component of social attitude that helps build and maintain long-term, healthy relationships which creates a strong foundation for cooperation, enabling individuals to work together effectively and…

Human-Computer Interaction · Computer Science 2025-07-30 Anushka Debnath , Stephen Cranefield , Emiliano Lorini , Bastin Tony Roy Savarimuthu

Large language models (LLM) have revolutionized the processing of natural language. Although first benchmarks of the process modeling abilities of LLM are promising, it is currently under debate to what extent an LLM can generate good…

Computation and Language · Computer Science 2025-03-19 Peter Fettke , Constantin Houy

Language is fundamental to human cooperation, facilitating not only the exchange of information but also the coordination of actions through shared interpretations of situational contexts. This study explores whether the Generative…

Computation and Language · Computer Science 2025-10-16 Agnese Lombardi , Alessandro Lenci

Theory of Mind (ToM) significantly impacts human collaboration and communication as a crucial capability to understand others. When AI agents with ToM capability collaborate with humans, Mutual Theory of Mind (MToM) arises in such human-AI…

Human-Computer Interaction · Computer Science 2024-09-16 Shao Zhang , Xihuai Wang , Wenhao Zhang , Yongshan Chen , Landi Gao , Dakuo Wang , Weinan Zhang , Xinbing Wang , Ying Wen

The rise of Large Language Models (LLMs) has sparked debate about whether these systems exhibit human-level cognition. In this debate, little attention has been paid to a structural component of human cognition: core beliefs, truths that…

Machine Learning · Computer Science 2026-05-06 Anna Sokol , Marianna B. Ganapini , Nitesh V. Chawla

Language has long been conceived as an essential tool for human reasoning. The breakthrough of Large Language Models (LLMs) has sparked significant research interest in leveraging these models to tackle complex reasoning tasks. Researchers…

A lively ongoing debate is taking place, since the extraordinary emergence of Large Language Models (LLMs) with regards to their capability to understand the world and capture the meaning of the dialogues in which they are involved.…

Computation and Language · Computer Science 2025-05-09 Daniel N. Nissani

Recent empirical results have sparked a debate about whether or not Large Language Models (LLMs) are capable of Theory of Mind (ToM). While some have found LLMs to be successful on ToM evaluations such as the False Belief task, others have…

Computation and Language · Computer Science 2025-05-29 Zhiqiang Pi , Annapurna Vadaparty , Benjamin K. Bergen , Cameron R. Jones

Social intelligence manifests the capability, often referred to as the Theory of Mind (ToM), to discern others' behavioral intentions, beliefs, and other mental states. ToM is especially important in multi-agent and human-machine…

Multiagent Systems · Computer Science 2023-11-09 Zhuoya Zhao , Feifei Zhao , Shiwen Wang , Yinqian Sun , Yi Zeng

System 2 reasoning is one of the defining characteristics of intelligence, which requires slow and logical thinking. Human conducts System 2 reasoning via the language of thoughts that organizes the reasoning process as a causal sequence of…

Computation and Language · Computer Science 2025-05-20 Chenxi Liu , Yongqiang Chen , Tongliang Liu , James Cheng , Bo Han , Kun Zhang

This paper presents a comprehensive survey of the current status and opportunities for Large Language Models (LLMs) in strategic reasoning, a sophisticated form of reasoning that necessitates understanding and predicting adversary actions…

Computation and Language · Computer Science 2024-04-02 Yadong Zhang , Shaoguang Mao , Tao Ge , Xun Wang , Adrian de Wynter , Yan Xia , Wenshan Wu , Ting Song , Man Lan , Furu Wei

"Thinking is for Doing." Humans can infer other people's mental states from observations--an ability called Theory-of-Mind (ToM)--and subsequently act pragmatically on those inferences. Existing question answering benchmarks such as ToMi…

Have Large Language Models (LLMs) developed a personality? The short answer is a resounding "We Don't Know!". In this paper, we show that we do not yet have the right tools to measure personality in language models. Personality is an…

Computation and Language · Computer Science 2023-05-25 Xiaoyang Song , Akshat Gupta , Kiyan Mohebbizadeh , Shujie Hu , Anant Singh

Humans continuously infer the states, goals, and behaviors of others by perceiving their surroundings in dynamic, real-world social interactions. However, most Theory of Mind (ToM) benchmarks only evaluate static, text-based scenarios,…

Computation and Language · Computer Science 2025-12-16 Xianzhe Fan , Xuhui Zhou , Chuanyang Jin , Kolby Nottingham , Hao Zhu , Maarten Sap

Emotion cognition in large language models (LLMs) is crucial for enhancing performance across various applications, such as social media, human-computer interaction, and mental health assessment. We explore the current landscape of…

Computation and Language · Computer Science 2024-09-23 Yuyan Chen , Yanghua Xiao

The rapid advancement of artificial intelligence, particularly with the development of Large Language Models (LLMs) built on the transformer architecture, has redefined the capabilities of natural language processing. These models now…

Computation and Language · Computer Science 2025-02-11 Andrea Matarazzo , Riccardo Torlone

As Large Language Models (LLMs) gain agentic abilities, they will have to navigate complex multi-agent scenarios, interacting with human users and other agents in cooperative and competitive settings. This will require new reasoning skills,…

Artificial Intelligence · Computer Science 2025-06-26 Andrei Lupu , Timon Willi , Jakob Foerster